Kubernetes & Cloud Native · 28.08.2026, 13:21 UTC
Your Kubernetes platform is ready for containers. Is it ready for AI?
| Schweregrad | info |
|---|---|
| Kategorie | Kubernetes & Cloud Native |
| Quelle | CNCF ↗ |
| Veröffentlicht | 28.08.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
Kubernetes has given platform teams a consistent way to deploy, scale, and operate containerized applications. Now, many of those same teams are being asked to support AI.
The transition is already underway. According to the CNCF 2025 Annual Cloud Native Survey, 66% of organizations hosting generative AI models use Kubernetes for some or all of their inference workloads. Yet only 7% of organizations deploy AI models daily. That gap highlights an important distinction: running AI on Kubernetes and having a Kubernetes platform ready to operate AI continuously are not the same thing.
The challenge is also showing up within platform teams. The 2025 State of AI in Platform Engineering research found that 35% of platform teams still don’t orchestrate AI workloads, pointing to a gap between AI adoption and the operational platforms needed to support it at scale.
AI doesn’t require platform teams to abandon cloud native practices. Kubernetes, GitOps, observability, automation, and self-service remain valuable foundations. But AI introduces new requirements around compute, scheduling, model delivery, and operations.
So, what needs to change?
Extend the resource model beyond CPU and memory
AI is often discussed as a GPU workload, but production AI pipelines are heterogeneous.
Data preparation, preprocessing, retrieval, orchestration, and application logic may run on CPUs, while training or inference uses GPUs or other accelerators. A single workload may depend on several resource types.
This changes scheduling. Platform teams need to consider accelerator type and …
Maßnahmen
⬇ Als MarkdownVerwandte Beiträge
- info Scale before the spike: Predictive autoscaling for GPU workloads on Kubernetes
- info Kubernetes v1.37: Metrics API graduates to stable
- info How to measure and improve instrumentation quality for better full-stack observability
- info Microsoft named a Leader in the KuppingerCole Leadership Compass for Cloud Native Application Protection Platforms (CNAPP)