CNCF Survey Finds Kubernetes Is AI’s ‘Operating System’ as Production Use Hits 82%
Organizational culture has overtaken technical hurdles as the chief constraint on scaling cloud native AI.
Overview
- Cloud native techniques are now near-universal, with 98% of surveyed organizations reporting adoption.
- Among organizations hosting generative models, 66% use Kubernetes to run some or all inference workloads.
- AI deployment remains cautious, with 7% pushing models daily, 47% doing so occasionally, and 44% not yet running AI/ML on Kubernetes.
- Operational maturity correlates with platform practices, as 58% of innovators use GitOps versus 23% of adopters and Backstage ranks as the No. 5 CNCF project by velocity.
- Observability gains momentum as OpenTelemetry becomes CNCF’s No. 2 project with 24,000+ contributors, highlighting a push for standardized telemetry and concerns about sustaining open-source infrastructure under growing AI demand.