KubeCon + CloudNativeCon Japan 2025

As Generative AI reshapes the tech landscape, its tools and solutions often feel overwhelming and disconnected - like scattered elements waiting to be forged into something greater. What does a complete GenAI platform look like? And how does it differ from application-focused platforms many organizations already run?

We’ll guide you through a practical transmutation of your platforms to add GenAI features. We’ll first define the base elements needed to deploy LLM inference on Kubernetes. We’ll then blend key elements into the MVP stage, adding core enterprise AI components like an AI Gateway, shared interfaces via Dapr, and KServe-based deployment strategies. Finally, we’ll tackle advanced features - intelligent load balancing for LLMs, observability patterns, and cost optimizations.

More than a tools showcase, this session is packed with real lessons from enterprise GenAI platform engineers, to help transmute your platform into the philosopher’s stone for AI innovation.