rank La Vigne, technical marketing manager at Klique, takes the KubeCon stage to talk about GPU control and token control for the SUSE AI Factory. You may not know the name Klique yet — it's ClearML, same DNA, same software, evolved for modern AI implementations, sitting on top of the foundation SUSE already gives you.
Walking the expo floor, Frank kept hearing two themes: cost control for token spend, and how you integrate AI into Kubernetes. Klique's answer is governed self-serve access, with four pieces: an AI development studio for practitioners, an orchestration engine so admins can manage GPUs, CPUs, and cloud APIs on one screen, a governance engine with spend visibility and auditability, and an AI engine that can sit in front of every model with spend control behind it. Enable, control, publish, and measure — for every user, AI actor, or agent.
SUSE AI Factory is built for managing the hardware, in a way that's comfortable for Kubernetes engineers. Klique runs on top of that and talks to the AI practitioner. The question Frank would ask IT ops: would you trust your data scientists with access to your Kubernetes cluster? The answer should be no. That's not their wheelhouse. It's the same GPUs and the same hardware, viewed through two lenses — one for the platform team in SUSE Rancher, one for the AI teams. That turns the cluster into pools, policies, and models. The end user sees a well-defined endpoint. Admins keep governance over what people can do and what they can spend, so you're talking to Dana before the surprise bill shows up at the end of the month.
The LLM gateway is one governed entry point to every model. You can change keys and models to adjust cost without sending a note to every developer to update an endpoint or an environment variable. Spend controls include cost quotas, wallet budgets, and budget metering, authenticated through the gateway and metered per session. A gateway alone, Frank says, is a commodity; tying it to cost, budget, and metering is the point.
In the live view, a tenant is at 62% of their allocation. Everybody's green except Dana, who's spending all the tokens. Maybe Dana has a good reason. Now you know who to ask — in a friendly way — instead of reverse-engineering it through financial alchemy when the bill arrives.
This episode is the audio from Frank's talk at KubeCon. The video is linked in the comments. Frank also pointed people to his LinkedIn if they want to talk more about Klique.
Mais episódios de "Data Driven"
Não percas um episódio de “Data Driven” e subscrevê-lo na aplicação GetPodcast.
