llm-d 1.0 Advances Open, Cost-Efficient AI Inference for Production Scale

Today, llm-d project contributors announced the release of llm-d 1.0, a major milestone for the open source project designed to help organizations deploy and scale large language model inference more efficiently across modern infrastructure. Founded in 2025 by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA, and now governed by the Cloud Native Computing Foundation (CNCF), llm-d plays a key role in the open foundation for enterprises deploying AI at scale in production. As organizations race to put AI into production, many are discovering that running AI at scale can be as challenging and exp

Reach Me

Request a Call Back by filling out and submitting the following form.

+1 408-568-3993

    What is Refresh icon