NVIDIA · Agent Runtime Infra

NVIDIA OpenShell, Snapshot and Kubernetes Engine

NVIDIA is donating OpenShell, an open-source runtime for securing and governing autonomous agents, to the Cloud Native Computing Foundation as a Sandbox project. It is also releasing NVIDIA Snapshot, an open-source component that restores checkpointed inference replicas without model reload or warmup. NVIDIA Kubernetes Engine and Kubernetes Recipes are in public preview for managed Kubernetes on GPU infrastructure. Design partner Saturn Cloud reported vLLM startup times falling from between 2 and 8.5 minutes to between 6 and 34 seconds.

Open the source ↗

Similar Developer Tools releases

More from NVIDIA

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.