NVIDIA Announces Global Availability of NIM at COMPUTEX 2024 to Simplify Generative AI Deployment with 150+ Partners

Jun 3, 2024, 05:00 PM

NVIDIA has announced the global availability of its NIM (NVIDIA Inference Microservices), a platform designed to simplify the deployment of generative AI applications. Unveiled at COMPUTEX 2024, NVIDIA NIM aims to revolutionize model deployment for enterprise applications, with over 150 partners across the AI ecosystem. The platform integrates with KServe to ensure AI models can be deployed like any other large enterprise application. NVIDIA NIM is available for deployment in the cloud, on-premise, or in air-gapped environments, providing a secure and production-optimal infrastructure. Additionally, WhyLabs has integrated with NVIDIA NIM to enable tracing and guardrails, enhancing the security and efficiency of generative AI models. Haystack RAG pipelines can also be deployed with NIMs. The announcement was made on June 2, 2024, and reiterated on June 3, 2024.