Together AI Launches Platform for 2-3x Faster Inference, Lower Costs in Private Clouds with NVIDIA NIM

Sep 23, 2024, 05:31 PM

Together AI has launched the Together Enterprise Platform, which promises faster inference and lower costs for enterprise AI deployments in private cloud environments. The platform allows for secure running of AI models in various settings, including virtual private clouds (VPC) and on-premises infrastructure. Customers have reported achieving 2-3x faster inference and cost reductions of up to 50% using their own infrastructure. This development aims to accelerate AI adoption in private clouds and on-prem environments using NVIDIA NIM.