LiveBench benchmark results published on official or tech analysis websites

DeepSeek Launches V3 Model with 685B Parameters, 60 Tokens/Second, Outperforming Claude 3.5 and Sonnet 3.5 at $0.28/1M Output

Dec 26, 2024, 02:52 AM

DeepSeek has officially launched its V3 model, now available on Hugging Face, featuring 685 billion parameters and a mixture of experts (MoE) architecture with 256 experts and 8 active per token. The model reportedly outperforms competitors such as Claude 3.5 and Sonnet 3.5 on various benchmarks, including a notable 60.4 score on LiveBench. The V3 model is designed to be highly efficient, achieving speeds of 60 tokens per second, which is three times faster than its predecessor, V2. It has also shown substantial improvements in coding capabilities, increasing its performance from 17.8% to 48.4% on the Aider Polyglot leaderboard. Additionally, the pricing structure for DeepSeek V3 is competitive, offering rates of $0.28 per million outputs, significantly lower than those of its main competitors. The release is seen as a major advancement in the open-source AI landscape, with implications for the future of AI development and deployment.