Mixture of Experts
DeepSeek V4 Release Shakes AI World With 1 Trillion Parameters and Disruptive Pricing
DeepSeek V4 launches with 1 trillion parameters, a 1 million token context window, and pricing up to 50x cheaper than GPT-5.4 and Claude Opus 4.5.
NVIDIA Releases Nemotron 3 Super: A 120B Hybrid MoE Model for Agentic AI Workloads
NVIDIA released Nemotron 3 Super on March 11, 2026, a 120B-parameter hybrid MoE model with a 1 million-token context window designed for multi-agent AI applications. The fully open model scores 85.6% on PinchBench and delivers over 5x the throughput of its predecessor.