facebook pixel
The largest open weight AI model ever released is here. Moonshot AI has published the full weights for Kimi K3, a 2.8 trillion parameter mixture of experts model that immediately becomes the largest openly available model released to the public. What makes it interesting is not just its size. K3 uses an MoE architecture with 896 experts, but activates only 16 experts per token, dramatically reducing inference costs while maintaining trillion scale capability. Other highlights include: • 1 million token context window • Native multimodal capabilities • API pricing around $3 per million input tokens and $15 per million output tokens • Strong early benchmark performance, including a top finish in Frontend Code Arena The benchmarks are impressive, but the real validation starts now that researchers and developers can inspect, test, and build on the released weights. One important distinction deserves attention. Open weights are not the same as universal accessibility. Running Kimi ...

 2

    Suggested Credits
    Tags, Events, and Projects