Kimi K3: 2.8T Parameter Open-Source Model Released

OpenSource Architecture

TL;DR: Moonshot AI released Kimi K3, an open-source model with 2.8 trillion parameters, setting a new benchmark for large-scale open models.

Summary: Moonshot AI has launched Kimi K3, an open-source weight model featuring an unprecedented 2.8 trillion parameters. This model offers a 1M context window, native multimodal input, and incorporates Kimi Delta Attention and Attention Residuals. Independent benchmarks from Artificial Analysis and Arena position its intelligence level comparable to Opus 4.8, while its pricing is closer to Sonnet.

Why it matters: This release pushes the boundaries of open-source model scale and capability, offering a powerful alternative to proprietary models. AI builders should explore Kimi K3 for applications requiring massive context and advanced intelligence at competitive costs.

Source: rss