Back to directory

Kimi K3

An open-weight, 2.8-trillion-parameter multimodal mixture-of-experts model built for long-horizon coding, agentic knowledge work and reasoning, with a one-million-token context window.

Kimi K3

Kimi K3 is an open-weight, native multimodal agentic model built on a new Kimi Delta Attention and Attention Residuals architecture, with 2.8 trillion total parameters, 104 billion activated per token across 896 experts, and native vision capabilities alongside a one-million-token context window.

It is designed for long-horizon coding sessions across large repositories and terminal tool orchestration, from GPU kernel optimization to chip design, and for agentic knowledge work such as producing research reports with interactive visualizations and motion design, with a text-and-image multimodal architecture.

Its full model weights are released under the Kimi K3 License for research, deployment and further development.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.