---
title: "Kimi K3 architecture: KDA, MLA and MoE"
description: "A source-led guide to Kimi K3’s hybrid attention, Attention Residuals, Stable LatentMoE, cache design, and deployment tradeoffs."
canonical_url: "https://fanout.sh/blog/kimi-k3-architecture-kda-mla-moe"
md_url: "https://fanout.sh/blog/kimi-k3-architecture-kda-mla-moe.md"
last_updated: "2026-07-29"
access: "public"
---

# Kimi K3 architecture: KDA, MLA and MoE

A source-led guide to Kimi K3’s hybrid attention, Attention Residuals, Stable LatentMoE, cache design, and deployment tradeoffs.

- Author: Suraj Gaud

- Published: 2026-07-29

- Track: Inference engineering

- Access: Fanout Pro

- Tags: Kimi K3, Kimi Delta Attention, mixture of experts, LLM architecture, long context

The complete article body is available to Fanout Pro members on the canonical page.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md