FRESH

Hacker News

Home

Kimi-K3 Technical Report [pdf]

385 points by vinhnx

by GodelNumbering

5 subcomments

Back of the envelope calculation (could be off, correct me if I am)
If you are a large enough company that spends million+ on inference a month, it makes sense to buy a GB300 rack ($6M on top range from what I could find) which has 20.7 TB. Since the model is mixed trained (MXFP4), you would need less than 10% of the rack's memory to serve the full model. Aggregate HBM bandwidth: 576 TB/s. You can run over 6000 parallel agentic workflows (each with ~100k context on average) at ~30 tok/s.
Assuming the annual amortization+electricity at $1.5M/year and about 50% average annual utilization, you get less than 60 cents (USD) per million output token, for a frontier model with plenty of capacity to share, all your data never leaving premises and well over an order of magnitude cheaper!
As long as a company believes that the openweight models will continue to get more capable and 'AI is here to stay', this model provides the first solid footing for a decision to just buy a rack.

by m_ke

3 subcomments

Also open sourced a bunch of infra to go with it.
Anyone who claims open source and open weights models are "decel" needs to get their head checked
https://github.com/MoonshotAI/MoonEP
https://github.com/kvcache-ai/AgentEnv
https://github.com/MoonshotAI/FlashKDA

by fahrradflucht

6 subcomments

License: https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE
> If the Licensee or any of its affiliates operates a Model as a Service business, and the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months, the Licensee must enter into a separate agreement with Moonshot AI before using the Software or its derivative works for any commercial purpose.
+ the existing 100 million monthly active users, or more than 20 million US dollars for commercial products have to name Kimi clause

by eamag

0 subcomment

> we build a self-evolving, hierarchically organized knowledge graph that agents continuously expand through web-scale exploration across knowledge-intensive and coding domains
That's interesting!

by whimsicalism

2 subcomments

It's funny that we've finally returned to tanh activation functions, time is a circle.

by tesnorindian

0 subcomment

> Two findings in the Linux kernel illustrate the depth of these results. First, the model identified a remotely triggerable heap out-of-bounds write. The bug was introduced by an incomplete upstream fix and affects all subsequent releases, up to and including the latest upstream code
Hope these Linux Kernel bugs due to some incomplete upstream fix identified by K3 patched? Moonshot did not provide much details on this.
https://www.opensourceforu.com/2026/07/linux-maintainers-bat...
Looks like K3 is good with identifying zero days
https://www.heise.de/en/news/Kimi-K3-Chinese-AI-finds-severa...

by a-dub

0 subcomment

knowledge graph guided task synthesis. very cool! i have long wondered about the "how do you get good coverage of all the tasks" problem.
maybe some interesting theoretical work there around the rate of production of new knowledge itself and various mechanisms (human approaches, mechanistic approaches, etc).

by storus

1 subcomments

What would be the current best method to fine-tune it for my own specific agentic tasks? LoRA + DPO? GRPO? Something else?

by eamag

2 subcomments

Can someone explain what are teachers in Multi-Teacher On-Policy Distillation? I can imagine math, coding and other verifiable domains, but they also have biology? Is it where distillation from bigger models come in?

by weberer

1 subcomments

Does anyone know if a torrent is available? I think it would take quite a while to download 1.5tb from their servers.

by lenerdenator

7 subcomments

What would it take to get an American open model to compete with this?

by colesantiago

1 subcomments

This is amazing to witness. Moonshot open sourcing Kimi K3, a frontier AI and other components really means we are getting abundant AI for all of humanity.
Kudos to Moonshot for truly being what OpenAI should have been.
Fable-level and frontier AI should be open source and available to everyone for free.

0 subcomment

by htrp

0 subcomment

Why is everyone's pricing the same? licensing agreements with moonshot as an inference provider?

by NguyenDat377

0 subcomment

That's pretty impressive, I don't want to be the one undermine but I personally think the industry is shifting to rather designs that enable Models to work instead of chugging it all to data and compute ?

by Tejush

1 subcomments

Any guess on the pre-training tokens/flops they consumed?

by Mohiuddin7

0 subcomment

That's the great achievement, but ahh, wanted to try it, but my RAM had other plans

by logicallee

0 subcomment

What are the coding/agent harnesses (like Claude Code or ChatGPT Codex) that can be used with this?

by Mkadri

0 subcomment

[dead]

by histiq

0 subcomment

[flagged]

by tudou527

0 subcomment

[flagged]

by abratabia

0 subcomment

[flagged]

by kiaansaraiya

0 subcomment

[dead]

by samxli

0 subcomment

[flagged]

by m00dy

0 subcomment

I would want to see three things before drawing strong conclusions:
End-to-end tokens/sec and cost on realistic coding agent trajectories, including tool outputs and retries, not isolated decode benchmarks.
Cache hit rates and prefill cost for branching, multi-turn sessions.
Router-load distributions after post-training, where expert collapse or specialization problems often show up.

by brcmthrowaway

0 subcomment

Is this p-hacking?