burner22/numbat
just landedmodel
Internal codename numbat, Anthropic's next Mythos-class training run. numbat is the codename referenced in the Claude Code source leak (Mar 2026). Dense, 6849B params. Context: 128K tokens (config). Vendor-reported: "~14T param, 114 layers, hybrid GDN/MLA, MoE (1,224 experts, top-48 + 1 shared), NVFP4."
- Vendor-reported: ~14T param, 114 layers, hybrid GDN/MLA, MoE (1,224 experts, top-48 + 1 shared), NVFP4.
- Org
- burner22
- Released
- 2026-10-23
- Status
- just landed
- License
- unknown
- Parameters
- 6849.4B
- Architecture
- dense · NumbatForCausalLM
- Context
- 131,072 tokens
- Signal
- 197 HF likes · 5846 downloads
Runs on
estimate from params; need = weights + FP16 KV cache for 8K tokens + 1GB. A sizing calculation, not tested.
- Q4 ~4692.8 GB (estimated size): no listed device
- Q8 ~7860.7 GB (estimated size): no listed device
- FP16 ~14282.0 GB (estimated size): no listed device
Links
First published here 2026-10-23 · updated 2026-11-02 · markdown · JSON