Rakuten/RakutenAI-3.0.1
archived · low-signalmodel
RakutenAI-3.0.1 is a post-trained version of RakutenAI-3.0. Mixture-of-experts, 684B total (256 experts, 8 per token). Context: 160K tokens (config). License: apache-2.0.
- Org
- Rakuten
- Released
- 2026-11-04
- Status
- archived · low-signal
- License
- apache-2.0 (permissive)
- Parameters
- 684.5B
- Architecture
- MoE · 256 experts, 8/token · DeepseekV3ForCausalLM
- Context
- 163,840 tokens (config.json)
- Task
- text-generation · text
- Signal
- 5 HF likes · 78 downloads
- Archived
- 2026-11-07 (no longer listed by the collector; stats as last seen)
Runs on
estimate from params; need = weights + FP16 KV cache for 8K tokens + 1GB. A sizing calculation, not tested.
- Q4 ~412.3 GB (estimated size): no listed device
- Q8 ~728.9 GB (estimated size): no listed device
- FP16 ~1370.6 GB (estimated size): no listed device
Links
First published here 2026-11-04 · updated 2026-11-07 · markdown · JSON