nkthebass/tinybrainbot-360m-a75m-v5.1-base

just landed · new, unvettedmodel

New, unvetted: created or first seen in the last few days, not from a trusted org and not past the signal threshold yet.

A mixture-of-experts base model trained from scratch on 17.9B tokens: 383M parameters in total, 75M active per token (24 experts per layer, 4 used per token). Mixture-of-experts, 383M total, 75M active (24 experts, 4 per token). Context: 2K tokens (config). License: apache-2.0. Vendor-reported: "It replaces TinyBrainBot-360M-A75M-v4.1-MoE-Base, with a new final training stage built around school-level knowledge, and it beats it on every Open SLM Leaderboard task."

Vendor-reported: It replaces TinyBrainBot-360M-A75M-v4.1-MoE-Base, with a new final training stage built around school-level knowledge, and it beats it on every Open SLM Leaderboard task.

Org: nkthebass
Released: 2026-10-31
Status: just landed · new, unvetted
License: apache-2.0 (permissive)
Parameters: 383M total, 75M active
Architecture: MoE · 24 experts, 4/token · MixtralForCausalLM
Context: 2,048 tokens
Task: text-generation · text
Signal: 2 HF likes · 0 downloads

Runs on

estimate from params; need = weights + FP16 KV cache for 8K tokens + 1GB. A sizing calculation, not tested.

Q4 ~1.3 GB (estimated size): no listed device
Q8 ~1.5 GB (estimated size): no listed device
FP16 ~1.9 GB (estimated size): 8GB GPU (4060 / 3070), 12GB GPU (RTX 3060), 16GB GPU (5060 Ti / 4060 Ti / 4080 / 5080), 24GB GPU (3090 / 4090), 32GB GPU (5090), 48GB GPU (RTX 6000 Ada / A6000), 96GB GPU (RTX Pro 6000 Blackwell), 1× DGX Spark (128GB), 2× DGX Spark (256GB), 16GB GPU (7800 XT / 9070 XT), 24GB GPU (7900 XTX), Strix Halo 128GB unified (~96GB usable), Arc B60 24GB, Arc B70 32GB, Mac 16GB, Mac 24GB, Mac 36GB, Mac 48GB, Mac 64GB (M1 Max), Mac 96GB, Mac 128GB, Mac 192GB, Mac 256GB, Mac 512GB, CPU only, 32GB RAM (slow), CPU only, 64GB RAM (slow), CPU only, 128GB RAM (slow), CPU only, 256GB RAM (slow)

nkthebass/tinybrainbot-360m-a75m-v5.1-base

Runs on

Links