tattrongvu/Jeffan-31b-1710
archived · low-signalmodel
Text classification model from tattrongvu (HF pipeline tag; the card has no one-line description). Dense, 31B params. Context: 256K tokens (config). License: apache-2.0. Vendor-reported: "The Decision Index runs use the engine in inference/, which also reads a question a second time (the input shown twice) when its top-1 probability is below 0.9, and codes up to 255 options."
- Vendor-reported: The Decision Index runs use the engine in inference/, which also reads a question a second time (the input shown twice) when its top-1 probability is below 0.9, and codes up to 255 options.
- Org
- tattrongvu
- Released
- 2026-10-19
- Status
- archived · low-signal
- License
- apache-2.0 (permissive)
- Parameters
- 31.3B
- Architecture
- dense · Gemma4ForConditionalGeneration
- Context
- 262,144 tokens
- Task
- text-classification · text
- Signal
- 9 HF likes · 247 downloads
- Archived
- 2026-10-25 (no longer listed by the collector; stats as last seen)
Runs on
real quant files; need = weights + FP16 KV cache for 8K tokens + 1GB. A sizing calculation, not tested.
- Q4 ~27.8 GB: 32GB GPU (5090), Mac 48GB
- Q8 ~42.5 GB: 48GB GPU (RTX 6000 Ada / A6000), Mac 64GB (M1 Max), CPU only, 64GB RAM (slow)
- FP16 ~71.6 GB: 96GB GPU (RTX Pro 6000 Blackwell), 1× DGX Spark (128GB), 2× DGX Spark (256GB), Strix Halo 128GB unified (~96GB usable), Mac 96GB, Mac 128GB, Mac 192GB, Mac 256GB, Mac 512GB, CPU only, 128GB RAM (slow), CPU only, 256GB RAM (slow)
Links
First published here 2026-10-19 · updated 2026-10-25 · markdown · JSON