GGUF models by theprint
136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.
LL
Llama3.2 1B ThinkMix
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
GeneralChat Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama3.2 1B ThinkMix Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Hemispheres Llama3.2 3B Final
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
MLF Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
MA
MathTutor 7B
Mathtutor · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama3.2 1B SelfHelp Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama3.1 8B CodeThink GGUF
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
TiTan Gemma3 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GE
Genuine Gemma3 12B
Gemma · theprint
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Financial v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
LL
Llama3.2 1B FantasySciFi Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Hemispheres v0.2 Llama3.2 3B Left
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Genuine 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
LL
Empathetic Llama 3.2 3B Instruct_merged
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Rewiz Gemma3 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GE
Gemma4 LitLit E2B
Gemma · theprint
Params4.65B
Context128K
Q4_K_M3.4 GB
LL
TiTan Llama 3.2 1B_merged
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
TiTan Gemma3 0.27B_merged
Gemma · theprint
Params436M
Context32K
Q4_K_M0.4 GB
MI
WorldBuilder 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
TiTan Qwen2.5 0.5B_merged
Qwen · theprint
Params494M
Context32K
Q4_K_M0.4 GB
CO
Coma 7B
Coma · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama3.2 1B STEM Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLM Data Science Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama CP1 8B GGUF
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Zeth Gemma3 4B_merged
Gemma · theprint
Params4.55B
Context128K
Q4_K_M2.9 GB
PY
PyRe 3B v1
Pyre · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Mistral 7b Instruct v0.2 python 18k
Mistral · theprint
Params7.24B
Context32K
Smallest7.7 GB
LL
Llama3.2 1B FantasySciFi
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
ReasonableMath Llama 3.2 3B Instruct_merged
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB