GGUF models by theprint

136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.2 1B ThinkMix
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
LL
GeneralChat Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama3.2 1B ThinkMix Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
LL
Hemispheres Llama3.2 3B Final
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
MLF Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MA
MathTutor 7B
Mathtutor · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama3.2 1B SelfHelp Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama3.1 8B CodeThink GGUF
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
TiTan Gemma3 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Genuine Gemma3 12B
Gemma · theprint
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Financial v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
LL
Llama3.2 1B FantasySciFi Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Hemispheres v0.2 Llama3.2 3B Left
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Genuine 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Empathetic Llama 3.2 3B Instruct_merged
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Rewiz Gemma3 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Gemma4 LitLit E2B
Gemma · theprint
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
LL
TiTan Llama 3.2 1B_merged
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
GE
TiTan Gemma3 0.27B_merged
Gemma · theprint
Params436M
Context32K
Q4_K_M0.4 GB
GGUF
MI
WorldBuilder 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
TiTan Qwen2.5 0.5B_merged
Qwen · theprint
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
CO
Coma 7B
Coma · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LL
Llama3.2 1B STEM Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
LLM Data Science Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama CP1 8B GGUF
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Zeth Gemma3 4B_merged
Gemma · theprint
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
PY
PyRe 3B v1
Pyre · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Mistral 7b Instruct v0.2 python 18k
Mistral · theprint
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
Llama3.2 1B FantasySciFi
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
ReasonableMath Llama 3.2 3B Instruct_merged
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing