GGUF models by theprint

136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hemispheres v0.2 Llama3.2 3B Final
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TI
tinyllama Evol Instruct
Tinyllama · theprint
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
GE
CleverBoi Gemma 2 9B
Gemma · theprint
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama3.2 1B RolePlaying Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
RoleplayTool use
QW
Qwen2.5 14B GameDev GGUF
Qwen · theprint
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
PH
phi 3 mini 4k gamedev
Phi · theprint
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
QW
SelfHelp v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
TE
TextSynth 3B GGUF
Textsynth · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
PositiveDetox Qwen2.5 14B
Qwen · theprint
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LL
LetsCode Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
CL
CleverBoi Nemo 12B
Cleverboi · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
CleverBoi 7B v3
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
PositiveDetox Qwen3 4B
Qwen · theprint
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MI
CleverBoi 7B v2
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Boptruth-NeuralMonarch-7B
Neuralmonarch · theprint
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
TextSynth Phi4 14B GGUF
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
Hemispheres Qwen2.5 3B Right
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
ProductiveHabits v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
ReWiz Qwen 2.5 14B
Qwen · theprint
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
TI
tinyllama alpaca cthulhu small
Tinyllama · theprint
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
MI
Conversely Mistral 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
PH
CleverBoi Phi 3.5 mini instruct
Phi · theprint
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
QW
ReWiz Qwen2.5 7B
Qwen · theprint
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
Hemispheres 7B Final
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
BO
Bohf 12B MoE 3A
Bohf · theprint
Params9.55B
Context128K
Q4_K_M5.9 GB
Tool use
MI
Hemispheres 7B Right
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Hemispheres v0.2 Gemma2 9B Combo
Gemma · theprint
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Tom Qwen 7B Instruct_merged
Qwen · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
ReWiz 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
MI
Hemispheres 7B Combiner
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing