GGUF models by theprint

136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
LM Expert Qwen2.5 Coder 14B
Qwen · theprint
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
LL
ReWiz Llama 3.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
ReWiz Llama 3.2 1B
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
PyRe Llama8.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
ReWiz Gemma2 9B
Gemma · theprint
Params9.24B
Context32K
Q4_K_M5.8 GB
GGUF
MI
mistral 7b cthulhu
Mistral · theprint
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
ThinkMix Gemma3 4B GRPO
Gemma · theprint
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
LL
Hemispheres Llama3.2 3B Left
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
PersonalFinance Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
CleverBoi Mistral 0.3 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Hemispheres 7B Left
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Hemispheres Llama3.2 3B Right
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Summarizer v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
LL
Hemispheres v0.2 Llama3.2 3B Right
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Hemispheres Llama3.2 3B Combiner
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
GeneralChat-Llama3.2-3B-DPO
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Hemispheres Qwen2.5 3B Left
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
TH
Theprint 12B MoE 3A
Theprint · theprint
Params9.55B
Context128K
Q4_K_M5.9 GB
Tool use
PH
ReWiz Phi 4 14B
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
LL
Hemispheres Llama3.1 8B Combo
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Conversely Llama3.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
ThinkMix Gemma3 4B
Gemma · theprint
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
TE
TextSynth 8B
Textsynth · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
CodeThink 8B GRPO GGUF
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
CodeLlama3.2 3B 1225
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
CogBeTh Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Hemispheres v0.2 Llama3.2 3B Combo
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Nerdish Llama 3.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Hemispheres Qwen2.5 1.5B Combo
Qwen · theprint
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
WO
WorldBuilder 12B
Worldbuilder · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing