GGUF models by theprint
136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.
QW
LM Expert Qwen2.5 Coder 14B
Qwen · theprint
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
ReWiz Llama 3.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ReWiz Llama 3.2 1B
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
PyRe Llama8.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
ReWiz Gemma2 9B
Gemma · theprint
Params9.24B
Context32K
Q4_K_M5.8 GB
MI
mistral 7b cthulhu
Mistral · theprint
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
ThinkMix Gemma3 4B GRPO
Gemma · theprint
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Hemispheres Llama3.2 3B Left
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
PersonalFinance Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
CleverBoi Mistral 0.3 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Hemispheres 7B Left
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
Hemispheres Llama3.2 3B Right
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Summarizer v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
LL
Hemispheres v0.2 Llama3.2 3B Right
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Hemispheres Llama3.2 3B Combiner
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
GeneralChat-Llama3.2-3B-DPO
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Hemispheres Qwen2.5 3B Left
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
TH
Theprint 12B MoE 3A
Theprint · theprint
Params9.55B
Context128K
Q4_K_M5.9 GB
PH
ReWiz Phi 4 14B
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
LL
Hemispheres Llama3.1 8B Combo
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Conversely Llama3.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
ThinkMix Gemma3 4B
Gemma · theprint
Params3.88B
Context128K
Q4_K_M2.5 GB
TE
TextSynth 8B
Textsynth · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeThink 8B GRPO GGUF
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
CodeLlama3.2 3B 1225
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
CogBeTh Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Hemispheres v0.2 Llama3.2 3B Combo
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Nerdish Llama 3.1 8B
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Hemispheres Qwen2.5 1.5B Combo
Qwen · theprint
Params1.54B
Context128K
Q4_K_M1.0 GB
WO
WorldBuilder 12B
Worldbuilder · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB