GGUF models by theprint
136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.
LL
Hemispheres v0.2 Llama3.2 3B Final
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
TI
tinyllama Evol Instruct
Tinyllama · theprint
Params1.1B
Context4K
Q4_K_M0.7 GB
GE
CleverBoi Gemma 2 9B
Gemma · theprint
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama3.2 1B RolePlaying Full
Llama · theprint
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Qwen2.5 14B GameDev GGUF
Qwen · theprint
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
phi 3 mini 4k gamedev
Phi · theprint
Params3.82B
Context4K
Q4_K_M2.3 GB
QW
SelfHelp v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
TE
TextSynth 3B GGUF
Textsynth · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
PositiveDetox Qwen2.5 14B
Qwen · theprint
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
LetsCode Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
CL
CleverBoi Nemo 12B
Cleverboi · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
CleverBoi 7B v3
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
PositiveDetox Qwen3 4B
Qwen · theprint
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
CleverBoi 7B v2
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
NE
Boptruth-NeuralMonarch-7B
Neuralmonarch · theprint
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
TextSynth Phi4 14B GGUF
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
Hemispheres Qwen2.5 3B Right
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
ProductiveHabits v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
ReWiz Qwen 2.5 14B
Qwen · theprint
Params14.8B
Context128K
Q4_K_M9.0 GB
TI
tinyllama alpaca cthulhu small
Tinyllama · theprint
Params1.1B
Context4K
Q4_K_M0.7 GB
MI
Conversely Mistral 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
PH
CleverBoi Phi 3.5 mini instruct
Phi · theprint
Params3.82B
Context128K
Q4_K_M2.3 GB
QW
ReWiz Qwen2.5 7B
Qwen · theprint
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Hemispheres 7B Final
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
BO
Bohf 12B MoE 3A
Bohf · theprint
Params9.55B
Context128K
Q4_K_M5.9 GB
MI
Hemispheres 7B Right
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
Hemispheres v0.2 Gemma2 9B Combo
Gemma · theprint
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Tom Qwen 7B Instruct_merged
Qwen · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
ReWiz 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Hemispheres 7B Combiner
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB