GGUF models by theprint
136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.
QW
RRT1 3B_merged
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
Gemma3 Python 22k 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
DE
DevilsAdvocate 1B_merged
Devilsadvocate · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
RE
ReWiz Worldbuilder 7B
Rewiz · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
RU
RuDolph Hermes 7B Q4 K S
Rudolph · theprint
Params7.24B
Context32K
Smallest4.1 GB
LL
Pythonified Llama 3.2 3B Instruct_merged
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Genuine 7B Instruct_merged
Genuine · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Genuine Zeth 4B_merged
Gemma · theprint
Params4.55B
Context128K
Q4_K_M2.9 GB
DE
DevilsAdvocate 7B_merged
Devilsadvocate · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
TiTan Gemma3 4B_merged
Gemma · theprint
Params4.55B
Context128K
Q4_K_M2.9 GB
QW
Rewiz Tom 7B_merged
Qwen · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
PY
PyRe 3B v2
Pyre · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
DevilsAdvocate 8B_merged
Devilsadvocate · theprint
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
ThinkMix Qwen2.5 1.5B
Qwen · theprint
Params1.54B
Context32K
Smallest1.6 GB
PH
Genuine Phi4
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
RU
RuDolph Hermes 7B Q6 K
Rudolph · theprint
Params7.24B
Context32K
Smallest5.9 GB