GGUF models by theprint

136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
RRT1 3B_merged
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
GE
Gemma3 Python 22k 1B_merged
Gemma · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
DE
DevilsAdvocate 1B_merged
Devilsadvocate · theprint
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
RE
ReWiz Worldbuilder 7B
Rewiz · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
RU
RuDolph Hermes 7B Q4 K S
Rudolph · theprint
Params7.24B
Context32K
Smallest4.1 GB
Tool use
LL
Pythonified Llama 3.2 3B Instruct_merged
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Genuine 7B Instruct_merged
Genuine · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GE
Genuine Zeth 4B_merged
Gemma · theprint
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
DE
DevilsAdvocate 7B_merged
Devilsadvocate · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GE
TiTan Gemma3 4B_merged
Gemma · theprint
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
QW
Rewiz Tom 7B_merged
Qwen · theprint
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PY
PyRe 3B v2
Pyre · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
DE
DevilsAdvocate 8B_merged
Devilsadvocate · theprint
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
ThinkMix Qwen2.5 1.5B
Qwen · theprint
Params1.54B
Context32K
Smallest1.6 GB
ReasoningTool use
PH
Genuine Phi4
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
RU
RuDolph Hermes 7B Q6 K
Rudolph · theprint
Params7.24B
Context32K
Smallest5.9 GB
Tool use

Keep browsing