GGUF models by theprint

136 GGUF models quantized by theprint on Hugging Face. Sizes run from 436M to 18B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
CreativeWriter Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
DO
DoItYourself v1 2B
Doityourself · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
LL
Llama3.2 3B Explained
Llama · theprint
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
PH
phi-3-mini-4k-python
Phi · theprint
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
TE
TextSynth 4B 0926
Textsynth · theprint
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
LL
ReWiz Llama 3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
LL
CleverBoi Llama 3.1 8B v2
Llama · theprint
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
RE
ReWiz Nemo 12B Instruct
Rewiz · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
CleverBoi Llama 3.1 8B Python
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LL
Code Llama Bagel 8B
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
BO
Boptruth Agatha 7B
Boptruth · theprint
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
TH
Theprint Moe 8x3 0126
Theprint · theprint
Params18B
Context128K
Q4_K_M11.1 GB
Tool use
QW
ComputerScience v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
LL
ReWiz Llama 3.1 8B v2
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
GameMaster v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
SoCode v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
SU
Survivor v1 2B
Survivor · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
CreativeWriter v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
LL
CleverBoi Llama 3.1 8B Instruct
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
CleverBoi Llama 3.2 3B Instruct
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
h4xx0r v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MI
CleverBoi Nemo 12B v2
Mistral · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
EV
EventPlanner v1 2B
Eventplanner · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
VanRossum Qwen2.5 Coder 3B
Qwen · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
TH
Theprint 10B MoE A3B 0126
Theprint · theprint
Params9.55B
Context128K
Q4_K_M5.9 GB
Tool use
LL
Llama 3 8B Lexi Smaug Uncensored
Llama · theprint
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Coma 3B
Coma · theprint
Params3.09B
Context32K
Q4_K_M1.9 GB
ReasoningTool use
GE
CleverBoi Gemma 2 9B v2
Gemma · theprint
Params9.24B
Context16K
Q4_K_M5.8 GB
GGUF
LL
Llama 3.2 3B VanRossum
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
ProgramManager v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use

About theprint on Hugging Face

theprint has published 136 GGUF models that ggufmodels.com tracks, across families such as Llama, Qwen and Gemma. The most downloaded are CreativeWriter Llama3.2 3B, DoItYourself v1 2B and Llama3.2 3B Explained.

The quants theprint publishes most often are Q8_0 (133), Q4_K_M (132), Q6_K (128) and Q5_K_M (127). Their Q4_K_M files range from 0.4 to 11.1 GB. Parameter counts run from 436M to 18B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has theprint published?

136 models are listed here, mainly from the Llama, Qwen and Gemma families. The most downloaded is CreativeWriter Llama3.2 3B.

Which quants does theprint publish?

The most common are Q8_0 (133 models), Q4_K_M (132 models), Q6_K (128 models) and Q5_K_M (127 models).

Keep browsing