GGUF models by paultimothymooney

39 GGUF models quantized by paultimothymooney on Hugging Face. Sizes run from 494M to 32.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · paultimothymooney
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen2.5 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Smallest8.1 GB
Tool use
GE
Gemma 3 27b It
Gemma · paultimothymooney
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It
Gemma · paultimothymooney
Params27B
Context128K
Smallest28.7 GB
Vision
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · paultimothymooney
Params494M
Context32K
Smallest0.5 GB
CodingTool use
LL
Llama 3.2 3B Instruct
Llama · paultimothymooney
Params3.21B
Context128K
Smallest3.4 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · paultimothymooney
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
GE
Gemma 2 9b It
Gemma · paultimothymooney
Params9.24B
Context8K
Smallest9.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · paultimothymooney
Params7.62B
Context128K
Smallest5.3 GB
ReasoningTool use
PH
phi 4 Q8 0
Phi · paultimothymooney
Params14.7B
Context16K
Smallest15.6 GB
Coding
MI
mistral 7b sft constitutional ai Q8 0
Mistral · paultimothymooney
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · paultimothymooney
Params7.25B
Context32K
Smallest7.7 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · paultimothymooney
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
DA
datagemma rig 27b it Q4 K M
Datagemma · paultimothymooney
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · paultimothymooney
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · paultimothymooney
Params1.54B
Context32K
Smallest1.6 GB
CodingTool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Smallest8.1 GB
CodingTool use
MI
Ministral 8B Instruct 2410
Mistral · paultimothymooney
Params8.02B
Context32K
Smallest8.5 GB
Tool use
DA
datagemma rag 27b it Q4 K M
Datagemma · paultimothymooney
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 27b It
Gemma · paultimothymooney
Params27.2B
Context8K
Smallest28.9 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · paultimothymooney
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
ZE
zephyr 7b dpo full Q8 0
Zephyr · paultimothymooney
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · paultimothymooney
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · paultimothymooney
Params3.82B
Context128K
Smallest4.1 GB
Coding
MI
mistral 7b anthropic Q8 0
Mistral · paultimothymooney
Params7.24B
Context32K
Smallest7.7 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Smallest8.1 GB
GGUF
GE
Gemma 2 9b It
Gemma · paultimothymooney
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · paultimothymooney
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · paultimothymooney
Params9.24B
Context8K
Smallest9.8 GB
GGUF

About paultimothymooney on Hugging Face

paultimothymooney has published 39 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Mistral. The most downloaded are Qwen2.5 7B Instruct, Llama 3.2 3B Instruct and Qwen2.5 7B Instruct.

The quants paultimothymooney publishes most often are Q8_0 (25), Q4_K_M (13) and Q5_0 (1). Their Q4_K_M files range from 2.0 to 16.6 GB. Parameter counts run from 494M to 32.8B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has paultimothymooney published?

39 models are listed here, mainly from the Qwen, Gemma and Mistral families. The most downloaded is Qwen2.5 7B Instruct.

Which quants does paultimothymooney publish?

The most common are Q8_0 (25 models), Q4_K_M (13 models) and Q5_0 (1 models).

Keep browsing