GGUF models by paultimothymooney

39 GGUF models quantized by paultimothymooney on Hugging Face. Sizes run from 494M to 32.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · paultimothymooney
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
GE
Gemma 2 27b It
Gemma · paultimothymooney
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ZE
zephyr 7b sft full Q8 0
Zephyr · paultimothymooney
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · paultimothymooney
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MI
Mistral 7B Instruct v0.3
Mistral · paultimothymooney
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
QW
QwQ 32B Preview
Qwen · paultimothymooney
Params32.8B
Context32K
Smallest34.8 GB
ReasoningTool use
DA
datagemma rig 27b it Q8 0
Datagemma · paultimothymooney
Params27.2B
Context8K
Smallest28.9 GB
GGUF
DA
datagemma rag 27b it Q8 0
Datagemma · paultimothymooney
Params27.2B
Context8K
Smallest28.9 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing