GGUF models by paultimothymooney
39 GGUF models quantized by paultimothymooney on Hugging Face. Sizes run from 494M to 32.8B parameters. The longest trained context is 128K tokens.
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · paultimothymooney
Params7.62B
Context128K
Smallest8.1 GB
GE
Gemma 2 27b It
Gemma · paultimothymooney
Params27.2B
Context8K
Q4_K_M16.6 GB
ZE
zephyr 7b sft full Q8 0
Zephyr · paultimothymooney
Params7.24B
Context32K
Smallest7.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · paultimothymooney
Params8.03B
Context128K
Smallest8.5 GB
MI
Mistral 7B Instruct v0.3
Mistral · paultimothymooney
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
QwQ 32B Preview
Qwen · paultimothymooney
Params32.8B
Context32K
Smallest34.8 GB
DA
datagemma rig 27b it Q8 0
Datagemma · paultimothymooney
Params27.2B
Context8K
Smallest28.9 GB
DA
datagemma rag 27b it Q8 0
Datagemma · paultimothymooney
Params27.2B
Context8K
Smallest28.9 GB
QW
Qwen2 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Q4_K_M4.7 GB