GGUF models by paul-stansifer

47 GGUF models quantized by paul-stansifer on Hugging Face. Sizes run from 54M to 13B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
qwpl gemma 4x1e 4 7b 1e 4
Gemma · paul-stansifer
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
qw3 gemma2 9b 1x4e 4
Gemma · paul-stansifer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
qwpl gemma 2e 4x1 7b
Gemma · paul-stansifer
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
qw gemma2 4e 4x1 2b
Gemma · paul-stansifer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
qw us gemma2 oldstyle 9b adapter
Gemma · paul-stansifer
Params54M
Context—
Smallest0.2 GB
GGUF
LL
qw3 llama3 8b 1x2e 4
Llama · paul-stansifer
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
qwpl mistral 4x1e 4 7b 1e 4
Mistral · paul-stansifer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
qw mistral 2e 4 7b
Mistral · paul-stansifer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
qw3 gemma2 9b 1x2e 4
Gemma · paul-stansifer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
qw mistral finaltoenail 7b
Mistral · paul-stansifer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qw3 Qwen3 8b 1x2e 4
Qwen · paul-stansifer
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
YI
qw yi 9b
Yi · paul-stansifer
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
MI
us mistral
Mistral · paul-stansifer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
qw mistral 3e 4 7b
Mistral · paul-stansifer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
qw Sheared 2.7b
Sheared · paul-stansifer
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
MI
qw mistral 2e 3 7b
Mistral · paul-stansifer
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gemma-7b
Gemma · paul-stansifer
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF

Keep browsing