GGUF models by neopolita

183 GGUF models quantized by neopolita on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama 3.2 3b instruct
Llama · neopolita
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
qwen2.5 0.5b instruct
Qwen · neopolita
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
qwen2.5 1.5b
Qwen · neopolita
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
qwen2.5 3b
Qwen · neopolita
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
qwen2.5 math 1.5b instruct
Qwen · neopolita
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
YI
yi 1.5 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
HA
hammer2.0 7b
Hammer · neopolita
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
QW
qwen2.5 math 7b
Qwen · neopolita
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
QW
qwen2 1.5b instruct
Qwen · neopolita
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GR
granite 3.0 8b base
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
SM
smollm 360m
SmolLM · neopolita
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
LL
meta llama 3 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
qwen2.5 3b instruct
Qwen · neopolita
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
meta llama guard 2 8b
Llama · neopolita
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TR
trilm 2.4b unpacked
Trilm · neopolita
Params2.46B
Context2K
Q4_K_M1.5 GB
GGUF
TO
toolace 8b
Toolace · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
Bitnet_B1_58 Large
Bitnet · neopolita
Params729M
Context2K
Q4_K_M0.5 GB
GGUF
QW
qwen2.5 coder 7b instruct
Qwen · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MA
magpielm 8b chat v0.1
Magpielm · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
qwen2.5 14b
Qwen · neopolita
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MI
mistral 7b instruct v0.3
Mistral · neopolita
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Niwaki Qwen3.6 24B A3B v3.0
Qwen · neopolita
Params23.7B
Context256K
Smallest10.8 GB
ReasoningTool use
QW
qwen2 7b instruct
Qwen · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
EX
exaone 3.0 7.8b instruct
Exaone · neopolita
Params7.82B
Context4K
Q4_K_M4.8 GB
GGUF
AR
arcee spark
Arcee · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
YI
yi 34b 200k
Yi · neopolita
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
qwen2 math 7b
Qwen · neopolita
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
MI
contextual kto mistral pairrm
Mistral · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
yi 1.5 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
GR
granite 3.0 8b instruct
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use

Keep browsing