GGUF models by neopolita
183 GGUF models quantized by neopolita on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 256K tokens.
LL
llama 3.2 3b instruct
Llama · neopolita
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
qwen2.5 0.5b instruct
Qwen · neopolita
Params494M
Context32K
Q4_K_M0.4 GB
QW
qwen2.5 1.5b
Qwen · neopolita
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
qwen2.5 3b
Qwen · neopolita
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
qwen2.5 math 1.5b instruct
Qwen · neopolita
Params1.54B
Context4K
Q4_K_M1.0 GB
YI
yi 1.5 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
HA
hammer2.0 7b
Hammer · neopolita
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
qwen2.5 math 7b
Qwen · neopolita
Params7.62B
Context4K
Q4_K_M4.7 GB
QW
qwen2 1.5b instruct
Qwen · neopolita
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
granite 3.0 8b base
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB
SM
smollm 360m
SmolLM · neopolita
Params362M
Context2K
Q4_K_M0.3 GB
LL
meta llama 3 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
qwen2.5 3b instruct
Qwen · neopolita
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
meta llama guard 2 8b
Llama · neopolita
Params8B
Context8K
Q4_K_M4.9 GB
TR
trilm 2.4b unpacked
Trilm · neopolita
Params2.46B
Context2K
Q4_K_M1.5 GB
TO
toolace 8b
Toolace · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
Bitnet_B1_58 Large
Bitnet · neopolita
Params729M
Context2K
Q4_K_M0.5 GB
QW
qwen2.5 coder 7b instruct
Qwen · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
magpielm 8b chat v0.1
Magpielm · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
qwen2.5 14b
Qwen · neopolita
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
mistral 7b instruct v0.3
Mistral · neopolita
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Niwaki Qwen3.6 24B A3B v3.0
Qwen · neopolita
Params23.7B
Context256K
Smallest10.8 GB
QW
qwen2 7b instruct
Qwen · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
EX
exaone 3.0 7.8b instruct
Exaone · neopolita
Params7.82B
Context4K
Q4_K_M4.8 GB
AR
arcee spark
Arcee · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
YI
yi 34b 200k
Yi · neopolita
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
qwen2 math 7b
Qwen · neopolita
Params7.62B
Context4K
Q4_K_M4.7 GB
MI
contextual kto mistral pairrm
Mistral · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
yi 1.5 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GR
granite 3.0 8b instruct
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB