GGUF models by neopolita
183 GGUF models quantized by neopolita on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 256K tokens.
QW
Qwen2.5 1.5B Bnb 4bit
Qwen · neopolita
Params1.54B
Context32K
Smallest3.1 GB
RA
rakutenai 7b instruct
Rakutenai · neopolita
Params7.37B
Context32K
Q4_K_M4.5 GB
SH
shieldgemma 9b
Shieldgemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
genstruct 7b
Genstruct · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
NU
numinamath 7b tir
Numinamath · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
GE
gemma 2 9b
Gemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
llama3 chatqa 1.5 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
h2o danube 1.8b base
Danube · neopolita
Params1.83B
Context16K
Q4_K_M1.1 GB
SM
smollm 360m instruct
SmolLM · neopolita
Params362M
Context2K
Q4_K_M0.3 GB
TR
trilm 390m unpacked
Trilm · neopolita
Params392M
Context2K
Q4_K_M0.2 GB
GE
Gemma-3-12B-It
Gemma · neopolita
Params11.8B
Context128K
Smallest23.5 GB
YI
yi 6b 200k
Yi · neopolita
Params6.06B
Context195K
Q4_K_M3.7 GB
QW
qwen2 math 1.5b instruct
Qwen · neopolita
Params1.54B
Context4K
Q4_K_M1.0 GB
WA
watt tool 8b
Watt · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
yi 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GE
Gemma 2b Bnb 4bit
Gemma · neopolita
Params2.51B
Context16K
Smallest5.0 GB
GE
Gemma 2 9b It
Gemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Ministral-3-8B-Instruct-2512
Mistral · neopolita
Params8.49B
Context256K
Smallest17.0 GB
OP
openchat 3.6 8b 20240522
Openchat · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
gemma 2 9b it
Gemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
IN
instructlm 500m
Instructlm · neopolita
Params568M
Context2K
Q4_K_M0.4 GB
YI
yi 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
mistral 7b v0.3
Mistral · neopolita
Params7.25B
Context32K
Q4_K_M4.4 GB
YI
yi 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
TA
tablegpt2 7b
Tablegpt · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
llama 3 instruct 8b simpo
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-8b-bnb-4bit-law-merged-gguf-f16
Llama · neopolita
Params8.03B
Context16K
Smallest16.1 GB
SM
SmolLM 360M Bnb 4bit
SmolLM · neopolita
Params362M
Context16K
Smallest0.7 GB
LL
sfr iterative dpo llama 3 8b r
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
yi coder 9b chat
Coder · neopolita
Params8.83B
Context128K
Q4_K_M5.3 GB