GGUF models by neopolita

183 GGUF models quantized by neopolita on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 1.5B Bnb 4bit
Qwen · neopolita
Params1.54B
Context32K
Smallest3.1 GB
GGUF
RA
rakutenai 7b instruct
Rakutenai · neopolita
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
SH
shieldgemma 9b
Shieldgemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
genstruct 7b
Genstruct · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NU
numinamath 7b tir
Numinamath · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
GE
gemma 2 9b
Gemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
llama3 chatqa 1.5 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
h2o danube 1.8b base
Danube · neopolita
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
SM
smollm 360m instruct
SmolLM · neopolita
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
TR
trilm 390m unpacked
Trilm · neopolita
Params392M
Context2K
Q4_K_M0.2 GB
GGUF
GE
Gemma-3-12B-It
Gemma · neopolita
Params11.8B
Context128K
Smallest23.5 GB
GGUF
YI
yi 6b 200k
Yi · neopolita
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
QW
qwen2 math 1.5b instruct
Qwen · neopolita
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
WA
watt tool 8b
Watt · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
YI
yi 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
GE
Gemma 2b Bnb 4bit
Gemma · neopolita
Params2.51B
Context16K
Smallest5.0 GB
GGUF
GE
Gemma 2 9b It
Gemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Ministral-3-8B-Instruct-2512
Mistral · neopolita
Params8.49B
Context256K
Smallest17.0 GB
Tool use
OP
openchat 3.6 8b 20240522
Openchat · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
gemma 2 9b it
Gemma · neopolita
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
instructlm 500m
Instructlm · neopolita
Params568M
Context2K
Q4_K_M0.4 GB
GGUF
YI
yi 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
MI
mistral 7b v0.3
Mistral · neopolita
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
YI
yi 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
TA
tablegpt2 7b
Tablegpt · neopolita
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
llama 3 instruct 8b simpo
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-8b-bnb-4bit-law-merged-gguf-f16
Llama · neopolita
Params8.03B
Context16K
Smallest16.1 GB
GGUF
SM
SmolLM 360M Bnb 4bit
SmolLM · neopolita
Params362M
Context16K
Smallest0.7 GB
GGUF
LL
sfr iterative dpo llama 3 8b r
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
yi coder 9b chat
Coder · neopolita
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding

Keep browsing