GGUF models by neopolita
183 GGUF models quantized by neopolita on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 256K tokens.
LL
Llama 3.1 Storm 8B
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Bnb 4bit
Llama · neopolita
Params1.24B
Context128K
Smallest2.5 GB
MA
magpielm 4b chat v0.1
Magpielm · neopolita
Params4.51B
Context128K
Q4_K_M2.8 GB
FA
Neo Falcon3 7B Instruct v0
Falcon · neopolita
Params7.46B
Context32K
Smallest14.9 GB
QW
Qwen2.5 0.5B Bnb 4bit
Qwen · neopolita
Params494M
Context32K
Smallest1.0 GB
DE
deepseek r1 redistill llama3 8b v1.1
DeepSeek · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
opencoder 8b instruct
Opencoder · neopolita
Params7.77B
Context8K
Q4_K_M4.7 GB
LL
llama 3 groq 8b tool use
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
FA
Falcon
Falcon · neopolita
Params11.1B
Context2K
Q4_K_M6.8 GB
GO
Gorilla Openfunctions v2
Gorilla · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
RA
rakutenai 7b
Rakutenai · neopolita
Params7.37B
Context32K
Q4_K_M4.5 GB
SA
saul base
Saul · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
starling lm 7b beta
Starling · neopolita
Params7.24B
Context8K
Q4_K_M4.4 GB
YI
yi 9b 200k
Yi · neopolita
Params8.83B
Context256K
Q4_K_M5.3 GB
QW
Qwen3.6-35B-A3B
Qwen · neopolita
Params34.7B
Context256K
Smallest36.9 GB
YI
yi 34b chat
Yi · neopolita
Params34.4B
Context4K
Q4_K_M20.7 GB
PH
phi 3 medium 4k instruct
Phi · neopolita
Params14B
Context4K
Q4_K_M8.6 GB
TR
trilm 3.9b unpacked
Trilm · neopolita
Params3.99B
Context2K
Q4_K_M2.4 GB
QW
qwen2 math 7b instruct
Qwen · neopolita
Params7.62B
Context4K
Q4_K_M4.7 GB
IN
instruction synthesizer
Instruction · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5-27B
Qwen · neopolita
Params26.9B
Context256K
Smallest28.6 GB
QW
Neo-Qwen3-4B-Instruct-2507
Qwen · neopolita
Params4.02B
Context256K
Smallest8.1 GB
TR
trilm 1.5b unpacked
Trilm · neopolita
Params1.52B
Context2K
Q4_K_M0.9 GB
LL
hermes 2 theta llama 3 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
medicine llama3 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
qwen2 7b
Qwen · neopolita
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · neopolita
Params8.41B
Context8K
Smallest16.8 GB
SA
saul instruct v1
Saul · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
yi 1.5 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
MI
Mistral 7b v0.3 Bnb 4bit
Mistral · neopolita
Params7.25B
Context32K
Smallest14.5 GB