GGUF models by neopolita

183 GGUF models quantized by neopolita on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Storm 8B
Llama · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Bnb 4bit
Llama · neopolita
Params1.24B
Context128K
Smallest2.5 GB
GGUF
MA
magpielm 4b chat v0.1
Magpielm · neopolita
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
FA
Neo Falcon3 7B Instruct v0
Falcon · neopolita
Params7.46B
Context32K
Smallest14.9 GB
Tool use
QW
Qwen2.5 0.5B Bnb 4bit
Qwen · neopolita
Params494M
Context32K
Smallest1.0 GB
GGUF
DE
deepseek r1 redistill llama3 8b v1.1
DeepSeek · neopolita
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
OP
opencoder 8b instruct
Opencoder · neopolita
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
LL
llama 3 groq 8b tool use
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
FA
Falcon
Falcon · neopolita
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
GO
Gorilla Openfunctions v2
Gorilla · neopolita
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
RA
rakutenai 7b
Rakutenai · neopolita
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
SA
saul base
Saul · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
starling lm 7b beta
Starling · neopolita
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
YI
yi 9b 200k
Yi · neopolita
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · neopolita
Params34.7B
Context256K
Smallest36.9 GB
ReasoningTool use
YI
yi 34b chat
Yi · neopolita
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
PH
phi 3 medium 4k instruct
Phi · neopolita
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
TR
trilm 3.9b unpacked
Trilm · neopolita
Params3.99B
Context2K
Q4_K_M2.4 GB
GGUF
QW
qwen2 math 7b instruct
Qwen · neopolita
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
IN
instruction synthesizer
Instruction · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5-27B
Qwen · neopolita
Params26.9B
Context256K
Smallest28.6 GB
ReasoningTool use
QW
Neo-Qwen3-4B-Instruct-2507
Qwen · neopolita
Params4.02B
Context256K
Smallest8.1 GB
ReasoningTool use
TR
trilm 1.5b unpacked
Trilm · neopolita
Params1.52B
Context2K
Q4_K_M0.9 GB
GGUF
LL
hermes 2 theta llama 3 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
medicine llama3 8b
Llama · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
qwen2 7b
Qwen · neopolita
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
Mistral NeMo Minitron 8B Base
Mistral · neopolita
Params8.41B
Context8K
Smallest16.8 GB
GGUF
SA
saul instruct v1
Saul · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
yi 1.5 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
MI
Mistral 7b v0.3 Bnb 4bit
Mistral · neopolita
Params7.25B
Context32K
Smallest14.5 GB
GGUF

Keep browsing