GGUF models by ZeroWw

204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
EX
EXAONE Deep 7.8B
Exaone · ZeroWw
Params7.82B
Context32K
Smallest5.1 GB
GGUF
SE
Seed Coder 8B Instruct
Seed · ZeroWw
Params8.25B
Context32K
Smallest5.5 GB
Coding
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
GGUF
PH
Phi 3 mini 128k instruct abliterated v3
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest2.5 GB
GGUF
CE
L3-8B-Celeste-v1
Celeste · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
QW
Qwen3.5 9B avg3 Q5 K M
Qwen · ZeroWw
Params8.95B
Context256K
Smallest6.5 GB
ReasoningTool use
AE
L3-Aethora-15B-V2
Aethora · ZeroWw
Params15B
Context8K
Smallest12.0 GB
GGUF
GE
Gemma 2 9B It SPPO Iter3
Gemma · ZeroWw
Params9.24B
Context8K
Smallest10.7 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
OP
OpenThinker3 7B
Openthinker · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
Tool use
QW
Qwen3 4B Instruct 2507
Qwen · ZeroWw
Params4.02B
Context256K
Smallest2.6 GB
ReasoningTool use
EX
EXAONE Deep 2.4B
Exaone · ZeroWw
Params2.41B
Context32K
Smallest1.6 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
Tool use
GL
GLM Z1 9B 0414
GLM · ZeroWw
Params9.4B
Context32K
Smallest6.6 GB
Tool use
QW
Qwen3 4B Thinking 2507
Qwen · ZeroWw
Params4.02B
Context256K
Smallest2.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · ZeroWw
Params7.62B
Context128K
Smallest5.1 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest2.6 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · ZeroWw
Params8.8B
Context32K
Smallest5.7 GB
GGUF
CO
codegeex4-all-9b
Codegeex · ZeroWw
Params9.4B
Context128K
Smallest8.7 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
Tool use
LL
Cogito v1 Preview Llama 8B
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
ReasoningTool use
QW
Qwen2.5 3B Instruct
Qwen · ZeroWw
Params3.09B
Context32K
Smallest2.0 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · ZeroWw
Params3.84B
Context128K
Smallest2.6 GB
Tool use
PH
Phi 3 mini 4k geminified
Phi · ZeroWw
Params3.82B
Context4K
Smallest3.1 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · ZeroWw
Params3.21B
Context128K
Smallest2.1 GB
Tool use
GH
Ghost 8b Beta 1608
Ghost · ZeroWw
Params8.03B
Context8K
Smallest5.3 GB
Tool use
GR
Granite 3.3 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
ReasoningTool use
GE
Fallen Gemma3 4B v1
Gemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB
GGUF

Keep browsing