GGUF models by ZeroWw
204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.
EX
EXAONE Deep 7.8B
Exaone · ZeroWw
Params7.82B
Context32K
Smallest5.1 GB
SE
Seed Coder 8B Instruct
Seed · ZeroWw
Params8.25B
Context32K
Smallest5.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
PH
Phi 3 mini 128k instruct abliterated v3
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
PH
Phi 3.5 Mini Instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest2.5 GB
CE
L3-8B-Celeste-v1
Celeste · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
QW
Qwen3.5 9B avg3 Q5 K M
Qwen · ZeroWw
Params8.95B
Context256K
Smallest6.5 GB
AE
L3-Aethora-15B-V2
Aethora · ZeroWw
Params15B
Context8K
Smallest12.0 GB
GE
Gemma 2 9B It SPPO Iter3
Gemma · ZeroWw
Params9.24B
Context8K
Smallest10.7 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
OP
OpenThinker3 7B
Openthinker · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
QW
Qwen3 4B Instruct 2507
Qwen · ZeroWw
Params4.02B
Context256K
Smallest2.6 GB
EX
EXAONE Deep 2.4B
Exaone · ZeroWw
Params2.41B
Context32K
Smallest1.6 GB
GE
Tiger-Gemma-9B-v1
Gemma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
GL
GLM Z1 9B 0414
GLM · ZeroWw
Params9.4B
Context32K
Smallest6.6 GB
QW
Qwen3 4B Thinking 2507
Qwen · ZeroWw
Params4.02B
Context256K
Smallest2.6 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · ZeroWw
Params7.62B
Context128K
Smallest5.1 GB
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest2.6 GB
IN
Internlm3 8b Instruct
InternLM · ZeroWw
Params8.8B
Context32K
Smallest5.7 GB
CO
codegeex4-all-9b
Codegeex · ZeroWw
Params9.4B
Context128K
Smallest8.7 GB
GR
Granite 3.1 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
LL
Cogito v1 Preview Llama 8B
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
QW
Qwen2.5 3B Instruct
Qwen · ZeroWw
Params3.09B
Context32K
Smallest2.0 GB
PH
Phi 4 Mini Instruct
Phi · ZeroWw
Params3.84B
Context128K
Smallest2.6 GB
PH
Phi 3 mini 4k geminified
Phi · ZeroWw
Params3.82B
Context4K
Smallest3.1 GB
LL
Llama 3.2 3B Instruct
Llama · ZeroWw
Params3.21B
Context128K
Smallest2.1 GB
GH
Ghost 8b Beta 1608
Ghost · ZeroWw
Params8.03B
Context8K
Smallest5.3 GB
GR
Granite 3.3 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
GE
Fallen Gemma3 4B v1
Gemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB