GGUF models by ZeroWw

204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest5.3 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · ZeroWw
Params1.24B
Context128K
Smallest0.9 GB
Tool use
ST
L3-8B-Stheno-v3.3-32K
Stheno · ZeroWw
Params8.03B
Context32K
Smallest7.0 GB
GGUF
GH
Ghost 8b Beta
Ghost · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
Tool use
LL
Llama 3.1 Minitron 4B Width Base
Llama · ZeroWw
Params4.51B
Context128K
Smallest3.1 GB
GGUF
GP
gpt2-xl
Gpt · ZeroWw
Params1.64B
Context1K
Smallest1.6 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
Tool use
QW
Qwen3 4B Esper3
Qwen · ZeroWw
Params4.02B
Context40K
Smallest2.6 GB
ReasoningTool use
LL
Llama 3.1 Storm 8B
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
GGUF
QW
Qwen1.5-7B-Chat
Qwen · ZeroWw
Params7.72B
Context32K
Smallest7.1 GB
GGUF
AR
Arcee-Spark
Arcee · ZeroWw
Params7.62B
Context32K
Smallest6.8 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · ZeroWw
Params1.54B
Context32K
Smallest1.0 GB
Tool use
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest6.8 GB
Tool use
RO
L3.2 Rogue Creative Instruct Uncensored Abliterated 7B D AU SILLY
Rogue · ZeroWw
Params7.53B
Context128K
Smallest8.0 GB
Tool use
GR
Granite 3.3 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest4.2 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
GGUF
LL
Llama Deepsync 1B
Llama · ZeroWw
Params1.24B
Context128K
Smallest0.9 GB
Tool use
LL
Llama 3.2 3B Instruct Abliterated
Llama · ZeroWw
Params3.61B
Context128K
Smallest4.6 GB
Tool use
GE
Amoral Gemma3 4B
Gemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · ZeroWw
Params10.7B
Context4K
Smallest7.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest14.3 GB
GGUF
MI
microsoft WizardLM 2 7B
Microsoft · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
GGUF
PH
phi3 uncensored chat
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
GGUF
QW
Samantha-Qwen-2-7B
Qwen · ZeroWw
Params7.62B
Context128K
Smallest6.8 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GGUF

Keep browsing