GGUF models by ZeroWw
204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest5.3 GB
LU
Lumimaid v0.2 12B
Lumimaid · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
PH
Phi 3 mini 128k instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
LL
Llama 3.2 1B Instruct
Llama · ZeroWw
Params1.24B
Context128K
Smallest0.9 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · ZeroWw
Params8.03B
Context32K
Smallest7.0 GB
GH
Ghost 8b Beta
Ghost · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · ZeroWw
Params4.51B
Context128K
Smallest3.1 GB
GP
gpt2-xl
Gpt · ZeroWw
Params1.64B
Context1K
Smallest1.6 GB
GR
Granite 3.1 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
QW
Qwen3 4B Esper3
Qwen · ZeroWw
Params4.02B
Context40K
Smallest2.6 GB
LL
Llama 3.1 Storm 8B
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
QW
Qwen1.5-7B-Chat
Qwen · ZeroWw
Params7.72B
Context32K
Smallest7.1 GB
AR
Arcee-Spark
Arcee · ZeroWw
Params7.62B
Context32K
Smallest6.8 GB
QW
Qwen2.5 1.5B Instruct
Qwen · ZeroWw
Params1.54B
Context32K
Smallest1.0 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest6.8 GB
RO
L3.2 Rogue Creative Instruct Uncensored Abliterated 7B D AU SILLY
Rogue · ZeroWw
Params7.53B
Context128K
Smallest8.0 GB
GR
Granite 3.3 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
PH
Phi 3.5 Mini Instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest4.2 GB
LL
Meta Llama 3 8B Instruct
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
LL
Llama Deepsync 1B
Llama · ZeroWw
Params1.24B
Context128K
Smallest0.9 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · ZeroWw
Params3.61B
Context128K
Smallest4.6 GB
GE
Amoral Gemma3 4B
Gemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · ZeroWw
Params10.7B
Context4K
Smallest7.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest14.3 GB
MI
microsoft WizardLM 2 7B
Microsoft · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
PH
phi3 uncensored chat
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
QW
Samantha-Qwen-2-7B
Qwen · ZeroWw
Params7.62B
Context128K
Smallest6.8 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB