GGUF models by ZeroWw
204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.
LL
Meta Llama 3.1 8B Claude 39fail 3000total
Llama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
PH
Phi 4 Mini Reasoning
Phi · ZeroWw
Params3.84B
Context128K
Smallest2.6 GB
GE
Gemma 3 R1 4B v1
Gemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB
PA
palmer-004-turbo
Palmer · ZeroWw
Params514M
Context8K
Smallest0.5 GB
GE
Gemma 3 1b It Abliterated
Gemma · ZeroWw
Params1B
Context32K
Smallest0.8 GB
MI
Mistral Nemo Base 2407
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
QW
Qwen3 1.7B
Qwen · ZeroWw
Params2.03B
Context40K
Smallest1.5 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · ZeroWw
Params8.19B
Context128K
Smallest5.5 GB
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest1.9 GB
ME
Medgemma 4b It
Medgemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB
LL
Llama 3 Nephilim v3 8B
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GE
Gemma 3 1b It
Gemma · ZeroWw
Params1B
Context32K
Smallest0.8 GB
GE
Gemma 3 4b It
Gemma · ZeroWw
Params3.88B
Context128K
Smallest2.7 GB
MI
NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1
Mistral · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · ZeroWw
Params3.82B
Context128K
Smallest4.2 GB
LL
llama3-8B-DarkIdol-2.1-Uncensored-32K
Llama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
QW
Qwen3 8B Esper3
Qwen · ZeroWw
Params8.19B
Context40K
Smallest5.5 GB
NU
NuminaMath-7B-TIR
Numinamath · ZeroWw
Params6.91B
Context4K
Smallest6.0 GB
LU
Lumimaid v0.2 8B
Lumimaid · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
DA
H2O Danube3 4b Chat
Danube · ZeroWw
Params3.96B
Context8K
Smallest3.1 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · ZeroWw
Params15.7B
Context160K
Smallest12.4 GB
GL
glm-4-9b-chat-1m
GLM · ZeroWw
Params9.48B
Context1024K
Smallest8.8 GB
GE
Gemmasutra Mini 2B v1
Gemma · ZeroWw
Params2.61B
Context8K
Smallest1.9 GB
FA
Falcon H1 7B Instruct
Falcon · ZeroWw
Params7.59B
Context256K
Smallest4.9 GB
AR
Art 0 8B
Art · ZeroWw
Params8.19B
Context40K
Smallest5.5 GB
GE
Gemma 2 Ifable 9B
Gemma · ZeroWw
Params9.24B
Context8K
Smallest6.0 GB
QW
Qwen3.5 4B
Qwen · ZeroWw
Params4.21B
Context256K
Smallest2.9 GB
TW
TwinLlama 3.1 8B
Twinllama · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
QW
Qwen3.5 2B
Qwen · ZeroWw
Params1.88B
Context256K
Smallest1.4 GB