GGUF models by ZeroWw

204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral_AI_Cyber_4.0
Mistral · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
GGUF
XL
xLAM 7b Fc R
Xlam · ZeroWw
Params6.91B
Context4K
Smallest6.0 GB
Tool use
LU
Lumimaid v0.2 12B SILLY
Lumimaid · ZeroWw
Params12.2B
Context1000K
Smallest14.3 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · ZeroWw
Params10.7B
Context4K
Smallest11.6 GB
GGUF
CE
L3.1 8B Celeste V1.5
Celeste · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
GGUF
GH
Ghost 8b Beta
Ghost · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
Tool use
CE
L3.1 8B Celeste V1.5 SILLY
Celeste · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GGUF
TW
TwinLlama 3.1 8B SILLY
Twinllama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest14.3 GB
Tool use
MA
Marco o1 SILLY
Marco · ZeroWw
Params7.62B
Context32K
Smallest9.1 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · ZeroWw
Params3.09B
Context32K
Smallest3.6 GB
Tool use
MI
Mistroll-7B-v2.2
Mistroll · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
GGUF
GE
gemma-2-9b-it
Gemma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
GGUF
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · ZeroWw
Params15B
Context8K
Smallest12.0 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · ZeroWw
Params8.41B
Context8K
Smallest10.0 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · ZeroWw
Params2.61B
Context8K
Smallest3.3 GB
GGUF
LL
open_llama_7b_v2
Llama · ZeroWw
Params6.74B
Context2K
Smallest5.1 GB
GGUF
EU
EuroLLM 1.7B Instruct SILLY
Eurollm · ZeroWw
Params1.66B
Context4K
Smallest2.3 GB
GGUF
NE
NeuralPipe-7B-slerp
Neuralpipe · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
GGUF
MO
Moistral-11B-v3
Moistral · ZeroWw
Params10.7B
Context8K
Smallest7.9 GB
GGUF
RO
L3 8b Rosier v1
Rosier · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
PH
Phi3Unlocked SILLY
Phi · ZeroWw
Params3.82B
Context4K
Smallest4.2 GB
GGUF
CE
L3 8B Celeste V1.2
Celeste · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
GH
ghost-7b-alpha
Ghost · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
GGUF
ST
L3-SthenoMaid-8B-V1
Sthenomaid · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF

Keep browsing