GGUF models by ZeroWw

204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.1 8b Instruct Abliterated
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
Tool use
QW
QwQ LCoT 3B Instruct
Qwen · ZeroWw
Params3.09B
Context32K
Smallest2.0 GB
ReasoningTool use
SH
Shieldgemma 2b
Shieldgemma · ZeroWw
Params2.61B
Context8K
Smallest1.9 GB
GGUF
CE
Celeste 12B V1.6
Celeste · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
GGUF
PY
Pythia-Chat-Base-7B
Pythia · ZeroWw
Params6.86B
Context2K
Smallest5.6 GB
GGUF
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest3.3 GB
GGUF
MI
MixTAO-7Bx2-MoE-v8.1
Mixtao · ZeroWw
Params12.9B
Context32K
Smallest9.5 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · ZeroWw
Params8.83B
Context32K
Smallest6.9 GB
GGUF
LL
llama3-turbcat-instruct-8b
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
MO
Moistral-11B-v4
Moistral · ZeroWw
Params10.7B
Context8K
Smallest7.9 GB
GGUF
CO
CodeQwen1.5-7B-Chat
Codeqwen · ZeroWw
Params7.25B
Context64K
Smallest6.4 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · ZeroWw
Params15.7B
Context160K
Smallest12.4 GB
GGUF
MA
Marco o1
Marco · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · ZeroWw
Params3.3B
Context128K
Smallest2.0 GB
Tool use
LL
open_llama_3b_v2
Llama · ZeroWw
Params3.43B
Context2K
Smallest3.0 GB
GGUF
EU
EuroLLM 1.7B Instruct
Eurollm · ZeroWw
Params1.66B
Context4K
Smallest1.2 GB
GGUF
LL
Cogito v1 Preview Llama 3B
Llama · ZeroWw
Params3.61B
Context128K
Smallest2.5 GB
ReasoningTool use
QW
Qwen2.5 7B Instruct
Qwen · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
Tool use
IN
InternLM2
InternLM · ZeroWw
Params7.74B
Context256K
Smallest6.5 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored SILLY
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · ZeroWw
Params8.03B
Context1024K
Smallest7.0 GB
GGUF
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest3.3 GB
GGUF
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · ZeroWw
Params7.62B
Context128K
Smallest6.8 GB
GGUF
GE
Gemmasutra-9B-v1b
Gemma · ZeroWw
Params9.24B
Context8K
Smallest10.7 GB
GGUF
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
GGUF
PH
Phi3Unlocked
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · ZeroWw
Params7.25B
Context32K
Smallest5.5 GB
GGUF
LL
LLaMAX3-8B
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
PH
Phi 3 song lyrics 1.0
Phi · ZeroWw
Params3.82B
Context4K
Smallest3.1 GB
GGUF
LL
H2Ogpt 4096 Llama2 13b Chat
Llama · ZeroWw
Params13B
Context4K
Smallest9.6 GB
GGUF

Keep browsing