GGUF models by ZeroWw
204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.
GR
Granite 3.1 8b Instruct Abliterated
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
QW
QwQ LCoT 3B Instruct
Qwen · ZeroWw
Params3.09B
Context32K
Smallest2.0 GB
SH
Shieldgemma 2b
Shieldgemma · ZeroWw
Params2.61B
Context8K
Smallest1.9 GB
CE
Celeste 12B V1.6
Celeste · ZeroWw
Params12.2B
Context1000K
Smallest10.4 GB
PY
Pythia-Chat-Base-7B
Pythia · ZeroWw
Params6.86B
Context2K
Smallest5.6 GB
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest3.3 GB
MI
MixTAO-7Bx2-MoE-v8.1
Mixtao · ZeroWw
Params12.9B
Context32K
Smallest9.5 GB
YI
Yi-1.5-9B-32K
Yi · ZeroWw
Params8.83B
Context32K
Smallest6.9 GB
LL
llama3-turbcat-instruct-8b
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
MO
Moistral-11B-v4
Moistral · ZeroWw
Params10.7B
Context8K
Smallest7.9 GB
CO
CodeQwen1.5-7B-Chat
Codeqwen · ZeroWw
Params7.25B
Context64K
Smallest6.4 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · ZeroWw
Params15.7B
Context160K
Smallest12.4 GB
MA
Marco o1
Marco · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
GR
Granite 3.1 3b A800M Instruct
Granite · ZeroWw
Params3.3B
Context128K
Smallest2.0 GB
LL
open_llama_3b_v2
Llama · ZeroWw
Params3.43B
Context2K
Smallest3.0 GB
EU
EuroLLM 1.7B Instruct
Eurollm · ZeroWw
Params1.66B
Context4K
Smallest1.2 GB
LL
Cogito v1 Preview Llama 3B
Llama · ZeroWw
Params3.61B
Context128K
Smallest2.5 GB
QW
Qwen2.5 7B Instruct
Qwen · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
IN
InternLM2
InternLM · ZeroWw
Params7.74B
Context256K
Smallest6.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored SILLY
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · ZeroWw
Params8.03B
Context1024K
Smallest7.0 GB
GE
Gemma 2 2b It
Gemma · ZeroWw
Params2.61B
Context8K
Smallest3.3 GB
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · ZeroWw
Params7.62B
Context128K
Smallest6.8 GB
GE
Gemmasutra-9B-v1b
Gemma · ZeroWw
Params9.24B
Context8K
Smallest10.7 GB
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
PH
Phi3Unlocked
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
MI
Mistral 7B Instruct v0.3
Mistral · ZeroWw
Params7.25B
Context32K
Smallest5.5 GB
LL
LLaMAX3-8B
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
PH
Phi 3 song lyrics 1.0
Phi · ZeroWw
Params3.82B
Context4K
Smallest3.1 GB
LL
H2Ogpt 4096 Llama2 13b Chat
Llama · ZeroWw
Params13B
Context4K
Smallest9.6 GB