GGUF models by ZeroWw
204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.
LL
Llama3.1 8B Enigma
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
XL
xLAM 1b Fc R
Xlam · ZeroWw
Params1.35B
Context16K
Smallest1.2 GB
QW
Qwen2.5 7B Instruct
Qwen · ZeroWw
Params7.62B
Context32K
Smallest9.1 GB
IN
InternLM2
InternLM · ZeroWw
Params7.74B
Context32K
Smallest6.5 GB
YI
Yi-1.5-6B-Chat
Yi · ZeroWw
Params6.06B
Context4K
Smallest5.0 GB
LL
Llama-3-8B-Instruct-Gradient-4194k
Llama · ZeroWw
Params8.03B
Context1K
Smallest7.0 GB
NE
neural chat 7b v3 3
Neural · ZeroWw
Params7.24B
Context32K
Smallest4.5 GB
DA
h2o-danube3-500m-chat
Danube · ZeroWw
Params514M
Context8K
Smallest0.5 GB
LL
Llama3.1 8B ShiningValiant2
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
QW
Qwen2.5 1.5B Instruct
Qwen · ZeroWw
Params1.54B
Context32K
Smallest1.9 GB
LL
Llama 3.2 1B Instruct
Llama · ZeroWw
Params1.24B
Context128K
Smallest1.6 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · ZeroWw
Params8.41B
Context8K
Smallest5.5 GB
MI
Mistral 7B Instruct v0.3
Mistral · ZeroWw
Params7.25B
Context32K
Smallest8.0 GB
PH
phillama-3.8b-v0.1
Phillama · ZeroWw
Params3.82B
Context4K
Smallest3.0 GB
SM
Smegmma-9B-v1
Smegmma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
SY
Symbol LLM 8B Instruct
Symbol · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
LL
Llama 3.2 3B Instruct
Llama · ZeroWw
Params3.21B
Context128K
Smallest3.8 GB
SM
Smegmma-Deluxe-9B-v1
Smegmma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
QW
Replete LLM Qwen2 7b Beta Preview SILLY
Qwen · ZeroWw
Params7.62B
Context128K
Smallest9.1 GB
NE
neural chat 7b v3 3 SILLY
Neural · ZeroWw
Params7.24B
Context32K
Smallest7.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
AY
aya-23-8B
Aya · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
LU
Lumimaid v0.2 8B
Lumimaid · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GH
Ghost 8b Beta 1608
Ghost · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
GR
Granite 3.2 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
HA
Hathor_Stable-v0.2-L3-8B
Hathor · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
LL
Llama 3.1 Storm 8B
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
LL
Llama3.1 8B Enigma
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
LL
LLaMAX3-8B-Alpaca
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB