GGUF models by ZeroWw

204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 8B Enigma
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
Tool use
XL
xLAM 1b Fc R
Xlam · ZeroWw
Params1.35B
Context16K
Smallest1.2 GB
Tool use
QW
Qwen2.5 7B Instruct
Qwen · ZeroWw
Params7.62B
Context32K
Smallest9.1 GB
Tool use
IN
InternLM2
InternLM · ZeroWw
Params7.74B
Context32K
Smallest6.5 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · ZeroWw
Params6.06B
Context4K
Smallest5.0 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-4194k
Llama · ZeroWw
Params8.03B
Context1K
Smallest7.0 GB
GGUF
NE
neural chat 7b v3 3
Neural · ZeroWw
Params7.24B
Context32K
Smallest4.5 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · ZeroWw
Params514M
Context8K
Smallest0.5 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
Tool use
QW
Qwen2.5 1.5B Instruct
Qwen · ZeroWw
Params1.54B
Context32K
Smallest1.9 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · ZeroWw
Params1.24B
Context128K
Smallest1.6 GB
Tool use
MI
Mistral NeMo Minitron 8B Instruct
Mistral · ZeroWw
Params8.41B
Context8K
Smallest5.5 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · ZeroWw
Params7.25B
Context32K
Smallest8.0 GB
GGUF
PH
phillama-3.8b-v0.1
Phillama · ZeroWw
Params3.82B
Context4K
Smallest3.0 GB
GGUF
SM
Smegmma-9B-v1
Smegmma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
GGUF
SY
Symbol LLM 8B Instruct
Symbol · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · ZeroWw
Params3.21B
Context128K
Smallest3.8 GB
Tool use
SM
Smegmma-Deluxe-9B-v1
Smegmma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
Tool use
QW
Replete LLM Qwen2 7b Beta Preview SILLY
Qwen · ZeroWw
Params7.62B
Context128K
Smallest9.1 GB
GGUF
NE
neural chat 7b v3 3 SILLY
Neural · ZeroWw
Params7.24B
Context32K
Smallest7.9 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · ZeroWw
Params8.03B
Context128K
Smallest5.3 GB
Tool use
AY
aya-23-8B
Aya · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GGUF
GH
Ghost 8b Beta 1608
Ghost · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
Tool use
GR
Granite 3.2 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
Tool use
HA
Hathor_Stable-v0.2-L3-8B
Hathor · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
GGUF
LL
Llama3.1 8B Enigma
Llama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
Tool use
LL
LLaMAX3-8B-Alpaca
Llama · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF

Keep browsing