GGUF models by ZeroWw
204 GGUF models quantized by ZeroWw on Hugging Face. Sizes run from 268M to 15.7B parameters. The longest trained context is 1024K tokens.
MI
Mixtral_AI_Cyber_4.0
Mistral · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
XL
xLAM 7b Fc R
Xlam · ZeroWw
Params6.91B
Context4K
Smallest6.0 GB
LU
Lumimaid v0.2 12B SILLY
Lumimaid · ZeroWw
Params12.2B
Context1000K
Smallest14.3 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · ZeroWw
Params10.7B
Context4K
Smallest11.6 GB
CE
L3.1 8B Celeste V1.5
Celeste · ZeroWw
Params8.03B
Context128K
Smallest7.0 GB
GH
Ghost 8b Beta
Ghost · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
CE
L3.1 8B Celeste V1.5 SILLY
Celeste · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
TW
TwinLlama 3.1 8B SILLY
Twinllama · ZeroWw
Params8.03B
Context128K
Smallest9.5 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ZeroWw
Params12.2B
Context1000K
Smallest14.3 GB
MA
Marco o1 SILLY
Marco · ZeroWw
Params7.62B
Context32K
Smallest9.1 GB
QW
Qwen2.5 3B Instruct
Qwen · ZeroWw
Params3.09B
Context32K
Smallest3.6 GB
MI
Mistroll-7B-v2.2
Mistroll · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
GE
gemma-2-9b-it
Gemma · ZeroWw
Params9.24B
Context8K
Smallest7.7 GB
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · ZeroWw
Params15B
Context8K
Smallest12.0 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · ZeroWw
Params8.41B
Context8K
Smallest10.0 GB
GE
Gemmasutra Mini 2B v1
Gemma · ZeroWw
Params2.61B
Context8K
Smallest3.3 GB
LL
open_llama_7b_v2
Llama · ZeroWw
Params6.74B
Context2K
Smallest5.1 GB
EU
EuroLLM 1.7B Instruct SILLY
Eurollm · ZeroWw
Params1.66B
Context4K
Smallest2.3 GB
NE
NeuralPipe-7B-slerp
Neuralpipe · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
MO
Moistral-11B-v3
Moistral · ZeroWw
Params10.7B
Context8K
Smallest7.9 GB
RO
L3 8b Rosier v1
Rosier · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
PH
Phi3Unlocked SILLY
Phi · ZeroWw
Params3.82B
Context4K
Smallest4.2 GB
CE
L3 8B Celeste V1.2
Celeste · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GH
ghost-7b-alpha
Ghost · ZeroWw
Params7.24B
Context32K
Smallest5.5 GB
ST
L3-SthenoMaid-8B-V1
Sthenomaid · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB