GGUF models by Undi95
127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.
BI
BigL 7B
Bigl · Undi95
Params7.24B
Context32K
Smallest7.7 GB
NE
NeMoe
Nemoe · Undi95
Params21.1B
Context1000K
Smallest22.4 GB
SO
SolarMaid v0.1.1
Solarmaid · Undi95
Params16B
Context32K
Q4_K_M9.6 GB
BA
C Based 2x7B iMatrix
Based · Undi95
Params12.9B
Context32K
Q4_K_M7.8 GB
UN
Unholy 8B DPO OAS
Unholy · Undi95
Params8.03B
Context8K
Smallest8.5 GB
FL
FlatDolphinMaid 8x7B
Flatdolphinmaid · Undi95
Params46.7B
Context32K
Smallest26.4 GB
ML
MLewd L2 Chat 13B GGUF Old
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB