GGUF models by Undi95

127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
BI
BigL 7B
Bigl · Undi95
Params7.24B
Context32K
Smallest7.7 GB
GGUF
NE
NeMoe
Nemoe · Undi95
Params21.1B
Context1000K
Smallest22.4 GB
GGUF
SO
SolarMaid v0.1.1
Solarmaid · Undi95
Params16B
Context32K
Q4_K_M9.6 GB
GGUF
BA
C Based 2x7B iMatrix
Based · Undi95
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
UN
Unholy 8B DPO OAS
Unholy · Undi95
Params8.03B
Context8K
Smallest8.5 GB
GGUF
FL
FlatDolphinMaid 8x7B
Flatdolphinmaid · Undi95
Params46.7B
Context32K
Smallest26.4 GB
GGUF
ML
MLewd L2 Chat 13B GGUF Old
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF

Keep browsing