GGUF models by Undi95

127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Nethena MLewd Xwin 23B
Nethena · Undi95
Params22.8B
Context4K
Smallest9.5 GB
GGUF
MI
Undi95_MistralThinker E2
Mistral · Undi95
Params23.6B
Context32K
Smallest25.1 GB
Reasoning
LE
Lewd Sydney 20B
Lewd · Undi95
Params20B
Context4K
Smallest8.7 GB
GGUF
ML
MLewdBoros LRPSGPT 1Char 13B
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
UN
UndiMix v1 13b
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM v2 L2 13B VARIANT
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
ML
MLewd L2 13B v2 1 015
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MY
X MythoChronos 13B
Mythochronos · Undi95
Params13B
Context4K
Smallest5.4 GB
GGUF
LL
Llama3 Unholy 8B OAS
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LO
LocalC 12B e2.0
Localc · Undi95
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
MY
66Mytho33Pyg2 13B
Mytho · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral 7B v0.1 PaperMarioDecomp 1k
Mistral · Undi95
Params7.24B
Context32K
Smallest7.7 GB
GGUF
UN
Unholy v2 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
EM
Emerhyst 13B
Emerhyst · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
MistRP AirOrca 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest3.5 GB
GGUF
LE
LewdMistral 7B 0.2
Lewdmistral · Undi95
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
MiquTotalMix 70B
Miqutotalmix · Undi95
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
PS
PsyMedRP v1 20B
Psymedrp · Undi95
Params20B
Context4K
Smallest9.7 GB
GGUF
UT
Utopia 13B
Utopia · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
BagelMix 8x7B
Mistral · Undi95
Params46.7B
Context32K
Smallest26.4 GB
GGUF
SU
Sushi v1.3
Sushi · Undi95
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ML
MLewd L2 13B v2 1 050
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LE
Leyley 13B
Leyley · Undi95
Params13B
Context4K
Smallest9.2 GB
GGUF
MI
Mistral 22B v0.1
Mistral · Undi95
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
NE
Nete 13B
Nete · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
SU
Sushi v1.4
Sushi · Undi95
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Undi95_MG-FinalMix-72B
Qwen · Undi95
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MI
MistRP v1.1 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest7.7 GB
GGUF
UN
UndiMix v4 13B
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LE
LewdGem 40B
Lewdgem · Undi95
Params38.5B
Context4K
Smallest21.7 GB
GGUF

Keep browsing