GGUF models by Undi95
127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.
NE
Nethena MLewd Xwin 23B
Nethena · Undi95
Params22.8B
Context4K
Smallest9.5 GB
MI
Undi95_MistralThinker E2
Mistral · Undi95
Params23.6B
Context32K
Smallest25.1 GB
LE
Lewd Sydney 20B
Lewd · Undi95
Params20B
Context4K
Smallest8.7 GB
ML
MLewdBoros LRPSGPT 1Char 13B
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
UN
UndiMix v1 13b
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM v2 L2 13B VARIANT
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
ML
MLewd L2 13B v2 1 015
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
MY
X MythoChronos 13B
Mythochronos · Undi95
Params13B
Context4K
Smallest5.4 GB
LL
Llama3 Unholy 8B OAS
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
LO
LocalC 12B e2.0
Localc · Undi95
Params12.2B
Context1000K
Smallest13.0 GB
MY
66Mytho33Pyg2 13B
Mytho · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
Mistral 7B v0.1 PaperMarioDecomp 1k
Mistral · Undi95
Params7.24B
Context32K
Smallest7.7 GB
UN
Unholy v2 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
EM
Emerhyst 13B
Emerhyst · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
MistRP AirOrca 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest3.5 GB
LE
LewdMistral 7B 0.2
Lewdmistral · Undi95
Params7.24B
Context32K
Smallest7.7 GB
MI
MiquTotalMix 70B
Miqutotalmix · Undi95
Params69B
Context32K
Q4_K_M41.4 GB
PS
PsyMedRP v1 20B
Psymedrp · Undi95
Params20B
Context4K
Smallest9.7 GB
UT
Utopia 13B
Utopia · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
BagelMix 8x7B
Mistral · Undi95
Params46.7B
Context32K
Smallest26.4 GB
SU
Sushi v1.3
Sushi · Undi95
Params70.6B
Context128K
Q4_K_M42.5 GB
ML
MLewd L2 13B v2 1 050
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
LE
Leyley 13B
Leyley · Undi95
Params13B
Context4K
Smallest9.2 GB
MI
Mistral 22B v0.1
Mistral · Undi95
Params22.2B
Context64K
Q4_K_M13.3 GB
NE
Nete 13B
Nete · Undi95
Params13B
Context4K
Smallest7.4 GB
SU
Sushi v1.4
Sushi · Undi95
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Undi95_MG-FinalMix-72B
Qwen · Undi95
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
MistRP v1.1 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest7.7 GB
UN
UndiMix v4 13B
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
LE
LewdGem 40B
Lewdgem · Undi95
Params38.5B
Context4K
Smallest21.7 GB