GGUF models by Undi95

127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LU
Lumimaid Magnum v4 12B
Lumimaid · Undi95
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
ML
MLewd v2.4 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral 7B claude chat
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MI
Miqu 70B Alpaca DPO
Miqu · Undi95
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
PS
PsyMedRP v1 13B
Psymedrp · Undi95
Params13B
Context4K
Smallest6.3 GB
GGUF
MI
Mistral 11B OmniMix
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TO
Toppy M 7B
Toppy · Undi95
Params7.24B
Context32K
Smallest4.1 GB
GGUF
XW
Xwin MLewd 13B V0.2
Xwin · Undi95
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mixtral 4x7B DPO RPChat
Mistral · Undi95
Params24.2B
Context32K
Smallest8.1 GB
GGUF
MI
Mistral RP 0.1 7B
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
Roleplay
MI
Mixtral 8x7B MoE RP Story
Mistral · Undi95
Params46.7B
Context32K
Q4_K_M26.4 GB
Roleplay
RE
ReMM v2 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
KI
ReMM S Kimiko v2 13B
Kimi · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
ML
MLewd L2 13B v2 1
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
Undi95_Llama-3-LewdPlay-8B-evo
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
Mistral ClaudeLimaRP v3 7B
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
GGUF
ML
MLewd L2 13B v2 2
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral 11B v0.1
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MX
MXLewd L2 20B
Mxlewd · Undi95
Params20B
Context4K
Smallest8.7 GB
GGUF
ML
MLewd L2 13B v2
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
SY
Synthia 7B v1.3
Synthia · Undi95
Params7.24B
Context32K
Smallest3.5 GB
GGUF
MI
Mistral 11B CC Air
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mistral 11B RP v1
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
ML
MLewd ReMM L2 Chat 20B
Mlewd · Undi95
Params20B
Context4K
Smallest11.3 GB
GGUF
MI
MistRP Dolphin 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest3.5 GB
GGUF
LL
Undi95_Llama-3-Unholy-8B
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Undi95_Meta Llama 3.1 8B Claude
Llama · Undi95
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
UN
UndiMix v3 13B
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Undi95_MistralThinker v1.1 E2
Mistral · Undi95
Params23.6B
Context32K
Smallest25.1 GB
ReasoningRoleplay
ML
MLewd L2 Chat 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF

About Undi95 on Hugging Face

Undi95 has published 127 GGUF models that ggufmodels.com tracks, across families such as Mistral, Mlewd and Remm. The most downloaded are Lumimaid Magnum v4 12B, MLewd v2.4 13B and Mistral 7B claude chat.

The quants Undi95 publishes most often are Q8_0 (106), Q5_K_M (95), Q6_K (88) and Q4_K_S (81). Their Q4_K_M files range from 4.9 to 47.4 GB. Parameter counts run from 7.24B to 72.7B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has Undi95 published?

127 models are listed here, mainly from the Mistral, Mlewd and Remm families. The most downloaded is Lumimaid Magnum v4 12B.

Which quants does Undi95 publish?

The most common are Q8_0 (106 models), Q5_K_M (95 models), Q6_K (88 models) and Q4_K_S (81 models).

Keep browsing