GGUF models by Undi95

127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MistralMegaOrca 7B
Mistral · Undi95
Params7.24B
Context32K
Smallest3.5 GB
GGUF
KI
MythoMax L2 Kimiko v2 13b
Kimi · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
Llama 2 13b longlora 16k
Llama · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
ML
MLewdBoros L2 13B SuperCOT
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
BO
Borealis 10.7b DPO
Borealis · Undi95
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LI
LimaBean
Limabean · Undi95
Params13B
Context4K
Smallest5.7 GB
GGUF
ML
MLewd ReMM L2 Chat 20B Inverted
Mlewd · Undi95
Params20B
Context4K
Smallest11.3 GB
GGUF
UN
Unholy v1 12L 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM SLERP L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LE
LewdAgentLM 13B
Lewdagentlm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral 11B OmniMix bf16
Mistral · Undi95
Params10.7B
Context32K
Smallest6.5 GB
GGUF
MI
Mistral 11B CC Air RP
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
XW
Xwin LM 13B V0.2
Xwin · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
Llamix2 MLewd 4x13B
Llamix · Undi95
Params38.5B
Context32K
Q4_K_M21.8 GB
GGUF
UN
UndiMix v2 13b
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
UT
UtopiaXL 13B
Utopiaxl · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
NO
Nous Hermes 13B Code
Nous · Undi95
Params13B
Context4K
Smallest7.4 GB
CodingTool use
ML
MLewd Chat v2 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral 11B Airoboros v0.1
Mistral · Undi95
Params10.7B
Context32K
Smallest11.4 GB
GGUF
RE
ReMM v1 LRPSGPT 1Char 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
EM
Emerhyst 20B
Emerhyst · Undi95
Params20B
Context4K
Smallest9.7 GB
GGUF
MX
MXLewdMini L2 13B
Mxlewdmini · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM Lion 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral PetroLimaRP v3 12B
Mistral · Undi95
Params11.2B
Context32K
Smallest6.3 GB
GGUF
OP
OpenRP 13B SuperCOT
Openrp · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
CL
Clover3 17B
Clover · Undi95
Params16.8B
Context32K
Smallest9.5 GB
GGUF
ML
MLewdBoros L2 13B
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
Mistral 11B Airoboros RP v1
Mistral · Undi95
Params10.7B
Context32K
Smallest8.8 GB
Roleplay
LL
Llama 3 Chatty 2x8B
Llama · Undi95
Params13.7B
Context8K
Smallest14.5 GB
GGUF
TO
Toppy Mix 4x7B
Toppy · Undi95
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF

Keep browsing