GGUF models by Undi95
127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.
MI
MistralMegaOrca 7B
Mistral · Undi95
Params7.24B
Context32K
Smallest3.5 GB
KI
MythoMax L2 Kimiko v2 13b
Kimi · Undi95
Params13B
Context4K
Smallest7.4 GB
LL
Llama 2 13b longlora 16k
Llama · Undi95
Params13B
Context4K
Smallest7.4 GB
ML
MLewdBoros L2 13B SuperCOT
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
BO
Borealis 10.7b DPO
Borealis · Undi95
Params10.7B
Context4K
Q4_K_M6.5 GB
LI
LimaBean
Limabean · Undi95
Params13B
Context4K
Smallest5.7 GB
ML
MLewd ReMM L2 Chat 20B Inverted
Mlewd · Undi95
Params20B
Context4K
Smallest11.3 GB
UN
Unholy v1 12L 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM SLERP L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
LE
LewdAgentLM 13B
Lewdagentlm · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
Mistral 11B OmniMix bf16
Mistral · Undi95
Params10.7B
Context32K
Smallest6.5 GB
MI
Mistral 11B CC Air RP
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
XW
Xwin LM 13B V0.2
Xwin · Undi95
Params13B
Context4K
Smallest7.4 GB
LL
Llamix2 MLewd 4x13B
Llamix · Undi95
Params38.5B
Context32K
Q4_K_M21.8 GB
UN
UndiMix v2 13b
Undimix · Undi95
Params13B
Context4K
Smallest7.4 GB
UT
UtopiaXL 13B
Utopiaxl · Undi95
Params13B
Context4K
Smallest7.4 GB
NO
Nous Hermes 13B Code
Nous · Undi95
Params13B
Context4K
Smallest7.4 GB
ML
MLewd Chat v2 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
Mistral 11B Airoboros v0.1
Mistral · Undi95
Params10.7B
Context32K
Smallest11.4 GB
RE
ReMM v1 LRPSGPT 1Char 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
EM
Emerhyst 20B
Emerhyst · Undi95
Params20B
Context4K
Smallest9.7 GB
MX
MXLewdMini L2 13B
Mxlewdmini · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM Lion 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
Mistral PetroLimaRP v3 12B
Mistral · Undi95
Params11.2B
Context32K
Smallest6.3 GB
OP
OpenRP 13B SuperCOT
Openrp · Undi95
Params13B
Context4K
Smallest7.4 GB
CL
Clover3 17B
Clover · Undi95
Params16.8B
Context32K
Smallest9.5 GB
ML
MLewdBoros L2 13B
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
Mistral 11B Airoboros RP v1
Mistral · Undi95
Params10.7B
Context32K
Smallest8.8 GB
LL
Llama 3 Chatty 2x8B
Llama · Undi95
Params13.7B
Context8K
Smallest14.5 GB
TO
Toppy Mix 4x7B
Toppy · Undi95
Params24.2B
Context32K
Q4_K_M13.6 GB