GGUF models by Undi95
127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.
PE
PetrolLM 7B
Petrollm · Undi95
Params7.24B
Context32K
Smallest4.1 GB
OP
OpenRP 13B
Openrp · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM L2 13B PIPPA
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
UN
Unholy v1 10L 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM v2.1 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
AM
Amethyst 13B
Amethyst · Undi95
Params13B
Context4K
Smallest5.7 GB
QW
Undi95_QwQ RP
Qwen · Undi95
Params32.8B
Context128K
Q4_K_M19.9 GB
KI
ReMM v2 Kimiko v2 13B
Kimi · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM v1 LRPSGPT 2Char 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
UN
Unholy v1.1 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
LU
Lumimaid Magnum 12B
Lumimaid · Undi95
Params12.2B
Context1000K
Smallest13.0 GB
BO
Borealis 10.7B
Borealis · Undi95
Params10.7B
Context4K
Q4_K_M6.5 GB
SY
SynthiAthena v2
Synthiathena · Undi95
Params13B
Context4K
Smallest7.4 GB
AT
Athene V2 Chat abliterated iMat
Athene · Undi95
Params72.7B
Context32K
Q4_K_M47.4 GB
ML
MLewd L2 13B v2 3
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
RE
ReMM v2.2 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
ZE
ZettaPi 13B
Zettapi · Undi95
Params13B
Context4K
Smallest7.4 GB
OP
OpenDolphinMaid 4x7b
Opendolphinmaid · Undi95
Params24.2B
Context32K
Smallest13.6 GB
EM
Emerald 13B
Emerald · Undi95
Params13B
Context4K
Smallest7.4 GB
LL
Undi95_Llama-3-LewdPlay-8B
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Miqu MS 70B
Miqu · Undi95
Params69B
Context32K
Smallest38.9 GB
RE
MM ReMM L2 20B
Remm · Undi95
Params20B
Context4K
Smallest11.3 GB
RE
ReMM L2 13B v1
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
AM
U Amethyst 20B
Amethyst · Undi95
Params20B
Context4K
Smallest8.7 GB
LL
Undi95_Meta-Llama-3-70B-Instruct-OAS
Llama · Undi95
Params70.6B
Context8K
Q4_K_M42.5 GB
ML
MLewd L2 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
MI
MistRP Airoboros 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest3.5 GB
ML
MLewdBoros LRPSGPT 2Char 13B
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
DA
Dawn v2 70B
Dawn · Undi95
Params69B
Context4K
Smallest29.3 GB
ON
OniiMaid alpha 13B
Oniimaid · Undi95
Params13B
Context4K
Smallest7.4 GB