GGUF models by Undi95

127 GGUF models quantized by Undi95 on Hugging Face. Sizes run from 7.24B to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
PE
PetrolLM 7B
Petrollm · Undi95
Params7.24B
Context32K
Smallest4.1 GB
GGUF
OP
OpenRP 13B
Openrp · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM L2 13B PIPPA
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
UN
Unholy v1 10L 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM v2.1 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
AM
Amethyst 13B
Amethyst · Undi95
Params13B
Context4K
Smallest5.7 GB
GGUF
QW
Undi95_QwQ RP
Qwen · Undi95
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningRoleplayTool use
KI
ReMM v2 Kimiko v2 13B
Kimi · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM v1 LRPSGPT 2Char 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
UN
Unholy v1.1 13B
Unholy · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LU
Lumimaid Magnum 12B
Lumimaid · Undi95
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
BO
Borealis 10.7B
Borealis · Undi95
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SY
SynthiAthena v2
Synthiathena · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
AT
Athene V2 Chat abliterated iMat
Athene · Undi95
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
ML
MLewd L2 13B v2 3
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
RE
ReMM v2.2 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
ZE
ZettaPi 13B
Zettapi · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
OP
OpenDolphinMaid 4x7b
Opendolphinmaid · Undi95
Params24.2B
Context32K
Smallest13.6 GB
GGUF
EM
Emerald 13B
Emerald · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
Undi95_Llama-3-LewdPlay-8B
Llama · Undi95
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Miqu MS 70B
Miqu · Undi95
Params69B
Context32K
Smallest38.9 GB
GGUF
RE
MM ReMM L2 20B
Remm · Undi95
Params20B
Context4K
Smallest11.3 GB
GGUF
RE
ReMM L2 13B v1
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
AM
U Amethyst 20B
Amethyst · Undi95
Params20B
Context4K
Smallest8.7 GB
GGUF
LL
Undi95_Meta-Llama-3-70B-Instruct-OAS
Llama · Undi95
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
ML
MLewd L2 13B
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
MI
MistRP Airoboros 7B
Mistrp · Undi95
Params7.24B
Context32K
Smallest3.5 GB
GGUF
ML
MLewdBoros LRPSGPT 2Char 13B
Mlewdboros · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
DA
Dawn v2 70B
Dawn · Undi95
Params69B
Context4K
Smallest29.3 GB
GGUF
ON
OniiMaid alpha 13B
Oniimaid · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF

Keep browsing