GGUF models by Lewdiculous

162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
UM
L3-Umbral-Mind-RP-v1.0-8B
Umbral · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ER
Eris PrimeV3.05 Vision 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
PA
Pasta Lake 7b
Pasta · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LW
experimental lwd Mirau RP 14B GGUF IQ Imatrix
Lwd · Lewdiculous
Params14.8B
Context32K
Q4_K_M9.0 GB
RoleplayTool use
KO
KukulStanta 7B GGUF IQ Imatrix
Konstanta · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
QW
Qwen2-7B-Instruct-abliterated
Qwen · Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PR
Mika Lelantacles 7b Longtext GGUF IQ Imatrix
Prima · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
Roleplay
MI
flammen10 mistral 7B GGUF IQ Imatrix Testing
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PO
Poppy Porpoise v0.6 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
PR
Prima LelantaclesV4 7b 16k
Prima · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
InfinityNexus 9B GGUF IQ Imatrix
Infinitynexus · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
Roleplay
AU
Aura L3 8B GGUF IQ Imatrix
Aura · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
CH
Chaos_RP_l3_8B
Chaos · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
BU
BuRPInfinity 9B GGUF IQ Imatrix
Burp · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
Roleplay
ER
Eris PrimeV4.20 Vision 32k 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
MI
flammen18X mistral 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IN
InfinityRP-v2-8B
Infinityrp · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
mistral 7b v0.2 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SI
Sinerva 7B GGUF IQ Imatrix
Sinerva · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LW
lwd Mirau 7b RP Merged GGUF IQ Imatrix
Lwd · Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
RoleplayTool use
BE
Bepis 9B GGUF IQ Imatrix
Bepis · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
Roleplay
FU
FuseChat Kunoichi 10.7B GGUF IQ Imatrix
Fusechat · Lewdiculous
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
KO
Kool Aid 7B GGUF IQ Imatrix
Kool · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
ER
Eris 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
KU
kukulemon 7B GGUF IQ Imatrix
Kukulemon · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Mini Magnum 12b v1.1
Mini · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
llama3-8B-aifeifei-1.3
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SL
SLIDE v2 GGUF IQ Imatrix
Slide · Lewdiculous
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama3-8B-aifeifei-1.0
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EN
EndlessRP v3 7B GGUF Imatrix
Endlessrp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay

Keep browsing