GGUF models by Lewdiculous
162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.
UM
L3-Umbral-Mind-RP-v1.0-8B
Umbral · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
ER
Eris PrimeV3.05 Vision 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
Pasta Lake 7b
Pasta · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
LW
experimental lwd Mirau RP 14B GGUF IQ Imatrix
Lwd · Lewdiculous
Params14.8B
Context32K
Q4_K_M9.0 GB
KO
KukulStanta 7B GGUF IQ Imatrix
Konstanta · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2-7B-Instruct-abliterated
Qwen · Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
PR
Mika Lelantacles 7b Longtext GGUF IQ Imatrix
Prima · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
MI
flammen10 mistral 7B GGUF IQ Imatrix Testing
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
Poppy Porpoise v0.6 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
Prima LelantaclesV4 7b 16k
Prima · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InfinityNexus 9B GGUF IQ Imatrix
Infinitynexus · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
AU
Aura L3 8B GGUF IQ Imatrix
Aura · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
Chaos_RP_l3_8B
Chaos · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
BU
BuRPInfinity 9B GGUF IQ Imatrix
Burp · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
ER
Eris PrimeV4.20 Vision 32k 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
flammen18X mistral 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InfinityRP-v2-8B
Infinityrp · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
mistral 7b v0.2 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
SI
Sinerva 7B GGUF IQ Imatrix
Sinerva · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LW
lwd Mirau 7b RP Merged GGUF IQ Imatrix
Lwd · Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
BE
Bepis 9B GGUF IQ Imatrix
Bepis · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
FU
FuseChat Kunoichi 10.7B GGUF IQ Imatrix
Fusechat · Lewdiculous
Params10.7B
Context8K
Q4_K_M6.5 GB
KO
Kool Aid 7B GGUF IQ Imatrix
Kool · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
ER
Eris 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
kukulemon 7B GGUF IQ Imatrix
Kukulemon · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini Magnum 12b v1.1
Mini · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
llama3-8B-aifeifei-1.3
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
SL
SLIDE v2 GGUF IQ Imatrix
Slide · Lewdiculous
Params7.28B
Context32K
Q4_K_M4.4 GB
LL
llama3-8B-aifeifei-1.0
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
EN
EndlessRP v3 7B GGUF Imatrix
Endlessrp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB