GGUF models by Lewdiculous

162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
VI
Violet Twilight v0.2 GGUF IQ Imatrix
Violet · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
WE
WestLake 10.7B v2 GGUF IQ Imatrix
Westlake · Lewdiculous
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
CA
Captain Eris Twighlight V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
PO
Poppy Porpoise v0.4 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ER
Eris Daturamix 7b v2 GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
mistral 7b v0.1 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
ER
Eris PrimeV4.69 Vision 32k 7B GGUF Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
OG
ogno monarch jaskier merge 7b OH PREF DPO GGUF IQ Imatrix
Ogno · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ER
Eris PrimeV4 Vision 32k 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
TE
Test1_SLIDE
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SOVL_Llama3_8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ER
Eris Prime Punch 9B GGUF IQ Imatrix
Eris · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
RoleplayVision
ER
Eris Lelanacles 7b GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama-3-Soliloquy-8B-v2
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
TH
L3-TheSpice-8b-v0.8.3
Thespice · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · Lewdiculous
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
BU
BuRP 7B GGUF IQ Imatrix
Burp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NY
Nyanade Stunna Maid 7B GGUF IQ Imatrix
Nyanade · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · Lewdiculous
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
MO
Moistral 11B v2 GGUF IQ Imatrix Testing
Moistral · Lewdiculous
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
VI
Visual LaylelemonMaidRP 7B GGUF IQ Imatrix
Visual · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
ER
Eris Remix 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
llama-3-Stheno-Mahou-8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
llama3-8B-DarkIdol-1.0
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FI
Fimbulvetr-11B-v2
Fimbulvetr · Lewdiculous
Params10.7B
Context4K
Q4_K_M6.5 GB
Roleplay
KU
kuno kunoichi v1 DPO v2 SLERP 7B GGUF IQ Imatrix
Kuno · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
LO
Loyal Toppy Bruins Maid 7B DARE GGUF Imatrix
Loyal · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nera Noctis 12B GGUF ARM Imatrix
Nera · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
ER
Kukul Stanta 0.420 32k 7B 0.2 GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
FE
Mika Longtext 7b GGUF IQ Imatrix
Fett · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
Roleplay

Keep browsing