GGUF models by Lewdiculous
162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.
VI
Violet Twilight v0.2 GGUF IQ Imatrix
Violet · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
WE
WestLake 10.7B v2 GGUF IQ Imatrix
Westlake · Lewdiculous
Params10.7B
Context32K
Q4_K_M6.5 GB
CA
Captain Eris Twighlight V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
PO
Poppy Porpoise v0.4 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
ER
Eris Daturamix 7b v2 GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b v0.1 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris PrimeV4.69 Vision 32k 7B GGUF Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
OG
ogno monarch jaskier merge 7b OH PREF DPO GGUF IQ Imatrix
Ogno · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris PrimeV4 Vision 32k 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
TE
Test1_SLIDE
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SOVL_Llama3_8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
ER
Eris Prime Punch 9B GGUF IQ Imatrix
Eris · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
ER
Eris Lelanacles 7b GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
L3-TheSpice-8b-v0.8.3
Thespice · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.2
Llama · Lewdiculous
Params8.03B
Context128K
Q4_K_M4.9 GB
BU
BuRP 7B GGUF IQ Imatrix
Burp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
Nyanade Stunna Maid 7B GGUF IQ Imatrix
Nyanade · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · Lewdiculous
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Moistral 11B v2 GGUF IQ Imatrix Testing
Moistral · Lewdiculous
Params10.7B
Context8K
Q4_K_M6.5 GB
VI
Visual LaylelemonMaidRP 7B GGUF IQ Imatrix
Visual · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris Remix 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama-3-Stheno-Mahou-8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-1.0
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
Fimbulvetr-11B-v2
Fimbulvetr · Lewdiculous
Params10.7B
Context4K
Q4_K_M6.5 GB
KU
kuno kunoichi v1 DPO v2 SLERP 7B GGUF IQ Imatrix
Kuno · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
LO
Loyal Toppy Bruins Maid 7B DARE GGUF Imatrix
Loyal · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nera Noctis 12B GGUF ARM Imatrix
Nera · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
ER
Kukul Stanta 0.420 32k 7B 0.2 GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
FE
Mika Longtext 7b GGUF IQ Imatrix
Fett · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB