GGUF models by Lewdiculous
162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.
ER
Eris Daturamix 7b GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Halu-8B-Llama3-Blackroot
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
Prima LelantaclesV5 7b
Pasta · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
NI
Nina v2 7B GGUF IQ Imatrix
Nina · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
Paradigm Shift 7B GGUF IQ Imatrix
Paradigm · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris PrimeV3.075 Vision 7B GGUF IQ Imatrix Test
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
L3-TheSpice-8b-v0.1.3
Thespice · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Elly 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
SO
Sonya 7B GGUF IQ Imatrix
Sonya · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
TH
Prodigy 7B GGUF Imatrix
This · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Infinitely Laydiculous 7B GGUF IQ Imatrix
Infinitely · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
DU
duloxetine-4b-v1
Duloxetine · Lewdiculous
Params3.95B
Context32K
Q4_K_M2.5 GB
TE
T.E 8.1 GGUF IQ Imatrix Request
Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
PO
Poppy Porpoise v0.2 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
BU
Bungo-L3-8B
Bungo · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
IR
Irene RP v2 7B GGUF IQ Imatrix
Irene · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
Persephone 7B GGUF IQ Imatrix
Persephone · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InfinityNoodleRP 7b GGUF IQ Imatrix
Infinityrp · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
AU
Aurora l3 8B GGUF IQ Imatrix
Aurora · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
AU
Aura 7B GGUF IQ Imatrix
Aura · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Rawr_Llama3_8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
firefly-gemma-7b
Gemma · Lewdiculous
Params8.54B
Context8K
Smallest2.6 GB
ER
Erosumika 7B v2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
opus v1.2 llama 3 8b GGUF IQ Imatrix
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
Test2 SLIDE GGUF IQ Imatrix
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Irene-v0.1
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
ER
InfinityRP v1 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
BU
InfiniteBuRP 7B GGUF IQ Imatrix
Burp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris PrimeV3.075 Vision 7B Longtext test GGUF IQ Imatrix Test
Eris · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
MI
Kunocchini 1.2 7b longtext GGUF Imatrix
Mistral · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB