GGUF models by Lewdiculous

162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
ER
Eris Daturamix 7b GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Halu-8B-Llama3-Blackroot
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
Prima LelantaclesV5 7b
Pasta · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NI
Nina v2 7B GGUF IQ Imatrix
Nina · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
PA
Paradigm Shift 7B GGUF IQ Imatrix
Paradigm · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
ER
Eris PrimeV3.075 Vision 7B GGUF IQ Imatrix Test
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
TH
L3-TheSpice-8b-v0.1.3
Thespice · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Elly 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SO
Sonya 7B GGUF IQ Imatrix
Sonya · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
TH
Prodigy 7B GGUF Imatrix
This · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Infinitely Laydiculous 7B GGUF IQ Imatrix
Infinitely · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
DU
duloxetine-4b-v1
Duloxetine · Lewdiculous
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
TE
T.E 8.1 GGUF IQ Imatrix Request
Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
PO
Poppy Porpoise v0.2 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
BU
Bungo-L3-8B
Bungo · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
IR
Irene RP v2 7B GGUF IQ Imatrix
Irene · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
PE
Persephone 7B GGUF IQ Imatrix
Persephone · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
IN
InfinityNoodleRP 7b GGUF IQ Imatrix
Infinityrp · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
Roleplay
AU
Aurora l3 8B GGUF IQ Imatrix
Aurora · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
AU
Aura 7B GGUF IQ Imatrix
Aura · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
LL
Rawr_Llama3_8B
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
firefly-gemma-7b
Gemma · Lewdiculous
Params8.54B
Context8K
Smallest2.6 GB
GGUF
ER
Erosumika 7B v2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
opus v1.2 llama 3 8b GGUF IQ Imatrix
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Test2 SLIDE GGUF IQ Imatrix
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Irene-v0.1
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ER
InfinityRP v1 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
BU
InfiniteBuRP 7B GGUF IQ Imatrix
Burp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ER
Eris PrimeV3.075 Vision 7B Longtext test GGUF IQ Imatrix Test
Eris · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
Vision
MI
Kunocchini 1.2 7b longtext GGUF Imatrix
Mistral · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing