GGUF models by Lewdiculous
162 GGUF models quantized by Lewdiculous on Hugging Face. Sizes run from 3.95B to 14.8B parameters. The longest trained context is 1000K tokens.
PR
Prima LelantaclesV6 7b GGUF IQ Imatrix
Prima · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
LemonadeRP 4.5.3 GGUF IQ Imatrix
Lemonaderp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IR
Irix 12B Reasoner V.0.2
Irix · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
AS
Asherah 7B GGUF IQ Imatrix
Asherah · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
PU
Puppy_Purpose_0.69
Puppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
fireblossom 32K 7B GGUF IQ Imatrix
Fireblossom · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Erosumika 7B GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PR
Prima LelantaclesV6.3 7b GGUF IQ Imatrix
Prima · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Infinitely Laydiculous 7b longtext GGUF IQ Imatrix
Infinitely · Lewdiculous
Params7.24B
Context128K
Q4_K_M4.4 GB
ER
Eris Floramix DPO 7B GGUF Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoleBeagle 11B GGUF IQ Imatrix
Rolebeagle · Lewdiculous
Params10.7B
Context32K
Q4_K_M6.5 GB
AU
Aura v2 7B GGUF IQ Imatrix
Aura · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris Beach Day 7b GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Aura Uncensored l3 8B GGUF IQ Imatrix
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
RP Vision 7B GGUF IQ Imatrix
Vision · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
RO
rogue-enchantress-32k-7B
Rogue · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
DarkSapling 7B v2.0 GGUF IQ Imatrix
Darksapling · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheSpice 7b v0.1.1 GGUF IQ Imatrix
Thespice · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
AV
Average_Normie_l3_v1_8B
Average · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
PO
Poppy_Porpoise-0.72-L3-8B
Poppy · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
DaturaCookie 7B GGUF IQ Imatrix
Daturacookie · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
ER
Eris PrimeV4 Vision 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PR
Prima LelantaclesV6.69 7b GGUF IQ Imatrix
Prima · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
AV
Average_Normie_v3.69_8B
Average · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Hathor-L3-8B-v.01
Hathor · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-cat-8b-instruct-v1
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
LA
Layris 9B GGUF IQ Imatrix
Layris · Lewdiculous
Params8.99B
Context32K
Q4_K_M5.4 GB
PR
Prima LelantaclesV7 experimental 7b GGUF IQ Imatrix
Prima · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
phencyclidine-8b-v1
Phencyclidine · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
flammen13 mistral 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB