GGUF models by l3utterfly

51 GGUF models quantized by l3utterfly on Hugging Face. Sizes run from 1.1B to 16.5B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemmasutra Mini 2B v1
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 2b It
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Impish_LLAMA_3B
Llama · l3utterfly
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
PH
phi 2 layla v1 chatml
Phi · l3utterfly
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MI
mistral-7b-v0.1-layla-v4-chatml
Mistral · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen1.5 1.8B Layla v4
Qwen · l3utterfly
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
L3 8B Stheno v3.2
Stheno · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RH
L3 Rhaenys 8B
Rhaenys · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AU
Aura Uncensored l3 8B
Aura · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 Ataraxy 9B
Gemma · l3utterfly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
mistral 7b v0.1 layla v4
Mistral · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UM
L3 Umbral Mind RP v0.3 8B
Umbral · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.2 3B Instruct
Llama · l3utterfly
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
SU
L3 Super Nova RP 8B
Super · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
PH
phi 2 layla v1
Phi · l3utterfly
Params2.78B
Context2K
Smallest1.1 GB
GGUF
LL
llava1.5 7b
LLaVA · l3utterfly
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
MO
MobileVLM2 1.7B
Mobilevlm · l3utterfly
Params1.36B
Context2K
Smallest0.8 GB
Vision
WI
WizardLM 2 7B abliterated
Wizardlm · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RA
X Ray Alpha
Ray · l3utterfly
Params3.88B
Context128K
Smallest1.7 GB
Vision
LL
llama 3 Stheno Mahou 8B
Llama · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
tinyllama-1.1b-layla-v4
Tinyllama · l3utterfly
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LU
L3 8B Lunaris v1
Lunaris · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 SthenoMaidBlackroot 8B V1
Sthenomaidblackroot · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ET
EtherealRainbow v0.3 8B
Etherealrainbow · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
Violet Twilight v0.2
Violet · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Gemma 3
Gemma · l3utterfly
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Llama 3.1 8B Instruct
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

About l3utterfly on Hugging Face

l3utterfly has published 51 GGUF models that ggufmodels.com tracks, across families such as Llama, Gemma and Phi. The most downloaded are Gemmasutra Mini 2B v1, Gemma 2 2b It and Impish_LLAMA_3B.

The quants l3utterfly publishes most often are Q2_K (45), F16 (45), Q8_0 (44) and Q6_K (44). Their Q4_K_M files range from 0.7 to 10.0 GB. Parameter counts run from 1.1B to 16.5B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has l3utterfly published?

51 models are listed here, mainly from the Llama, Gemma and Phi families. The most downloaded is Gemmasutra Mini 2B v1.

Which quants does l3utterfly publish?

The most common are Q2_K (45 models), F16 (45 models), Q8_0 (44 models) and Q6_K (44 models).

Keep browsing