GGUF models by l3utterfly

51 GGUF models quantized by l3utterfly on Hugging Face. Sizes run from 1.1B to 16.5B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
AV
Ava 1.0 12B
Ava · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3.1 Minitron 4B Width Base
Llama · l3utterfly
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
GE
Fallen Gemma3 4B v1
Gemma · l3utterfly
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
ST
L3 SthenoMaid 8B V1
Sthenomaid · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3SOME 8B V2D
Llama · l3utterfly
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
NE
NemoMix Unleashed 12B
Nemomix · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PH
phi 3 mini 128k instruct
Phi · l3utterfly
Params3.82B
Context128K
Smallest1.4 GB
GGUF
DA
L3 Dark Planet 8B
Dark · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NY
L3 Nymeria v2 8B
Nymeria · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
magnum v2.5 12b kto
Magnum · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
llava llama 3 8b v1 1
Llama · l3utterfly
Params8.03B
Context8K
Smallest4.9 GB
Vision
DA
L3 DARKEST PLANET 16.5B
Darkest · l3utterfly
Params16.5B
Context8K
Q4_K_M10.0 GB
GGUF
EL
Ellaria 9B
Ellaria · l3utterfly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CE
MN 12B Celeste V1.9
Celeste · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PH
llava phi3 mini
Phi · l3utterfly
Params3.82B
Context4K
Smallest2.3 GB
Vision
MA
magnum twilight 12b
Magnum · l3utterfly
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
WI
WizardLM 2 7B
Wizardlm · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama-3-Korean-Bllossom-8B
Llama · l3utterfly
Params8.03B
Context8K
Smallest3.3 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · l3utterfly
Params6.92B
Context4K
Smallest3.9 GB
GGUF
LL
Mahou 1.3 llama3 8B
Llama · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing