GGUF models by l3utterfly
51 GGUF models quantized by l3utterfly on Hugging Face. Sizes run from 1.1B to 16.5B parameters. The longest trained context is 1000K tokens.
AV
Ava 1.0 12B
Ava · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · l3utterfly
Params4.51B
Context128K
Q4_K_M2.8 GB
GE
Fallen Gemma3 4B v1
Gemma · l3utterfly
Params3.88B
Context128K
Q4_K_M2.5 GB
ST
L3 SthenoMaid 8B V1
Sthenomaid · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3SOME 8B V2D
Llama · l3utterfly
Params8.03B
Context10K
Q4_K_M4.9 GB
NE
NemoMix Unleashed 12B
Nemomix · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
phi 3 mini 128k instruct
Phi · l3utterfly
Params3.82B
Context128K
Smallest1.4 GB
DA
L3 Dark Planet 8B
Dark · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
NY
L3 Nymeria v2 8B
Nymeria · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
magnum v2.5 12b kto
Magnum · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
llava llama 3 8b v1 1
Llama · l3utterfly
Params8.03B
Context8K
Smallest4.9 GB
DA
L3 DARKEST PLANET 16.5B
Darkest · l3utterfly
Params16.5B
Context8K
Q4_K_M10.0 GB
EL
Ellaria 9B
Ellaria · l3utterfly
Params9.24B
Context8K
Q4_K_M5.8 GB
CE
MN 12B Celeste V1.9
Celeste · l3utterfly
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
llava phi3 mini
Phi · l3utterfly
Params3.82B
Context4K
Smallest2.3 GB
MA
magnum twilight 12b
Magnum · l3utterfly
Params12.2B
Context128K
Q4_K_M7.5 GB
WI
WizardLM 2 7B
Wizardlm · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · l3utterfly
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama-3-Korean-Bllossom-8B
Llama · l3utterfly
Params8.03B
Context8K
Smallest3.3 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · l3utterfly
Params6.92B
Context4K
Smallest3.9 GB
LL
Mahou 1.3 llama3 8B
Llama · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB