Q5_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
MU
Muse Glimmer 30B
Muse · atrezonator
Params27.9B
Context128K
Smallest1.6 GB
LL
L3-Aethora-15B-V2
Llama · bartowski
Params15B
Context8K
Q4_K_M9.1 GB
GE
Gemma 4 26B A4B It
Gemma · indiansatoshi
Params25.2B
Context256K
Q4_K_M17.0 GB
MU
Muse Glimmer 30B
Muse · Krasnopjorovs
Params27.9B
Context128K
Q4_K_M16.9 GB
NU
NuExtract
Nuextract · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Qwythos 9B v2 Q5 K L imat
Qwythos · DarkKitsune
Params9.2B
Context1024K
Smallest0.0 GB
DE
DeepSeek R1 Distill Qwen 14B unsloth gguf japanese imatrix
DeepSeek · dahara1
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 14B_Uncencored
Qwen · Da-master
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Gemma 3 27b It
Gemma · peezyrhodes
Params27B
Context128K
Q4_K_M16.5 GB
HA
Hathor_Gamma-L3-8B-0.6
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
Fireball 12B v1.0
Fireball · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.2 1B Instruct
Llama · weluvmusic767-maker
Params1.24B
Context128K
Q4_K_M0.8 GB
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
BU
Buddy 2B v1
Buddy · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 4 A4B 98e v7 coderx it
Gemma · fribourgquant
Params19.9B
Context256K
Q4_K_M13.2 GB
MA
Maginum Cydoms 24B
Maginum · Casual-Autopsy
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.6 27B uncensored heretic v2
Qwen · Jolex98
Params26.9B
Context256K
Smallest10.2 GB
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 Mini Instruct
Phi · stratalab-org
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Voxtral Small 24B 2507
Mistral · kukidevalml
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.2 3B Instruct
Llama · EasierAI
Params3.61B
Context128K
Q4_K_M2.2 GB
SU
MS Sunfall v0.7.0
Sunfall · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · chiakelvin
Params7.62B
Context4K
Q4_K_M4.7 GB
HU
Hunyuan 1.8B Instruct
Hunyuan · Dzluck
Params1.79B
Context256K
Q4_K_M1.1 GB
MU
Muse Glimmer 30B
Muse · Hagwell
Params27.9B
Context128K
Smallest1.6 GB
DE
Qwen2.5 32B
DeepSeek · viwo50
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Llama 3.2 1B Instruct
Llama · AlexRudy
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
Gemma 2 2b Jpn It
Gemma · dahara1
Params2.61B
Context8K
Q4_K_M1.7 GB
AR
Arcee-Spark
Arcee · arcee-ai
Params7.62B
Context32K
Q4_K_M4.7 GB
SP
RP Spectrum 24B
Spectrum · Casual-Autopsy
Params23.6B
Context128K
Smallest16.3 GB