Q5_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
VI
ai video studio
Video · autotools
Params1.6B
Context4K
Q4_K_M0.2 GB
QW
qwen2-15b-rewritequery_orpo
Qwen · johnbridges
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
BigBubba Qwen3.6 27B
Qwen · Guile
Params27.3B
Context256K
Q4_K_M17.8 GB
AR
Arco Put 6
Arco · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
MA
Magidonia 24B v4.3
Magidonia · Mrd1011
Params23.6B
Context128K
Q4_K_M14.3 GB
RH
L3 Rhaenys 8B
Rhaenys · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TQ
Tqwendo 36b
Tqwendo · bartowski
Params35.7B
Context32K
Q4_K_M21.6 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · shaffhausen
Params26.9B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 E2B It
Gemma · Capsulanet
Params4.65B
Context128K
Q4_K_M3.5 GB
LL
Llama 3.2 1B Instruct
Llama · sir0min
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama-3-8B-Stroganoff
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
Maginum Cydoms 24B
Maginum · Casual-Autopsy
Params23.6B
Context128K
Smallest16.3 GB
GE
Gemma 4 E4B It
Gemma · Capsulanet
Params7.52B
Context128K
Q4_K_M5.4 GB
QW
Qwen2.5 7B Instruct
Qwen · dahara1
Params7.62B
Context32K
Q4_K_M4.7 GB
SM
SmolLM2 1.7B Instruct
SmolLM · aa1602295777
Params1.71B
Context8K
Q4_K_M1.1 GB
NE
NemoMix Unleashed 12B
Nemomix · violetahayashi69
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
codegeex4-all-9b
Codegeex · qwp4w3hyb
Params9.4B
Context128K
Smallest3.1 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · fribourgquant
Params26.9B
Context256K
Q4_K_M16.5 GB
FA
FanFic Illustrator
Fanfic · webbigdata
Params3.09B
Context32K
Smallest2.0 GB
LL
Llama 3.2 3B Instruct
Llama · benniekiss
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Hyze1BInstruct
Llama · HyzeAI
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
Gemma 4 E4B It
Gemma · Krasnopjorovs
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
my_QwQ 32B Preview Abliterated Linear25
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
LF
LFM2.5 2.6B
Lfm · kelvinlamptey
Params2.7B
Context125K
Q4_K_M1.7 GB
CR
CREC N WREC Mate 24B v2
Crec · Casual-Autopsy
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
my_QwQ 32B Preview Abliterated Linear50
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
my_QwQ 32B Preview Abliterated Linear75
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama 3.2 1B Instruct
Llama · asad959191
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
Phi 4 Mini Instruct
Phi · lucasxie2025
Params3.84B
Context128K
Q4_K_M2.5 GB
GR
grug 9b Q5 K L imat
Grug · DarkKitsune
Params8.95B
Context256K
Smallest0.0 GB