Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · Fastiraz
Params32.8B
Context128K
Q4_K_M19.9 GB
LF
LFM Improved
Lfm · Xenobd
Params230M
Context125K
Q4_K_M0.2 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · Fastiraz
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek-V3-0324
DeepSeek · moxin-org
Params671B
Context160K
Smallest113.4 GB
LF
LFM2.5 2.6B
Lfm · kelvinlamptey
Params2.7B
Context125K
Q4_K_M1.7 GB
PH
Phi 4 Mini Instruct
Phi · TAKADOX
Params3.84B
Context128K
Q4_K_M2.5 GB
ET
ML MS Etheris 123B
Etheris · bartowski
Params123B
Context32K
Q4_K_M73.2 GB
VE
Venator1
Venator · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
QW
annoying ai 2b
Qwen · robloxianer
Params1.9B
Context256K
Q4_K_M1.3 GB
MO
Moonberry 2B
Moonberry · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
LLaMA3.2 3B Instruct talkie distill
Llama · Raydev
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen 2.5 0.5B gsm8k
Qwen · Rzkoohi
Params494M
Context32K
Smallest0.3 GB
PU
Purlie 2B
Purlie · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
PH
Phi 4 Mini Instruct
Phi · lucasxie2025
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
Qwable 4B Distilled
Qwen · reecdev
Params4.33B
Context256K
Q4_K_M2.8 GB
KO
KomorTTS 1.0 Nano eng
Komortts · KomorAI
Params3.3B
Context128K
Smallest1.6 GB
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Fastiraz
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Testing
Gemma · Bax-uzi
Params2.61B
Context8K
Q4_K_M1.7 GB
DE
Deepseek-R1-0528
DeepSeek · moxin-org
Params671B
Context160K
Smallest200.0 GB
LL
Magnum 72b v1 Llama
Llama · leafspark
Params72.7B
Context32K
Q4_K_M50.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · recursechat
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Devstral-Small-2505
Mistral · XythicK
Params23.6B
Context128K
Smallest8.9 GB
QW
Qwen3.5 27B
Qwen · Manojb
Params26.9B
Context256K
Smallest12.0 GB
GE
unsloth gemma infinity 4 E2B IT Q2 K L
Gemma · AIEv1LC0RP
Params4.65B
Context128K
Smallest3.7 GB
DE
Deepseek-V3.1-Terminus
DeepSeek · bobchenyx
Params671B
Context160K
Q4_K_M404.7 GB
DR
droplychee 2.1 27b
Droplychee · droplychee
Params26.9B
Context256K
Smallest12.0 GB
QW
qwen2.5-0.5b-instruct
Qwen · biali
Params630M
Context32K
Q4_K_M0.5 GB
GR
ibm granite 4.1 8b project aisafety v1.0
Granite · BBwolvBB
Params8.79B
Context128K
Smallest3.8 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · ldov
Params14.8B
Context128K
Q4_K_M4.7 GB