Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
AR
Arcee-Agent
Arcee · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · demotul8
Params30.5B
Context256K
Q4_K_M18.6 GB
GE
mythopus
Gemma · orangejuicesmith
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma-3-1B-It
Gemma · manojbillionaire123
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 12b It
Gemma · recursechat
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Ministral-3-3B-Instruct-2512
Mistral · erics465
Params3.43B
Context256K
Q4_K_M2.1 GB
LL
Llama 3 8B Stroganoff 2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
Tess 3 7B SFT
Tess · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
CO
codegeex4-all-9b
Codegeex · nitsuai
Params9.4B
Context128K
Q4_K_M6.3 GB
GE
gemma 4 26b a4b opus 4.7 distilled
Gemma · glyphsoftware
Params25.2B
Context256K
Q4_K_M16.8 GB
SM
SmolLM2 360M Instruct Distill Reasoning Mix 2
SmolLM · maxylium
Params362M
Context8K
Q4_K_M0.3 GB
LL
Llama 3.2 3B Instruct
Llama · Ether4o4
Params3.61B
Context128K
Q4_K_M2.2 GB
SM
SmolLM3 3B Instruct heretic
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · osllmai-community
Params7.62B
Context128K
Q4_K_M4.7 GB
CO
C4Ai-Command-A-03-2025
Command R · unsloth
Params111B
Context256K
Q4_K_M67.1 GB
ME
Medgemma-27B-It
Medgemma · AestheticLabs
Params27B
Context128K
Q4_K_M16.5 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Q4_K_M2.2 GB
GL
Glm-4.7-Flash
GLM · Open4bits
Params29.9B
Context198K
Smallest8.3 GB
GW
Gwimi 4 12B IT
Gwimi · trjxter
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · Azerty76
Params8.03B
Context128K
Q4_K_M4.9 GB
LI
limite 1b base GGUF LiteRT
Limite · Tdamre
Params1.07B
Context128K
Q4_K_M0.7 GB
YO
Yoshino2 2B
Yoshino · en5yme
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.5 4B Base CPT Gascon Enrichie SFT
Qwen · Kadabra
Params4.21B
Context256K
Q4_K_M2.7 GB
FI
firefunction-v2
Firefunction · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
Gemma-3-12B-It
Gemma · fwwrsd
Params11.8B
Context128K
Q4_K_M7.3 GB
PI
Pip 2B
Pip · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
MI
Magistral-Small-2509
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Minicpm5 1B Tool Use
MiniCPM · koshuro
Params1.08B
Context128K
Q4_K_M0.7 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · osllmai-community
Params32.8B
Context128K
Q4_K_M19.9 GB
MA
Magnaraxy 9b
Magnaraxy · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB