Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
GE
Gemma 3 4b It
Gemma · recursechat
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
Ministral-3-3B-Reasoning-2512
Mistral · Jeney
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
BrainrotGPT2 4B
Qwen · lmyzzz
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen2-Wukong-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama 3.2 3B Instruct
Llama · Atmpushout
Params3.61B
Context128K
Q4_K_M2.2 GB
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · Light-Asriel
Params1.78B
Context128K
Q4_K_M1.1 GB
GR
Grok 2 GGUF 270B
Grok · yrrhall
Params270B
Context128K
Q4_K_M164.1 GB
QW
unsloth Qwen3.5 2B 1781178548
Qwen · azazeal2
Params1.94B
Context256K
Q4_K_M1.3 GB
PH
Phi 3.5 Mini Instruct
Phi · ALexJM19
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · anurag4884
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
parallax 2 preview
Qwen · parallaxlabs
Params4.33B
Context256K
Q4_K_M2.8 GB
GE
Gemma-3N-E4B-It
Gemma · tripolskypetr
Params6.87B
Context32K
Q4_K_M4.2 GB
QW
Qwen3.5 2B CasualConversations
Qwen · theminji
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
vai 0.6b
Qwen · votal-ai
Params596M
Context40K
Q4_K_M0.4 GB
TR
Trinity
Trinity · invinciblejha01
Params399B
Context256K
Q4_K_M241.8 GB
MA
magnum v4 27b
Magnum · ihpocksnet
Params27.2B
Context8K
Q4_K_M16.6 GB
AU
AurethV2 4B
Aurethv · OusiaResearch
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · 39mk39mk
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
phi4 mini reasoning
Phi · gopalparashar
Params3.84B
Context128K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · osllmai-community
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Hercules 6.0 Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Voxtral Small 24B 2507
Mistral · Abu-Dju
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 4 E4B It
Gemma · recursechat
Params7.52B
Context128K
Q4_K_M5.4 GB
CE
Celeste 12B V1.6
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · osllmai-community
Params8.03B
Context128K
Q4_K_M4.9 GB
FU
Functiongemma-270M-It
Functiongemma · ajmcclary
Params268M
Context32K
Q4_K_M0.3 GB
QW
qwen2-15b-rewritequery_orpo
Qwen · johnbridges
Params1.54B
Context128K
Q4_K_M1.0 GB
CR
CrystalThink 2B
Crystalthink · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
BigBubba Qwen3.6 27B
Qwen · Guile
Params27.3B
Context256K
Q4_K_M17.8 GB
GE
Gemma-3N-E2B-It
Gemma · tripolskypetr
Params4.46B
Context32K
Q4_K_M2.8 GB