Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
OL
olmOCR 2 7B 1025
OLMo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
CO
Yi Coder 1.5B Chat
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
FA
Fara1.5 4B
Fara · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
ME
Medgemma-27B-Text-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
NE
Nemotron Cascade 2 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
DO
Dots3 Note Prev
Dots · bartowski
Params280B
Context512K
Q4_K_M171.1 GB
JA
Jan-Nano-128K
Jan · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
Granite-4.0-H-Micro
Granite · unsloth
Params3.2B
Context1024K
Q4_K_M1.9 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB