Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
GR
Granite 3.1 2b Instruct
Granite · Dzluck
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Qwen3 8B Abliterated
Qwen · 123lanhua
Params8.19B
Context40K
Q4_K_M5.0 GB
MU
Muse Glimmer 30B Heretic
Muse · cryptonaut
Params27.9B
Context128K
Q4_K_M17.3 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · violetahayashi69
Params8.03B
Context128K
Q4_K_M4.9 GB
PY
Pydevmini1
Pydevmini · bartowski
Params4.02B
Context40K
Q4_K_M2.5 GB
PH
Phi 4 Mini Instruct
Phi · musaamadni01
Params3.84B
Context128K
Q4_K_M2.5 GB
GE
slimorca-gemma2-9b-fft
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · niemozeszwyswietlicnazwyuzytkownikaerror69
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · Heppy94
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Llama 3.2 1B Instruct tg signal extract
Llama · Sigrex
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
Gemma 4 26B A4B It
Gemma · indiansatoshi
Params25.2B
Context256K
Q4_K_M17.0 GB
GE
gemma 3 1b it tg signal extract
Gemma · Sigrex
Params1B
Context32K
Q4_K_M0.8 GB
QW
shisa v2.1 qwen3 8b UD japanese imatrix
Qwen · SiliconJelly
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen2.5 14B_Uncencored
Qwen · Da-master
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Gemma 3 27b It
Gemma · peezyrhodes
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen2.5-Omni-7B
Qwen · findingispointless
Params7.62B
Context32K
Q4_K_M4.7 GB
FI
Fireball 12B v1.0
Fireball · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
grok 2
Grok · cooonhwe
Params270B
Context128K
Q4_K_M164.1 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · EasierAI
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
KiwiMate Small Preview
Qwen · KiwiMate
Params8.95B
Context256K
Q4_K_M5.6 GB
AS
ASCII Machine
Ascii · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
qwen3 0.6b claude opus 4.7 rus distilled
Qwen · FGFGFGGDFGDFGSD
Params596M
Context32K
Q4_K_M0.4 GB
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · chatseeon
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
GR
grok 2
Grok · oki692
Params270B
Context128K
Q4_K_M164.1 GB
GP
Gpt-Oss-120B
gpt-oss · jerryzhuang
Params117B
Context128K
Q4_K_M62.8 GB
PH
Phi 3.5 Mini Instruct
Phi · stratalab-org
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Voxtral Small 24B 2507
Mistral · kukidevalml
Params23.6B
Context128K
Q4_K_M14.3 GB
FA
Fallen Command A 111B v1
Fallen · ClonedGizzards
Params111B
Context256K
Q4_K_M67.1 GB