Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 4B Nahida RP V2
Qwen · Moranyunchen
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Llama 3.2 3B Instruct
Llama · EasierAI
Params3.61B
Context128K
Q4_K_M2.2 GB
SU
MS Sunfall v0.7.0
Sunfall · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · chiakelvin
Params7.62B
Context4K
Q4_K_M4.7 GB
HU
Hunyuan 1.8B Instruct
Hunyuan · Dzluck
Params1.79B
Context256K
Q4_K_M1.1 GB
QN
QNS 2
Qns · mithulaartigala
Params773M
Context256K
Q4_K_M0.5 GB
EV
Evathene v1.3
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
BrainrotGPT2 9B
Qwen · lmyzzz
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · Fastiraz
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Qwen2.5 32B
DeepSeek · viwo50
Params32.8B
Context128K
Q4_K_M19.9 GB
GE
gemma 4 E2B qat gguf it Assamese Updesh
Gemma · KhyontekAI
Params4.65B
Context128K
Q4_K_M3.4 GB
ME
Medgemma-4B-It
Medgemma · Tavorish
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 4BxOpus 4.7 Code Reasoning Distilled
Qwen · nphearum
Params4.21B
Context256K
Q4_K_M2.7 GB
LF
Lfm2.5-1.2B-Thinking
Lfm · EmogheneAkpomedaye
Params1.17B
Context125K
Q4_K_M0.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · EasierAI
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5.1 Coder 7B Instruct
Qwen · sagemax
Params7.62B
Context32K
Q4_K_M4.7 GB
OP
Opus4.8 tuned super fast
Opus · nphearum
Params1.17B
Context125K
Q4_K_M0.7 GB
EV
Evathene v1.0
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Qwen3.5 9bxOpus 4.7 sonic
Qwen · nphearum
Params8.95B
Context256K
Q4_K_M5.6 GB
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
LA
Lazarus 2407 100B
Lazarus · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
LF
LFM2.5 1.2B Thinking LeetCode QLoRA
Lfm · RenShiPDev
Params1.17B
Context125K
Q4_K_M0.7 GB
GE
Gemma 3 1b reasoning 2.0
Gemma · KomorAI
Params1B
Context32K
Q4_K_M0.8 GB
ME
medcode
Medcode · apparelsgoat
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
Qwen2.5 7B Instruct
Qwen · drug80
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 e2bxOpus 4.7 turbo
Gemma · nphearum
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · EmancipateL
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 4 31B It
Gemma · indiansatoshi
Params30.7B
Context256K
Q4_K_M19.6 GB
SM
Smegmma-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
SR
sriq mimo v2.6 9b v1.6
Sriq · sriq-ai
Params8.95B
Context256K
Q4_K_M5.6 GB