Q2_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SN
Snarkle 2B
Snarkle · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MA
Magidonia 24B v4.3
Magidonia · Mrd1011
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
LL
Llama-3.2-3B-Instruct
Llama · goingmerry91
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
RH
L3 Rhaenys 8B
Rhaenys · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
TQ
Tqwendo 36b
Tqwendo · bartowski
Params35.7B
Context32K
Q4_K_M21.6 GB
CodingTool use
LL
Llama-3.1-8B-Instruct
Llama · mohammedqarnuon
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
VE
Venator1.1 2B
Venator · azminawwar
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · recursechat
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ER
Ernie-4.5-0.3B-Pt
Ernie · Dc15er
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
QW
Qwen3.6 27B Omnimerge v4
Qwen · shaffhausen
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
GE
Gemma 4 E2B It
Gemma · Capsulanet
Params4.65B
Context128K
Q4_K_M3.5 GB
ReasoningTool useVision
LL
Llama-3-8B-Stroganoff
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GL
GLM 4.5 Air Derestricted
GLM · TMNE
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
LL
KiwiMate Mini Preview
Llama · KiwiMate
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Gemma 4 E4B It
Gemma · Capsulanet
Params7.52B
Context128K
Q4_K_M5.4 GB
ReasoningTool useVision
GE
Gemma-3-4B-It
Gemma · Sci-fi-vy
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3.5 0.8B Talkie Distill
Qwen · Raydev
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
SM
SmolLM2 1.7B Instruct
SmolLM · aa1602295777
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
MO
Mochi 2B
Mochi · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · EasierAI
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
NemoMix Unleashed 12B
Nemomix · violetahayashi69
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 72B Embiggened
Qwen · Ailearner007
Params72.7B
Context40K
Q4_K_M47.4 GB
ReasoningTool use
QW
Qwen3.6 27B Omnimerge v4
Qwen · fribourgquant
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
PI
Pixel 2B
Pixel · PinkPixel
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
GE
Gemma2 2B Reasoning
Gemma · KomorAI
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
zubr tiny 2b
Qwen · Zubr-AI
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
vai 8b
Qwen · votal-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GP
Gpt-Oss-20B
gpt-oss · Locosdeamor
Params20.9B
Context128K
Q4_K_M11.6 GB
Tool use
VE
Venator1.1 0.8B
Venator · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · osllmai-community
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use

Other quants

Keep browsing