Q2_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EN
Endurance 100B v1.1
Endurance · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
Tool use
BE
Behemoth ReduX 123B v1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
LL
Llama 3.1 Tulu 3 8B SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M9.2 GB
ReasoningVision
QW
Lancer Coder Next abliterated
Qwen · Rixf123
Params79.7B
Context256K
Q4_K_M48.6 GB
CodingTool use
LL
Meta Llama 3.1 8B Instruct
Llama · starshina3003
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TR
Trinity
Trinity · arcee-ai
Params399B
Context256K
Q4_K_M241.8 GB
ReasoningTool use
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Tiger Gemma 9B v2
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TU
Tulu MathLingo 8B
Tulu · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AR
Arcee Blitz
Arcee · arcee-ai
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mimo-Vl-7B-Rl
Mimo · akpsahan
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
AR
Arch Function 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
MiroThinker v1.0 72B
Mirothinker · bartowski
Params72.7B
Context256K
Q4_K_M47.4 GB
Tool use
YO
Yoshino 0.8B
Yoshino · en5yme
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen3 8B
Qwen · EnlistedGhost
Params8.19B
Context40K
Q4_K_M5.3 GB
ReasoningTool use
AB
L3.1 Ablaze Vulca v0.1 8B
Ablaze · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
VI
Virtuoso Large
Virtuoso · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
GE
Gemma-3-27B-It
Gemma · tripolskypetr
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SE
Seeker 9b
Seeker · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
SubtleOne Qwen2.5 32b Erudite Writer
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning
TH
Theia 21B V2A
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
GGUF
DE
DeepSeek Llama3.3 Bllossom 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
TA
TAID LLM 1.5B
Taid · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MA
magnum v4 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
QW
Qwen3.8-27B
Qwen · bramburn
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · EnlistedGhost
Params8.19B
Context128K
Q4_K_M5.2 GB
Reasoning
QW
Chuluun Qwen2.5 72B v0.01
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF

Other quants

Keep browsing