Q2_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
GGUF
AR
Arcee Blitz
Arcee · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
Gemma-3-12B-It
Gemma · Abc7347
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · Hi821119
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
Mistral v0.3 7B ORPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
PO
Polaris 4B Preview
Polaris · bartowski
Params4.02B
Context128K
Q4_K_M2.5 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
CO
context 1
Context · nicolasembleton
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GE
Google_Gemma_2_9b_it
Gemma · Nexesenex
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
OpenR1-Qwen-7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
CA
Captain Eris Violet V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ME
Megrez 3B Instruct
Megrez · bartowski
Params2.92B
Context32K
Q4_K_M1.8 GB
GGUF
GE
Gemma-3-4B-It
Gemma · Abc7347
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
Llama-3.2-3B-Instruct
Llama · mny1238
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
SH
L3.3 Unnamed Exp 70B v0.8
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GR
Granite 4.1 3b
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.2 GB
Tool use
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · AskMeCodes
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
Vision
RE
Replete LLM Mist Nemo 12b
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
UM
L3 Umbral Mind RP v3.0 8B
Umbral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Anubis 70B v1
Negative · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3.1-8B-Think
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use

Other quants

Keep browsing