Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
ST
Starfallen Snow Fantasy 24B MS3.2 v0.0
Starfallen · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
TR
Trinity Nano Preview
Trinity · bartowski
Params6.12B
Context128K
Q4_K_M3.8 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Red Team
Qwen · LuisPPB16
Params9.2B
Context256K
Q4_K_M5.8 GB
BE
Behemoth R1 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
BI
allura org Bigger Body 70b
Bigger · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Big-Tiger-Gemma-27B-v1
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3.5 4B Neo
Qwen · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
MI
Mistral Nemo Gutenberg Doppel 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
Phi 4 14B
Phi · EasierAI
Params14.7B
Context16K
Q4_K_M8.9 GB
CA
Captain Eris Diogenes Twilight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
SD
SDRPC CHML e1.2 12B
Sdrpc · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
FuseChat Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
AU
Austral Xgen 9B Winton
Austral · bartowski
Params10.7B
Context256K
Q4_K_M6.5 GB
QW
Qwen3-4B-Instruct-2507
Qwen · rgth007
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen2.5 3B Instruct
Qwen · Alexs28
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
nbeerbower Dumpling Qwen2.5 32B v2
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · bartowski
Params7.6B
Context128K
Q4_K_M4.7 GB
LL
OrcaAgent llama3.2 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
HU
HuatuoGPT O1 72B v0.1
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
NemoRemix 12B
Nemoremix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Thespis Llama 3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
Austral 32B GLM4 Winton
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
LL
Dracarys Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
XY
XYZ Aquila Pro
Xyz · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
NA
NaturalLM 7B Instruct
Naturallm · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB