Q4_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
EL
Eleusis 12B
Eleusis · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Replete Coder Qwen2 1.5b
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CE
Celestial Harmony 14b v1.0 Experimental 1016
Celestial · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
RE
ozone ai Reverb 7b
Reverb · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
KA
KAT Dev
Kat · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
SY
Synthia S1 27b
Synthia · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
DH
Dhanishtha 2.0 Preview 0825
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
TE
Tessa T1 7B
Tessa · bartowski
Params7.62B
Context117K
Q4_K_M4.7 GB
QW
Qwen3.8-27B
Qwen · LeeMantras
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
ST
Steelskull L3.3 Mokume Gane R1 70b
Steelskull · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
FU
functionary small v3.1
Functionary · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
VE
Q2.5 Veltha 14B 0.5
Veltha · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
dnotitia_Smoothie Qwen3 1.7B
Qwen · Alcoft
Params1.72B
Context40K
Q4_K_M1.0 GB
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
SI
simplescaling s1.1 32B
bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
NA
Nanbeige4 3B Thinking 2511
Nanbeige · bartowski
Params3.93B
Context64K
Q4_K_M2.4 GB
GE
Gemma 4 31B Storymaxxed3
Gemma · MRockatansky
Params30.7B
Context256K
Q4_K_M18.7 GB
CA
Cassiopeia 70B
Cassiopeia · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
JA
Jan Nano 128k
Jan · bartowski
Params4B
Context128K
Q4_K_M2.5 GB
FI
v6 Finch 14B HF
Finch · bartowski
Params14.1B
Context1024K
Q4_K_M8.8 GB
SA
Steelskull L3.3 San Mai R1 70b
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiroThinker v1.0 30B
Mirothinker · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB