Q4_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
AMD OLMo 1B SFT DPO
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
QW
OpenR1-Qwen-7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CA
Captain Eris Violet V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
ME
Megrez 3B Instruct
Megrez · bartowski
Params2.92B
Context32K
Q4_K_M1.8 GB
LL
Llama 3.1 SuperNova 8B Lite TIES with Base
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
Samantha-Qwen-2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek-coder-7b-instruct-v1.5
DeepSeek · qwp4w3hyb
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
Ministrations 8B v1
Ministrations · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
SH
L3.3 Unnamed Exp 70B v0.8
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
Granite 4.1 3b
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.2 GB
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
LF
LFM2.5-1.2B-Base
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · k0ndra
Params34.7B
Context256K
Q4_K_M21.2 GB
RE
Replete LLM Mist Nemo 12b
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
UM
L3 Umbral Mind RP v3.0 8B
Umbral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama-3.1-8B-Think
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
SE
SERA 8B GA
Sera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
huihui ai Qwen3 Coder Next ablisdterated
Qwen · Slaxxis
Params79.7B
Context256K
Q4_K_M48.6 GB
CY
cybertron v4 qw7B MGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
BY
ByteCraft
Bytecraft · bartowski
Params8.39B
Context32K
Q4_K_M5.2 GB
OL
Olmo Marvin Full Merged
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
MI
Minitron 4B Base
Minitron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
IN
MN 12b RP Ink
Ink · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
HA
Hathor Tahsin L3 8B v0.9
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Deductive Reasoning Qwen 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB