Q4_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
Vision
QU
Quest AI quest corruption 7b s375 v3 GRPO
Quest · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
JA
Jan v1 4B
Jan · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
NE
Nemomix v2.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
ReasoningTool useVision
GE
Gemma4 31b Gembrain Equinox
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
AN
AnubisLemonade 70B v1.1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OL
Olmo 3 7B Think
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
ReasoningTool use
AV
Ava 1.0 12B
Ava · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
SA
Sarvam M
Sarvam · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
OP
OpenThinker Agent v1
Openthinker · bartowski
Params8.2B
Context40K
Q4_K_M5.0 GB
Coding
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LU
Lucy 128k
Lucy · bartowski
Params1.72B
Context128K
Q4_K_M1.1 GB
GGUF
LA
Lamarck 14B v0.7
Lamarck · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Llama Krikri 8B Instruct
Llama · bartowski
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
TE
Teuken 7B Instruct Research v0.4
Teuken · bartowski
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
IN
JanusCoderV 7B
InternLM · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
GR
Granite 4.0 Tiny Preview
Granite · bartowski
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
HU
HuatuoGPT O1 8B
Huatuogpt · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
IN
Inf O1 Pi0
Inf · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MI
miniG
Minig · bartowski
Params9.5B
Context1024K
Q4_K_M6.3 GB
GGUF
QW
Rombos Coder V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding

Other quants

Keep browsing