Q4_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Yi Coder 1.5B Chat
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
Coding
AE
AesCode 32B
Aescode · bartowski
Params32.8B
Context256K
Q4_K_M20.5 GB
CodingVision
DA
Darwin 27B RSI
Darwin · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Reasoning
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
FA
Fara1.5 4B
Fara · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
Vision
NE
Nemotron Cascade 2 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Reasoning
QW
Qwen3 235B A22B Instruct 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
GGUF
HO
Holo4 35B A3B
Holo · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Vision
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · bartowski
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DO
Dots3 Note Prev
Dots · bartowski
Params280B
Context512K
Q4_K_M171.1 GB
Vision
PH
Phi 3.5 Mini instruct_Uncensored
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
ReasoningVision
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
Coding
AN
Anubis 70B v1.2
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PH
Phi 3.1 mini 128k instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3 4B Instruct 2507 Heretic
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GGUF

Other quants

Keep browsing