Q4_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
MathCoder2 Llama 3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Coding
ST
Step 3.7 Flash
Step · bartowski
Params199B
Context256K
Q4_K_M121.6 GB
ReasoningTool useVision
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
QW
Rombo LLM V3.0 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ReasoningTool use
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
SA
TheSkullery L3.3 exp unnamed model 70b v0.5
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GL
GLM4 32B Neon v2
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.5 27B Anko
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GGUF
NE
Neeto 1.0 8b
Neeto · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
UIGEN-X-32B-0727
Qwen · johnbridges
Params32.8B
Context40K
Q4_K_M20.0 GB
ReasoningTool use
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SA
Sailor2 1B Chat
Sailor · bartowski
Params988M
Context32K
Q4_K_M0.7 GB
GGUF
MI
MiMo Ornith 9B AGSI
Mimo · OliviaRossi
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
ST
Starfallen Snow Fantasy 24B MS3.2 v0.0
Starfallen · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
TR
Trinity Nano Preview
Trinity · bartowski
Params6.12B
Context128K
Q4_K_M3.8 GB
Tool use
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
GE
Big-Tiger-Gemma-27B-v1
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.5 4B Neo
Qwen · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
ReasoningVision
MI
Mistral Nemo Gutenberg Doppel 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
CA
Captain Eris Diogenes Twilight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SD
SDRPC CHML e1.2 12B
Sdrpc · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
FuseChat Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
AU
Austral Xgen 9B Winton
Austral · bartowski
Params10.7B
Context256K
Q4_K_M6.5 GB
Roleplay
QW
Qwen2.5 3B Instruct
Qwen · Alexs28
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use

Other quants

Keep browsing