Q4_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
firstaid Chatbot llama3
Llama · sobia1
Params3.21B
Context128K
Q4_K_M0.8 GB
Tool use
SO
Soliloquy 7B v3
Soliloquy · Reiterate3680
Params7.62B
Context32K
Smallest5.1 GB
GGUF
LY
MN 12B Lyra v3
Lyra · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
AU
AuraFinal12B
Aurafinal · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
QW
Qwen3.6 27B Omnimerge v4 MTP Q4 K L
Qwen · kdqemre
Params27.3B
Context256K
Smallest17.4 GB
CodingReasoningTool use
AU
Aura NeMo 12B
Aura · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
SU
L3 Super Nova RP 8B
Super · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SU
MN 12b Sunrose
Sunrose · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
TA
MN 12B Tarsus
Tarsus · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
ST
MN 12B Starcannon v3
Starcannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
TU
Tuldur 8B
Tuldur · Reiterate3680
Params8.03B
Context128K
Smallest5.3 GB
GGUF
AZ
Azure Dusk v0.1
Azure · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
GE
gemma-2-9b-it
Gemma · kolosal
Params9.24B
Context8K
Smallest6.0 GB
GGUF
SA
L3 SAO MIX 8B V1
Sao · Reiterate3680
Params8.03B
Context8K
Smallest5.3 GB
GGUF
NE
NemoMix 12B DellaV1b
Nemomix · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LI
AuraGo-Ling-3.0-tiny
Ling · antibyte
Params7.89B
Context128K
Smallest5.1 GB
ReasoningTool use
MA
Magnum 12b v2.5 Kto
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
SC
MS Schisandra 22B v0.2 Q5 K M
Schisandra · Nohobby
Params22.2B
Context128K
Smallest13.5 GB
Tool use
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest6.3 GB
GGUF
NE
nemo 12b hiwaifu
Nemo · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LO
MN LooseCannon 12B v2 Step1
Loosecannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
CO
C4Ai Command A 03 2025
Command R · Huzderu
Params111B
Context16K
Smallest67.9 GB
Tool use
LU
Lumimaid v0.2 12B GGUF Imat
Lumimaid · Nerhess
Params12.2B
Context1000K
Smallest6.7 GB
GGUF
YE
YetAnotherMerge v0.45
Yetanothermerge · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
GE
Gemma 4 E2B It
Gemma · BlacknodeLTDAI
Params4.65B
Context128K
Smallest4.1 GB
ReasoningTool use
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest6.3 GB
GGUF
WA
warrenbuffett
Warrenbuffett · mahimalolla
Params3.21B
Context128K
Smallest2.1 GB
Tool use
LL
Llama 3.3 70B Instruct
Llama · bgarcia3
Params70.6B
Context128K
Smallest43.3 GB
Tool use
IC
ICONNAI ICONN 1
Iconnai · bartowski
Params84B
Context32K
Q4_K_M50.9 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · Bosswinner
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use

Other quants

Keep browsing