Q5_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.5 GB
ReasoningTool useVision
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest7.4 GB
ReasoningTool useVision
GE
Testing
Gemma · Bax-uzi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.6 GB
ReasoningTool useVision
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · fribourgquant
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
AR
gguf q5 k l imat arcee lite
Arcee · Felladrin
Params1.78B
Context32K
Smallest1.4 GB
GGUF
HE
Kainaticulous Rp 7b
Hexoteric · kainatq
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MA
MagnumV2
Magnumv · Nazosan
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
QW
Qwen3.6 27B
Qwen · juan1995-dev
Params26.9B
Context256K
Smallest21.3 GB
ReasoningTool use
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.7 GB
ReasoningTool useVision
CR
Crypto GPT v1.0
Crypto · vsnaichuk
Params494M
Context32K
Smallest0.4 GB
Tool use
LI
Ling Mini 2.0
Ling · Manojb
Params16.3B
Context32K
Smallest11.8 GB
ReasoningTool use
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest7.0 GB
GGUF
SC
MS Schisandra 22B v0.2 Q5 K M
Schisandra · Nohobby
Params22.2B
Context128K
Smallest13.5 GB
Tool use
NE
gguf Q5 K L Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest3.5 GB
Tool use
LU
Lumimaid v0.2 12B GGUF Imat
Lumimaid · Nerhess
Params12.2B
Context1000K
Smallest6.7 GB
GGUF
AR
gguf q5 k l imat arcee lite
Arcee · mitulagr2
Params1.78B
Context32K
Smallest1.4 GB
GGUF
SC
MS Schisandra 22B v0.3 Q5 K L
Schisandra · Nohobby
Params22.2B
Context32K
Smallest15.8 GB
Tool use
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest7.1 GB
GGUF
CO
Confusion
Confusion · jikuncul23
Params14.8B
Context32K
Smallest11.0 GB
Tool use
IC
ICONNAI ICONN 1
Iconnai · bartowski
Params84B
Context32K
Q4_K_M50.9 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · Bosswinner
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
LL
Meta Llama 3.1 8B Instruct
Llama · balajiduraisamy
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Other quants

Keep browsing