Q5_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SK
Skyfall 31B v4.1
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF
LL
Liberalis Cogitator Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OP
OpenThinker2 32B
Openthinker · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · Guile
Params177B
Context256K
Q4_K_M119.6 GB
Vision
OP
OpenThinker 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
EV
L3.3 MS Evayale 70B
Evayale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Gemma 2 Ataraxy v2 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MU
G4 31B Musica v1
Musica · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
ReasoningRoleplay
TX
Txgemma 27b Chat
Txgemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AR
katanemo Arch Function Chat 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
GO
goppa ai Goppa LogiLlama
Goppa · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
TI
TinyR1 32B Preview v0.1
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BI
Big Alice 28B v1
Big · bartowski
Params28.6B
Context64K
Q4_K_M17.3 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
GGUF
FI
Fireball 3.1 8B ORPO
Fireball · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
HU
Hubble 4B V1C
Hubble · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · ApplePlacer10
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DN
dnotitia DNA R1
Dna · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
RI
Ring Mini 2.0
Ring · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
SA
Sarvam 1
Sarvam · bartowski
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
LL
Replete LLM V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
IN
OREAL 7B
InternLM · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Other quants

Keep browsing