Q5_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
RO
Rocinante X 12B v1
Rocinante · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GL
GLM 4 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
GL
GLM 4.6V Flash
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
LL
Dolphin 3.0 Llama 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
Roleplay
QW
Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
SK
Skyfall 31B v4.2
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.3 GB
GGUF
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
MA
MN 12B Mag Mell R1
Mag · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
IN
InternVL3_5 8B
Internvl · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
Vision
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use

Other quants

Keep browsing