Q5_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LU
L3-8B-Lunaris-v1
Lunaris · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 Next 80B A3B Thinking
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Reasoning
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
Dolphin3.0 R1 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoningTool use
RO
TheDrummer Rocinante XL 16B v1
Rocinante · bartowski
Params16.1B
Context128K
Q4_K_M10.1 GB
GGUF
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MA
UI Mate 9B
Mate · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
FA
Fara1.5 9B
Fara · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen3 VL 30B A3B Instruct
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen2.5 14B_Uncencored
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 Coder 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
BE
Behemoth 128B v3
Behemoth · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
GGUF
QW
Qwen2.5.1 Coder 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
LA
Laguna XS 2.1
Laguna · bartowski
Params33.4B
Context256K
Q4_K_M20.5 GB
GGUF
QW
Qwen3 VL 2B Instruct
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
Qwen3.5 397B A17B
Qwen · bartowski
Params403B
Context256K
Q4_K_M248.3 GB
Vision
OR
Ornith 1.0 35B
Ornith · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
GE
Gemma 3 4b It Abliterated
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
OR
Orion 26B A4B v1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
Vision
QW
Dolphin3.0 Qwen2.5 1.5B
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OL
olmOCR 2 7B 1025
OLMo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
CO
Yi Coder 1.5B Chat
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
Coding
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision

Other quants

Keep browsing