Q5_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
orpheus-finetuned-3b
Orpheus · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Qwen2.5-1.5B-Open-R1-GRPO
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningTool use
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · Alcoft
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
GE
Gemma 2 27b Chatml
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SK
Skyfall 39B V1A WS
Skyfall · bartowski
Params39B
Context128K
Q4_K_M23.4 GB
Tool use
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
AT
Athene V2 Agent
Athene · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
PA
Pantheon Rp 1.6 12b Nemo Kto
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
DA
Dans DangerousWinds V1.1.0 12b
Dans · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
Gemma 2b Aps It
Gemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
YU
YuLan Mini
Yulan · diskrot
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
LI
ozone research 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
JE
Jedi 7B 1080p
Jedi · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DU
Duet Minitron8b v0.5
Duet · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Llama3.1 8b_codeio_pp
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
EN
Endurance 100B v1.1
Endurance · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
Tool use
LL
Llama 3.1 Tulu 3 8B SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Lancer Coder Next abliterated
Qwen · Rixf123
Params79.7B
Context256K
Q4_K_M48.6 GB
CodingTool use
LL
Meta Llama 3.1 8B Instruct
Llama · starshina3003
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TR
Trinity
Trinity · arcee-ai
Params399B
Context256K
Q4_K_M241.8 GB
ReasoningTool use
LL
Llama3 Crab DPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Tiger Gemma 9B v2
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TU
Tulu MathLingo 8B
Tulu · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AR
Arcee Blitz
Arcee · arcee-ai
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
AR
Arch Function 7B
Arch · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AB
L3.1 Ablaze Vulca v0.1 8B
Ablaze · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SE
Seeker 9b
Seeker · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
SubtleOne Qwen2.5 32b Erudite Writer
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning

Other quants

Keep browsing