Q5_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1644 models have a Q5_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
RO
Rocinante X 12B v1
Rocinante · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GL
GLM 4 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
LL
Hermes 3 Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GL
GLM 4.6V Flash
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.2 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
QW
Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
SK
Skyfall 31B v4.2
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.3 GB
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
MA
MN 12B Mag Mell R1
Mag · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
IN
InternVL3_5 8B
Internvl · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB