Q6_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2-Horizon-MoVA-36B-A4B
Horizon · bartowski
Params37.4B
Context512K
Q4_K_M22.7 GB
GGUF
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
SK
Skyfall 31B v4.2
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.3 GB
GGUF
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
HE
Hemmingway 1
Hemmingway · botp
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool use
MA
MN 12B Mag Mell R1
Mag · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
QW
Swift Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
IN
InternVL3_5 8B
Internvl · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
Vision
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ON
OneJev 27B
Onejev · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
LU
L3-8B-Lunaris-v1
Lunaris · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Computer 10
Computer · bartowski
Params70.6B
Context128K
Q4_K_M44.0 GB
GGUF
QW
Qwen3 Next 80B A3B Thinking
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Reasoning
ME
Mellum2.1 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.8 GB
Reasoning
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
Dolphin3.0 R1 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoningTool use
RO
TheDrummer Rocinante XL 16B v1
Rocinante · bartowski
Params16.1B
Context128K
Q4_K_M10.1 GB
GGUF
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
GGUF
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use

Other quants

Keep browsing