Q6_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
MI
Miscii 14b 1028
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
TE
Tessa Rust T1 7B
Tessa · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CY
Cydonia Redux 22B v1.1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
SU
TQ2.5 14B Sugarquill v1
Sugarquill · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Cogito v1 Preview Qwen 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
BI
Bielik 11B v3.0 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
TW
TwinLlama 3.1 8B
Twinllama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
SE
Sekhmet_Bet L3.1 8B v0.2
Sekhmet · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
IN
Internlm2_5 1_8b Chat
InternLM · bartowski
Params1.89B
Context32K
Q4_K_M1.2 GB
OL
open r1 OlympicCoder 32B
Olympiccoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CY
Cydonia ReduX 22B v1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Replete LLM Qwen2 7b
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NextCoder 32B
Nextcoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
TE
Tessa T1 3B
Tessa · bartowski
Params3.09B
Context117K
Q4_K_M1.9 GB
GR
Granite 4.0 H Micro
Granite · bartowski
Params3.2B
Context1024K
Q4_K_M1.9 GB
GE
Gemma 2 9b It WPO HB
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
SK
Skywork OR1 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
MA
magnum v3 9b customgemma2
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Artificium llama3.1 8B 001
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
IN
INTELLECT 2
Intellect · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
RN
Rnj 1 Instruct
Rnj · bartowski
Params8.3B
Context32K
Q4_K_M5.1 GB
PH
luvGPT phi3 uncensored chat
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
VE
Veritas 12B
Veritas · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.8-27B
Qwen · emee-ai
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen_Qwen3 4B
Qwen · Alcoft
Params4.02B
Context40K
Q4_K_M2.5 GB
CO
codegeex4-all-9b
Codegeex · zai-org
Params9.4B
Context128K
Q4_K_M6.3 GB