Q6_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B Reflect
Qwen · annnnnnnd
Params27.3B
Context256K
Smallest17.6 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 ML
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MN
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
LL
Hyze1BInstruct
Llama · HyzeAI
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
Gemma 4 E4B It
Gemma · Krasnopjorovs
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
my_QwQ 32B Preview Abliterated Linear25
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
TI
Tiny Aya Earth
Tiny · mazrba
Params3.35B
Context488K
Q4_K_M2.4 GB
LF
LFM2.5 2.6B
Lfm · kelvinlamptey
Params2.7B
Context125K
Q4_K_M1.7 GB
GE
Gemma 2 2b It
Gemma · indiansatoshi
Params2.61B
Context8K
Q4_K_M1.7 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MT
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
GE
Gemma 2 2b It
Gemma · ZT6000
Params2.61B
Context8K
Q4_K_M1.7 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MJ
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MK
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
CR
CREC N WREC Mate 24B v2
Crec · Casual-Autopsy
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
my_QwQ 32B Preview Abliterated Linear50
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MH
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MS
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MI
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
GE
Gemma 3 TAIDE 12b Chat 2602
Gemma · gn00029914
Params13.2B
Context128K
Smallest11.4 GB
HA
Hathor Sofit L3 8B v1
Hathor · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
my_QwQ 32B Preview Abliterated Linear75
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama 3.2 1B Instruct
Llama · asad959191
Params1.24B
Context128K
Q4_K_M0.8 GB
CO
codegeex4-all-9b
Codegeex · manaladan6
Params9.4B
Context128K
Q4_K_M6.3 GB
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.8 GB
PH
Phi 4 Mini Instruct
Phi · lucasxie2025
Params3.84B
Context128K
Q4_K_M2.5 GB
GE
gemma-4-26B-A4B
Gemma · venketh
Params25.2B
Context256K
Smallest15.3 GB
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
GE
Testing
Gemma · Bax-uzi
Params2.61B
Context8K
Q4_K_M1.7 GB
RO
Rocinante 12B v1.1
Rocinante · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
QW
wollf v7sf3
Qwen · wolffe-lang
Params27.3B
Context256K
Smallest23.0 GB