Q6_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
CE
Celeste 12B V1.6
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
VI
ai video studio
Video · autotools
Params1.6B
Context4K
Q4_K_M0.2 GB
QW
qwen2-15b-rewritequery_orpo
Qwen · johnbridges
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
BigBubba Qwen3.6 27B
Qwen · Guile
Params27.3B
Context256K
Q4_K_M17.8 GB
AR
Arco Put 6
Arco · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
MA
Magidonia 24B v4.3
Magidonia · Mrd1011
Params23.6B
Context128K
Q4_K_M14.3 GB
RH
L3 Rhaenys 8B
Rhaenys · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TQ
Tqwendo 36b
Tqwendo · bartowski
Params35.7B
Context32K
Q4_K_M21.6 GB
SE
Sekhmet_Bet L3.1 8B v0.2
Sekhmet · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
wollf v9 q38
Qwen · wolffe-lang
Params27.3B
Context256K
Smallest23.0 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · shaffhausen
Params26.9B
Context256K
Q4_K_M16.5 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MV
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
GE
Gemma 4 E2B It
Gemma · Capsulanet
Params4.65B
Context128K
Q4_K_M3.5 GB
LL
Llama 3.2 1B Instruct
Llama · sir0min
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama-3-8B-Stroganoff
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MW
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
MA
Maginum Cydoms 24B
Maginum · Casual-Autopsy
Params23.6B
Context128K
Smallest16.3 GB
GE
Gemma 4 E4B It
Gemma · Capsulanet
Params7.52B
Context128K
Q4_K_M5.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · fluidapp
Params8.03B
Context128K
Smallest4.4 GB
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest8.2 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MU
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
QW
Qwen2.5 7B Instruct
Qwen · dahara1
Params7.62B
Context32K
Q4_K_M4.7 GB
SM
SmolLM2 1.7B Instruct
SmolLM · aa1602295777
Params1.71B
Context8K
Q4_K_M1.1 GB
NE
NemoMix Unleashed 12B
Nemomix · violetahayashi69
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
codegeex4-all-9b
Codegeex · qwp4w3hyb
Params9.4B
Context128K
Smallest3.1 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · fribourgquant
Params26.9B
Context256K
Q4_K_M16.5 GB
FA
FanFic Illustrator
Fanfic · webbigdata
Params3.09B
Context32K
Smallest2.0 GB
LL
Llama 3.2 3B Instruct
Llama · benniekiss
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Gemma 2 2b It
Gemma · tgsc
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen3.8-27B
Qwen · 2531oupp
Params27.3B
Context256K
Q4_K_M16.5 GB