Q6_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.
LL
worker model llama 3.1 8b instruct
Llama · neurochainai
Params8.03B
Context128K
Smallest6.6 GB
LU
Lumimaid v0.2 12B GGUF Imat
Lumimaid · Nerhess
Params12.2B
Context1000K
Smallest6.7 GB
NA
Nanbeige4 3B Thinking 2511
Nanbeige · CCSU-ML
Params3.93B
Context64K
Smallest3.4 GB
YE
YetAnotherMerge v0.45
Yetanothermerge · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
QW
QwQ 32B
Qwen · Antigma
Params32.8B
Context128K
Smallest27.3 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 slerp50
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MD
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
MI
Mistral Large Instruct 2411
Mistral · Valeciela
Params123B
Context128K
Smallest101.9 GB
CO
Command t2 111b Q6 K L
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
CO
Command t3 111b Q6 K L
Command · bruhzair
Params111B
Context128K
Smallest91.1 GB
SF
G4 26B SFT v2 1 GRPO chkpt40 MF
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
AR
artemis 31b q6kl
Artemis · bliblubbla
Params30.7B
Context256K
Smallest27.1 GB
CO
Command t1 111b Q6 K L
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
RU
runpod bundle 100gb
Runpod · Azam
Params34.7B
Context256K
Smallest30.3 GB
LI
Ling Mini 2.0
Ling · Manojb
Params16.3B
Context32K
Smallest13.5 GB
PH
Phi 3 medium 128k instruct
Phi · bgarcia3
Params14B
Context128K
Smallest11.5 GB
IC
ICONNAI ICONN 1
Iconnai · bartowski
Params84B
Context32K
Q4_K_M50.9 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · Bosswinner
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
2026 08 25 . unsloth . Qwen3.8 27B
Qwen · burningfeet
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B
Qwen · DollasAndSpence
Params27.3B
Context256K
Q4_K_M16.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · balajiduraisamy
Params8.03B
Context128K
Q4_K_M4.9 GB
LF
LFM3 VL 2B
Lfm · bartowski
Params1.73B
Context125K
Q4_K_M1.1 GB
HE
Hemmingway 1.5
Hemmingway · npario
Params27.3B
Context256K
Q4_K_M17.4 GB