Q6_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · fribourgquant
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MA
MagnumV2
Magnumv · Nazosan
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
GE
Gemma 2 9b It
Gemma · Iambackup
Params9.24B
Context8K
Smallest7.8 GB
GGUF
HO
Hollow Tail V1 12B
Hollow · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
RO
Rocinante 12B v1b
Rocinante · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
HA
Hathor Trihexa L3 8B Anarchy Edition
Hathor · Reiterate3680
Params8.03B
Context8K
Smallest5.3 GB
GGUF
MA
Magnum 12b v2
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.7 GB
ReasoningTool useVision
GE
Gemma 2 9b It
Gemma · guiopen
Params9.24B
Context8K
Smallest7.8 GB
GGUF
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.8 GB
ReasoningTool useVision
SO
Soliloquy 7B v3
Soliloquy · Reiterate3680
Params7.62B
Context32K
Smallest5.1 GB
GGUF
LY
MN 12B Lyra v3
Lyra · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
AU
AuraFinal12B
Aurafinal · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
AU
Aura NeMo 12B
Aura · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
SU
L3 Super Nova RP 8B
Super · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
RO
RoGemma-7b-Instruct
Rogemma · NikolayKozloff
Params8.54B
Context8K
Smallest7.9 GB
GGUF
SU
MN 12b Sunrose
Sunrose · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
TA
MN 12B Tarsus
Tarsus · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
SA
Sapphira L3.3 70b 0.1
Sapphira · Valeciela
Params70.6B
Context128K
Smallest59.1 GB
GGUF
ST
MN 12B Starcannon v3
Starcannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
TU
Tuldur 8B
Tuldur · Reiterate3680
Params8.03B
Context128K
Smallest5.3 GB
GGUF
AZ
Azure Dusk v0.1
Azure · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
SF
G4 26B SFT v2 1 GRPO chkpt40
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
ReasoningTool use
SA
L3 SAO MIX 8B V1
Sao · Reiterate3680
Params8.03B
Context8K
Smallest5.3 GB
GGUF
RO
RoLlama3-8b-Instruct
Rollama · NikolayKozloff
Params8.03B
Context8K
Smallest7.8 GB
GGUF
NE
NemoMix 12B DellaV1b
Nemomix · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
NE
nemo 12b hiwaifu
Nemo · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LO
MN LooseCannon 12B v2 Step1
Loosecannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
SF
G4 26B SFT v2 1 GRPO chkpt20
Sft · ApocalypseParty
Params25.2B
Context256K
Smallest22.8 GB
ReasoningTool use

Other quants

Keep browsing