Q6_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1820 models have a Q6_K_L file. Sizes run from 30M to 403B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AR
katanemo Arch Function Chat 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
ZE
xysera zen 4b
Zen · bartowski
Params4.02B
Context32K
Q4_K_M2.6 GB
ReasoningTool use
GO
goppa ai Goppa LogiLlama
Goppa · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
TI
TinyR1 32B Preview v0.1
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BI
Big Alice 28B v1
Big · bartowski
Params28.6B
Context64K
Q4_K_M17.3 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
GGUF
FI
Fireball 3.1 8B ORPO
Fireball · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
HU
Hubble 4B V1C
Hubble · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · ApplePlacer10
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DN
dnotitia DNA R1
Dna · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
RI
Ring Mini 2.0
Ring · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
SA
Sarvam 1
Sarvam · bartowski
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
LL
Replete LLM V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
IN
OREAL 7B
InternLM · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
CO
Cosmic Lightning
Cosmic · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
GE
gemma-2-27b-it
Gemma · qwp4w3hyb
Params27.2B
Context8K
Smallest6.1 GB
GGUF
PA
MS3.2 PaintedFantasy Visage 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
Roleplay
GE
gemma 4 A4B 98e v7 coder it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
CodingVision
MI
Tess 3 Mistral Nemo
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Karlsen Chat 27B abliterated
Qwen · karlsencoin
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
JA
Jan v3 4B Base Instruct
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.7 GB
Coding
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF

Other quants

Keep browsing