Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
QW
Qwen2 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
BE
BeaverAI NeMoist 21B v1a
Beaverai · RichardErkhov
Params21B
Context—
Q4_K_M0.0 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · thesven
Params7B
Context32K
Q4_K_M4.4 GB
OR
Ornith 1.5 9B
Ornith · AtomicChat
Params8.95B
Context256K
Smallest2.8 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
FL
FLUX 3 Image Klein GGUFs
Flux · realrebelai
Params5.54B
Context—
Q4_K_M3.4 GB
FB
fblgit juanako 7b UNA
Fblgit · RichardErkhov
Params7.24B
Context—
Q4_K_M0.0 GB
LF
LFM2.5 2.6B GGUF shards
Lfm · Arki05
Params2.7B
Context128K
Smallest0.0 GB
CY
z image cyberrealistic v9
Cyberrealistic · gimly13
Params6.15B
Context40K
Q4_K_M2.5 GB
DR
drama-3
Drama · sakasegawa
Params35.8B
Context—
Smallest20.8 GB
FL
Flux2 Klein 9B True V3
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
OR
Ornith 1.5 35B A3B
Ornith · AtomicChat
Params34.7B
Context256K
Q4_K_M21.2 GB
GR
Grok 1
Grok · Arki05
Params316B
Context8K
Smallest65.3 GB
SA
Sao10K L3 8B Stheno v3.1
Sao · RichardErkhov
Params8B
Context—
Q4_K_M0.3 GB
QW
Qwen3.6 35B A3B DFlash GGUF llama.cpp
Qwen · Alittlehammmer
Params386M
Context256K
Q4_K_M0.2 GB
MI
avemio digital mistral 7b Sft pretrain 6000 steps merge
Mistral · RichardErkhov
Params7.24B
Context—
Q4_K_M0.1 GB
MI
MiniCPM-V-4.7-35B-A3B
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest10.1 GB
QW
DFlash
Qwen · Alittlehammmer
Params1.73B
Context256K
Q4_K_M1.0 GB
FL
FLUX 3 Image Klein
Flux · AtomicChat
Params5.55B
Context256K
Smallest2.5 GB
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
QW
Qwen3.6 35B A3B Uncensored HauhauCS MTP
Qwen · morikomorizz
Params447M
Context256K
Smallest15.9 GB
BA
BarryFutureman NeuralTurdusVariant1 7B
Barryfutureman · RichardErkhov
Params7B
Context—
Q4_K_M0.0 GB
OR
Ornith-1.5-122B
Ornith · AtomicChat
Params125B
Context256K
Smallest35.0 GB
MO
MOSS Image SFT
Moss · leejet
Params5.08B
Context—
Smallest2.2 GB
LL
VAGOsolutions Llama 3 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params6B
Context—
Q4_K_M0.0 GB
UN
Undi95 Emerhyst 20B
Undi · RichardErkhov
Params920M
Context—
Q4_K_M0.0 GB
KO
Huihui Kolibri 1 BF16 Abliterated
Kolibri · huihui-ai
Params78B
Context256K
Q4_K_M47.5 GB
LL
4yo1 llama3 pre1 pre2 ds ins2 lora3
Llama · RichardErkhov
Params200M
Context—
Q4_K_M0.0 GB
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
MI
MiniCPM V 2 6
MiniCPM · openbmb
Params7.61B
Context32K
Q4_K_M4.7 GB