Q4_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 16028 models have a Q4_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
GL
GLM-5.3-Flash Vision Encoder
GLM · antirez
Params321B
Context—
Smallest1.1 GB
CY
Huihui CyberStrike OffSec 35B Abliterated
Cyberstrike · huihui-ai
Params35.5B
Context256K
Smallest21.7 GB
SE
SeaLLMs SeaLLMs v3 7B Chat
Seallms · RichardErkhov
Params7.62B
Context—
Q4_K_M0.0 GB
TE
test gguf sample
Test · Isotr0py
Params29M
Context—
Smallest0.0 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
QW
Huihui Qwen3.6 27B Abliterated
Qwen · huihui-ai
Params27.3B
Context256K
Smallest10.9 GB
FA
Jiqing tiny random falcon
Falcon · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
QW
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated MTP
Qwythos · huihui-ai
Params9.2B
Context1024K
Smallest5.8 GB
GR
ibm granite granite 20b code instruct
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
AN
anthracite org magnum 12b v2
Anthracite · RichardErkhov
Params12.2B
Context—
Q4_K_M0.0 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
GL
gliner2 base v1
Gliner · antflydb
Params184M
Context—
Smallest0.0 GB
FL
flux 3 image klein
Flux · leejet
Params5.55B
Context—
Smallest2.3 GB
GR
ibm granite granite 20b code base
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · TechnoBaptist
Params8.2B
Context256K
Smallest3.3 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen2 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
BE
BeaverAI NeMoist 21B v1a
Beaverai · RichardErkhov
Params21B
Context—
Q4_K_M0.0 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · thesven
Params7B
Context32K
Q4_K_M4.4 GB
OR
Ornith 1.5 9B
Ornith · AtomicChat
Params8.95B
Context256K
Smallest2.8 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
FL
FLUX 3 Image Klein GGUFs
Flux · realrebelai
Params5.54B
Context—
Q4_K_M3.4 GB
FB
fblgit juanako 7b UNA
Fblgit · RichardErkhov
Params7.24B
Context—
Q4_K_M0.0 GB
LF
LFM2.5 2.6B GGUF shards
Lfm · Arki05
Params2.7B
Context128K
Smallest0.0 GB
AG
Huihui Agents A1 Abliterated
Agents · huihui-ai
Params34.7B
Context256K
Smallest21.2 GB
CY
z image cyberrealistic v9
Cyberrealistic · gimly13
Params6.15B
Context40K
Q4_K_M2.5 GB
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · huihui-ai
Params284B
Context—
Smallest135.3 GB
DR
drama-3
Drama · sakasegawa
Params35.8B
Context—
Smallest20.8 GB
FL
Flux2 Klein 9B True V3
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB