Q4_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 16028 models have a Q4_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
AU
AurelPx Percival 01 7b slerp
Aurelpx · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IR
irodori tts
Irodori · cstr
Params98M
Context—
Smallest0.0 GB
CS
csm 1b
Csm · cstr
Params1.78B
Context—
Smallest1.4 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Ahmedcarpenter
Params1.86B
Context256K
Smallest0.9 GB
MI
MiniMax H3
Minimax · robertbschuette
Params20.1B
Context—
Q4_K_M18.2 GB
MI
Mistral7B PairRM SPPO Iter2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
kartoffel orpheus 3b german natural
Kartoffel · cstr
Params3.3B
Context—
Smallest1.9 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context4K
Q4_K_M1.0 GB
LO
longchat 7b v1.5 32k
Longchat · shaowenchen
Params6.74B
Context32K
Smallest2.8 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
maldv winter garden 7b delta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JS
jsfs11 MixtureofMerges MoE 2x7b SLERPv0.9
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
MiniCPM5 2B
MiniCPM · eaddario
Params2.52B
Context—
Smallest0.0 GB
IR
Irodori-TTS-v4-Large
Irodori · sakasegawa
Params3.38B
Context—
Smallest2.6 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · Justbackup
Params284B
Context—
Smallest10.9 GB
EU
euclaise ReMask 3B
Euclaise · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
LL
chinese llama 2 13b
Llama · hfl
Params13.3B
Context4K
Smallest5.0 GB
LL
Llama 3 Base 8B SFT DPO
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
QW
LuffyTheFox Qwen3.6 35B A3B Uncensored Wasserstein
Qwen · CCSSNE
Params34.7B
Context256K
Smallest11.7 GB
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
LL
ProjectZLLM SFT dna Llama 3.1 8B Instruct 20 r16 merged
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
SP
Spark X2.5 1.7B
Spark · eaddario
Params1.71B
Context—
Smallest0.0 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · andrijdavid
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB