Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
OU
outetts 0.3 1b
Outetts · cstr
Params1.19B
Context—
Smallest0.1 GB
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
JP
jpacifico Chocolatine 14B Instruct 4k DPO
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
SP
Spark X2.5 4B
Spark · eaddario
Params4.11B
Context—
Smallest0.0 GB
ST
L3-8B-Stheno-v3.2
Stheno · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
NE
addis scribe streaming
Nemotron · addisai
Params99M
Context—
Smallest0.0 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · legraphista
Params4.51B
Context128K
Smallest1.8 GB
MA
Matter 0.1 7B Boost
Matter · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
arcee ai Saul Instruct Clown 7b
Arcee · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Warumauchimmer
Params1.86B
Context—
Smallest0.9 GB
LL
Llama 3.1 SuperNova Lite
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
PE
PersianMind v1.0
Persianmind · RichardErkhov
Params6.8B
Context2K
Q4_K_M4.1 GB
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
GR
grimjim kunoichi lemon royale 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
IR
Irodori-TTS-v4.1-Small
Irodori · sakasegawa
Params859M
Context—
Smallest0.9 GB
AU
AutoCoder
Autocoder · legraphista
Params33.3B
Context16K
Smallest7.2 GB
QW
Qwen3.6 35B A3B
Qwen · eaddario
Params34.7B
Context—
Smallest0.4 GB
MO
MOSS Image Base
Moss · leejet
Params5.08B
Context—
Smallest2.2 GB
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · RichardErkhov
Params36.1B
Context32K
Q4_K_M21.8 GB
DA
Dart Math Dsmath 7b Prop2Diff
Dart · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
QW
voxprint huihui qwen36 27b
Qwen · Mitroshenkov87
Params27.3B
Context—
Smallest0.0 GB
JS
jsfs11 MixtureofMerges MoE 2x7bRP v8
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
GR
granite-7b-base
Granite · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
SH
Shieldgemma 27b
Shieldgemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
DA
datagemma rag 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
MI
grimjim Mistral Starling merge trial3 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB