Q4_0 GGUF models

Older 4-bit format. Q4_K_M is usually a better choice at a similar size. 54307 models have a Q4_0 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SE
SEX ROLEPLAY 3.2 1B i1
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
LE
ignos_leoscorpius-greennode-platypus-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
X Coder RL Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Coding
OP
q-bert_optimus-7b
Optimus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
granite 4.2 3b heretic
Granite · saidutta69
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningRoleplayTool use
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Roleplay
AT
Atom 80b
Atom · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
Reasoning
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
MI
nruaif_kimiko-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MI
uukuguy_speechless-mistral-dolphin-orca-platypus-samantha-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
HE
L3.1 RP Hero InBetween 8B
Hero · DavidAU
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
IC
IceEspressoRPv2 7b i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
GR
GritLM 8x7B KTO i1
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MI
teknium_mistral-trismegistus-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RP
rpguild chatml 13B
Rpguild · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
ME
merlyn education corpus qa v2
Merlyn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
janhq_mistral-7b-instruct-v0.2-dare
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
SW
Swallow 7B
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing