Q4_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.5 9B Claude 4.6 OS HERETIC UNCENSORED INSTRUCT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
TA
Tacit 1.7B
Tacit · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
LI
Liquid A1B 8B PL Coder
Liquid · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
QW
Qwen3.8 9B Heretic Uncensored
Qwen · marafx2007
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama3.1 MOE 4X8B Gated IQ Multi Tier Deep Reasoning 32B
Llama · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
GR
Granite 8b Code Instruct 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
FA
Faithful_Thinking_with_Image
Faithful · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ER
Erk 32B
Erk · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · mradermacher
Params129B
Context256K
Q4_K_M87.0 GB
GE
Gemma 4 E2B It Anon Reasoning
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen3 4B Abliterated TIES
Qwen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
QW
Qwen3.5 13B Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
QW
Qwen3 ASR
Qwen · Jaffe2718
Params938M
Context—
Smallest0.9 GB
MI
mistralai Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OL
Olmo 3 7B Instruct
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GP
Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
RO
Roleplay 9B lora 800 porn i1
Roleplay · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB