Q4_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.5 9B Claude 4.6 Opus Deckard V4.2 Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · RichardErkhov
Params10.9B
Context32K
Q4_K_M6.6 GB
QW
Qwen2.5 0.5B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
QW
CoPaw Flash 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 42B A3B Spock Brutal Recall Instruct
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
MI
Dolphin Mistral 24B Venice Edition Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
JA
Jais Adapted 7b Chat
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
KU
Kuvera 8B v0.1.0
Kuvera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
AV
average-dolphin-8x7B
Average · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
HO
K2-Horizon-0.9B
Horizon · bartowski
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 1million Ctx
Qwen · mradermacher
Params42.4B
Context1024K
Q4_K_M25.7 GB
TI
TigerLLM 12B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
NA
Nanonets OCR S
Nanonets · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
PH
microsoft Phi 3 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
TO
tokyotech llm Swallow 13b instruct hf
Tokyotech · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QI
QiMing CognitiveForge 14B
Qiming · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
FO
Foresight 32B
Foresight · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GE
gemma 4 E2B it heretic
Gemma · saidutta69
Params4.63B
Context128K
Q4_K_M3.4 GB
MI
allura org Mistral Small Sisyphus 24b 2503
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB