Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B Claude 4.6 Opus Deckard V4.2 Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · RichardErkhov
Params10.9B
Context32K
Q4_K_M6.6 GB
GGUF
QW
Qwen2.5 0.5B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
GGUF
QW
CoPaw Flash 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3 42B A3B Spock Brutal Recall Instruct
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
MI
Dolphin Mistral 24B Venice Edition Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
JA
Jais Adapted 7b Chat
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
Coding
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
KU
Kuvera 8B v0.1.0
Kuvera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
AV
average-dolphin-8x7B
Average · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HO
K2-Horizon-0.9B
Horizon · bartowski
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
QW
Qwen2.5 Coder 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 1million Ctx
Qwen · mradermacher
Params42.4B
Context1024K
Q4_K_M25.7 GB
CodingReasoning
TI
TigerLLM 12B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
NA
Nanonets OCR S
Nanonets · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
PH
microsoft Phi 3 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
TO
tokyotech llm Swallow 13b instruct hf
Tokyotech · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningRoleplay
QI
QiMing CognitiveForge 14B
Qiming · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
Coding
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
CodingReasoning
FO
Foresight 32B
Foresight · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GE
gemma 4 E2B it heretic
Gemma · saidutta69
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
MI
allura org Mistral Small Sisyphus 24b 2503
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning

Other quants

Keep browsing