Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 24B A3B Claude Opus Gemini 3.1 Pro Reasoning Distilled Heretic
Qwen · mradermacher
Params24.5B
Context256K
Q4_K_M15.0 GB
Reasoning
QW
QwQ LCoT2 7B Instruct i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
GR
granite 4.2 3b
Granite · NANI-Nithin
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3 Yoyo V3 42B A3B Thinking Total Recall
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoning
MI
Mistral Small 3.2 24B Instruct 2506 Ultra Uncensored Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
EU
Eurus 2 7B PRIME
Eurus · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
LL
Llama 3.2 3B Instruct heretic
Llama · saidutta69
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
KU
Kunoichi DPO v2 7B
Kunoichi · brittlewis12
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DE
Josiefied DeepSeek R1 0528 Qwen3 8B Abliterated v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
RU
MN 12B Runeweaver RP RU
Runeweaver · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
TR
Trinity Mini
Trinity · bartowski
Params26B
Context128K
Q4_K_M15.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Qwen3.8 27B MindMeld OneJev1.6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
LL
ToolACE 2.5 Llama 3.1 8B Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
PI
Piaget 8B
Piaget · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
QW
GrayLine Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
GL
zai org GLM 4.5
GLM · bartowski
Params358B
Context128K
Q4_K_M218.5 GB
GGUF
DR
DrakIdol Roleplayer 1.0
Drakidol · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
LL
Llama 3.2 3B Agent007 Coder
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
PO
Polaris VGA 27B Post1.0e
Polaris · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
OP
Openhands Lm 32b v0.1
Openhands · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
QW
Qwen3-Vl-4B-Thinking-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
ReasoningVision
YI
Yi 1.5 6B Chat
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen3 coder REAP 25B A3B Rust
Qwen · Em-80
Params25B
Context256K
Q4_K_M15.1 GB
Coding
LL
Hermes 2 Theta Llama 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Other quants

Keep browsing