Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Liberation Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
PR
Prashna 7b
Prashna · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
MA
Mario Html v2 9B
Mario · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool useVision
KA
KAT Ornith HERO 35B A3B Fusion
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
MO
Mox Tiny 1
Mox · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QV
QVikhr 3 4B Instruction
Qvikhr · Vikhrmodels
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
CL
Clef Flash
Clef · taurusduan
Params9.1B
Context256K
Q4_K_M6.0 GB
CodingVision
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
OP
OpenCodeInterpreter-DS-1.3B
Opencodeinterpreter · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
OR
Ornith 1.5 397B
Ornith · bartowski
Params397B
Context256K
Q4_K_M241.8 GB
Vision
TR
Trinity Nano Preview
Trinity · arcee-ai
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
RA
RakutenAI-7B-instruct
Rakutenai · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
MI
MiMo Ornith 9B AGSI
Mimo · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool use
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
dolphin 2.9 llama3 8b 256k GGUF smashed
Llama · PrunaAI
Params8B
Context512K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ST
stable code instruct 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
MA
MN 12B Mag Mell R1 Uncensored Scale1.2 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
LT
LTX2.3 10Eros 1.4
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
DA
Darwin 36B Opus ABLITERATED HERETIC
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use

Other quants

Keep browsing