Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
Vision
GE
Gemma 4 Gembrain X Core 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
KW
KwaiCoder AutoThink Preview
Kwaicoder · bartowski
Params40.6B
Context32K
Q4_K_M24.6 GB
Coding
DR
DreadPoor Harpy 7B Model Stock
Dreadpoor · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Coding
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
VE
Veloxy SLM 3B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ME
Melody1437 26B A4B
Melody · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
MI
MiMo Ornith 9B AGSI Abliterated HQ
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
BE
Behemoth T1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
ReasoningRoleplay
UC
UCLA AGI zephyr 7b sft full SPIN iter2
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
NI
NicholasCorrado zephyr 7b uf rlced conifer dpo 2e
Nicholascorrado · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
FLUX.1 Fill dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
GGUF
TE
TerraIncognita 24B
Terraincognita · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
GL
GLM4 9B Neon v2
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
BL
Blossom V6.2 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
GE
L3.3 GeneticLemonade Opus 70B
Geneticlemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingTool use
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
ME
Megamind v2 VL high
Megamind · digitranslab
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
ReasoningVision
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
LLDS A GRPO Qwen2.5 7B Ins i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Other quants

Keep browsing