Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt-Oss-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
GGUF
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
TO
Topxtral-4x7B-v0.1
Topxtral · RichardErkhov
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
WA
Wan2.2 S2V 14B
Wan · QuantStack
Params16.3B
Context—
Q4_K_M13.9 GB
GGUF
NO
nomic-embed-text-v2-moe
Nomic · nomic-ai
Params475M
Context512
Q4_K_M0.3 GB
Embedding
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · bartowski
Params108B
Context10240K
Q4_K_M67.5 GB
GGUF
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
WA
WAN2.2 I2V A14B DISTILL LIGHTX2V 4STEP
Wan · jayn7
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
Vision
SE
SeaLLMs SeaLLMs v3 7B Chat
Seallms · RichardErkhov
Params7.62B
Context—
Q4_K_M0.0 GB
GGUF
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
AR
Artemis 31B v1.2
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
Vision
FA
Jiqing tiny random falcon
Falcon · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
LL
Llama 3.3 70B Instruct Abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
Vision
QW
Qwen3-32B
Qwen · unsloth
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GR
ibm granite granite 20b code instruct
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
LL
Llama3.3 8B Instruct Thinking Heretic Uncensored Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
QW
Qwen3.5 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
Vision
GE
Gemma-3-1B-It
Gemma · unsloth
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
ST
stable diffusion v1 5
Stable · second-state
Params1.07B
Context—
Smallest1.6 GB
GGUF
AN
anthracite org magnum 12b v2
Anthracite · RichardErkhov
Params12.2B
Context—
Q4_K_M0.0 GB
GGUF

Other quants

Keep browsing