Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · crusoeai
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Coding
QW
SummOrchestra Qwen3 8B GRPO BRLP SAMSUM
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoning
QW
Qwen3.5 9B Claude Fable 5xMerge
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
GL
GLM-ASR-Nano-2512
GLM · Mungert
Params1.59B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Ministral 3 3B Qwen3.8 Max Reasoning Distilled
Qwen · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool use
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
NO
Noema 1.5 4B Fast
Noema · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoning
AR
Artemis 31B v1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
TO
ToriiGate 0.5
Toriigate · DraconicDragon
Params4.84B
Context256K
Q4_K_M3.1 GB
Vision
LF
LFM2 VL 450M
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
Vision
NO
Nock Coder 1.5b
Nock · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
JE
Jebadiah 27b v2 1
Jebadiah · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
RW
rwkv 6 finch 14b
Rwkv · latestissue
Params14.1B
Context1024K
Smallest5.4 GB
GGUF
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
GGUF
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
HE
HERO 4B
Hero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview v0.1
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
MI
Mistral-Large-3-675B-Instruct-2512
Mistral · unsloth
Params675B
Context288K
Q4_K_M407.0 GB
Vision
OL
Olmo-3-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
NA
NaNovel 35B A3B
Nanovel · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LF
LFM2.5 2.6B UNCENSORED ABLITERATED PHILADELPHIA CLASS
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningTool use
NE
Nemotron 3.5 Embed 1B BF16
Nemotron · W4D
Params1.14B
Context256K
Q4_K_M0.7 GB
EmbeddingVision
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
SW
Swallow MS 7b Instruct v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing