Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenELM-270M-Instruct
Openelm · RichardErkhov
Params272M
Context2K
Q4_K_M0.2 GB
GGUF
IN
Internvl3-8B
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingVision
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Magistral Small 2506
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
NousResearch DeepHermes 3 Mistral 24B Preview
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
LL
Cogito v1 Preview Llama 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Coding
QW
Qwen3.5 0.8B Heretic
Qwen · saidutta69
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
qwen2.5 coder 32b combined verilog c i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Coding
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
SK
TheDrummer Skyfall 36B v2
Skyfall · bartowski
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
QW
Bella Tao Merged Qwen2_5 Coder 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
LL
Taigi Llama 2 Translator 7B
Llama · RichardErkhov
Params6.94B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Qwen3.6 28B REAP
Qwen · mradermacher
Params28.2B
Context256K
Q4_K_M17.3 GB
GGUF
GE
Gemma 3 Uncensored_v2 Merged
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PH
Phi 3 mini 4k geminified
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GR
Grug 9b
Grug · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
CodingReasoningTool use
HU
Huihui Hunyuan MT Chimera 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama3 German 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GGUF
LL
Llama OuteTTS 1.0 1B
Llama · OuteAI
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF

Other quants

Keep browsing