Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CY
CyberPal-2.0-20B
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
MI
Mistral Trismegistus 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Motif Video 2B
Motif · Motif-Technologies
Params2.04B
Context—
Q4_K_M1.2 GB
GGUF
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
GR
Granite Guardian 4.1 8b
Granite · mrutkows
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoning
QW
Qwen2.5 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
CY
CyberOss 2.0 20B i1
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
Llama 3.2 1B Instruct Abliterated
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
QW
Qwen3.5 9B Claude 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
CodingReasoningTool use
BO
B2 Bophades 9B
Bophades · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Hemlock Qwen2.5 Coder 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B ReMax v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QW
Qwopus3.6 27B v1 Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QV
QVikhr 3 8B Instruction
Qvikhr · Vikhrmodels
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
YI
yihao llm 7b i1
Yihao · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
DAU_Qwen3.6_27B_H2_FT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
GE
gemma 2 2b it Flight Multi Turn V3 DPO
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
RWKV6QwQ 32B Final 250307
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
Reasoning
FA
Fabliq 8B Agent FromBase Reasoning
Fabliq · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
Reasoning

Other quants

Keep browsing