Q4_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Cogito v1 Preview Qwen 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
Qwen3.5 21B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
BI
Bielik 11B v3.0 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
QW
Qwen2.5 0.5b RBase
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
SI
Simplicio 27B
Simplicio · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
MiniCPM5 1B Heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
OPSD Qwen3 4B
Qwen · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
CH
CHIMERA 4B SFT
Chimera · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
MA
Marco Nano Instruct
Marco · mradermacher
Params8B
Context32K
Q4_K_M5.4 GB
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
AD
MN Adversary 12B v1
Adversary · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwable 9B Claude Fable 5
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
AH
Ahma 7B
Ahma · QuantFactory
Params7B
Context2K
Q4_K_M4.3 GB
PH
Phi 4 Heretic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
QW
Qwen3 Hermes8B v1
Qwen · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.5 27B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SW
Swish 26B A4B
Swish · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
OL
open r1 OlympicCoder 32B
Olympiccoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
CY
Cydonia ReduX 22B v1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
NE
Heretic Nemotron Content Safety Reasoning 4B
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ST
STELLA VLM JoVE 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
OL
Olmo-3.1-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
AR
Ariel Alloy V1 24B Heretic
Ariel · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB