IQ1_M GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenChat 3.5 7B SOLAR v2.0 i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
Coding
MI
MiroThinker 1.7 Mini
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
LL
Llama 3.2 Chibi 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
RI
RigoChat 7b v2
Rigochat · IIC
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
GU
Gumini 1.5B Base i1
Gumini · GuminiResearch
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
MARTHA 73B Qwen2 VL i1
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
EU
EuroLLM 9B Instruct Heretic
Eurollm · mradermacher
Params9.15B
Context4K
Q4_K_M5.6 GB
Roleplay
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MA
Magnum Picaro 0.7 v2 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 27B Deckard PKD Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
TU
Turbo Ai 7b
Turbo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
RE
Rei 12B V3 Base
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
VE
Veloxy 1B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
CARA Sage 24B
Cara · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
PE
PersonaVLM
Personavlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CY
CyberPal-2.0-20B
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
PI
PiVoT SUS RP i1
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
Roleplay
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
XW
Xwinter 120b i1
Xwinter · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
CoT 2.5 i1
Cot · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Other quants

Keep browsing