IQ1_M GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
EgoActor 8b Qwen3VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
CO
Codegemma 7b
Codegemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
FO
Foundation Sec 1.1 8B Instruct
Foundation · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
GL
Qwopus GLM 18B Healed
GLM · mradermacher
Params15.9B
Context256K
Q4_K_M9.8 GB
ReasoningTool use
GE
Gemma 4 26B A4B It Arli
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
BO
boto-27B
Boto · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
FL
Aurostral Small
Flamguard · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · Vikhrmodels
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Llama 3 8b Dolphin Uncensored
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
FR
Franqwenstein 35b
Franqwenstein · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
GGUF
HY
Hy MT2 30B A3B
mradermacher
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
QW
Community Blend Qwen3 8b
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
CA
CADD Base 7B
Cadd · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingTool use
GR
Granite-4.0-1B
Granite · unsloth
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.X Workout 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen2.5 2X11B CODER Dueling Wolverines V2 28B
Qwen · mradermacher
Params28B
Context32K
Q4_K_M17.0 GB
CodingTool use
VE
Vecteus v1
Vecteus · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Medichat Llama3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
Pantheon-RP-1.0-8b-Llama-3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
EU
L3.3 70B Euryale v2.3 Heretic
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
FR
Frank 26B A4B
Frank · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
WI
WizardMath 70B V1.0
Wizardmath · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF

Other quants

Keep browsing