IQ3_M GGUF models

Importance-matrix 3-bit quant, medium. Aimed at low-memory setups. 47889 models have a IQ3_M file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
AN
Anubis Mini 8B v1
Anubis · bartowski
Params8B
Context128K
Q4_K_M5.1 GB
GGUF
QW
QwQ 32B Abliterated
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Vision
LL
Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NO
Novel Humanize 4b
Novel · bartowski
Params4.02B
Context40K
Q4_K_M2.6 GB
ReasoningTool use
NI
Ninja-v1-NSFW-RP
Ninja · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B heretic ara i1
Nemotron · spiritfather
Params121B
Context1024K
Q4_K_M86.1 GB
Vision
LL
dolphin-2.9.1-llama-3-8b
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
CodingTool use
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningRoleplayTool use
GE
Tiger Gemma 12B v3
Gemma · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
LF
LFM3 1.7B Heretic Abliterated
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
GGUF
GR
granite 20b code instruct i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
MP
Mpt 7b Storywriter
Mpt · mradermacher
Params6.65B
Context64K
Q4_K_M4.3 GB
GGUF
CO
codegeex4-all-9b
Codegeex · legraphista
Params9.4B
Context128K
Smallest3.1 GB
GGUF
QW
Qwen Image 2.1 Text Encoder Heretic DHQ
Qwen · pottokao
Params8.2B
Context256K
Q4_K_M5.0 GB
CodingVision
QW
Qwen3 1.7B Abliterated
Qwen · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
NO
Nous Capybara limarpv3 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · ThomasBaruzier
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
PA
PaddleOCR-VL-1.6
Paddleocr · Mungert
Params467M
Context128K
Q4_K_M0.4 GB
Vision
PA
Pantheon Reasoning 27B
Pantheon · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningRoleplay
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
WI
Wicked Stuff 26B A4B v3.0 Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
XY
Xyntetik Kvist 14B
Xyntetik · mradermacher
Params14.4B
Context128K
Q4_K_M10.3 GB
Tool use
HO
K2-Horizon-3.7B
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
HU
Hunyuan 0.5B Instruct
Hunyuan · bartowski
Params539M
Context256K
Q4_K_M0.4 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF

Other quants

Keep browsing