IQ3_M GGUF models

Importance-matrix 3-bit quant, medium. Aimed at low-memory setups. 47889 models have a IQ3_M file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 32b Instruct Heretic Sft
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · noctrex
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
XY
XYZ Aquila Mini
Xyz · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
AR
BAAI AREX 2
Arex · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
BA
BarryFutureman NeuralTurdusVariant1 7B
Barryfutureman · RichardErkhov
Params7B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen2 VL 2B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen3 128k 30B A3B NEO MAX Imatrix
Qwen · DavidAU
Params30.5B
Context128K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Therapy 3.8
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
Vision
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
QW
Qwen3 30B A3B
Qwen · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
FL
RecursiveSI flint
Flint · bartowski
Params39.8B
Context256K
Q4_K_M25.3 GB
GGUF
GE
Sprinkle Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
VAGOsolutions Llama 3 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params6B
Context—
Q4_K_M0.0 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · bartowski
Params119B
Context1024K
Q4_K_M72.6 GB
Vision
MA
magnum v4 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
SP
Spark X2.6 4B
Spark · bartowski
Params4.11B
Context1024K
Q4_K_M2.6 GB
GGUF
NA
Nanbeige4.2 3B
Nanbeige · bartowski
Params4.17B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Atomic Chat / Qwen3.5 4B
Qwen · AtomicChat
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
UN
Unlimited OCR
Unlimited · sahilchachra
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
QW
Qwen3 Zero Coder Reasoning V2 0.8B NEO EX
Qwen · DavidAU
Params816M
Context40K
Q4_K_M0.5 GB
CodingReasoning
GR
Granite Embedding 107m Multilingual
Granite · bartowski
Params107M
Context512
Q4_K_M0.1 GB
Embedding

Other quants

Keep browsing