IQ3_M GGUF models
Importance-matrix 3-bit quant, medium. Aimed at low-memory setups. 47889 models have a IQ3_M file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
QW
Qwen2.5 Coder 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 2B
Qwen · bartowski
Params1.94B
Context256K
Q4_K_M1.4 GB
QW
Qwen3 1.7B
Qwen · bartowski
Params2.03B
Context32K
Q4_K_M1.3 GB
CY
Cydonia 24B v4.3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GR
ibm granite granite 20b code base
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
GE
Gemma 4 E4B It
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FR
FrogNano 4B 2609
Frognano · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB
LL
Llama 3.2 3B Instruct
Llama · bartowski
Params3.61B
Context128K
Q4_K_M2.2 GB
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params9.2B
Context256K
Q4_K_M5.8 GB
OR
Ornith 1.5 35B A3B
Ornith · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
CL
Clef Flash
Clef · bartowski
Params9.1B
Context256K
Q4_K_M6.0 GB
QW
Qwen2 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
CL
Cloudflare clef
Clef · bartowski
Params27B
Context256K
Q4_K_M17.7 GB
BE
BeaverAI NeMoist 21B v1a
Beaverai · RichardErkhov
Params21B
Context—
Q4_K_M0.0 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
OR
Ornith 1.5 9B
Ornith · AtomicChat
Params8.95B
Context256K
Smallest2.8 GB
OR
Orion 26B A4B v1.1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
GE
Gemma 3 4b It
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SM
SmolLM3 3B
SmolLM · bartowski
Params3.08B
Context64K
Q4_K_M1.9 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bartowski
Params32.9B
Context1024K
Q4_K_M25.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB