IQ3_M GGUF models

Importance-matrix 3-bit quant, medium. Aimed at low-memory setups. 47889 models have a IQ3_M file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
Marco Mini Instruct
Marco · mradermacher
Params17.3B
Context32K
Q4_K_M10.5 GB
Reasoning
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
Embedding
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Clinical BR Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OP
opus v1 34b i1
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
MI
zephyr-orpo-141b-A35b-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
GGUF
MO
G4 Moonlight Dusk 26B A4B Heretic
Moonlight · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3 30B A3B Claude 4.5 Opus High Reasoning 2507 ABLITERATED UNCENSORED V2
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
Reasoning
WI
WizardCoder 15B V1.0
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Coding
NA
Nanbeige4.3 33B
Nanbeige · mradermacher
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use
SH
OS Shepherd 9B
Shepherd · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
GL
LongWriter Glm4 9b
GLM · bartowski
Params9.4B
Context1024K
Q4_K_M6.3 GB
GGUF
QW
Qwen3.5 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GL
L3 V2 S M B Grand HORROR 17B GLM4.7 Thinking UNCENSORED NEO Imatrix
GLM · DavidAU
Params16.5B
Context8K
Q4_K_M10.1 GB
ReasoningRoleplay
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
GE
Gemma2 Gutenberg Doppel 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Concept 7b V1 Full
Concept · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
SO
Sorjin1.1 7B Instruct
Sorjin · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning

Other quants

Keep browsing