IQ3_M GGUF models

Importance-matrix 3-bit quant, medium. Aimed at low-memory setups. 47889 models have a IQ3_M file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt Oss 20b RichardErkhov Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LO
LongWriter V 7B
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PE
Pelican1.0 VL 235B A22B FC
Pelican · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Vision
MI
MissLizzy_7b_HF
Misslizzy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
I2S Qwen3 8B Confidence
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 Lumen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CU
CursorCore QW2.5 7B i1
Cursorcore · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Coding
SQ
OG SQL 7B
Sql · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.5 9B Polaris HighIQ THINKING
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
DA
Darwin 35B A3B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningTool useVision
SP
Spark-X2.6-4B
Spark · Mungert
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen2.5 72b RP Ink
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Roleplay
QW
Qwen3 32B LoRA ECHO KK GRPO
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 Godzilla Coder 51B 128k
Qwen · mradermacher
Params51B
Context128K
Q4_K_M30.7 GB
Coding
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
ME
Meliodas 7b dare
Meliodas · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
OM
OmniCoder Queen 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingRoleplayVision
HA
Hathor_Tahsin-L3-8B-v0.85
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SN
Snowpiercer 15B v1
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
NE
Nekomata 14b Instruction
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
MO
L3.1 MOE 6X8B Dark Reasoning Dantes Peak HORROR R1 Uncensored 36B
Moe · DavidAU
Params36.2B
Context128K
Q4_K_M22.0 GB
ReasoningRoleplay
QW
UwU Qwen3.5 27B v0.1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
ZE
Zen4 Coder
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
GGUF
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF

Other quants

Keep browsing