IQ1_M GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B v0.3 Middo Alpaca 4o Mini
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 7B KStack Clean
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
AN
Anansi 35B A3B
Anansi · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplay
LL
Prox-Llama-3-8B-abliterated-orpo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
MI
MiroThinker 1.7 Mini Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SeaLLMs v3 7B
Seallms · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
WI
WizardLM-2-7B-abliterated
Wizardlm · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
SvS LLama 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite Speech 5.0 2b
Granite · mradermacher
Params1.84B
Context16K
Q4_K_M1.1 GB
GGUF
LE
LemonadeRP-4.5.3
Lemonaderp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Bioinspired Base Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool useVision
QW
Qwq-32B
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
LL
Linkbricks-Horizon-AI-Ko-llama3-Instruct-dpo-8B-base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
WE
WeirdCompound v1.7 24b
Weirdcompound · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
AS
ASearcher Local 14B
Asearcher · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
GP
OpenAi GPT Oss 36B BrainStorm20x Uncensored
gpt-oss · mradermacher
Params36.6B
Context128K
Q4_K_M27.5 GB
CodingReasoning
CA
CataLlama-v0.2-Instruct-SFT
Catallama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
AS
Assistant_Pepe_32B
Assistant · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
CY
Cyberdonia 24B v11
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
AR
L3.1 Artemis a 8B i1
Artemis · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Orion 26B A4B v1
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GL
GLM 4.7 Flash REAP 39
GLM · mradermacher
Params19.1B
Context198K
Q4_K_M11.6 GB
CodingTool use
GE
genz 70b i1
Genz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HO
Hornybot Mara POV
Hornybot · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
NI
L3-8B-Niitama-v1
Niitama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GL
CreativeSocialAgent_GLM_4.7_Flash
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
MI
Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing