IQ1_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Mistral 7B v0.3 Middo Alpaca 4o Mini
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
CodeLlama 7B KStack Clean
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
AN
Anansi 35B A3B
Anansi · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Prox-Llama-3-8B-abliterated-orpo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiroThinker 1.7 Mini Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
SE
SeaLLMs v3 7B
Seallms · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
WI
WizardLM-2-7B-abliterated
Wizardlm · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
SvS LLama 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GR
Granite Speech 5.0 2b
Granite · mradermacher
Params1.84B
Context16K
Q4_K_M1.1 GB
LE
LemonadeRP-4.5.3
Lemonaderp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Bioinspired Base Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwq-32B
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Linkbricks-Horizon-AI-Ko-llama3-Instruct-dpo-8B-base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
WE
WeirdCompound v1.7 24b
Weirdcompound · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
AS
ASearcher Local 14B
Asearcher · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GP
OpenAi GPT Oss 36B BrainStorm20x Uncensored
gpt-oss · mradermacher
Params36.6B
Context128K
Q4_K_M27.5 GB
CA
CataLlama-v0.2-Instruct-SFT
Catallama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
AS
Assistant_Pepe_32B
Assistant · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CY
Cyberdonia 24B v11
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
AR
L3.1 Artemis a 8B i1
Artemis · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
OR
Orion 26B A4B v1
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GL
GLM 4.7 Flash REAP 39
GLM · mradermacher
Params19.1B
Context198K
Q4_K_M11.6 GB
GE
genz 70b i1
Genz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
HO
Hornybot Mara POV
Hornybot · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NI
L3-8B-Niitama-v1
Niitama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GL
CreativeSocialAgent_GLM_4.7_Flash
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
MI
Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB