IQ1_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25491 models have a IQ1_S file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
Calme-7B-Instruct-v0.1.1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AR
ARK 270M Base i1
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
GGUF
QW
Qwen2.5 Godzilla Coder V2 51B
Qwen · mradermacher
Params51B
Context32K
Q4_K_M30.7 GB
Coding
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · mradermacher
Params41B
Context256K
Q4_K_M25.0 GB
Coding
ME
Menage 12B
Menage · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LO
LogicLumina-L3-13B-v2
Logiclumina · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Citrus1.0 Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SH
Shellwhisperer 1.5b
Shellwhisperer · fableforge-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
CH
Chewy-Lemon-Cookie-11B
Chewy · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenChat 3.5 7B SOLAR v2.0 i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
Coding
MI
MiroThinker 1.7 Mini
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
LL
Llama 3.2 Chibi 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
RI
RigoChat 7b v2
Rigochat · IIC
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
GU
Gumini 1.5B Base i1
Gumini · GuminiResearch
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
MARTHA 73B Qwen2 VL i1
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
EU
EuroLLM 9B Instruct Heretic
Eurollm · mradermacher
Params9.15B
Context4K
Q4_K_M5.6 GB
Roleplay
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MA
Magnum Picaro 0.7 v2 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 27B Deckard PKD Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
TU
Turbo Ai 7b
Turbo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
RE
Rei 12B V3 Base
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
VE
Veloxy 1B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
CARA Sage 24B
Cara · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF

Other quants

Keep browsing