IQ1_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25491 models have a IQ1_S file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FR
FrogNano 4B Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingRoleplayTool use
QW
Qwen3.5 2B Base Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
YI
Yi-1.5-9B-Chat
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
QW
Qwen3-8B-128K
Qwen · unsloth
Params8.19B
Context128K
Q4_K_M5.0 GB
GGUF
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
MI
Mistral-Large-4-1T-A52B-DSpark
Mistral · unsloth
Params1050B
Context1024K
Smallest2.2 GB
ReasoningTool useVision
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
Coding
DE
DeepSeek V2.5
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
GGUF
QW
Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Sperma Aj Qwen3.8 27b
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
SK
Sketch Cydonia 24B V1.3
Sketch · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
OL
Olmo-3-7B-Think
OLMo · unsloth
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
JI
jina embeddings v4 text retrieval
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
EmbeddingVision
SL
Slimaki Tavern 24B v1.3
Slimaki · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplay
SE
Seed-Coder-8B-Reasoning
Seed · unsloth
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.5 35B A3B Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
archangel_sft-kto_llama30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
D1
d1 3B
NANI-Nithin
Params2.7B
Context32K
Q4_K_M1.7 GB
GGUF
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
NE
nexus medical
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay

Other quants

Keep browsing