IQ3_XXS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28129 models have a IQ3_XXS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Esper3 Reasoning Instruct 6B Brainstorm20x Enhanced E32 128k Ctx
Qwen · mradermacher
Params5.94B
Context128K
Q4_K_M3.6 GB
CodingReasoning
LA
Laguna S 2.1
Laguna · bartowski
Params118B
Context1024K
Q4_K_M71.8 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · SeraphicHero
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
QW
Samantha-qwen-0.5b-ptbr
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
ADG CoT LLaMa3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NO
North Mini Code 1.0
North · mradermacher
Params30.5B
Context488K
Q4_K_M18.6 GB
CodingReasoningTool use
NE
Neuron 46x4B
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Tool use
FI
Fimbulvetr-11B-v2
Fimbulvetr · backyardai
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NI
Nightshade-Violet-12B
Nightshade · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
Meta Llama Llama 3.2 3B Instruct Heretic Nosyco
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
AE
aegolius acadicus v1 30b i1
Aegolius · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
CS
Csg Wukong 1B
Csg · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwen3 53B A3B 2507 THINKING TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoning
SN
Snowpiercer 15B v3
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
AN
Andy 4.2
Andy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LL
Llama-3-8B-Magpie-Mix-SFT-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dolphin v2 8b Abliterated
Dolphin · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
MI
Mistral Nemo NT Ko 12B sft i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
SE
Selene 3B Instruct
Selene · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
RE
Reggie v3 7b
Reggie · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningVision
HU
Huihui Qwopus3.5 9B v3 Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
DR
DrakIdol Roleplayer 1.0
Drakidol · Emerald7664
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
LL
Yarn-Llama-2-7b-128k
Llama · duyntnet
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
DE
DeepSeek V3 0324
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M404.4 GB
GGUF
TE
Tess 4 9B
Tess · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool useVision
CA
Captain Eris Violet V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay

Other quants

Keep browsing