IQ3_XS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 46199 models have a IQ3_XS file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 VL 3B Uncensored
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
QW
Qwen3 14B ARPO DeepSearch
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
MY
Mythos v2 9b
Mythos · fableforge-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
Tool use
TO
tokyotech llm Swallow MS 7b instruct v0.1
Tokyotech · mmnga
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
XO
Xor 26B A4B
Xor · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
PR
Promethean Dawn 26B A4B
Promethean · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
EM
Source Hf Embeddinggemma 2
Embeddinggemma · ngquocvinh
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b i1
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
Reasoning
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
SA
Sabi Noema
Sabi · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Tool use
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
DEV ThinkingCap Qwen3.8 27B
Qwen · ngquocvinh
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
FA
Fara1.5 4B
Fara · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
Vision
NE
Nemotron Cascade 2 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Reasoning
CO
Yi Coder 9B Chat
Coder · RichardErkhov
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
TW
Twilight Embrace 31B
Twilight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
ReasoningTool use
MI
maywell Mistral ko 7B v0.1
Mistral · RichardErkhov
Params1.5B
Context—
Q4_K_M0.0 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF

Other quants

Keep browsing