Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
GE
Gemma 4 E4B
Gemma · lmstudio-community
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
MI
Voxtral Mini 4B Realtime
Mistral · handy-computer
Params4.43B
Context—
Q4_K_M2.8 GB
GGUF
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
AP
Apodex 1.1 Mini
Apodex · abenzerps
Params35.5B
Context256K
Q4_K_M19.8 GB
Vision
MO
models moved
Models · ggml-org
Params34M
Context—
Smallest0.0 GB
GGUF
LA
Laguna S 2.1
Laguna · poolside
Params118B
Context1024K
Q4_K_M96.0 GB
GGUF
OR
Ornith 1.5 122B
Ornith · ornith-ai
Params125B
Context256K
Q4_K_M75.8 GB
Vision
WH
Whisper Large v3
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
WA
Wan2.2 TI2V 5B
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3.5 9B Kimi K3 Distilled
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningVision
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
GGUF
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Vision
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
qwen2.5-1.5b-instruct
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen Image 2.1 viggle turbo
Qwen · Viggle
Params7.12B
Context—
Q4_K_M4.3 GB
GGUF
B1
B1 9B
mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
TE
Tess 4 27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
ReasoningVision
EM
Embeddinggemma 300m
Embeddinggemma · ggml-org
Params308M
Context2K
Smallest0.3 GB
Embedding
QW
Qwen3.8-27B-DFlash2
Qwen · z-lab
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · huihui-ai
Params10B
Context—
Smallest10.9 GB
GGUF
FL
FLUX.2 klein 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.7 GB
GGUF
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · prism-ml
Params2.5B
Context256K
Smallest1.6 GB
Vision
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Ornith-1.0-9B
Ornith · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
WA
Wan2.2 TI2V 5B
Wan · unsloth
Params5B
Context—
Q4_K_M3.4 GB
GGUF

Other quants

Keep browsing