Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
Muse Glimmer 30B
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · OBLITERATUS
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
QW
Qwen3 Next 80B A3B Instruct
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
ST
stable diffusion 3.5 large
Stable · second-state
Params695M
Context—
Smallest0.7 GB
GGUF
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
GGUF
OR
Ornith 1.5 9B Heretic v2
Ornith · Thunder13240
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
JI
JiRackUltra 1b
Jirackultra · CMSManhattan
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
Reasoning
MI
Devstral Small 2 24B Instruct 2512
Mistral · bartowski
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
QW
Qwen3 VL 2B Instruct
Qwen · ggml-org
Params1.72B
Context256K
Smallest1.8 GB
Vision
LL
codellama_codellama-7b-instruct-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
MistralRP Noromaid NSFW Mistral 7B
Mistral · Ttimofeyka
Params7.24B
Context32K
Smallest4.1 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · BnhHo
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
DE
DeepSeek V4.1 Flash
DeepSeek · vcruz305
Params748B
Context—
Q4_K_M444.7 GB
GGUF
QW
Qwen Image Edit
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · incoai
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB
Embedding
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · bartowski
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
QW
Qwen3-Vl-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Huihui Qwen3.8 27B Coder390 EfficientThink Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingVision
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
GGUF
TE
HY MT1.5 7B
Tencent · tencent
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3.8 27B UNCENSORED
Qwen · dealignai
Params27.3B
Context256K
Q4_K_M17.0 GB
ReasoningVision
LF
LFM3 Audio 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
QW
Qwen3.5 Text 9B NSFW RP RolePlay
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
LT
LTXV 13B 0.9.8 distilled
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
GGUF
QW
Qwen3.6 27B Heretic Uncensored FINETUNE NEO CODE Di IMatrix MAX
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.9 GB
CodingReasoningRoleplay
NE
NemoMix Unleashed 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Other quants

Keep browsing