Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
FLUX 3 Image Klein
Flux · AtomicChat
Params5.55B
Context256K
Smallest2.5 GB
GGUF
MI
Ministral-3-8B-Instruct-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
CE
MN 12B Celeste V1.9
Celeste · nothingiisreal
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 0.6B Heretic
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · HuggingFaceTB
Params362M
Context8K
Smallest0.4 GB
GGUF
TU
SD Turbo
Turbo · Green-Sky
Params1.3B
Context—
Smallest2.0 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · orcarouter
Params321B
Context1024K
Q4_K_M193.0 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Uncensored
Qwen · xCloudinfo
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
QW
Bahushruth Qwen3.6 35B A3B Abliterated v4
Qwen · Bahushruth
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
GGUF
LI
Ling-3.0-tiny
Ling · inclusionAI
Params7.9B
Context128K
Q4_K_M4.8 GB
GGUF
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen_Qwen3.5 0.8B
Qwen · lmstudio-community
Params752M
Context256K
Q4_K_M0.5 GB
Vision
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
ReasoningTool use
QW
Z Image Qwen 3 4b text encoder
Qwen · worstplayer
Params4B
Context40K
Smallest2.1 GB
Coding
QW
Qwen2.5 VL 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
GGUF
QW
Qwen3 8B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params7.66B
Context256K
Q4_K_M4.7 GB
Roleplay
OR
Ornith 1.5 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
BR
breeze-tts-2
Breeze · cstr
Params2.85B
Context—
Smallest2.2 GB
GGUF
FL
flux2 klein 9b uncensored text encoder
Flux · ponpoke
Params8.19B
Context—
Q4_K_M5.0 GB
Coding
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · huihui-ai
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision

Other quants

Keep browsing