Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniCPM-V-4.7-1B
MiniCPM · AtomicChat
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
MI
ehartford_dolphin-2.5-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
WH
Whisper Medium (English)
Whisper · handy-computer
Params764M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 VL 7B Instruct Unredacted MAX
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
OP
OpenJev
Openjev · ggml-org
Params27B
Context256K
Q4_K_M19.4 GB
Vision
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
GGUF
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
GGUF
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
FL
flux 3 image klein sd
Flux · Abiray
Params5.55B
Context—
Q4_K_M3.3 GB
GGUF
QW
Qwopus3.6 27B Coder MTP
Qwopus · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · petruhonk
Params9.2B
Context256K
Smallest9.8 GB
GGUF
OM
d1-omni-600M
Omni · LiquidAI
Params381M
Context125K
Smallest0.4 GB
Vision
CA
Canary 1B
Canary · handy-computer
Params1.02B
Context—
Q4_K_M0.7 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
OM
OmniCoder 9B
Omnicoder · Tesslate
Params8.95B
Context256K
Q4_K_M5.7 GB
Coding
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GL
GLM 4.6V Flash
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
PH
phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
ME
Melody1437 26B A4B v2.0
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
MI
MiniMax H3 Singularity
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LA
poolside_Laguna S 2.1
Laguna · lmstudio-community
Params118B
Context256K
Q4_K_M71.2 GB
GGUF
LL
Llama 3.2 11B Vision Instruct
Llama · leafspark
Params9.78B
Context128K
Q4_K_M6.0 GB
Vision
FL
Flint
Flint · ggml-org
Params39.8B
Context256K
Q4_K_M23.4 GB
GGUF
MI
MiniCPM V 2 6
MiniCPM · openbmb
Params7.61B
Context32K
Q4_K_M4.7 GB
Vision
OR
Huihui Ornith 1.0 9B abliterated MTP
Ornith · huihui-ai
Params2.28B
Context256K
Q4_K_M6.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use

Other quants

Keep browsing