Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
GD
GDP 4B
Gdp · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 27B
Qwen · ArtomYuan
Params27.3B
Context256K
Smallest14.6 GB
LL
Llm Jp 4.1 32b A3B Thinking
Llm · OS-Software
Params32B
Context64K
Q4_K_M21.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3.8-2.4T-A95B
Qwen · unsloth
Params2450B
Context256K
Smallest397.3 GB
QW
Qwen3.8 Flash Next FP8 Abliterated
Qwen · GCSA-AiLab
Params177B
Context256K
Q4_K_M2.8 GB
GE
gemma-1.1-7b-it
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
FL
Sakura FLUX.3 Image Klein
Flux · webmp3
Params5.55B
Context—
Q4_K_M3.3 GB
JA
stabilityai_japanese-stablelm-instruct-gamma-7b
Japanese · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
LFM2.5 Audio 1.5B GGUF LEAP
Lfm · LiquidAI
Params1.17B
Context—
Smallest0.1 GB
QW
silicon based girlfriend v2
Qwen · RX5950XT
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 27B uncensored
Qwen · ressl
Params27.3B
Context256K
Q4_K_M16.8 GB
GL
Glistening Gem 31B v2.1
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
LU
G4 LuneLight 31B
Lunelight · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · bartowski
Params7.62B
Context986K
Q4_K_M4.7 GB
PO
pony v7 base
Pony · purplesmartai
Params6.86B
Context—
Smallest3.9 GB
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
Darrellbest Qwen Image 2.1 PE I2I Heretic
Qwen · darrellbest
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
llava 1.6 mistral 7b
Mistral · cjpais
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Wanabi Gemma4 31B
Gemma · kawaimasa
Params30.7B
Context256K
Q4_K_M18.7 GB
NU
nuextract 1.5 tiny mealie ingredient parser
Nuextract · abyrne55
Params494M
Context32K
Smallest0.5 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB