Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 Coder Next
Qwen · ggml-org
Params80B
Context256K
Smallest84.8 GB
LF
lfm2.5 2.6b fable5 coding agent heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
FL
flux2 dev
Flux · gguf-org
Params17.8B
Context—
Q4_K_M20.0 GB
ID
ideogram 4
Ideogram · stduhpf
Params9.28B
Context—
Smallest3.6 GB
ST
StartLux-Decision-v1.1-9B-Instant
Startlux · startlux-models
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3.2 1B Instruct
Llama · lmstudio-community
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
qwen3 asr 1.7b
Qwen · cstr
Params2.35B
Context—
Smallest1.5 GB
GE
Gemma 3 4b It Abliterated
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
OR
Orion 26B A4B v1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
LI
LightOnOCR 2 1B
Lightonocr · ggml-org
Params596M
Context16K
Smallest0.6 GB
FU
Functiongemma-270M-It
Functiongemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
DI
diar streaming sortformer 4spk v2
Diar · vibe-app
Params123M
Context—
Smallest0.1 GB
QW
Qwen Image 2.1
Qwen · chfm
Params7.12B
Context—
Q4_K_M4.2 GB
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · DavidAU
Params24.2B
Context32K
Q4_K_M14.7 GB
ON
OneJev 4B
Onejev · bartowski
Params4.84B
Context256K
Q4_K_M3.2 GB
LL
calme 2.4 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
AT
Athena v1
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HE
Hermes-4-70B
Hermes · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwythos 9B Claude Mythos 5 1M Uncensored Heretic
Qwythos · llmfan46
Params8.95B
Context1024K
Q4_K_M6.2 GB
NE
Nex N2.5 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
VI
Violet Twilight v0.2
Violet · Epiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
gemma 4 26B A4B it
Gemma · AtomicChat
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
huihui ai Huihui Qwen3.5 0.8B abliterated Ultimate Offensive Red Team
Qwen · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
AP
Apertus-8B-Instruct-2509
Apertus · unsloth
Params8.05B
Context64K
Q4_K_M5.1 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · unsloth
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5-7B-Instruct-1M
Qwen · Mungert
Params7.6B
Context986K
Q4_K_M4.8 GB
AI
Airoboros L2 13B 2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AP
Apex-35B-V1.0
Apex · Apexintelligence-AI
Params35.5B
Context256K
Q4_K_M21.7 GB