Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M17.4 GB
SE
SenseNova 6.8 Code2Video MTP
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
DE
Qwen3.5 9B Distill Deepseek V4.1 Flash 20261003
DeepSeek · kevinzhou21
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · jaromer
Params27.3B
Context256K
Q4_K_M16.5 GB
MA
openaccess-ai-collective_manticore-13b-chat-pyg
Manticore · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
AU
AuraFlow v0.3
Auraflow · city96
Params6.86B
Context—
Q4_K_M4.0 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context256K
Smallest32.5 GB
SM
SmolLM2 1.7B Instruct
SmolLM · lmstudio-community
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CA
CausalLM 14B DPO alpha
Causallm · tastypear
Params14.2B
Context8K
Q4_K_M9.2 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
qwen3 tts 0.6b base
Qwen · cstr
Params915M
Context—
Smallest0.5 GB
GE
Gemma 4 12B Unified System One
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
JI
jina embeddings v4 text matching
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VO
voxcpm2
Voxcpm · cstr
Params2.38B
Context—
Smallest0.0 GB
HU
Huihui Hunyuan MT 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
QW
Qwen3 4B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params4B
Context256K
Q4_K_M2.5 GB
JA
Jan-v1-4B
Jan · janhq
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 8B JP Uncensored
Qwen · ryo559
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
gemma-2-9b-it
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
MU
Muse Glimmer 30B uncensored
Muse · TrevorJS
Params28B
Context128K
Q4_K_M16.9 GB
LL
togethercomputer_llama-2-7b-32k-instruct
Llama · TheBloke
Params6.74B
Context32K
Q4_K_M4.1 GB
TA
UI TARS 7B DPO
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB