Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
QW
Qwen_Qwen3 VL 4B Instruct
Qwen · lmstudio-community
Params4B
Context256K
Q4_K_M2.5 GB
WH
Whisper Large v2
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
QW
Sakura Qwen Image 2.1 Turbo Uncensored
Qwen · webmp3
Params7.12B
Context—
Q4_K_M4.1 GB
QW
qwen2.5-14b-instruct
Qwen · Qwen
Params14.8B
Context128K
Q4_K_M9.0 GB
LF
LFM3 VL 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
QW
Qwen3.8 Flash CIRU STRIX Orca
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
QW
Qwen2.5 14B Uncensored Instruct
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
PA
orukeet-gabor-half.q8_0
Parakeet · oruk
Params627M
Context—
Smallest0.7 GB
CA
Canary 1B Flash
Canary · handy-computer
Params890M
Context—
Q4_K_M0.7 GB
LL
Llama 3.2 8X3B MOE Dark Champion Instruct uncensored abliterated 18.4B
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB
AC
xl_regrind_v1
Acestep · mdmachine
Params4.99B
Context32K
Q4_K_M3.0 GB
DE
DeepSeek V4.1 Flash UNCENSORED
DeepSeek · Adolphsson
Params748B
Context—
Q4_K_M426.1 GB
LL
Llama-3.3-70B-Instruct
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
FL
FLUX 3 Image Klein GGUFs
Flux · realrebelai
Params5.54B
Context—
Q4_K_M3.4 GB
QW
Qwen3 Omni 30B A3B Thinking
Qwen · ggml-org
Params30.5B
Context64K
Q4_K_M18.6 GB
FB
fblgit juanako 7b UNA
Fblgit · RichardErkhov
Params7.24B
Context—
Q4_K_M0.0 GB
DI
diar streaming sortformer 4spk v2
Diar · nvidia
Params123M
Context—
Smallest0.1 GB
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3.8-27B-RANA-abliterated
Qwen · abliterant
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 9B heretic uncensored NVFP4
Qwen · Noobito45
Params8.95B
Context256K
Q4_K_M5.2 GB
MI
mistralai_mistral-7b-instruct-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM V 4.7 35B A3B CRACKv5 2p0
MiniCPM · dealignai
Params34.7B
Context256K
Q4_K_M22.6 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen3 8B
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
LF
LFM2.5 2.6B GGUF shards
Lfm · Arki05
Params2.7B
Context128K
Smallest0.0 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3 14B
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
OR
Ornith 1.5 9B UNCENSORED
Ornith · dealignai
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB