Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 8B NSFW Caption V4.5 Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
AE
AesCode 8B
Aescode · bartowski
Params8.19B
Context256K
Q4_K_M5.2 GB
CodingVision
IM
imgmodel
Imgmodel · koboldcpp
Params3.47B
Context40K
Q4_K_M2.5 GB
Vision
LL
MiniCPM Llama3 V 2 5
Llama · openbmb
Params8.2B
Context8K
Q4_K_M4.9 GB
Vision
HU
Ornith 1.5 35B A3B Abliterated
Huihui · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
Vision
MO
MOSS Image
Moss · molbal
Params5.08B
Context—
Q4_K_M3.6 GB
GGUF
OV
OvisOCR3
Ovisocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Gemma 3 27b It Abliterated
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
RO
RoLlama2-7b-Base
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF
ME
Medgemma 4b It
Medgemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
LF
LFM2.5 2.6B Heretic Abliterated
Lfm · Abiray
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
NE
nexus finance
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
FA
FastWan2.2 TI2V 5B FullAttn
Fastwan · Green-Sky
Params5B
Context—
Smallest4.2 GB
GGUF
LL
FILM6912 Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
MI
Mistral Small 24B Instruct 2501
Mistral · unsloth
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
Speechless Llama2 Hermes Orca Platypus WizardLM 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
MI
MiniCPM V 4
MiniCPM · openbmb
Params3.6B
Context32K
Q4_K_M2.2 GB
CodingVision
DE
Qwen3.5 9B Distill Deepseek V4.1 Flash 20261004
DeepSeek · kevinzhou21
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · WANG-CC
Params8.19B
Context40K
Smallest8.7 GB
Coding
GE
gemma 4 31B it uncensored
Gemma · TrevorJS
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1
Qwen · IsValorum
Params35.5B
Context256K
Smallest1.2 GB
ReasoningTool useVision
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · ggml-org
Params539M
Context32K
Smallest0.6 GB
Vision
QW
Qwen3 4B Instruct 2507 Polaris Alpha Distill Heretic Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
IM
Z-Image-Engineer-V6-SMART-DoRA-StyleBlendV9-25V17-75
Image · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
Coding

Other quants

Keep browsing