Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · zugquants
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
AI
jondurbin_airoboros-m-7b-3.1.2
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
ST
L3 8B Stheno v3.1
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Tencent Hy MT2 30B A3B
litigerking
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Hermes 3 Llama 3.1 405B
Llama · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
RoleplayTool use
MI
MiniMax H3 Prompt Rewriter LoRA
Minimax · pytraveler
Params1.87B
Context—
Smallest2.0 GB
GGUF
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
Coding
RU
surogate rune 26b a4b
Rune · owao
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
DI
Diffusiongemma 26B A4B It HERETIC Uncensored
Diffusiongemma · yabaimimi
Params25.3B
Context256K
Q4_K_M16.8 GB
GGUF
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
Vision
DE
Q3 30B A3B Designant
Designant · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningRoleplay
GE
Gemma 3 4b It Heretic Uncensored Abliterated Extreme
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3 8B Heretic GGUF
Qwen · xFanexx
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
UN
unlimited ocr
Unlimited · vimalnakrani
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
GE
Gemma 4 12B
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool use
OC
Occamy 1.0 APEX I NanoPlus
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3Vl 32b Thinking
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
MO
moss tts
Moss · ilintar
Params2.04B
Context—
Smallest4.1 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
GE
Gemma 4 Vain 26B A4B
Gemma · Ozili
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SA
Sakura SOLAR Instruct
Sakura · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · NANI-Nithin
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
GE
Artemis 31B v1.1
Gemma · TheDrummer
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Other quants

Keep browsing