Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB
ReasoningTool useVision
KR
Krea 2 Turbo
Krea · Abiray
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Qwen Image 2.1 Turbo Quantized
Qwen · abenzerps
Params7.1B
Context—
Q4_K_M4.1 GB
GGUF
NE
NeoHorse-1-9B
Neohorse · TokenRhythm
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced
GLM · HauhauCS
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
SA
Sage A1.5 Sangreal ICE
Sage · gbuzhf
Params35.5B
Context256K
Smallest12.2 GB
ReasoningTool useVision
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
ReasoningTool use
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
JI
JiRackUltra_14b
Jirackultra · CMSManhattan
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
WI
Wicked Stuff 26B A4B v2.1 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Assistant
Gemma · RachidAR
Params420M
Context128K
Smallest0.2 GB
GGUF
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PA
Parakeet CTC 1.1B
Parakeet · handy-computer
Params1.06B
Context—
Q4_K_M0.8 GB
GGUF
QW
Qwen3 30B A3B
Qwen · lmstudio-community
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
LU
L3-8B-Lunaris-v1
Lunaris · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
MI
teknium_openhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
CO
Computer 10
Computer · bartowski
Params70.6B
Context128K
Q4_K_M44.0 GB
GGUF

Other quants

Keep browsing