Q8_0 GGUF models

8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Devstral Small 2 24B Instruct 2512
Mistral · ggml-org
Params23.6B
Context384K
Smallest25.1 GB
CodingVision
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
RN
EssentialAI_rnj 1 Instruct
Rnj · lmstudio-community
Params8.3B
Context32K
Q4_K_M5.1 GB
GGUF
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
RoleplayVision
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
QW
Qwen3.8-27B
Qwen · loscrossos
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3-ASR-1.7B
Qwen · FlippyDora
Params2.35B
Context—
Smallest3.2 GB
GGUF
QW
Qwen3.5 35B A3B ultra uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
Coding
QW
Qwen Qwen3 VL 8B Instruct Heretic
Qwen · ThalisAI
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
ReasoningTool useVision
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3 VL 4B Instruct Uncensored Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
EX
EXAONE-4.5-33B
Exaone · LGAI-EXAONE
Params33B
Context256K
Q4_K_M20.0 GB
Vision
DE
decider 2b
Decider · Mapika
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
GGUF
AB
Hy MT2 7B Abliterated Bf16
Abliterated · alexwkleung
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
MU
Muse Glimmer 30B Heretic
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
LO
LongCat Image Edit
Longcat · vantagewithai
Params6.29B
Context—
Q4_K_M3.9 GB
GGUF
MI
MiMo-V2.6-Flash-RL
Mimo · vultr
Params309B
Context1024K
Smallest2.4 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · qtum
Params27B
Context256K
Q4_K_M17.7 GB
Vision
QW
Viggle Qwen Image 2.1 Turbo GGUFs
Qwen · realrebelai
Params7.12B
Context—
Q4_K_M5.6 GB
GGUF
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
CodingReasoningVision
GE
Gemma The Writer Mighty Sword 9B
Gemma · DavidAU
Params9.2B
Context8K
Q4_K_M5.6 GB
Roleplay
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
Reasoning
QW
qwen3 asr 0.6b
Qwen · cstr
Params938M
Context—
Smallest0.0 GB
GGUF
QW
qwen3 tts 12hz 1.7b ru stress
Qwen · sknyazev
Params142M
Context32K
Smallest0.2 GB
GGUF
QW
Qwen3.8 27B NVFP4 Src
Qwen · LibertAIDAI
Params27B
Context256K
Q4_K_M15.8 GB
Vision

Other quants

Keep browsing