Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
MI
Cydonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
gemma 4 12b heretic abliterated
Gemma · culturerevolt
Params11.9B
Context256K
Q4_K_M7.4 GB
YO
yovoice model
Yovoice · leemysw
Params—
Context—
Smallest0.3 GB
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · llmfan46
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 1b It
Gemma · lmstudio-community
Params1B
Context32K
Q4_K_M0.8 GB
KR
Krea 2 Turbo
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
QW
Qwen3 4B Instruct 2507
Qwen · lmstudio-community
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
FL
Recursive Flint
Flint · lmstudio-community
Params39.8B
Context256K
Q4_K_M24.2 GB
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.8 27B Humanlike Chat
Qwen · LessThanThreeAI
Params26.9B
Context256K
Q4_K_M16.6 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · unsloth
Params7.52B
Context128K
Smallest0.0 GB
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
VI
VibeVoice ASR Streaming 1.5B
Vibevoice · christopherthompson81
Params3.1B
Context—
Smallest2.1 GB
MI
MiniMax H3
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.6-27B
Qwen · ggml-org
Params26.9B
Context256K
Q4_K_M19.1 GB
HE
Hermes 4 14B
Hermes · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Q4_K_M5.9 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · llmfan46
Params35.5B
Context256K
Q4_K_M21.8 GB
LT
LTX 2.5 uncensored v1.1 FP8
Ltx · ChrisColeTech
Params21B
Context—
Q4_K_M7.5 GB
GE
Gemma 4 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4b It
Gemma · ggml-org
Params3.88B
Context128K
Q4_K_M2.5 GB
NA
Nanbeige4.3 33B
Nanbeige · bartowski
Params33.1B
Context512K
Q4_K_M20.8 GB
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
CL
Clef-Flash
Clef · ggml-org
Params9.08B
Context256K
Q4_K_M6.7 GB