Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
MI
maywell Mistral ko 7B v0.1
Mistral · RichardErkhov
Params1.5B
Context—
Q4_K_M0.0 GB
QW
Qwen3.5 9B Claude 4.6 HighIQ THINKING HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
HU
HunyuanVideo
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
LF
LFM2 350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwopus3.5 4B Coder MTP HF
Qwen · Jackrong
Params334M
Context256K
Q4_K_M2.8 GB
MI
Mistral Small 4 119B ROCmFP4
Mistral · kingjones777
Params119B
Context1024K
Smallest67.7 GB
PA
parakeet tdt 0.6b v3
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
SE
Serenity 26B A4B
Serenity · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
KI
MythoMax L2 Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CH
chatterbox
Chatterbox · calcuis
Params264M
Context—
Q4_K_M0.3 GB
RO
Rocinante 12B v1.1
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
HO
Holo4 35B A3B
Holo · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
LA
latxa-7b-v1.2
Latxa · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3.5 9B
Qwen · SoAIHQ
Params9.2B
Context256K
Q4_K_M5.8 GB
JI
Hf Jinen v2 Small
Jinen · togatogah
Params110M
Context1K
Q4_K_M0.1 GB
LI
Ling 3.0 tiny
Ling · NANI-Nithin
Params7.89B
Context128K
Q4_K_M4.8 GB
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
HU
HunyuanVideo 1.5 I2V 720p
Hunyuanvideo · jayn7
Params8.33B
Context—
Q4_K_M5.1 GB
MI
Source Hf Minicpm V 4.7 1b
MiniCPM · ngquocvinh
Params1.01B
Context256K
Q4_K_M0.7 GB
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Andy 4.2
Qwen · Mindcraft-CE
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · Youssofal
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
ehartford_dolphin-2.2.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 4B Abliterated
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
WA
Wan2.1 VACE 1.3B
Wan · samuelchristlie
Params2.15B
Context—
Q4_K_M1.5 GB