Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen3.8 27B abliterated MTP
Qwen · hotdogs
Params27B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
XI
Xing4.0 29B A4B
Xing · XingChen-AGI
Params31.2B
Context256K
Smallest0.2 GB
XX
encoder
Xxl · chatpig
Params219M
Context512
Q4_K_M2.9 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
OR
Ornith 1.5 9b Mtp
Ornith · protoLabsAI
Params456M
Context256K
Q4_K_M5.8 GB
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
NE
NeoHorse-1-4B
Neohorse · TokenRhythm
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
WI
ehartford_wizard-vicuna-13b-uncensored
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LF
LiquidAI_LFM2.5 1.2B Instruct
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.2 8X4B MOE V2 Dark Champion Instruct uncensored abliterated 21B
Llama · DavidAU
Params20.9B
Context128K
Q4_K_M12.9 GB
GL
Glm-4-9B-0414
GLM · unsloth
Params9.4B
Context32K
Q4_K_M6.2 GB
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
MI
minimax_music3_dit_Q6_K
Minimax · ChrisColeTech
Params7.61B
Context—
Smallest2.1 GB
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FU
Fun ASR Nano
Fun · FunAudioLLM
Params234M
Context—
Smallest0.5 GB
MI
MiniCPM5 2B Math
MiniCPM · Caldalis
Params2.52B
Context128K
Q4_K_M1.6 GB
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB