Q8_0 GGUF models
8-bit quant. Near-lossless, at roughly twice the size of a 4-bit quant. 111847 models have a Q8_0 file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
OR
ddh0_orcamaidxl-17b-32k
Orcamaidxl · TheBloke
Params17.5B
Context32K
Q4_K_M10.5 GB
LT
ltxv 13b 0.9.7 dev
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
MI
mlabonne_neuralhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
Realistic Vision V6.0 B1
Realistic · second-state
Params1.07B
Context—
Smallest1.5 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
EU
EuroLLM 9B Instruct
Eurollm · bartowski
Params9.15B
Context4K
Q4_K_M5.6 GB
WI
ehartford_wizardlm-7b-v1.0-uncensored
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
NE
NeoHorse 1 4B
Neohorse · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 4B EmperoAI Qwen3.8 Distill
Qwen · insraq
Params4.33B
Context256K
Q4_K_M2.8 GB
OR
Ornith 1.5 35B A3B uncensored
Ornith · ressl
Params35.5B
Context256K
Q4_K_M21.7 GB
AM
AMALIA 9B 0626 SFT
Amalia · NoxNotreve
Params9.15B
Context32K
Q4_K_M5.6 GB
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
GR
Granite 34b Code Instruct 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
RW
rwitz_go-bruins-v2
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
FR
FrogNano 4B 2609
Frognano · NANI-Nithin
Params4.33B
Context256K
Q4_K_M2.8 GB
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
AN
Anubis Mini 8B v1
Anubis · bartowski
Params8B
Context128K
Q4_K_M5.1 GB
AI
Airochronos L2 13B
Airochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
QwQ 32B Abliterated
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
CA
canary ctc aligner
Canary · cstr
Params626M
Context—
Smallest0.4 GB
NO
nomic-embed-text-v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
LL
ShiningValiantXS 1.1
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
JI
Jina Embeddings v5 Text Nano Classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
PO
Pony Diffusion V6 XL
Pony · morikomorizz
Params2.57B
Context—
Smallest2.7 GB
QW
calme-2.2-qwen2-72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
NO
Novel Humanize 4b
Novel · bartowski
Params4.02B
Context40K
Q4_K_M2.6 GB
QW
Qwen3Vl 235b A22B Instruct
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B heretic ara i1
Nemotron · spiritfather
Params121B
Context1024K
Q4_K_M86.1 GB