Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DO
Dolus 14b Mini
Dolus · QuantFactory
Params11.5B
Context8K
Q4_K_M7.0 GB
Reasoning
LL
llama 3 nvidia ChatQA 1.5 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ER
10Eros Max h3 TURBO hybrid beta3
Eros · electroglyph
Params20.1B
Context—
Smallest13.9 GB
GGUF
GU
GA Guard AIO
Guard · prithivMLmods
Params4.02B
Context250K
Q4_K_M0.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
HE
0 hero Matter 0.1 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
HE
0 hero Matter 0.1 Slim 7B B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LE
Lewd Sydney 20B
Lewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
UN
Unholy v2 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AP
AppleSauce L2 13B
Applesauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 4B Base
Qwen · titan0115
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · mmnga
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
DA
Daredevil 8B abliterated
Daredevil · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
BatsResearch Llama 3.1 8B bonito v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
fpham_karen_theeditor_v2_strict_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3_3-Nemotron-Super-49B-v1_5
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.6 GB
ReasoningTool use
YI
Yi 1.5 9B 32K
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
DE
Llama3.1 8B PRM Deepseek Data
DeepSeek · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MA
MAmmoTH2 8B
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Execute
Qwen · EXECUTE-2026
Params7.62B
Context128K
Q4_K_M9.4 GB
CodingTool use
DE
deepseek-coder-6.7b-base
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GE
Gemma 7b
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FL
flux dev de distill
Flux · BigStationW
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
IN
Infinity Parser2 Flash
Infinity · prithivMLmods
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision

Other quants

Keep browsing