Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Reranker 8B
Qwen · QuantFactory
Params8.2B
Context40K
Q4_K_M5.0 GB
Embedding
LO
louisbrulenaudet Maxine 7B 0401 stock
Louisbrulenaudet · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DR
DreadPoor Harpy 7B Model Stock
Dreadpoor · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Coding
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
UC
UCLA AGI zephyr 7b sft full SPIN iter2
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NI
NicholasCorrado zephyr 7b uf rlced conifer dpo 2e
Nicholascorrado · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
LL
Dolphin 3.0 Llama 3.2 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingTool use
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
ME
Megamind v2 VL high
Megamind · digitranslab
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NO
notus 7b v1
Notus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
T5 Base
Base · chatpig
Params223M
Context512
Q4_K_M0.1 GB
Coding
KU
KukulStanta InfinityRP 7B slerp
Kukulstanta · AlekseiPravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
vicgalle Configurable Janus 7B
Vicgalle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MI
failspy Codestral 22B v0.1 abliterated v3
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
MI
AmeerH Mistral Math 2x7b mix
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
GE
Gemma 2 27b It Abliterated
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 8B TKK Elite V1.0
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
stable diffusion 3.5 large turbo
Stable · city96
Params8.15B
Context—
Smallest4.8 GB
GGUF
WH
whisper base
Whisper · oxide-lab
Params73M
Context—
Smallest0.0 GB
GGUF
WA
PORNHUBAI
Wan · Boombaaa
Params5.25B
Context—
Q4_K_M3.9 GB
GGUF
LL
Llama 3.2 Taiwan 3B Instruct
Llama · lianghsun
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
Yarn-Llama-2-7b-128k
Llama · duyntnet
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
GR
Granite 20b Code Base 8k
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
Coding

Other quants

Keep browsing