Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
gemma 2b GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
CO
Yi Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
DE
Delexa-Instruct-V0.1-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
Reasoning
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · RichardErkhov
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
CH
Ph3della3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen3 TTS 12Hz 1.7B CustomVoice
Qwen · BricksDisplay
Params694M
Context32K
Q4_K_M1.1 GB
GGUF
AN
Anything
Anything · mzwing
Params1.07B
Context—
Smallest1.3 GB
GGUF
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
FA
FastHunyuan
Fasthunyuan · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k GGUF v2
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B EZO 1.1 it
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
JA
Jais Adapted 7b Chat
Jais · QuantFactory
Params7B
Context4K
Q4_K_M4.3 GB
Coding
AL
Alpha Orionis v0.1
Alpha · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alphacode AI AlphaMist7B slr v3
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
MythoMax L2 13b
Mythomax · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TU
Turkcell LLM 7b v1
Turkcell · QuantFactory
Params7.38B
Context32K
Q4_K_M4.5 GB
GGUF
IN
Intel neural chat 7b v3 1
Intel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · RemySkye
Params34.7B
Context256K
Q4_K_M21.2 GB
Coding
MI
Mika 7B
Mika · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NI
L3.1 Celestial Stone 2x8B
Niitama · QuantFactory
Params13.7B
Context128K
Q4_K_M8.3 GB
GGUF

Other quants

Keep browsing