Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MA
macadeliccc magistrate 3.2 3b it
Macadeliccc · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SQ
sqlcoder
Sqlcoder · QuantFactory
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
GR
Granite 4.0 350m Base
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
FL
Flex.2 preview
Flex · Eviation
Params8.16B
Context—
Smallest1.7 GB
GGUF
LL
Llama 3 Tulu 2 70b
Llama · RichardErkhov
Params70.6B
Context2K
Q4_K_M42.5 GB
GGUF
GR
ClinicalThought AI 8B
Granite · Raymond-dev-546730
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GE
Gemma 2 2B Stheno Filtered
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Llama3 DocChat 1.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 TTS 12Hz 0.6B CustomVoice
Qwen · BricksDisplay
Params652M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 2 7b Pruned50 Retrained
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
KU
Kukedlc SuperMente 7B v4
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 8B Instruct Finance RAG
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
kykim0 Llama 2 7b ultrachat syn
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MY
Maxtopia 13B
Mythomax · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
reflect_llm8B_om2-mstlrg-300k460k-llm33-130k-t12_SFTt1-DPOsPSDPt1_b1
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
SanGuoYanYi 6b
Sanguoyanyi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QI
Qianfan-OCR
Qianfan · Mungert
Params4.42B
Context32K
Q4_K_M3.1 GB
ReasoningVision
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
LL
KISTI KONI KONI Llama3 8B Merged 20240724
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
read1337 Llama 3.1 8B bnb 4bit marketing
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
LL
Llama3.1 8B Esper2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
WI
Wizard Vicuna 13B Uncensored
Wizard · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · QuantFactory
Params12B
Context—
Q4_K_M6.3 GB
GGUF
QW
calme-2.8-qwen2-7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
FL
FLUX.1 schnell Quantized
Flux · aifoundry-org
Params11.9B
Context—
Smallest3.9 GB
GGUF

Other quants

Keep browsing