Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
OLMoE 1B 7B 0924 Instruct
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
ST
Starcoder2 15b Fp16
StarCoder · RichardErkhov
Params16B
Context16K
Q4_K_M9.9 GB
Coding
PY
pythia_2.8b_deduped-task065_timetravel_consistent_sentence_classification
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
microsoft Phi 3 medium 128k instruct
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
LL
jc9080 llama3 open ko 8b Instruct shimshimi 500 ver2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DR
dreamshaper lcm
Dreamshaper · acojaco
Params1.07B
Context—
Smallest1.7 GB
GGUF
BI
BioMistral BioMistral 7B DARE
Biomistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hercules 5.0 Qwen2 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
LL
Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Canum med Qwen3 Reasoning
Qwen · prithivMLmods
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama3.2 1b Train Aware Quantization
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
NO
nota ai st vicuna v1.3 5.5b ppl
Nota · RichardErkhov
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF
QW
Qwen2.5 Coder 1.5B
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
QW
nomic-embed-code
Qwen · Mungert
Params7.07B
Context32K
Q4_K_M4.3 GB
CodingEmbeddingTool use
GR
Granite 3.3 8b Base
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
TE
Tensoic TinyLlama 1.1B 2.5T openhermes
Tensoic · RichardErkhov
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
OR
orpheus_3b_0.1_GGUF
Orpheus · Prince-1
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
GE
ko gemma 2 9b it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PR
prometheus eval prometheus bgb 8x7b v2.0
Prometheus · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
IN
Inexpertus 1.1 8B LINEAR i1
Inexpertus · BasedAGI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WH
whisper large v3
Whisper · oxide-lab
Params1.61B
Context—
Smallest0.5 GB
GGUF
PH
Agnuxo Phi 3.5 Trinitron Instruct CODE Python English Asistant 16bit v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
Coding
LF
LFM2.5 350M Uncensored
Lfm · Null-Guard
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool use
OL
OLMoE 1B 7B 0924 Base
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
AR
ArmurAI Pentest AI
Armurai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gemma 3 1b it
Gemma · abcsnoobai
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SE
seyf1elislam WestKunai Hermes 7b
Seyf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CL
Climategpt 7b Fsg
Climategpt · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7B Instruct ORPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing