Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama3
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
IC
ichigoberry pandafish 2 7b 32k
Ichigoberry · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gervasio-7b-portuguese-ptpt-decoder
Gervasio · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
PH
edumunozsala phi3 mini 4k qlora python code 20k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
DP
J.O.S.I.E.V4O 1.5b Dpo Stage1 v1
Dpo · Goekdeniz-Guelmez
Params1.5B
Context32K
Q4_K_M1.0 GB
GGUF
HE
Heejindo rationale model e10 save5000 eos
Heejindo · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
pair preference model LLaMA3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
QW
Krx Qwen2 7b Instruct v2
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CH
ChaoticNeutrals Eris PrimeV4 Vision 7B
Chaoticneutrals · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
CL
Climategpt 7b
Climategpt · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.0 1b
Granite · mrutkows
Params1.63B
Context128K
Q4_K_M1.0 GB
Tool use
PO
Polaris 4B Preview
Polaris · dzur658
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
BU
Buddy 2B v1
Buddy · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
AI Sweden Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3n E4B It
Gemma · muranAI
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
SO
SOLAR 10B Nector DPO Jawade
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-1431k-3T-laser-dpo
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
SmallThinker 3B Preview
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
Reasoning
LL
LLaMAntino 2 Chat 13b Hf UltraChat ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2-0.5B-OnlineDPO-GRM-Gemma
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
UN
universeTBD astrollama 7b chat alpha
Universetbd · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
stable diffusion inpainting
Stable · genai-archive
Params1.07B
Context—
Smallest2.1 GB
GGUF
CR
crestf411 L3.1 8B sunfall stheno v0.6.1
Crestf · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NA
Nanbeige2 16B Chat
Nanbeige · RichardErkhov
Params15.8B
Context4K
Q4_K_M9.6 GB
GGUF
GE
Gemma 2 Ifable 9B
Gemma · Hampetiudo
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GR
MoE Girl 800MA 3BT
Granite · QuantFactory
Params3.3B
Context8K
Q4_K_M2.0 GB
Roleplay
AR
Arcee Scribe
Arcee · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
BR
BroAlanTaps GPT2 large 64 20000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF

Other quants

Keep browsing