Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
mlfoundations dev stackoverflow 5000tasks .25p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
thkim0305 Meta Llama3 8B Circuit breaker
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLAR-10.7B-Instruct-SOLARC-M-10.7B-slerp
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
Coding
QW
Qwen3-1.7B
Qwen · Mungert
Params2.03B
Context40K
Q4_K_M1.4 GB
ReasoningTool use
IN
InternLM2
InternLM · duyntnet
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
BR
BroAlanTaps GPT2 large 4 62000steps
Broalantaps · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
GGUF
MO
Mondhirch Natural Language to Cypher 2.7b
Mondhirch · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SA
SakanaAI EvoLLM JP v1 7B
Sakanaai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RA
RaushanTurganbay GPT2 sft and dpo tuned
Raushanturganbay · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
QW
Qwen2 Math 7B Instruct
Qwen · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
QW
Qwen2 0.5B Instruct
Qwen · Goekdeniz-Guelmez
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
DA
Dans DiscountModels Dans Instruct Mix 8b ChatML V0.0.1
Dans · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
BM25Chunk
Chunk · RichardErkhov
Params1.35B
Context8K
Q4_K_M0.9 GB
GGUF
TI
TIPO 500M
Tipo · QuantFactory
Params508M
Context2K
Q4_K_M0.3 GB
Vision
MI
Mistral 7B Base SFT SimPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
phildunphy14 llama 3 1 non quant 8b 55k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
arnavgrg codellama 13b instruct nf4 fp16 upscaled
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QW
Qwen3 58B Embiggened
Qwen · QuixiAI
Params58B
Context40K
Q4_K_M38.2 GB
GGUF
PH
grounded ai phi3.5 rag relevance judge merge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Layerskip Llama3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
JP
jpalgo jp 3k shlow qft v1
Jpalgo · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Vikhr-Llama-3.2-1B-Instruct-abliterated
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
OC
occiglot 7b it en instruct
Occiglot · mayflowergmbh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LordNoah Alpaca spin gpt2 e1 se0
Lordnoah · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
LL
AIML GEEK promptv5 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen2.5 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
BL
Bloom 1b1
Bloom · RichardErkhov
Params1.45B
Context2K
Q4_K_M1.0 GB
GGUF
AV
avibe
Avibe · NightForger
Params7.9B
Context32K
Q4_K_M4.8 GB
Tool use
DP
OGNO 7B
Dpo · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo gpteacher
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Other quants

Keep browsing