Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
Lawma 8b
Lawma · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
TE
Teuken 7B instruct research v0.4
Teuken · QuantFactory
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SeaLLM 7B Chat
Seallm · parinzee
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · leeminwaan
Params10.2B
Context128K
Q4_K_M7.7 GB
Tool use
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
QwenLong-L1.5-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool use
GR
Granite 4.0 H Tiny BE
Granite · taronaeo
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GE
Leniachat Gemma 2b v0
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TI
TinySlime-1.1B-v1.0
Tinyslime · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GP
GPT OSS Cybersecurity Merged 20B Heretic Ara
gpt-oss · piotreknow02
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GP
gpt-oss-20b-heretic
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
Tool use
LL
ArliAI Llama 3 8B Cumulus v0.3.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nirosunid Llama 3.1 8B bnb 4bit python v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
ChronoEdit
Chronoedit · vantagewithai
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
EM
EMO 1.5B GGUF smashed
Emo · PrunaAI
Params1.84B
Context4K
Q4_K_M1.2 GB
GGUF
QW
Qwen3.5-2B
Qwen · Mungert
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
DE
deepseek math 7b instruct
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
SK
SkyCaptioner-V1
Skycaptioner · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
Tool use
OW
OWoTGPT 1.3
Owotgpt · Pomni
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Infinity Instruct 7M Gen mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b Chinese it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
MOSS TTS Realtime
Moss · Yanlis
Params2.08B
Context40K
Q4_K_M1.1 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
RuterNorway Llama 2 13b chat norwegian GGUF smashed
Llama · PrunaAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Other quants

Keep browsing