Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 8B Web
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PY
Pydevmini1
Pydevmini · duyntnet
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
PH
phi 2
Phi · andrijdavid
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
XX
t5 v1 1 xxl old encoder
Xxl · chatpig
Params4.86B
Context—
Q4_K_M2.7 GB
GGUF
GP
gpt2-large
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
DE
Deepseek Coder 6.7b Chat
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
CodingTool use
LF
LFM2.5 230M Uncensored
Lfm · Null-Guard
Params230M
Context125K
Q4_K_M0.2 GB
ReasoningTool use
OL
akrishnan TOFU olmo 7b ft full 25epochs lr1e 05 seed42 run1
OLMo · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
LU
Lucy
Lucy · Menlo
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3.5 0.8B Uncensored
Qwen · Null-Guard
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
LL
AndreyRzhaksinskiy CDS CodeLlama 7b 20241112 pretrain
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Tor 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
GGUF
MI
JJhooww Mistral 7B v0.2 Base ptbr
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VO
vox jot models
Vox · IrieDinamik
Params4.43B
Context—
Q4_K_M2.9 GB
GGUF
FL
FLUX.2 klein 9B
Flux · Yuro1991
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
ZE
Zephyr 7b Beta_Bio Tutor_Dpo
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nex-N2-mini
Nex · Mungert
Params34.7B
Context256K
Q4_K_M21.8 GB
ReasoningTool use
DA
DaringMaid-20B-V1.1
Daringmaid · RichardErkhov
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MI
mistral-7b-dolphin-sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
ST
Starcoderbase 1b
StarCoder · RichardErkhov
Params1.14B
Context8K
Q4_K_M0.8 GB
Coding
FI
Fimbulvetr-11B-v2
Fimbulvetr · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
laser-dolphin-mixtral-4x7b-dpo
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
SP
speakleash Bielik 7B v0.1 GGUF smashed
Speakleash · PrunaAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GE
gemma-1.1-7b-it
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
DO
DolphinStar-12.5B
Dolphinstar · RichardErkhov
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
HE
Heejindo rationale model e10 save5000
Heejindo · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QU
quant type
Quant · gguf-org
Params—
Context—
Q4_K_M0.0 GB
GGUF

Other quants

Keep browsing