Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
DE
DeepMedix-R1
Deepmedix · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
ReasoningTool use
LL
Pair Preference Model LLaMA3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 7b
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
PY
Pythia-160M-Deduped-Adventure
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6 x8 MoE
Tinyllama · tsunemoto
Params6.43B
Context2K
Q4_K_M3.6 GB
GGUF
LU
Lucy-128k
Lucy · Menlo
Params1.72B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
aialt MMedL3 MI
Aialt · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
it-5.4-fp16-orpo-v2
Orpo · Vikhrmodels
Params7.63B
Context32K
Q4_K_M4.6 GB
GGUF
QW
nirusanan Qwen2.5 1.5B NextJs code GGUF smashed
Qwen · PrunaAI
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
MA
Maverick 7B imatrix
Maverick · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
granite-4.0-h-tiny
Granite · Mungert
Params6.94B
Context1024K
Q4_K_M4.3 GB
Tool use
MO
Monero WizardLM 30B Uncensored Guanaco SuperCOT 30b
Monero · RichardErkhov
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
FA
Falcon
Falcon · RichardErkhov
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
cognitivecomputations dolphin 2.9.2 qwen2 72b GGUF smashed
Qwen · PrunaAI
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
TR
trojblue gpt2 prompt upscaler v1
Trojblue · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
WI
WizardMath 7B V1.1
Wizardmath · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
starcoder2-3b
StarCoder · RichardErkhov
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
QW
online-dpo-qwen2-2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 3.1 OpenScholar 8B
Llama · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NX
Nxcode CQ 7B orpo
Nxcode · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
Coding
FA
Falcon
Falcon · RichardErkhov
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
CH
Chatty Harry V3.0
Chronos · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
OC
occiglot 7b de en instruct
Occiglot · mayflowergmbh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Hercules 5.0 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ET
ethzanalytics ai msgbot gpt2 XL dialogue
Ethzanalytics · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
LL
rasa cmd gen codellama 13b calm demo
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding

Other quants

Keep browsing