Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
stable code 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Meta-Llama-3-8B-Instruct
Llama · duyntnet
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CO
cohere transcribe ja v0.1
Cohere · TransWithAI
Params2.07B
Context—
Smallest1.5 GB
GGUF
QW
gte-Qwen2-7B-instruct
Qwen · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
GL
GLM 4.7 Flash NEO CODE Imatrix MAX
GLM · DavidAU
Params30B
Context198K
Q4_K_M18.5 GB
CodingReasoning
HA
Harmonic 9B
Harmonic · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IQ
IQuest Coder V1 40B Instruct
Iquest · AaryanK
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingTool use
PH
chrisob94 phi 3 7b dissertation doc chat experiment 10 fold
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
BL
Blue Orchid 2x7b
Blue · QuantFactory
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · sphaela
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
LL
Llama-3-8B-Instruct-64k
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7B KStack
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
CO
Yi Coder 1.5B Chat
Coder · QuantFactory
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
MI
Mistral-7B-Instruct-v0.3
Mistral · SanctumAI
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
JP
jpacifico Chocolatine 14B Instruct 4k DPO
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
phi4
Phi · calcuis
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
MI
MiniCPM3 4B
MiniCPM · QuantFactory
Params4.07B
Context32K
Q4_K_M2.5 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Agent007
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
ST
starchat2 15b v0.1
Starchat · QuantFactory
Params16B
Context16K
Q4_K_M9.9 GB
GGUF
ZE
zephyr-7b-sft-full-SPIN-iter3
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
RoLlama2 7b Base
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
suzume llama 3 8B multilingual
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 14B Instruct 1M
Qwen · duyntnet
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF

Other quants

Keep browsing