Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
GL
Huihui GLM 4.6V Flash Abliterated
GLM · seanbailey518
Params9.4B
Context128K
Q4_K_M6.2 GB
FL
FLUX.2 klein 9B
Flux · drends
Params9.08B
Context—
Q4_K_M5.9 GB
OP
OpenELM-270M-Instruct
Openelm · RichardErkhov
Params272M
Context2K
Q4_K_M0.2 GB
LL
Taigi Llama 2 Translator 7B
Llama · RichardErkhov
Params6.94B
Context4K
Q4_K_M4.2 GB
PH
Phi 3 mini 4k geminified
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
Llama3 German 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
TE
test gguf models
Test · ngxson
Params2B
Context32K
Q4_K_M1.2 GB
LL
Llama OuteTTS 1.0 1B
Llama · OuteAI
Params1.25B
Context128K
Q4_K_M0.8 GB
RE
ReflectionCoder DS 33B
Reflectioncoder · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
LL
Llama 3 Alpha Ko 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
SP
Spark-X2.6-4B
Spark · Mungert
Params4.11B
Context1024K
Q4_K_M2.6 GB
TI
Tinyllama 15M
Tinyllama · QuantFactory
Params15M
Context256
Q4_K_M0.0 GB
GR
granite 3b code base 128k
Granite · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
BA
internistai base 7b v0.2
Base · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spark-X2.5-1.7B
Spark · Mungert
Params1.71B
Context1024K
Q4_K_M1.1 GB
YI
Yi-6B-200K
Yi · duyntnet
Params6.06B
Context195K
Q4_K_M3.7 GB
UC
UCLA AGI zephyr 7b sft full SPIN iter0
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Starcoder2 3b
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
MI
mrm8488 mistral 7b ft AgentInstruct
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
bagel
Bagel · calcuis
Params14.6B
Context—
Q4_K_M8.9 GB
PH
Phi 3 mini 4k instruct
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.3 GB
GP
OpenAi GPT oss 36B BrainStorm20x uncensored
gpt-oss · DavidAU
Params36.6B
Context128K
Smallest21.2 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · ThomasBaruzier
Params4.51B
Context128K
Q4_K_M2.8 GB
MI
MiniCPM-OCR 1.0 DSpark
MiniCPM · openbmb
Params297M
Context256K
Q4_K_M0.2 GB
PH
Phi 3 medium 128k instruct imatrix
Phi · duyntnet
Params14B
Context128K
Q4_K_M8.6 GB
FA
Falcon H1 1.5B Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
LL
dolphin 2.9 llama3 70b GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · RichardErkhov
Params10.9B
Context32K
Q4_K_M6.6 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB