Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2 1.5B Ita
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.1 8B Instuct Uz
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
Dolus 14b Mini
Dolus · QuantFactory
Params11.5B
Context8K
Q4_K_M7.0 GB
LL
llama 3 nvidia ChatQA 1.5 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
BI
BioinspiredLLM
Bioinspiredllm · lamm-mit
Params13B
Context4K
Q4_K_M7.9 GB
GU
GA Guard AIO
Guard · prithivMLmods
Params4.02B
Context250K
Q4_K_M0.4 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
HE
0 hero Matter 0.1 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes 3 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
HE
0 hero Matter 0.1 Slim 7B B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 4B Base
Qwen · titan0115
Params4.21B
Context256K
Q4_K_M2.7 GB
DA
Daredevil 8B abliterated
Daredevil · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
BatsResearch Llama 3.1 8B bonito v1
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3_3-Nemotron-Super-49B-v1_5
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.6 GB
YI
Yi 1.5 9B 32K
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
DE
Llama3.1 8B PRM Deepseek Data
DeepSeek · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
MAmmoTH2 8B
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
deepseek-coder-6.7b-base
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GE
Gemma 7b
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
FL
flux dev de distill
Flux · BigStationW
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Replete AI_Replete LLM Qwen2 7b_Beta Preview
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
PL
Plamo 2 Translate
Plamo · mitmul
Params9.53B
Context10240K
Q4_K_M6.3 GB
GE
Gemma 3 4B IT
Gemma · brittlewis12
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
OpenBioLLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
math shepherd mistral 7b prm
Mistral · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
YI
Yi-1.5-9B-32K
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
KU
kukulemon-spiked-9B
Kukulemon · RichardErkhov
Params8.99B
Context8K
Q4_K_M5.4 GB