Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
NE
QI-neural-chat-7B-ko-DPO
Neural · joongi007
Params7.24B
Context32K
Q4_K_M4.4 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
WS
WSB GPT 7B
Wsb · tsunemoto
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
CodeLlama 13b Instruct Hf
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
MI
Bitnet-Mistral.0.2-330m-v0.2-grokfast-v2.9
Mistral · RichardErkhov
Params330M
Context4K
Q4_K_M0.2 GB
PH
Phi 3 Mini 128k Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
OL
OLMoE 1B 7B 0924 Instruct Base
OLMo · RichardErkhov
Params6.92B
Context4K
Q4_K_M4.2 GB
QW
Eagle2-2B
Qwen · Mungert
Params1.78B
Context32K
Q4_K_M1.2 GB
EX
EXAONE-Deep-32B
Exaone · Mungert
Params32B
Context32K
Q4_K_M19.3 GB
SM
SmolLM2-135M-Instruct-K12-5000
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
IN
interview eval zephyr 7b math case 8 fixed
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Instruct Mcqa Circuit Broken
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Granite 3.0 3b A800M Base
Granite · RichardErkhov
Params3.37B
Context4K
Q4_K_M2.1 GB
UM
Umt5 Base
Umt · chatpig
Params282M
Context512
Q4_K_M0.2 GB
RE
reflect_llm8B_om2-mstlrg-300k460k-llm33-130k-t12_SFTt1-DPOsPSDPt1_b2.0
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ottis llama3.2 arcLoRaFT
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Meta Llama 3 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
QW
Qwen2 7B Instruct deccp
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
ReAligned Qwen3.5 2B
Qwen · Lazarus-Ai
Params1.88B
Context256K
Smallest1.0 GB
LL
T3Q LLM Product T3Q LLM2 Solar 10.7B v1.0
Llm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
SK
SkyReels V2 I2V 1.3B 540P
Skyreels · ThePun1sher
Params1.56B
Context—
Q4_K_M1.1 GB
QW
CosyVoice3 qwen2.5 0.5b speech
Qwen · Ferraronp
Params642M
Context32K
Q4_K_M0.5 GB
MI
Candle MistralTrix v1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
LL
MathCoder2 Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Lambent qwen2.5 reinstruct alternate lumen 14B
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
JA
Jan-v2-VL-max-Instruct-FP8
Jan · fuutott
Params30.5B
Context256K
Q4_K_M18.6 GB
AL
AlphaMist7B Slr v2
Alphamist · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB