Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
WA
Phantom Wan 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
MI
Dolphin-Mistral-24B-Venice-Edition
Mistral · Mungert
Params23.6B
Context32K
Q4_K_M14.5 GB
PH
Phi 3 Mini 4k Instruct
Phi · SanctumAI
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
YI
Yi 34B 200K DARE Merge v7
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
ST
L3 SthenoMaidBlackroot 8B V1
Sthenomaidblackroot · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
TH
TheSpice-7b-FT-v0.3.1
Thespice · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
FLUX.1 Fill dev
Flux · second-state
Params11.9B
Context—
Smallest4.2 GB
LL
PiSSA Llama 2 7b R128
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · RichardErkhov
Params34.4B
Context128K
Q4_K_M20.7 GB
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
WA
Wan2.2 TI2V 5B
Wan · squirrelae
Params5B
Context—
Q4_K_M3.4 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · crusoeai
Params34.4B
Context32K
Q4_K_M20.7 GB
GR
granite-4.0-micro-base
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
PH
Phi 3.5 Mini Instruct
Phi · duyntnet
Params3.82B
Context128K
Q4_K_M2.4 GB
GL
GLM 4.7 Flash
GLM · evilfreelancer
Params29.9B
Context198K
Q4_K_M18.1 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen Image Edit 2511
Qwen · w3ss
Params20.4B
Context—
Q4_K_M13.2 GB
FL
Flux Fusion DS merge gguf nf4 fp4 fp8 fp16
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
CL
ClaudioItaly Evolutionstory 7B v3.0
Claudioitaly · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
YuisekinAI Mistral 0.7B
Mistral · RichardErkhov
Params746M
Context4K
Q4_K_M0.5 GB
MI
flammenai flammen15X mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Yi Coder 1.5B
Coder · QuantFactory
Params1.48B
Context128K
Q4_K_M1.0 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · bullerwins
Params25.2B
Context256K
Q4_K_M16.8 GB
MI
speechless-mistral-six-in-one-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Kukedlc NeuralSynthesis 7B v0.3
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB