Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
GE
gemma2 gutenberg 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GP
Gpt Oss 20b Heretic
gpt-oss · botp
Params20.9B
Context128K
Smallest11.8 GB
QW
leniachat qwen2 1.5B v0
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
EZO Common 9B gemma 2 it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 2 9b it SimPO rudpo
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LF
LFM2 1.2B Tool
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
GE
dolphin 2.8 gemma 2b
Gemma · Goekdeniz-Guelmez
Params3.03B
Context8K
Q4_K_M1.9 GB
PO
Poro 34B Chat
Poro · RichardErkhov
Params35.1B
Context7K
Q4_K_M22.4 GB
GE
thusinh1969 gemma2 2b rerank checkpoint 8800
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
PH
Phi-4-reasoning
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
LL
scb10x llama 3 typhoon v1.5x 8b instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
MAmmoTH2 8B Plus
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
TheDrummer Big Tiger Gemma 27B v1
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
Laim Llama 3.1 MedPalm2 imitate 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3_0.6B
Qwen · Open4bits
Params752M
Context40K
Q4_K_M0.5 GB
LL
sepctrum ties sqlcoder 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
alpindale pygmalion instruct
Alpindale · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
SA
SAINEMO reMIX
Saiga · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
FL
FLUX.1 Fill dev
Flux · akikuli
Params11.9B
Context—
Smallest5.2 GB
CH
CheckGPT SOLAR 10.7B
Checkgpt · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
Gemma 2 9b It
Gemma · ThomasBaruzier
Params9.24B
Context8K
Q4_K_M5.8 GB
LF
LFM2-1.2B-Extract
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
LF
LFM2.5-1.2B-Base
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
LL
ArliAI Llama 3 8B Cumulus v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 6B v0
Llama · RichardErkhov
Params6.29B
Context8K
Q4_K_M3.9 GB
SA
SauerkrautLM 1.5b
Sauerkrautlm · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
PY
Pyxidis Manim CodeGen 1.7B
Pyxidis · prithivMLmods
Params1.72B
Context40K
Q4_K_M1.1 GB