Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
WEBGEN-4B-Preview
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
LL
meta llama CodeLlama 34b Instruct hf
Llama · RichardErkhov
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite 3.1 1b a400m instruct
Granite · QuantFactory
Params1.38B
Context128K
Q4_K_M0.9 GB
Tool use
LL
Meta Llama 3 8B Instruct
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 2 7b langchain chat
Llama · shaowenchen
Params6.74B
Context4K
Smallest2.8 GB
GGUF
LL
Lama DPOlphin 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B HomerCreative Mix
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
RoleplayTool use
FL
FLAMA 0.1 3B
Flama · xaviviro
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool use
LL
llama 2 7b langchain chat
Llama · lucianosb
Params6.74B
Context4K
Smallest3.8 GB
GGUF
MI
Magistral-Small-2506-abliterated
Mistral · Mungert
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
K2S3 Mistral 7b v1.0
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Romulus cpt Llama 3.1 8B v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 0.8B BE
Qwen · taronaeo
Params773M
Context256K
Q4_K_M0.5 GB
GGUF
GP
Gpt Oss 20b Heretic
gpt-oss · DzikuPL
Params20.9B
Context128K
Smallest11.8 GB
CodingReasoning
GL
glm 4.7 flash uncensored
GLM · haellsigh
Params29.9B
Context198K
Q4_K_M18.5 GB
ReasoningRoleplayTool use
GE
ajinkya ftpl gemma loan develop 28jan GGUF smashed
Gemma · PrunaAI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · duyntnet
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
BA
baichuan2 7b base
Baichuan · shaowenchen
Params7.51B
Context4K
Smallest3.3 GB
GGUF
QW
Qwen3.5 18B REAP A3B Coding
Qwen · Flagstone8878
Params18.5B
Context256K
Q4_K_M11.4 GB
ReasoningTool use
GR
Granite 4.0 Tiny Preview
Granite · ibm-granite
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
Granite 4.0 Micro BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
JE
JEJUMA 002
Jejuma · joongi007
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
PR
Prometheus 8x7b v2.0
Prometheus · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
GP
Gpt Oss 20b Heretic
gpt-oss · ManuelZnnmc
Params20.9B
Context128K
Smallest11.8 GB
CodingReasoningTool use
GR
Granite 4.0 H 350m Base
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
TI
TinyDolphin 2.8 1.1b
Tinydolphin · tsunemoto
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
QW
Qwen Qwen3.5 2B Base
Qwen · aashish1904
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use

Other quants

Keep browsing