Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
MI
MiniMA-3B
Minima · duyntnet
Params3.02B
Context4K
Q4_K_M1.8 GB
MI
MiMo-Embodied-7B
Mimo · Mungert
Params7.62B
Context125K
Q4_K_M5.1 GB
GE
Gemma 3 1B IT
Gemma · brittlewis12
Params1B
Context32K
Q4_K_M0.8 GB
CO
Control Nanuq 8B
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GR
granite 3.1 8b instruct
Granite · QuantFactory
Params8.37B
Context128K
Q4_K_M5.1 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
TH
TherapyBeagle 11B v1
Therapybeagle · QuantFactory
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Lily Cybersecurity 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
LF
LFM2-2.6B-Exp
Lfm · Mungert
Params2.7B
Context125K
Q4_K_M1.7 GB
MI
Linkbricks Horizon AI Korean Advanced 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 0.6B Heretic
Qwen · wfen
Params596M
Context40K
Q4_K_M0.4 GB
MI
mistral nemo gutenberg 12B v3
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
ST
sd3.5 large turbo
Stable · calcuis
Params8.15B
Context—
Smallest4.8 GB
SA
saishf SOVLish Maid L3 8B
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
PranavHarshan NarraLarge
Pranavharshan · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Codestral-22B-v0.1
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
LL
Llama 3.2 1b
Llama · callgg
Params1.24B
Context128K
Q4_K_M0.8 GB
CO
Yi Coder 9B Chat Instruct TIES
Coder · RichardErkhov
Params28.3B
Context128K
Q4_K_M17.1 GB
LL
namespace Pt Llama 3 8B Instruct 80K QLoRA Merged
Llama · RichardErkhov
Params8.03B
Context80K
Q4_K_M4.9 GB
LL
Pantheon RP 1.0 8b Llama 3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
MediX R1 30B
Medix · MBZUAI
Params30.5B
Context256K
Q4_K_M18.6 GB
YI
Yi-1.5-9B-Chat
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GE
gemma-2b-it
Gemma · asedmammad
Params2.51B
Context8K
Q4_K_M1.5 GB
ST
Starling-LM-11B-alpha
Starling · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GG
ggml CLIP ViT H 14 laion2B s32B b79K
Ggml · mys
Params986M
Context—
Smallest0.2 GB
LL
Configurable-Llama-3-8B-v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
LFM2 350M Math
Lfm · QuantFactory
Params422M
Context125K
Q4_K_M0.3 GB
QW
Josiefied Qwen2.5 Coder 7B Instruct Abliterated v1
Qwen · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
ReAligned Qwen3.5 0.8B
Qwen · Lazarus-Ai
Params752M
Context256K
Smallest0.4 GB