Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
QW
Arch Agent 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
UM
v000000 L3 Umbral Storm 8B t0.0001
Umbral · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
SmallThinker 3B Preview
Smallthinker · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
ST
StructLM 7B
Structlm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
HuatuoGPT o1 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
mistral nemo gutenberg 12B v4
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
medius erebus magnum 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Holo-3.1-4B
Qwen · Mungert
Params4.84B
Context256K
Q4_K_M3.6 GB
CH
Chatntq Ja 7b v1.0
Chatntq · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GE
gemma 7b aps it
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
QW
Josiefied-Qwen3-8B-abliterated-v1
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.1 GB
MI
Mistral Nemo Japanese Instruct 2408
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
gemma-3-27b-it-codeforces-SFT
Gemma · BasedAGI
Params27B
Context128K
Q4_K_M16.5 GB
MO
moody porn mix v10 dpo
Moody · Gthalmie1
Params6.15B
Context—
Q4_K_M5.0 GB
QW
Qwen3 Embedding 0.6B Bf16
Qwen · Mungert
Params596M
Context32K
Q4_K_M0.4 GB
LL
AIML GEEK prompt finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
NO
Nous-Hermes-2-SOLAR-10.7B
Nous · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
SK
SkyReels V2 DF 1.3B 540P
Skyreels · ThePun1sher
Params1.44B
Context—
Q4_K_M1.0 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
SK
SkyReels V2 I2V 14B 540P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
BO
Boris 75M Instruct
Boris · opencerebral
Params77M
Context1K
Q4_K_M0.1 GB
LL
cais HarmBench Llama 2 13b cls
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
JS
jstredacted gamma 2b instruct ft awesome chatgpt prompts
Jstredacted · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
LT
ltxv0.9.5
Ltx · calcuis
Params1.92B
Context—
Q4_K_M1.1 GB
QW
Qwen2.5 3B Instruct
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
UIGEN X 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
EM
emailgen-pythia-410m-deduped
Emailgen · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
PH
TroyDoesAI Phi 3 Context Obedient RAG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB