GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Fireball Alpaca Llama3.1.08 8B Philos C R1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GE
turkish gemma9b v0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SE
Sekhmet Bet L3.1 8B v0.2
Sekhmet · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HA
Hathor RP v.01 L3 8B
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
MN 12B Starcannon v2
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2 7B Multilingual RP
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
MI
OpenHermes Emojitron 001
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
TI
TITPOP 200M dev
Titpop · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
QW
Samantha Qwen 2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
ME
MentaLLaMA chat 7B
Mentallama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AR
ArrowPro 7B KillerWhale
Arrowpro · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
VI
Violet Twilight v0.1
Violet · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DA
L3 Dark Planet 8B
Dark · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SQ
sqlcoder 7b
Sqlcoder · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
UM
L3 Umbral Mind RP v1.0 8B
Umbral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3 Alpha Ko 8B Evo
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NI
L3.1 Niitorm 8B DPO t0.0001
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral Nemo Prism 12B v7
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Templare 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FI
Fimbulvetr 11B v2.1 16K
Fimbulvetr · QuantFactory
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
MI
mistral nemo gutades 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SO
SOVL Mega Mash V2 L3 8B
Sovl · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 2.1 Uncensored 1048K
Llama · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Llama Spark
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 medium 4k instruct abliterated v3
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
Coding
NI
L3.1 8B Niitama v1.1
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
LLaMA Pro 8B Instruct
Llama · QuantFactory
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
GE
Gemma 2 Ataraxy 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GR
granite guardian 3.0 2b
Granite · QuantFactory
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF

Keep browsing