GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
LL
Fireball Alpaca Llama3.1.08 8B Philos C R1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
turkish gemma9b v0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
SE
Sekhmet Bet L3.1 8B v0.2
Sekhmet · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
HA
Hathor RP v.01 L3 8B
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
MN 12B Starcannon v2
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2 7B Multilingual RP
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
WH
WhiteRabbitNeo 13B v1
Whiterabbitneo · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
MI
OpenHermes Emojitron 001
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TITPOP 200M dev
Titpop · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Samantha Qwen 2 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ME
MentaLLaMA chat 7B
Mentallama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
AR
ArrowPro 7B KillerWhale
Arrowpro · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
VI
Violet Twilight v0.1
Violet · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
L3 Dark Planet 8B
Dark · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SQ
sqlcoder 7b
Sqlcoder · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
UM
L3 Umbral Mind RP v1.0 8B
Umbral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Alpha Ko 8B Evo
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NI
L3.1 Niitorm 8B DPO t0.0001
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral Nemo Prism 12B v7
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Templare 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
FI
Fimbulvetr 11B v2.1 16K
Fimbulvetr · QuantFactory
Params10.7B
Context16K
Q4_K_M6.5 GB
MI
mistral nemo gutades 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
SO
SOVL Mega Mash V2 L3 8B
Sovl · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 8B DarkIdol 2.1 Uncensored 1048K
Llama · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Llama Spark
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 medium 4k instruct abliterated v3
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
NI
L3.1 8B Niitama v1.1
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA Pro 8B Instruct
Llama · QuantFactory
Params8.36B
Context4K
Q4_K_M5.1 GB
GE
Gemma 2 Ataraxy 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GR
granite guardian 3.0 2b
Granite · QuantFactory
Params2.53B
Context8K
Q4_K_M1.5 GB