GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
PO
Poppy Porpoise 1.4 L3 8B
Poppy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 2
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
ST
Starling LM 7B alpha
Starling · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GE
Gemma 2 2b TitanFusion
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
EZO gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · QuantFactory
Params7.62B
Context986K
Q4_K_M4.7 GB
LL
Meta Llama 3 8B GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SH
shisa 7b v1
Shisa · QuantFactory
Params7.96B
Context32K
Q4_K_M4.9 GB
BL
bloom 7b1
Bloom · QuantFactory
Params8.1B
Context4K
Q4_K_M5.3 GB
MI
Mistral 7B v0.3 Chinese Chat
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
MA
Maral 7B alpha 1
Maral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
ArliAI Llama 3 8B Dolfin v0.5
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
SeaLLMs v3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Fireball Alpaca Llama 3.1 8B Instruct KTO beta
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
BL
bloomz 7b1
Bloomz · QuantFactory
Params8.1B
Context2K
Q4_K_M5.3 GB
NE
Starcannon Unleashed 12B v1.0
Nemomix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Roci Maxx v2
Mistral · QuantFactory
Params10.3B
Context1000K
Q4_K_M6.3 GB
LL
Llama 3 8B WildChat
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
gemma 2b aps it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GR
granite 3.0 3b a800m base
Granite · QuantFactory
Params3.3B
Context4K
Q4_K_M2.0 GB
LL
llama3.1 cc 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
DO
dolly v2 12b
Dolly · QuantFactory
Params11.8B
Context2K
Q4_K_M7.6 GB
LL
MagpieLM 4B SFT v0.1
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GH
Ghost 8b Beta
Ghost · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Lyra Gutenberg mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
PA
StarDust 12b v1
Pantheon · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 8B Ultrachat 200K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
FO
Fox 1 1.6B
Fox · QuantFactory
Params1.67B
Context32K
Q4_K_M1.1 GB