GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PO
Poppy Porpoise 1.4 L3 8B
Poppy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi 2
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
ST
Starling LM 7B alpha
Starling · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b TitanFusion
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
CodingReasoning
GE
EZO gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 7B Instruct 1M
Qwen · QuantFactory
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
LL
Meta Llama 3 8B GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
shisa 7b v1
Shisa · QuantFactory
Params7.96B
Context32K
Q4_K_M4.9 GB
GGUF
BL
bloom 7b1
Bloom · QuantFactory
Params8.1B
Context4K
Q4_K_M5.3 GB
Coding
MI
Mistral 7B v0.3 Chinese Chat
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MA
Maral 7B alpha 1
Maral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
ArliAI Llama 3 8B Dolfin v0.5
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SE
SeaLLMs v3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Fireball Alpaca Llama 3.1 8B Instruct KTO beta
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BL
bloomz 7b1
Bloomz · QuantFactory
Params8.1B
Context2K
Q4_K_M5.3 GB
Coding
NE
Starcannon Unleashed 12B v1.0
Nemomix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Roci Maxx v2
Mistral · QuantFactory
Params10.3B
Context1000K
Q4_K_M6.3 GB
GGUF
LL
Llama 3 8B WildChat
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
gemma 2b aps it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GR
granite 3.0 3b a800m base
Granite · QuantFactory
Params3.3B
Context4K
Q4_K_M2.0 GB
GGUF
LL
llama3.1 cc 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
dolly v2 12b
Dolly · QuantFactory
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
LL
MagpieLM 4B SFT v0.1
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
GH
Ghost 8b Beta
Ghost · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
MI
Lyra Gutenberg mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PA
StarDust 12b v1
Pantheon · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
Llama 3 8B Ultrachat 200K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FO
Fox 1 1.6B
Fox · QuantFactory
Params1.67B
Context32K
Q4_K_M1.1 GB
GGUF

Keep browsing