GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Arch Function 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
PH
phi 3 portuguese tom cat 4k instruct
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
GE
gemma 2b
Gemma · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LI
T lite 0.1
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Tess 3 7B SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo gutenberg 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool use
MI
Pantheon Rp 1.5 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
HY
MegaHyperLlama3.1
Hyperllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Ko 8B Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Name Classifier Llama3 8B 16b V2.2.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PI
Pip Sql 1.3b
Pip · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
HE
HelpingAI flash
Helpingai · QuantFactory
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
ST
state-0
State · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LF
LFM2 1.2B RAG
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
GGUF
AR
Arcee Agent
Arcee · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
RE
reader lm 0.5b
Reader · QuantFactory
Params630M
Context250K
Q4_K_M0.5 GB
GGUF
NI
NIHAPPY L3.1 8B v0.09
Nihappy · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B OmniMatrix
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
sarashina2 7b
Sarashina · QuantFactory
Params7.32B
Context4K
Q4_K_M4.5 GB
GGUF
GE
gemma portuguese luana 2b
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Bigstral 12b 32k
Mistral · QuantFactory
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
QW
Qwen2 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 3 8B Instruct 262k
Llama · QuantFactory
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
QW
Arch Agent 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
SM
SmallThinker 3B Preview
Smallthinker · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
QW
HuatuoGPT o1 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use

Keep browsing