GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
QW
Arch Function 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
PH
phi 3 portuguese tom cat 4k instruct
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GE
gemma 2b
Gemma · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LI
T lite 0.1
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Tess 3 7B SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo gutenberg 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
MI
Pantheon Rp 1.5 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
HY
MegaHyperLlama3.1
Hyperllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Ko 8B Instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Name Classifier Llama3 8B 16b V2.2.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PI
Pip Sql 1.3b
Pip · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
HE
HelpingAI flash
Helpingai · QuantFactory
Params2.24B
Context4K
Q4_K_M1.4 GB
ST
state-0
State · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LF
LFM2 1.2B RAG
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
AR
Arcee Agent
Arcee · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
RE
reader lm 0.5b
Reader · QuantFactory
Params630M
Context250K
Q4_K_M0.5 GB
NI
NIHAPPY L3.1 8B v0.09
Nihappy · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B OmniMatrix
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
sarashina2 7b
Sarashina · QuantFactory
Params7.32B
Context4K
Q4_K_M4.5 GB
GE
gemma portuguese luana 2b
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
LL
Llama3.1 8B ShiningValiant2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Fireball Alpaca Llama3.1 8B Philos
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Bigstral 12b 32k
Mistral · QuantFactory
Params12.5B
Context32K
Q4_K_M7.5 GB
QW
Qwen2 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
LL
Llama 3 8B Instruct 262k
Llama · QuantFactory
Params8.03B
Context256K
Q4_K_M4.9 GB
QW
Arch Agent 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
SM
SmallThinker 3B Preview
Smallthinker · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
HuatuoGPT o1 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB