GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
MI
Mistral NeMo Minitron 8B Chat
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GE
Pocket Tiger Gemma 2B v1g
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
RH
rho math 1b v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
ArliAI Llama 3 8B Cumulus v0.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Insanity
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Polaris 4B Preview
Qwen · QuantFactory
Params4.41B
Context128K
Q4_K_M2.7 GB
QW
Teleut 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GR
granite 3.1 3b a800m base
Granite · QuantFactory
Params3.37B
Context128K
Q4_K_M2.1 GB
EU
EuroLLM 1.7B
Eurollm · QuantFactory
Params1.66B
Context4K
Q4_K_M1.0 GB
AR
Art 0 8B
Art · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
ZE
Zenith 4B
Zenith · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
AceReason Nemotron 7B
Nemotron · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
dolphin 2.9.3 mistral 7B 32k
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MA
Matter 0.1 7B
Matter · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 3 8b Instruct Matter 0.1 Slim A
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
Virgil 9B
Dante · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
ArliAI RPMax Formax v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
TO
TooManyMixRolePlay 7B Story V3.5
Toomanymixroleplay · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
lola v1
Lola · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GP
gpt2 xl
Gpt · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
MI
MiniCPM4 0.5B
MiniCPM · QuantFactory
Params509M
Context32K
Q4_K_M0.3 GB
QW
Liberated Qwen1.5 7B
Qwen · QuantFactory
Params7.72B
Context32K
Q4_K_M4.8 GB
QW
Q2.5 Veltha 14B
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Gemma 2 Ataraxy v4a Advanced 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
BA
BabyMistral
Babymistral · QuantFactory
Params1.55B
Context8K
Q4_K_M0.9 GB
DE
Polaris 7B Preview
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2 1.5b Instruct Replete Adapted
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB