GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GE
gemma 2b it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mistral 7B Base SFT SimPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
GRMR 2B Instruct old
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
reflection llama 3.1 8B Solshine Full
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 mini 4k instruct Matter 0.1 Slim A
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.3 GB
ME
Meltemi 7B Instruct v1.5
Meltemi · QuantFactory
Params7.48B
Context32K
Q4_K_M4.5 GB
AS
L3 Aspire Heart Matrix 8B
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
MMed Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
MN Chunky Lotus 12B
Violet · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Llama3.1 8B Fireplace2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Sailor2 1B Chat
Sailor · QuantFactory
Params988M
Context32K
Q4_K_M0.7 GB
MI
Pantheon Rp 1.6 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
MyAlee Qwen Instruct v2 16k v1
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama3.1 8B Cobalt
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
HomerCreativeAnvita Mix Qw7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Clinical BR LlaMA 2 7B
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
SM
Biggie SmoLlm 0.15B Base
SmolLM · QuantFactory
Params152M
Context2K
Q4_K_M0.1 GB
GE
gemma 2 2b it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
EU
EuroLLM 9B
Eurollm · QuantFactory
Params9.15B
Context4K
Q4_K_M5.6 GB
BA
Bamboo base v0.1
Bamboo · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GE
Gemma Ataraxy Dare 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 4B Thinking 2507
Qwen · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
Qwen2 0.5B
Qwen · QuantFactory
Params494M
Context128K
Q4_K_M0.4 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · QuantFactory
Params2.67B
Context32K
Q4_K_M1.6 GB
QW
Qwen2.5 Math 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
deepseek math 7b rl
DeepSeek · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 ArrowSE v0.4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB