GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GR
MoE Girl 800MA 3BT
Granite · QuantFactory
Params3.3B
Context8K
Q4_K_M2.0 GB
AR
Arcee Scribe
Arcee · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
LL
Llama 3.2 Taiwan 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama 3.1 Minitron 4B Depth Base
Llama · QuantFactory
Params4.54B
Context128K
Q4_K_M2.8 GB
ME
mem agent
Mem · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
oxy 1 micro
Qwen · QuantFactory
Params1.78B
Context32K
Q4_K_M1.1 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
LLaMA3 iterative DPO final
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OneLLM Doey V1 Llama 3.2 1B it
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
gemma 2 9b it DPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Ellaria 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
TE
Teuken 7B instruct commercial v0.4
Teuken · QuantFactory
Params8.48B
Context4K
Q4_K_M5.6 GB
FA
Falcon3 10B Instruct
Falcon · QuantFactory
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
LL
Llama 3.1 Korean 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
instinct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Q25 1.5B VeoLu
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
Apollo2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
LLaMA 2 7B 32K
Llama · QuantFactory
Params6.74B
Context32K
Q4_K_M4.1 GB
HA
Hathor Stable v0.2 L3 8B
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 4
Phi · QuantFactory
Params14.7B
Context16K
Q4_K_M9.1 GB
LL
Llama Magpie 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
Arcee VyLinh
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2 Math 7B Instruct
Qwen · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
TI
TIPO 500M
Tipo · QuantFactory
Params508M
Context2K
Q4_K_M0.3 GB
LL
Llama 3.1 Tulu 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB