GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
MoE Girl 800MA 3BT
Granite · QuantFactory
Params3.3B
Context8K
Q4_K_M2.0 GB
Roleplay
AR
Arcee Scribe
Arcee · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama 3.2 Taiwan 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Reasoning
LL
Llama 3.1 Minitron 4B Depth Base
Llama · QuantFactory
Params4.54B
Context128K
Q4_K_M2.8 GB
GGUF
ME
mem agent
Mem · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
GGUF
QW
oxy 1 micro
Qwen · QuantFactory
Params1.78B
Context32K
Q4_K_M1.1 GB
Roleplay
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
LLaMA3 iterative DPO final
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OneLLM Doey V1 Llama 3.2 1B it
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
gemma 2 9b it DPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GE
Gemma 2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Ellaria 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
TE
Teuken 7B instruct commercial v0.4
Teuken · QuantFactory
Params8.48B
Context4K
Q4_K_M5.6 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · QuantFactory
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool use
LL
Llama 3.1 Korean 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
instinct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Q25 1.5B VeoLu
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
GE
Apollo2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
LLaMA 2 7B 32K
Llama · QuantFactory
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
HA
Hathor Stable v0.2 L3 8B
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi 4
Phi · QuantFactory
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
LL
Llama Magpie 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
QW
Arcee VyLinh
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2 Math 7B Instruct
Qwen · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
TI
TIPO 500M
Tipo · QuantFactory
Params508M
Context2K
Q4_K_M0.3 GB
Vision
LL
Llama 3.1 Tulu 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing