GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 2b it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mistral 7B Base SFT SimPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
GRMR 2B Instruct old
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
reflection llama 3.1 8B Solshine Full
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PH
Phi 3 mini 4k instruct Matter 0.1 Slim A
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
ME
Meltemi 7B Instruct v1.5
Meltemi · QuantFactory
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
AS
L3 Aspire Heart Matrix 8B
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MMed Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
MN Chunky Lotus 12B
Violet · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
Llama3.1 8B Fireplace2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Sailor2 1B Chat
Sailor · QuantFactory
Params988M
Context32K
Q4_K_M0.7 GB
GGUF
MI
Pantheon Rp 1.6 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
MyAlee Qwen Instruct v2 16k v1
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Llama3.1 8B Cobalt
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
HomerCreativeAnvita Mix Qw7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Clinical BR LlaMA 2 7B
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SM
Biggie SmoLlm 0.15B Base
SmolLM · QuantFactory
Params152M
Context2K
Q4_K_M0.1 GB
GGUF
GE
gemma 2 2b it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
EU
EuroLLM 9B
Eurollm · QuantFactory
Params9.15B
Context4K
Q4_K_M5.6 GB
GGUF
BA
Bamboo base v0.1
Bamboo · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
DE
natural sql 7b
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
GE
Gemma Ataraxy Dare 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
Reasoning
QW
Qwen3 4B Thinking 2507
Qwen · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen2 0.5B
Qwen · QuantFactory
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · QuantFactory
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF
QW
Qwen2.5 Math 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
DE
deepseek math 7b rl
DeepSeek · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 ArrowSE v0.4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Minitron 4B Width Base
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
GE
Vikhr-Gemma-2B-instruct
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing