GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
Matter 0.1 7B DPO preview
Matter · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NexusRaven V2 13B
Nexusraven · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Evil Alpaca 3B L3.2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
llama3 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
magnum v2 4b
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
llama 3.1 medprm reward v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
polanka qwen2 1.5b v0.1 ckpt 401000
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
LL
Sparse Llama 3.1 8B 2of4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
BI
Biomistral Calme Instruct 7b
Biomistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3-ChatQA-1.5-8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
FA
Falcon 11B
Falcon · QuantFactory
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
TR
Triangulum 1B
Triangulum · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
ReasoningTool use
GE
saiga gemma2 10b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
EU
EuroLLM 1.7B Instruct
Eurollm · QuantFactory
Params1.66B
Context8K
Q4_K_M1.0 GB
GGUF
ST
Stellar Odyssey 12b v0.0
Stellar · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3.1 8B Instruct Reasoner 1o1 v0.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
MI
Mistral Nemo Instruct 2407 GGUF iamlemec
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HE
HelpingAI2 6B
Helpingai · QuantFactory
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
LL
ArliAI Llama 3 8B Instruct Dolfin v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
DA
L3 Darker Planet 12.15B
Darker · QuantFactory
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
QW
Qwen2.5 Math 7B Instruct
Qwen · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use

Keep browsing