GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Gutenberg Doppel 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MI
Mistral 7B Base SFT RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
Astral Fusion 8b v0.0
Astral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct 8B RDPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 8b v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Fireball Alpaca Llama3.1.07 8B Philos Math
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3 8B OpenHermes 243K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
TH
TherapyLlama 8B v1
Therapyllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Pantheon Rp 1.6 12b Nemo Kto
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MA
Magnaraxy 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
MachineLearningLM 7B v1
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
MiniCPM4 8B
MiniCPM · QuantFactory
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
HA
mergekit slerp vlrddld
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
orpheus 3b 0.1 ft
Orpheus · QuantFactory
Params3.78B
Context128K
Q4_K_M2.4 GB
Tool use
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
OpenReasoning Nemotron 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
LL
Baldur 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
WA
wavecoder ds 6.7b
Wavecoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Qwen2.5 14B_Uncencored
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MI
MonadGPT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
llama2 7b chat uncensored
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GE
Gemma Radiation RP 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
CA
Captain Eris Diogenes Twilight V0.420 12B
Captain · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
ArliAI Llama 3 8B Argon v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
INTELLECT 1 Instruct
Intellect · QuantFactory
Params10.2B
Context8K
Q4_K_M6.2 GB
Coding
QW
Qwen2.5 7B HomerAnvita NerdMix
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
RoleplayTool use

Keep browsing