GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5 Gutenberg Doppel 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Mistral 7B Base SFT RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
AS
Astral Fusion 8b v0.0
Astral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B RDPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Turkish Llama 8b v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Fireball Alpaca Llama3.1.07 8B Philos Math
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B OpenHermes 243K
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
TherapyLlama 8B v1
Therapyllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Pantheon Rp 1.6 12b Nemo Kto
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Magnaraxy 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
MachineLearningLM 7B v1
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
MiniCPM4 8B
MiniCPM · QuantFactory
Params8.19B
Context32K
Q4_K_M5.0 GB
SM
SmolLM2 1.7B
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
HA
mergekit slerp vlrddld
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
orpheus 3b 0.1 ft
Orpheus · QuantFactory
Params3.78B
Context128K
Q4_K_M2.4 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
OpenReasoning Nemotron 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Baldur 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
WA
wavecoder ds 6.7b
Wavecoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 14B_Uncencored
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
MonadGPT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama2 7b chat uncensored
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GE
Gemma Radiation RP 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
CA
Captain Eris Diogenes Twilight V0.420 12B
Captain · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
ArliAI Llama 3 8B Argon v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
INTELLECT 1 Instruct
Intellect · QuantFactory
Params10.2B
Context8K
Q4_K_M6.2 GB
QW
Qwen2.5 7B HomerAnvita NerdMix
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB