GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
MI
mini magnum 12b v1.1
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
BH
BharatGPT 3B Indic
Bharatgpt · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Math 1.5B
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
LL
Llama3 ChatQA 2 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MP
mpt 7b
Mpt · QuantFactory
Params6.65B
Context2K
Q4_K_M4.3 GB
NI
L3.1 Storniitova 8B
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
cosmo 1b
Cosmo · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
TR
Trendyol LLM 8b Chat v2.0
Trendyol · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Atlas Chat 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
L3.1 Aglow Vulca v0.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Storm 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
UIGEN FX 4B Preview
Qwen · QuantFactory
Params4.4B
Context256K
Q4_K_M2.7 GB
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
EU
EuroLLM 9B Instruct
Eurollm · QuantFactory
Params9.15B
Context4K
Q4_K_M5.6 GB
LL
Llama 3.1 SuperNova Lite
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB