GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mini magnum 12b v1.1
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
BH
BharatGPT 3B Indic
Bharatgpt · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Math 1.5B
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
LL
Llama3 ChatQA 2 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MP
mpt 7b
Mpt · QuantFactory
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
NI
L3.1 Storniitova 8B
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
cosmo 1b
Cosmo · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
TR
Trendyol LLM 8b Chat v2.0
Trendyol · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Atlas Chat 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
L3.1 Aglow Vulca v0.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 3.1 Storm 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
UIGEN FX 4B Preview
Qwen · QuantFactory
Params4.4B
Context256K
Q4_K_M2.7 GB
GGUF
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
GGUF
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
EuroLLM 9B Instruct
Eurollm · QuantFactory
Params9.15B
Context4K
Q4_K_M5.6 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay

Keep browsing