GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Octopus v2
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
WEBGEN 4B Preview
Qwen · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
GGUF
LL
dolphin 2.9 llama3 70b
Llama · QuantFactory
Params70.6B
Context8K
Smallest48.7 GB
CodingTool use
QW
QwenTies 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
PR
SD Prompter 1.5B V0.1
Prompter · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
QW
Vapor 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
TA
tabula 8b
Tabula · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Neural SOVLish Devil 8B L3
Neural · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EX
EXAONE Deep 7.8B
Exaone · QuantFactory
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
LL
UltraLlama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
NuExtract
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
MI
Stella mistral nemo 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
EX
EXAONE 3.0 7.8B Instruct
Exaone · QuantFactory
Params7.82B
Context4K
Q4_K_M4.8 GB
GGUF
AL
AlphaMaze v0.2 1.5B
Alphamaze · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
EA
eagle 3b preview
Eagle · QuantFactory
Params3.1B
Context16K
Q4_K_M1.9 GB
GGUF
LU
Lumimaid Magnum 12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
OpenR1 Distill 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
BE
Berghof NSFW 7B
Berghof · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
CU
RP Naughty v1.0c 8b
Cursedmatrix · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
QW
QwenTies 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
MegaBeam Mistral 7B 512k
Mistral · QuantFactory
Params7.24B
Context512K
Q4_K_M4.4 GB
GGUF
MI
MadWizard SFT v2 Mistral 7b v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Muse 12B
Mistral · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LF
LFM2 1.2B Extract
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
GGUF
MI
Mistral Nemo Base 2407 GGUF iamlemec
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
LL
Fireball Meta Llama 3.1 8B Instruct Math
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
QwQ 14B Math v0.2
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Replete LLM V2.5 Qwen 14b
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MI
Mistral Crab SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing