GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GE
Octopus v2
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
WEBGEN 4B Preview
Qwen · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
LL
dolphin 2.9 llama3 70b
Llama · QuantFactory
Params70.6B
Context8K
Smallest48.7 GB
QW
QwenTies 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
PR
SD Prompter 1.5B V0.1
Prompter · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Vapor 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
TA
tabula 8b
Tabula · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Neural SOVLish Devil 8B L3
Neural · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
EX
EXAONE Deep 7.8B
Exaone · QuantFactory
Params7.82B
Context32K
Q4_K_M4.8 GB
LL
UltraLlama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
NuExtract
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
MI
Stella mistral nemo 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · QuantFactory
Params7.82B
Context4K
Q4_K_M4.8 GB
AL
AlphaMaze v0.2 1.5B
Alphamaze · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
EA
eagle 3b preview
Eagle · QuantFactory
Params3.1B
Context16K
Q4_K_M1.9 GB
LU
Lumimaid Magnum 12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
OpenR1 Distill 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
BE
Berghof NSFW 7B
Berghof · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
CU
RP Naughty v1.0c 8b
Cursedmatrix · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
QW
QwenTies 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
MegaBeam Mistral 7B 512k
Mistral · QuantFactory
Params7.24B
Context512K
Q4_K_M4.4 GB
MI
MadWizard SFT v2 Mistral 7b v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Muse 12B
Mistral · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
LF
LFM2 1.2B Extract
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
MI
Mistral Nemo Base 2407 GGUF iamlemec
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
LL
Fireball Meta Llama 3.1 8B Instruct Math
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
QwQ 14B Math v0.2
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Mistral Crab SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB