GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
MI
Mistral 7b chat finetune veechan
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
q llama 2 7b chat v3
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
TW
TwinLlama 3.1 8B 2
Twinllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Stroganoff
Llama · QuantFactory
Params157M
Context2K
Q4_K_M0.1 GB
LL
Llama3 ArrowSE 8B v0.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
robust llama3 8b instruct
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
Lite Oute 1 65M
Lite · QuantFactory
Params65M
Context2K
Q4_K_M0.0 GB
MI
Mistral 7B Base SFT DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB