GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
LL
LLaMA 3 8B SFR SFT R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
instruction synthesizer
Instruction · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Ita 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
TE
Teuken 7B instruct research v0.4
Teuken · QuantFactory
Params7.45B
Context4K
Q4_K_M5.0 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Leniachat Gemma 2b v0
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
ArliAI Llama 3 8B Cumulus v0.3.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
deepseek math 7b instruct
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
Infinity Instruct 7M Gen mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 2b Chinese it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Llama3 8B Instruct Replete Adapted
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct function calling json mode
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
YU
YugoGPT
Yugogpt · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
NU
NuminaMath 7B TIR
Numinamath · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
AY
aya 23 8B
Aya · QuantFactory
Params8B
Context4194304K
Q4_K_M5.1 GB
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
UL
UltraMerge 7B
Ultramerge · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Gemma 2 Ataraxy Doppel 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama3 ChatQA 1.5 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Replete LLM V2.5 Qwen 7b
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
OU
Oumuamua 7b instruct v2
Oumuamua · QuantFactory
Params7.33B
Context32K
Q4_K_M4.4 GB
BI
BioMistral DARE NS
Biomistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
Bielik 11B v2
Bielik · QuantFactory
Params11.2B
Context32K
Q4_K_M6.7 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
MI
Clinical BR Mistral 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
L3 8B Stheno v3.3 32K
Stheno · QuantFactory
Params8.03B
Context32K
Q4_K_M4.9 GB
AZ
MN Halide 12b v1.0
Azure · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB