GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GR
granite 3.1 8b base
Granite · QuantFactory
Params8.37B
Context128K
Q4_K_M5.1 GB
CA
Calme Instruct Extended
Calme · QuantFactory
Params8.99B
Context32K
Q4_K_M5.4 GB
LL
Apollo 2.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
NI
L3 8B Niitama v1
Niitama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral Nemo Gutenberg Doppel 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
ST
L3 Nymeria 8B
Stheno · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 mini 4k instruct GGUF imatrix
Phi · QuantFactory
Params3.82B
Context4K
Smallest1.2 GB
MI
TouchNight Ministral 8B Instruct 2410 HF
Mistral · QuantFactory
Params8.02B
Context32K
Q4_K_M4.9 GB
FA
Fatgirl v2 DPO 8B
Fatgirl · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
UM
L3 Umbral Storm 8B t0.0001
Umbral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
UL
UltimateANJIR 8B L3 Blackroot
Ultimateanjir · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
EX
Experimental Alpha Orionis 2x7B v0.1
Experimental · QuantFactory
Params12.9B
Context32K
Q4_K_M7.8 GB
GE
Apollo2 2B
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
OC
OCRonos
Ocronos · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Replete Coder Qwen2 1.5b
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GE
gemma 2 baku 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
MI
MistralLite
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · QuantFactory
Params8.19B
Context128K
Q4_K_M5.0 GB
AT
Athene Codegemma 2 7b It Alpaca v1
Athene · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Magic v2 8B
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
OC
octopus planning
Octopus · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GR
granite guardian 3.0 8b
Granite · QuantFactory
Params8.17B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9B It SPPO Iter3
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
magnum v4 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QU
a1 v002
Quantfactory · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GO
Gorilla Openfunctions v2
Gorilla · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
MA
MN 12B Starcannon v3
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
VI
st vicuna v1.3 5.5b taylor
Vicuna · QuantFactory
Params5.52B
Context2K
Q4_K_M3.3 GB