GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
granite 3.1 8b base
Granite · QuantFactory
Params8.37B
Context128K
Q4_K_M5.1 GB
GGUF
CA
Calme Instruct Extended
Calme · QuantFactory
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
LL
Apollo 2.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NI
L3 8B Niitama v1
Niitama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Nemo Gutenberg Doppel 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ST
L3 Nymeria 8B
Stheno · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
PH
Phi 3 mini 4k instruct GGUF imatrix
Phi · QuantFactory
Params3.82B
Context4K
Smallest1.2 GB
Coding
MI
TouchNight Ministral 8B Instruct 2410 HF
Mistral · QuantFactory
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
FA
Fatgirl v2 DPO 8B
Fatgirl · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
UM
L3 Umbral Storm 8B t0.0001
Umbral · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
UL
UltimateANJIR 8B L3 Blackroot
Ultimateanjir · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EX
Experimental Alpha Orionis 2x7B v0.1
Experimental · QuantFactory
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
GE
Apollo2 2B
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
OC
OCRonos
Ocronos · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Replete Coder Qwen2 1.5b
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
Coding
GE
gemma 2 baku 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
MI
MistralLite
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · QuantFactory
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
AT
Athene Codegemma 2 7b It Alpaca v1
Athene · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
Magic v2 8B
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
OC
octopus planning
Octopus · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GR
granite guardian 3.0 8b
Granite · QuantFactory
Params8.17B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 9B It SPPO Iter3
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
magnum v4 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QU
a1 v002
Quantfactory · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GO
Gorilla Openfunctions v2
Gorilla · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MA
MN 12B Starcannon v3
Magnum · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
VI
st vicuna v1.3 5.5b taylor
Vicuna · QuantFactory
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF

Keep browsing