GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GE
saiga gemma2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Genstruct
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
granite 3.0 1b a400m instruct
Granite · QuantFactory
Params1.33B
Context4K
Q4_K_M0.8 GB
QW
Qwen2.5 14B
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
HA
Hathor Respawn L3 8B v0.8
Hathor · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
OP
OpenCoder 1.5B Instruct
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
CE
MN 12B Celeste V1.9
Celeste · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
SA
Saiga_Nemo_12B_Sft_M9_D14
Saiga · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Replete LLM V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
gemma advanced v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
oxy 1 small
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Hermes 2 Pro Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
Not WizardLM 2 7B
Not · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
AS
Aurora faustus 8B LINEAR
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Delirium v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
SH
shieldgemma 2b
Shieldgemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma2 gutenberg 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
leniachat qwen2 1.5B v0
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
EZO Common 9B gemma 2 it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 2 9b it SimPO rudpo
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LF
LFM2 1.2B Tool
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
MA
MAmmoTH2 8B Plus
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
sepctrum ties sqlcoder 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SAINEMO reMIX
Saiga · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
ArliAI Llama 3 8B Cumulus v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SauerkrautLM 1.5b
Sauerkrautlm · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
DI
Distilgpt2
Distilgpt · QuantFactory
Params121M
Context1K
Q4_K_M0.1 GB
KU
Kunoichi DPO v2 7B
Kunoichi · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB