GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
saiga gemma2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Genstruct
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
granite 3.0 1b a400m instruct
Granite · QuantFactory
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
QW
Qwen2.5 14B
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
HA
Hathor Respawn L3 8B v0.8
Hathor · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OP
OpenCoder 1.5B Instruct
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
CE
MN 12B Celeste V1.9
Celeste · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SA
Saiga_Nemo_12B_Sft_M9_D14
Saiga · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Replete LLM V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
GE
gemma advanced v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen3 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
oxy 1 small
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
LL
Hermes 2 Pro Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
NO
Not WizardLM 2 7B
Not · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
Aurora faustus 8B LINEAR
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Delirium v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SH
shieldgemma 2b
Shieldgemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma2 gutenberg 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
leniachat qwen2 1.5B v0
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GE
EZO Common 9B gemma 2 it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 9b it SimPO rudpo
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LF
LFM2 1.2B Tool
Lfm · QuantFactory
Params1.3B
Context125K
Q4_K_M0.8 GB
Tool use
MA
MAmmoTH2 8B Plus
Mammoth · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
sepctrum ties sqlcoder 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
SA
SAINEMO reMIX
Saiga · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
ArliAI Llama 3 8B Cumulus v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
SauerkrautLM 1.5b
Sauerkrautlm · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
DI
Distilgpt2
Distilgpt · QuantFactory
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
KU
Kunoichi DPO v2 7B
Kunoichi · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing