GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
LL
Meta Llama 3 8B Instruct abliterated v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Tongda1 1.5B BKI
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
CO
codegeex4-all-9b
Codegeex · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
SM
SmolLM2 360M Instruct
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
LI
T lite instruct 0.1
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
InternLM2StepProver
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
QW
Reasoning 0.5b
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
NuminaMath 7B CoT
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3 Yggdrasil 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Groq 8B Tool Use
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InstructLM 500M
Instructlm · QuantFactory
Params568M
Context2K
Q4_K_M0.4 GB
LL
FireStorm Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Artificium llama3.1 8B 001
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · QuantFactory
Params12.2B
Context8K
Q4_K_M7.4 GB
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
DA
Loki v2.6 8b 1024k
Daybreak · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
ST
L3 SthenoMaid 8B V1
Sthenomaidblackroot · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
QW
Rombos LLM V2.6 Qwen 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3Guard Gen 0.6B
Qwen · QuantFactory
Params752M
Context32K
Q4_K_M0.5 GB
DO
L3 OVA Test 8B
Domain · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ArliAI Llama 3 8B Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OneLLM Doey V1 Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
HA
Hathor Tahsin L3 8B v0.85
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB