GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3 8B Instruct abliterated v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Tongda1 1.5B BKI
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
CO
codegeex4-all-9b
Codegeex · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
LI
T lite instruct 0.1
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IN
InternLM2StepProver
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
QW
Reasoning 0.5b
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
MI
OpenHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DE
NuminaMath 7B CoT
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
LL
Llama 3 Yggdrasil 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Groq 8B Tool Use
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
IN
InstructLM 500M
Instructlm · QuantFactory
Params568M
Context2K
Q4_K_M0.4 GB
GGUF
LL
FireStorm Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Artificium llama3.1 8B 001
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · QuantFactory
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DA
Loki v2.6 8b 1024k
Daybreak · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
L3 SthenoMaid 8B V1
Sthenomaidblackroot · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
Llama 3.2 3B
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Rombos LLM V2.6 Qwen 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Qwen3Guard Gen 0.6B
Qwen · QuantFactory
Params752M
Context32K
Q4_K_M0.5 GB
Reasoning
DO
L3 OVA Test 8B
Domain · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
ArliAI Llama 3 8B Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OneLLM Doey V1 Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
HA
Hathor Tahsin L3 8B v0.85
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing