GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral NeMo Minitron 8B Chat
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
Tool use
GE
Pocket Tiger Gemma 2B v1g
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
RH
rho math 1b v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
ArliAI Llama 3 8B Cumulus v0.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Insanity
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Polaris 4B Preview
Qwen · QuantFactory
Params4.41B
Context128K
Q4_K_M2.7 GB
GGUF
QW
Teleut 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GR
granite 3.1 3b a800m base
Granite · QuantFactory
Params3.37B
Context128K
Q4_K_M2.1 GB
GGUF
EU
EuroLLM 1.7B
Eurollm · QuantFactory
Params1.66B
Context4K
Q4_K_M1.0 GB
GGUF
AR
Art 0 8B
Art · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
ZE
Zenith 4B
Zenith · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
AceReason Nemotron 7B
Nemotron · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MI
dolphin 2.9.3 mistral 7B 32k
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Matter 0.1 7B
Matter · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama 3 8b Instruct Matter 0.1 Slim A
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
Virgil 9B
Dante · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
ArliAI RPMax Formax v1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TO
TooManyMixRolePlay 7B Story V3.5
Toomanymixroleplay · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LO
lola v1
Lola · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
GP
gpt2 xl
Gpt · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
MI
MiniCPM4 0.5B
MiniCPM · QuantFactory
Params509M
Context32K
Q4_K_M0.3 GB
GGUF
QW
Liberated Qwen1.5 7B
Qwen · QuantFactory
Params7.72B
Context32K
Q4_K_M4.8 GB
CodingTool use
QW
Q2.5 Veltha 14B
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
GE
Gemma 2 Ataraxy v4a Advanced 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
BA
BabyMistral
Babymistral · QuantFactory
Params1.55B
Context8K
Q4_K_M0.9 GB
GGUF
DE
Polaris 7B Preview
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen2 1.5b Instruct Replete Adapted
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF

Keep browsing