GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Tiger Gemma 9B v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QU
a1 v005
Quantfactory · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Foundation Sec 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AE
L3 Aethora 15B
Aethora · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OD
Odin 9B
Odin · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OP
OpenCrystal 15B L3 v2
Opencrystal · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
PL Llama 3 6B Instruct v0.1
Llama · QuantFactory
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
DI
DiarizationLM 8b Fisher v1
Diarizationlm · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Wayfarer 12b
Mistral · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
Llama 3 LewdPlay 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Yggdrasil 2.0 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QW
DRT O1 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
AMD Llama 350M Upgraded
Llama · QuantFactory
Params332M
Context2K
Q4_K_M0.2 GB
GGUF
ME
Meditron3 8B
Meditron · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NU
NuExtract tiny
Nuextract · QuantFactory
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
YA
YamshadowExperiment28 7B
Yamshadowexperiment · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2 Math 7B
Qwen · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
LL
MiniThinky v2 1B Llama 3.2
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
Llama3.1 Allades 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
diffullama
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
CE
L3 8B Celeste V1.2
Celeste · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Hathor L3 8B v.01
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SA
Saul Legal Calme Instruct
Saul · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 Ataraxy v3b 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MalayaLLM Gemma 7B Instruct V1
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
ME
medllama3 v20
Medllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
L3 8B Lunar Stheno
Lunar · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing