GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
GE
Tiger Gemma 9B v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QU
a1 v005
Quantfactory · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Foundation Sec 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
AE
L3 Aethora 15B
Aethora · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
VI
Vicuna 13b v1.5
Vicuna · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
OD
Odin 9B
Odin · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
OP
OpenCrystal 15B L3 v2
Opencrystal · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
LL
PL Llama 3 6B Instruct v0.1
Llama · QuantFactory
Params6.29B
Context8K
Q4_K_M3.9 GB
DI
DiarizationLM 8b Fisher v1
Diarizationlm · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Wayfarer 12b
Mistral · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Llama 3 LewdPlay 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Yggdrasil 2.0 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
DRT O1 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
AMD Llama 350M Upgraded
Llama · QuantFactory
Params332M
Context2K
Q4_K_M0.2 GB
ME
Meditron3 8B
Meditron · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
NU
NuExtract tiny
Nuextract · QuantFactory
Params464M
Context32K
Q4_K_M0.3 GB
YA
YamshadowExperiment28 7B
Yamshadowexperiment · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2 Math 7B
Qwen · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
MiniThinky v2 1B Llama 3.2
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Llama3.1 Allades 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
diffullama
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
CE
L3 8B Celeste V1.2
Celeste · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Hathor L3 8B v.01
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
Saul Legal Calme Instruct
Saul · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy v3b 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MalayaLLM Gemma 7B Instruct V1
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
ME
medllama3 v20
Medllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
L3 8B Lunar Stheno
Lunar · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB