GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
TR
TriLM 3.9B Unpacked
Trilm · QuantFactory
Params3.99B
Context2K
Q4_K_M2.4 GB
LL
Llama3 ArrowSE 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Swallow 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
RH
rho math 7b interpreter v0.1
Rho · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy v4c 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
VI
visocial Sailor 1.8B Instruct
Visocial · QuantFactory
Params1.84B
Context8K
Q4_K_M1.2 GB
QW
Celestial Harmony 14b v1.0 Experimental 1016
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama 2 13b chat hf
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
IN
internlm2 5 1 8b
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
HA
Hathor Sofit L3 8B v1
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
LL
Halu 8B Llama3 v0.35
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
h2o danube3 500m base
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
LL
KONI Llama3 8B Merged 20240724
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LY
MN 12B Lyra v1
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
OP
OpenCrystal L3 15B v2.1
Opencrystal · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
AR
arcee lite
Arcee · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama3 ArrowSE 8B v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
L3 8B Chara v1 Alpha
Chara · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 8B DarkIdol 1.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Lumimaid v0.2 12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
h2o danube3 500m chat
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
BU
Bungo L3 8B
Bungo · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 7b chat hf
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
LE
Lexora Medium 7B
Lexora · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Tiger Gemma 9B v2
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
ON
oneirogen 7B
Oneirogen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
HA
Hathor Aleph L3 8B v0.72
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
TW
TwinLlama 3.1 8B trl
Twinllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB