GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
TriLM 3.9B Unpacked
Trilm · QuantFactory
Params3.99B
Context2K
Q4_K_M2.4 GB
GGUF
LL
Llama3 ArrowSE 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Swallow 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RH
rho math 7b interpreter v0.1
Rho · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 Ataraxy v4c 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
VI
visocial Sailor 1.8B Instruct
Visocial · QuantFactory
Params1.84B
Context8K
Q4_K_M1.2 GB
GGUF
QW
Celestial Harmony 14b v1.0 Experimental 1016
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
LL
Llama 2 13b chat hf
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
internlm2 5 1 8b
InternLM · QuantFactory
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
HA
Hathor Sofit L3 8B v1
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
LL
Halu 8B Llama3 v0.35
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
h2o danube3 500m base
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
LL
KONI Llama3 8B Merged 20240724
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LY
MN 12B Lyra v1
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OP
OpenCrystal L3 15B v2.1
Opencrystal · QuantFactory
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
AR
arcee lite
Arcee · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Llama3 ArrowSE 8B v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
L3 8B Chara v1 Alpha
Chara · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 1.2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DA
h2o danube3 500m chat
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
BU
Bungo L3 8B
Bungo · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 7b chat hf
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
IN
InternLM2
InternLM · QuantFactory
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
LE
Lexora Medium 7B
Lexora · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
GE
Tiger Gemma 9B v2
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ON
oneirogen 7B
Oneirogen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
HA
Hathor Aleph L3 8B v0.72
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TW
TwinLlama 3.1 8B trl
Twinllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing