GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
LL
Llama 3 Perky Pat Instruct 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Swallow 8B Instruct v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 8B DarkIdol 2.0 Uncensored
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Luna AI Llama2 Uncensored
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
MO
Moistral 11B v3
Moistral · QuantFactory
Params10.7B
Context8K
Q4_K_M6.5 GB
LL
Llama 3 8B Instruct MopeyMule
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 Ataraxy v4d 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
OL
AMD OLMo 1B
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
OL
AMD OLMo 1B SFT
OLMo · QuantFactory
Params1.18B
Context2K
Q4_K_M0.7 GB
LL
vietnamese llama2 7b 120GB
Llama · QuantFactory
Params6.85B
Context2K
Q4_K_M4.2 GB
LL
Llama3 DiscoLeo Instruct 8B v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
RE
Replete Coder Instruct 8b Merged
Replete · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
Lite Oute 1 300M Instruct
Lite · QuantFactory
Params300M
Context4K
Q4_K_M0.2 GB
CO
Control 8B
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PO
Poppy Porpoise 0.85 L3 8B
Poppy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceMartiniRP 7b
Icemartinirp · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
h2o danube3 4b chat
Danube · QuantFactory
Params3.96B
Context8K
Q4_K_M2.4 GB
LL
HALU 8B LLAMA3 BRSLURP
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
NemoReRemix 12B
Nemoreremix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepCoder 1.5B Preview
Deepcoder · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Meta Llama 3 225B Instruct
Llama · QuantFactory
Params225B
Context8K
Q4_K_M134.8 GB
DE
DeepCoder 14B Preview
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
BU
bueble lm 2b
Bueble · QuantFactory
Params2.07B
Context8K
Q4_K_M1.3 GB
RH
rho math 7b v0.1
Rho · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chat2DB SQL 7B
Chat · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
FA
FastApply 1.5B v1.0
Fastapply · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
PH
Borea Phi 3.5 mini Instruct Jp
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
LLaMA O1 Supervised 1129
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
FU
functionary small v2.2
Functionary · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 9B Chinese Chat
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB