Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
Model_Pmc_Kl2_3.5_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
MO
model
Model · samtse123
Params7.62B
Context128K
Q4_K_M1.1 GB
MO
AM model ll S
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · Uta911918
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model202412041043
Model · CSLin3303
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model01
Model · kmavie
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · Houbid
Params3.09B
Context32K
Smallest3.3 GB
MO
model
Model · lijd2005
Params21B
Context—
Smallest7.9 GB
MO
model
Model · Helen0313
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · vmiu
Params14.8B
Context32K
Smallest15.7 GB
MO
model
Model · scottwoo
Params494M
Context32K
Q4_K_M0.4 GB
MO
Model 2
Model · rmsdud
Params84M
Context—
Smallest0.3 GB
MO
Model_Gguf_8Bit
Model · hyu1
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · chogo123
Params3.09B
Context32K
Smallest6.2 GB
MO
1112 model 2
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
MO
model3d 1024 multi
Model · fqb
Params3.3B
Context128K
Smallest2.4 GB
MO
model
Model · axelblenna
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
Model_Q4_K_M_Aks
Model · vnyaryan
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
Gn Model
Model · eric-hugging-cn
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · thor-x-me
Params8.54B
Context8K
Smallest8.8 GB
MO
model
Model · Mrwildfox
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · youngcho
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · lokeshdotp
Params3.21B
Context128K
Smallest2.8 GB
MO
model truth
Model · Fredbay
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · nightcrawlers512
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · lindaelise
Params1.24B
Context128K
Smallest1.3 GB
MO
model
Model · sennylau
Params1.54B
Context32K
Q4_K_M1.0 GB
MO
model
Model · inumulaisk
Params1.78B
Context128K
Smallest1.9 GB
MO
model
Model · karlyip
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · CvLelouch
Params8.03B
Context128K
Smallest8.5 GB