Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · charan2509
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · meisKiet
Params8.03B
Context128K
Smallest8.5 GB
MO
model ncert
Model · pranavsw
Params1.54B
Context32K
Q4_K_M1.0 GB
MO
model
Model · barisKacin
Params4.02B
Context256K
Q4_K_M2.5 GB
MO
Model Stock Mixv0.1 7B
Model · jsfs11
Params7.24B
Context32K
Smallest4.1 GB
MO
model4
Model · bayeshan
Params8.03B
Context128K
Smallest8.5 GB
MO
Model10021426 ollama V1
Model · jyunjia
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · ClassyB
Params8.03B
Context128K
Smallest16.1 GB
MO
AM model eff
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · gonzalomelov
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model 8bit
Model · reaper24
Params3.21B
Context128K
Smallest3.4 GB
MO
Model_Pmc_Kl_0.1_Noise0_0_Epoch0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
MO
model
Model · Wendyam1
Params3.09B
Context32K
Smallest3.3 GB
MO
model
Model · SEONGhohoho
Params8.03B
Context128K
Smallest8.5 GB
MO
Model62
Model · neilchien
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · hugohe2003
Params14.8B
Context32K
Smallest15.7 GB
MO
model3 dapo
Model · jerrycheng233
Params3.82B
Context128K
Smallest4.1 GB
MO
Model_Merged
Model · IrisCHEN04
Params8.03B
Context128K
Smallest4.9 GB
MO
model
Model · 0mercjh
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · fredhurui
Params3.21B
Context128K
Smallest3.4 GB
MO
AM model new eff2
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · MarcoLedda
Params494M
Context32K
Smallest1.0 GB
MO
model
Model · kneth90
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
Model2Epoch
Model · vmiu
Params14.8B
Context32K
Smallest15.7 GB
MO
Model_Ther
Model · rushil1808
Params1.24B
Context128K
Smallest2.5 GB
MO
model
Model · Strawberry1
Params8.03B
Context128K
Smallest8.5 GB
MO
model3d 2048 multi
Model · fqb
Params3.3B
Context128K
Smallest2.4 GB
MO
model Q4 K M
Model · Yubaiyubai
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · anhduc4w
Params4B
Context—
Q4_K_M0.3 GB
MO
Model10021426 ollama V2
Model · jyunjia
Params8.03B
Context128K
Q4_K_M4.9 GB