Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
MODEL
Model · alcatreseo
Params14.3B
Context—
Smallest15.4 GB
MO
model deep1
Model · n0rmis
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · tabjen99
Params4.02B
Context40K
Q4_K_M2.5 GB
MO
model
Model · ponapan
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · wcwong22000
Params8.03B
Context128K
Smallest16.1 GB
MO
sm model by dong 1.5b
Model · dongjun7232756
Params1.78B
Context128K
Smallest1.9 GB
MO
model
Model · classifiedshadow
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · lorevity
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · Mohammedstalin
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
model
Model · miketan1234
Params8.03B
Context128K
Smallest8.5 GB
MO
model q4 k m
Model · miketan1234
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
CH_model
Model · ChanHyeokLEE
Params8.03B
Context128K
Smallest8.5 GB
MO
model_256_256
Model · musamrc
Params2.51B
Context8K
Smallest2.7 GB
MO
model
Model · AhmedAbdelgalil
Params8.03B
Context128K
Smallest4.7 GB
MO
model
Model · may7777
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · Irene1028
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · Pratham0712
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · keivenlombo
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · zeezooryu
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · v8859
Params3.82B
Context128K
Q4_K_M2.3 GB
MO
model
Model · jiinnn
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · CJieB
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · jramos02
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · HugoStiglitz
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · rohitranjan20
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · Faust345
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · NANCY13
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · m4n4
Params8.03B
Context8K
Smallest8.5 GB
MO
AM model eff3
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
AM model eff7
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB