Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · collagen
Params1.24B
Context128K
Smallest1.3 GB
MO
model
Model · Rajib73
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · souvik2132
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · akkydev
Params3.09B
Context32K
Smallest3.3 GB
MO
model3DataTest
Model · SlepiqEmo
Params4.02B
Context40K
Smallest4.3 GB
MO
model
Model · conff
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · harxsan
Params494M
Context32K
Smallest0.5 GB
MO
model
Model · sagaie
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · jinwkim90
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
AM model new eff
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · Marti0198
Params8.03B
Context8K
Smallest8.5 GB
MO
model
Model · arir44741
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · rmsdud
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · LawItApps
Params3.09B
Context32K
Smallest6.2 GB
MO
Model_Matchwise
Model · Senabetul
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model ya1
Model · n0rmis
Params8.04B
Context32K
Smallest16.1 GB
MO
Model_V1
Model · pangluo
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · env3d
Params494M
Context32K
Q4_K_M0.4 GB
MO
model
Model · hipolito
Params4.02B
Context256K
Smallest4.3 GB
MO
model QAO v4
Model · zxcvmh666
Params4.02B
Context256K
Q4_K_M2.5 GB
MO
My_Model
Model · Zhtnge
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · stphencliffs
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Model10021426 ollama
Model · jyunjia
Params8.03B
Context128K
Smallest16.1 GB
MO
model list
Model · lean9096
Params14.8B
Context128K
Smallest4.5 GB
MO
model for telegram bot
Model · Glherme
Params1.24B
Context128K
Smallest1.3 GB
MO
Model_Gguf_16Bit0603
Model · hyu1
Params3.21B
Context128K
Smallest6.4 GB
MO
Model1Orj
Model · Berk2003
Params8.03B
Context128K
Smallest8.5 GB
MO
Model_Test
Model · nyongnyongi
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · mlho
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
model2
Model · lethanhbaotran
Params2.51B
Context8K
Smallest2.7 GB