Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
Model_Q4
Model · skymqune
Params7.62B
Context32K
Q4_K_M4.7 GB
MO
model
Model · jedsadasjp
Params3.21B
Context128K
Smallest3.4 GB
MO
model new jenkins
Model · abdullah00111
Params3.21B
Context128K
Smallest6.4 GB
MO
model_QA_medical
Model · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · huichaomeng
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Model_Gguf
Model · anish12
Params1.72B
Context40K
Q4_K_M1.1 GB
MO
Model Cerita
Model · Swallowtaill
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
model
Model · rubyrosedragon
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Ko Pt Model Test1
Model · tensorblock
Params8.17B
Context8K
Smallest3.3 GB
MO
model
Model · RushabhShah122000
Params3.21B
Context128K
Smallest3.4 GB
MO
Model_Mirage_16_Bit
Model · atsintli
Params14.8B
Context32K
Q4_K_M9.0 GB
MO
model_16_EE
Model · berger815
Params8.03B
Context8K
Smallest16.1 GB
MO
model
Model · NicholasLuo
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · SweetPanda
Params8.03B
Context128K
Smallest16.1 GB
MO
model
Model · bmahr
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model2
Model · Prakyy
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · meltingsnowflake
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · wuquanquan123
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
Model_Pmc_Beta_0.01_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
MO
model 13b v2
Model · ashk72
Params13B
Context4K
Smallest26.0 GB
MO
model2
Model · johaanm
Params8.03B
Context8K
Smallest8.5 GB
MO
model q4 k m
Model · SweetPanda
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · humanhow
Params8.03B
Context128K
Smallest8.5 GB
MO
t5 ft model Q4 K M
Model · mrbutter
Params—
Context512
Q4_K_M0.0 GB
MO
model
Model · 0xGreyson
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · ellinakim
Params8.03B
Context128K
Smallest8.5 GB
MO
model for test
Model · xiaozhu0805
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · MrSolace
Params3.09B
Context32K
Q4_K_M1.9 GB
MO
model 8b v1
Model · better11lyh
Params14.8B
Context128K
Smallest15.7 GB
MO
model
Model · DaniOWOWOWO
Params8.03B
Context128K
Q4_K_M4.9 GB