Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
Model_Q4
Model · skymqune
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MO
model
Model · jedsadasjp
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model new jenkins
Model · abdullah00111
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model_QA_medical
Model · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · huichaomeng
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Model_Gguf
Model · anish12
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MO
Model Cerita
Model · Swallowtaill
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model
Model · rubyrosedragon
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Ko Pt Model Test1
Model · tensorblock
Params8.17B
Context8K
Smallest3.3 GB
GGUF
MO
model
Model · RushabhShah122000
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
Model_Mirage_16_Bit
Model · atsintli
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MO
model_16_EE
Model · berger815
Params8.03B
Context8K
Smallest16.1 GB
GGUF
MO
model
Model · NicholasLuo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · SweetPanda
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · bmahr
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model2
Model · Prakyy
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · meltingsnowflake
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · wuquanquan123
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Model_Pmc_Beta_0.01_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model 13b v2
Model · ashk72
Params13B
Context4K
Smallest26.0 GB
GGUF
MO
model2
Model · johaanm
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model q4 k m
Model · SweetPanda
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · humanhow
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
t5 ft model Q4 K M
Model · mrbutter
Params—
Context512
Q4_K_M0.0 GB
GGUF
MO
model
Model · 0xGreyson
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · ellinakim
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model for test
Model · xiaozhu0805
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · MrSolace
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
model 8b v1
Model · better11lyh
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
MO
model
Model · DaniOWOWOWO
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing