Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model medicalqa 16
Model · RifkiArz
Params3.21B
Context128K
Smallest6.4 GB
GGUF
MO
model 1
Model · aghReza
Params1.24B
Context128K
Smallest0.9 GB
Tool use
MO
model syntax without info
Model · abdullah00111
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · AlexB007
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model
Model · zengleno
Params7.62B
Context128K
Smallest8.1 GB
GGUF
MO
model
Model · Masterd2025
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · jaiVenkatasai
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
F16_Model
Model · Growcompany
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · prerana17
Params1.54B
Context32K
Smallest1.6 GB
Tool use
MO
model
Model · cdixo82
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · yongjunwang2005
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · jazzkong1219
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · VR29
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
model
Model · Soafp
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · mrnetx
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model1 Q4 K M
Model · neurosynced
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · cgaege
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
my model
Model · versus666
Params494M
Context32K
Smallest0.5 GB
GGUF
MO
Model_Pmc_Kl2_3.0_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model
Model · MartinAB
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · againnr
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · rakin24
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model 1238 cost
Model · Stephen123456
Params494M
Context32K
Smallest0.5 GB
Tool use
MO
model
Model · Lycof
Params1.24B
Context128K
Smallest1.3 GB
GGUF
MO
model
Model · Rohya
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
My_Model
Model · wenjing0213
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MO
model
Model · potatobeans
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · helfff
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
MO
model
Model · yoonzema1126
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · robcorey
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing