Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
Model_Pmc_Kl2_3.5_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model
Model · samtse123
Params7.62B
Context128K
Q4_K_M1.1 GB
GGUF
MO
AM model ll S
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · Uta911918
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model202412041043
Model · CSLin3303
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model01
Model · kmavie
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model
Model · Houbid
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MO
model
Model · lijd2005
Params21B
Context—
Smallest7.9 GB
GGUF
MO
model
Model · Helen0313
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · vmiu
Params14.8B
Context32K
Smallest15.7 GB
Tool use
MO
model
Model · scottwoo
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MO
Model 2
Model · rmsdud
Params84M
Context—
Smallest0.3 GB
GGUF
MO
Model_Gguf_8Bit
Model · hyu1
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · chogo123
Params3.09B
Context32K
Smallest6.2 GB
GGUF
MO
1112 model 2
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model3d 1024 multi
Model · fqb
Params3.3B
Context128K
Smallest2.4 GB
Tool use
MO
model
Model · axelblenna
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
Model_Q4_K_M_Aks
Model · vnyaryan
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Gn Model
Model · eric-hugging-cn
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MO
model
Model · thor-x-me
Params8.54B
Context8K
Smallest8.8 GB
GGUF
MO
model
Model · Mrwildfox
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · youngcho
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · lokeshdotp
Params3.21B
Context128K
Smallest2.8 GB
GGUF
MO
model truth
Model · Fredbay
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MO
model
Model · nightcrawlers512
Params8.03B
Context128K
Smallest16.1 GB
Tool use
MO
model
Model · lindaelise
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model
Model · sennylau
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MO
model
Model · inumulaisk
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
MO
model
Model · karlyip
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · CvLelouch
Params8.03B
Context128K
Smallest8.5 GB
GGUF

Keep browsing