Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · charan2509
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · meisKiet
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model ncert
Model · pranavsw
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MO
model
Model · barisKacin
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MO
Model Stock Mixv0.1 7B
Model · jsfs11
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MO
model4
Model · bayeshan
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Model10021426 ollama V1
Model · jyunjia
Params8.03B
Context128K
Smallest16.1 GB
Tool use
MO
model
Model · ClassyB
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
AM model eff
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · gonzalomelov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model 8bit
Model · reaper24
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
Model_Pmc_Kl_0.1_Noise0_0_Epoch0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model
Model · Wendyam1
Params3.09B
Context32K
Smallest3.3 GB
GGUF
MO
model
Model · SEONGhohoho
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Model62
Model · neilchien
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
MO
model
Model · hugohe2003
Params14.8B
Context32K
Smallest15.7 GB
Tool use
MO
model3 dapo
Model · jerrycheng233
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
Model_Merged
Model · IrisCHEN04
Params8.03B
Context128K
Smallest4.9 GB
Tool use
MO
model
Model · 0mercjh
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · fredhurui
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
AM model new eff2
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · MarcoLedda
Params494M
Context32K
Smallest1.0 GB
Tool use
MO
model
Model · kneth90
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Model2Epoch
Model · vmiu
Params14.8B
Context32K
Smallest15.7 GB
GGUF
MO
Model_Ther
Model · rushil1808
Params1.24B
Context128K
Smallest2.5 GB
GGUF
MO
model
Model · Strawberry1
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model3d 2048 multi
Model · fqb
Params3.3B
Context128K
Smallest2.4 GB
Tool use
MO
model Q4 K M
Model · Yubaiyubai
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · anhduc4w
Params4B
Context—
Q4_K_M0.3 GB
GGUF
MO
Model10021426 ollama V2
Model · jyunjia
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing