Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · darkstorm2150
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model005 dogruAI q4 k m
Model · dogruaitech
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · DATA28
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model003 dogruAI q4 k m
Model · dogruaitech
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MO
model
Model · asasidh
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MO
model004 dogruAI q4 k m
Model · dogruaitech
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MO
model 02
Model · djtar
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
my model p
Model · Terisara
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model
Model · noah-vandal
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
model 6gb ram
Model · jeuzu
Params7.62B
Context128K
Smallest3.8 GB
GGUF
MO
Model_Pmc_Gamma_0.05_Noise0_0_Epoch0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
Model1
Model · menacing-american-patriot
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MO
AM model AAEC 2
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
AM model AAEC 4
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model1129
Model · JJaeHeon
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · PAUL1122
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · ehsankhan525
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model1gf
Model · pratak
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · mozturk
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · fuguowen
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model 8gb ram
Model · jeuzu
Params7.46B
Context128K
Smallest4.2 GB
ReasoningTool useVision
MO
Model V2 cot
Model · FarhanAkhtar
Params3.21B
Context128K
Smallest6.4 GB
GGUF
MO
model
Model · aghReza
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
Model Beta3 Gguf
Model · ambrosfitz
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · royanirban355
Params9.24B
Context8K
Smallest18.5 GB
GGUF
MO
model002 dogruAI q4 k m
Model · dogruaitech
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MO
model 1
Model · shhubhhaam
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Model Beta2 Gguf
Model · ambrosfitz
Params8.03B
Context128K
Smallest4.9 GB
Tool use
MO
model_01
Model · softgood
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
my model
Model · lordmagic
Params3.21B
Context128K
Smallest6.4 GB
Tool use

Keep browsing