Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
my ft model
Model · PMGAgent
Params1.24B
Context128K
Smallest2.5 GB
Tool use
MO
model
Model · fudanda
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
MO
ai model
Model · daskush
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MO
model gguf ner 1.7bqwen
Model · anish12
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MO
model gguf ner 4bqwen
Model · anish12
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
MO
model gguf ner 0.6 e 1
Model · anish12
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
MO
model name
Model · 0xgr3y
Params494M
Context32K
Smallest1.0 GB
Tool use
MO
Model2_1311
Model · Kobubu
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
MO
hn model
Model · koderik
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
Model
Model · Nihal9983
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MO
model.gguf beta
Model · user-1qaz2wsx
Params742M
Context125K
Smallest0.5 GB
Tool use
MO
model
Model · Akakkskssk
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
MO
model
Model · testgguf
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
MO
model Syne
Model · YassineBak
Params15.7B
Context160K
Smallest7.5 GB
GGUF
MO
model1
Model · qiuzhi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · Sarra215
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model test
Model · SuyashKirti96
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model QA medical
Model · thviet79
Params7.29B
Context32K
Smallest14.6 GB
GGUF
MO
model asistan
Model · Sezerogras
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · chidafrenchie
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model5
Model · rith19
Params6.7B
Context—
Smallest0.0 GB
GGUF
MO
model bank
Model · todie
Params23.6B
Context384K
Smallest6.1 GB
Tool use

Keep browsing