Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · MrSplatchy
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · R-uslan
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MO
model
Model · jeuzu
Params1.5B
Context128K
Smallest1.2 GB
GGUF
MO
model
Model · bzhang143
Params1.24B
Context128K
Smallest1.3 GB
GGUF
MO
AM model together new
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · mattgptchat
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model 1125 q3k
Model · bau0221
Params3.82B
Context128K
Smallest1.9 GB
GGUF
MO
model
Model · katya1836
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model
Model · javenda
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · Incorrect12321
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MO
model
Model · shravankumar147
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model updated
Model · khurrameycon
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · leesalminen
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model 1127 1b 501
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model project
Model · nimbXnumb
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · JustinYuann
Params8B
Context—
Q4_K_M2.1 GB
GGUF
MO
model
Model · lemongooooo
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · medazizktata
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
my model
Model · prasannaJagadesh
Params362M
Context8K
Smallest0.3 GB
GGUF
MO
model
Model · VladislavElite
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · whj9068
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
model q4 k m
Model · vachacorne
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
MO
model
Model · lomim
Params3.21B
Context128K
Smallest1.4 GB
Tool use
MO
model
Model · deep02
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · mraryavart
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
model
Model · Vithrack
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · Modular
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
my model
Model · xiaoYu201
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MO
ll model
Model · SiddarthaG
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
AM model together segm
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing