Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · MrSplatchy
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · R-uslan
Params8.03B
Context128K
Smallest5.7 GB
MO
model
Model · jeuzu
Params1.5B
Context128K
Smallest1.2 GB
MO
model
Model · bzhang143
Params1.24B
Context128K
Smallest1.3 GB
MO
AM model together new
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · mattgptchat
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model 1125 q3k
Model · bau0221
Params3.82B
Context128K
Smallest1.9 GB
MO
model
Model · katya1836
Params8.03B
Context8K
Smallest8.5 GB
MO
model
Model · javenda
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · Incorrect12321
Params8.03B
Context128K
Smallest5.7 GB
MO
model
Model · shravankumar147
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model updated
Model · khurrameycon
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · leesalminen
Params8.03B
Context128K
Smallest8.5 GB
MO
model 1127 1b 501
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
MO
model project
Model · nimbXnumb
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · JustinYuann
Params8B
Context—
Q4_K_M2.1 GB
MO
model
Model · lemongooooo
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · medazizktata
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
my model
Model · prasannaJagadesh
Params362M
Context8K
Smallest0.3 GB
MO
model
Model · VladislavElite
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · whj9068
Params3.82B
Context128K
Smallest4.1 GB
MO
model q4 k m
Model · vachacorne
Params1.1B
Context4K
Q4_K_M0.7 GB
MO
model
Model · lomim
Params3.21B
Context128K
Smallest1.4 GB
MO
model
Model · deep02
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · mraryavart
Params3.09B
Context32K
Q4_K_M1.9 GB
MO
model
Model · Vithrack
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · Modular
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
my model
Model · xiaoYu201
Params8.03B
Context128K
Smallest8.5 GB
MO
ll model
Model · SiddarthaG
Params3.21B
Context128K
Smallest6.4 GB
MO
AM model together segm
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB