Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
Model_New2
Model · Kanoksak
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · diamondsick
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Model3
Model · ewoody
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · MrBoltik
Params4.02B
Context40K
Q4_K_M2.5 GB
MO
Model_Name_Q5Km
Model · latiftondossama
Params3.21B
Context128K
Smallest2.3 GB
MO
Model_20250613_Gguf
Model · SamYoungYin
Params7.62B
Context32K
Q4_K_M4.7 GB
MO
model
Model · robert-br
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · aditya168
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · DeveloperZoyel
Params8.03B
Context128K
Smallest8.5 GB
MO
model denemee
Model · kmk4444
Params1.24B
Context128K
Smallest2.5 GB
MO
model
Model · miadninezero
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model1
Model · nguyenhh3305
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model-7b
Model · CromonZhang
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model
Model · kobzarvs
Params494M
Context32K
Q4_K_M0.4 GB
MO
my model
Model · aniket43
Params494M
Context128K
Q4_K_M0.4 GB
MO
AM model ll TQ2
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · ImNotATeapot
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · YulaMaya
Params8.03B
Context128K
Smallest16.1 GB
MO
model2
Model · mustafasalfiti
Params3.21B
Context128K
Smallest2.3 GB
MO
model
Model · guruprasath05
Params3.19B
Context1024K
Smallest3.4 GB
MO
model Q8 0
Model · farikaw599
Params3.82B
Context4K
Smallest4.1 GB
MO
model
Model · tawsif502
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · yamasa2006
Params8.03B
Context128K
Q4_K_M0.8 GB
MO
model
Model · codeandcodes
Params8.03B
Context8K
Smallest8.5 GB
MO
model
Model · Hhendrix
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · musdbi
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Model Func
Model · ar08
Params362M
Context8K
Smallest0.4 GB
MO
SOA Model
Model · mradermacher
Params61M
Context512
Q4_K_M0.0 GB
MO
model
Model · ayushmangarg
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
Ft 1.5B 47k Wo Model
Model · sergey-z
Params1.54B
Context32K
Q4_K_M1.0 GB