Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · fangxynn
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · daijun753
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · joonhyun2
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · jubay
Params720M
Context—
Q4_K_M0.4 GB
MO
model
Model · sheepwjy
Params7.62B
Context128K
Smallest8.1 GB
MO
model
Model · xpower1991
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
Mh Model
Model · marin-radjenovic
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · Requiiin
Params14.8B
Context32K
Q4_K_M9.0 GB
MO
model
Model · pl4y3pic
Params494M
Context32K
Smallest0.5 GB
MO
model
Model · xyksaa
Params7.62B
Context128K
Smallest8.1 GB
MO
model
Model · rhenzu
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · Timbo89
Params3.19B
Context1024K
Q4_K_M1.9 GB
MO
GK Model 150M_local_hf
Model · sriauraworx
Params162M
Context1K
Smallest0.3 GB
MO
model gAO extract
Model · zxcvmh666
Params4.02B
Context256K
Q4_K_M2.5 GB
MO
model
Model · salipour
Params8.03B
Context128K
Smallest8.5 GB
MO
model4
Model · VR29
Params3.82B
Context128K
Smallest4.1 GB
MO
model
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
MO
model1
Model · Leepaul
Params3.21B
Context128K
Smallest3.4 GB
MO
model merged pp Q2 K
Model · emrd95
Params23.6B
Context32K
Smallest8.9 GB
MO
model overfitted Q5 K M
Model · fabian6567
Params8.03B
Context128K
Smallest5.7 GB
MO
model
Model · lebronzhang224
Params3.09B
Context32K
Smallest3.3 GB
MO
model
Model · ChuKaHang
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · simu12
Params8.03B
Context128K
Smallest8.5 GB
MO
model name
Model · Gorantlasuhas
Params1B
Context32K
Q4_K_M0.8 GB
MO
model q4 K
Model · julicq
Params13B
Context2K
Smallest7.9 GB
MO
My Model
Model · jnjj
Params13M
Context1K
Smallest0.0 GB
MO
model
Model · focknames
Params8.19B
Context128K
Smallest8.7 GB
MO
model
Model · ImJericho
Params8.03B
Context128K
Smallest4.4 GB
MO
model
Model · plocx
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · Cesarbasurto
Params9.24B
Context8K
Q4_K_M5.8 GB