Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · fangxynn
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · daijun753
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · joonhyun2
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · jubay
Params720M
Context—
Q4_K_M0.4 GB
GGUF
MO
model
Model · sheepwjy
Params7.62B
Context128K
Smallest8.1 GB
GGUF
MO
model
Model · xpower1991
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Mh Model
Model · marin-radjenovic
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · Requiiin
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MO
model
Model · pl4y3pic
Params494M
Context32K
Smallest0.5 GB
Tool use
MO
model
Model · xyksaa
Params7.62B
Context128K
Smallest8.1 GB
GGUF
MO
model
Model · rhenzu
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · Timbo89
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
MO
GK Model 150M_local_hf
Model · sriauraworx
Params162M
Context1K
Smallest0.3 GB
GGUF
MO
model gAO extract
Model · zxcvmh666
Params4.02B
Context256K
Q4_K_M2.5 GB
GGUF
MO
model
Model · salipour
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model4
Model · VR29
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
model
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model1
Model · Leepaul
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model merged pp Q2 K
Model · emrd95
Params23.6B
Context32K
Smallest8.9 GB
GGUF
MO
model overfitted Q5 K M
Model · fabian6567
Params8.03B
Context128K
Smallest5.7 GB
Tool use
MO
model
Model · lebronzhang224
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MO
model
Model · ChuKaHang
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · simu12
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model name
Model · Gorantlasuhas
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MO
model q4 K
Model · julicq
Params13B
Context2K
Smallest7.9 GB
GGUF
MO
My Model
Model · jnjj
Params13M
Context1K
Smallest0.0 GB
GGUF
MO
model
Model · focknames
Params8.19B
Context128K
Smallest8.7 GB
Tool use
MO
model
Model · ImJericho
Params8.03B
Context128K
Smallest4.4 GB
GGUF
MO
model
Model · plocx
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · Cesarbasurto
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing