Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · AnderSander
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model 6hs
Model · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MO
model
Model · trnghuybru
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Rp model_E2B_v5.1
Model · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
MO
model
Model · HillPhelmuth
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · s30km0
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
MODEL
Model · orderoftime
Params7.72B
Context32K
Q4_K_M4.9 GB
Coding
MO
model
Model · gautham11
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · saiarunanshu
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model 1127 1b 351
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model the best
Model · jeuzu
Params1.24B
Context128K
Smallest1.3 GB
GGUF
MO
model Q5 K M
Model · fabian6567
Params8.03B
Context128K
Smallest5.7 GB
Tool use
MO
model
Model · TinaAbt
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
model 1127 1b
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model sonbee 8bits
Model · atsintli
Params1.54B
Context32K
Smallest1.6 GB
Tool use
MO
model
Model · jimmyken
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · JERRYNPC
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
Model Quran Tafseer Model GPT2
Model · fadelfitrah
Params163M
Context1K
Smallest0.3 GB
GGUF
MO
model 1127 1b 16
Model · bau0221
Params1.24B
Context128K
Smallest2.5 GB
Tool use
MO
Model_Q4_K_M
Model · vnyaryan
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MO
model
Model · Zaki-Zan
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · sridevbox374
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
R_Model
Model · farikaw599
Params3.82B
Context4K
Smallest4.1 GB
GGUF
MO
model
Model · dcoder0101
Params8.03B
Context128K
Smallest8.5 GB
Coding
MO
model
Model · SiwaSathya
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
MO
model
Model · h3lmi
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · sheliak
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · TouseefAhmad
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Sf_Model_V0.1
Model · jiddykwon
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MO
model 2gb
Model · jeuzu
Params3.61B
Context128K
Smallest2.5 GB
Tool use

Keep browsing