Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · agentzefen
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · steq28
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · stage1
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · angrybyte
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model123
Model · Crystalhavanvo
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
1113 model 2 hf
Model · bau0221
Params3.82B
Context128K
Smallest4.1 GB
GGUF
MO
model500
Model · Gwizzly
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · Stixludde
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
Ft 1.5B 117k Og Model
Model · sergey-z
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MO
model
Model · jamjam4826
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · robailleo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · Jaju
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · guineapig
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model 1
Model · mhumza37
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · butterKuma
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · serdom02
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model
Model · alifalferdiansyah
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · Anton-Ding
Params20.4B
Context—
Q4_K_M2.0 GB
GGUF
MO
model
Model · haoyaqi
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MO
Model_Pmc_Gamma_0.05_Noise0_0_Epoch1
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model3d
Model · fqb
Params3.3B
Context128K
Smallest2.4 GB
Tool use
MO
model
Model · szwen
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
ur3 3model
Model · JingwuLuo
Params3.39B
Context—
Smallest1.9 GB
GGUF
MO
model2
Model · TozluLider6393
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · aldav76
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
Model
Model · JavoMendoza
Params8.19B
Context40K
Q4_K_M10.9 GB
GGUF
MO
QA_model
Model · Ak1104
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
MO
AM model qw T
Model · LucileFavero
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · c4st4
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · ctwjconnell
Params3.21B
Context128K
Smallest3.4 GB
GGUF

Keep browsing