Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
Model Flux
Model · SkylinkLabs
Params11.9B
Context—
Smallest8.3 GB
GGUF
MO
model
Model · Dunkardy
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
MO
model2 gspo
Model · jerrycheng233
Params4.02B
Context40K
Smallest4.3 GB
ReasoningTool use
MO
model
Model · dcibils00
Params8.03B
Context128K
Smallest3.4 GB
GGUF
MO
model not overfitted Q4 K M
Model · fabian6567
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · ryie0407
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model
Model · cooljelly
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
my model
Model · Divyadharshiny
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MO
model
Model · Avvis
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model SFT enron 4B
Model · Sr-Carlos
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MO
my b2b model
Model · hemantkumar5122001
Params7.62B
Context32K
Smallest4.7 GB
Tool use
MO
model3
Model · cyanezjo
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
MO
model food 7b
Model · 523
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MO
model
Model · emreakdogan
Params6.95B
Context4K
Smallest7.4 GB
GGUF
MO
model
Model · ulisesdasca
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · Tanisha121
Params8.03B
Context128K
Smallest4.9 GB
GGUF
MO
model test
Model · JeongHun22
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model 1
Model · amoghbindal28
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model updated
Model · spthechamp
Params8.03B
Context128K
Smallest4.1 GB
GGUF
MO
model
Model · erikdz
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
Model_Pmc_Kl_0.1_Noise0_0
Model · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MO
model_tuned
Model · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
MO
Model_No_Bias_My_13M
Model · jnjj
Params13M
Context1K
Smallest0.0 GB
ReasoningTool use
MO
model
Model · beelinekim
Params20.9B
Context128K
Smallest13.8 GB
Tool use
MO
hp model
Model · sevgjan
Params3.82B
Context128K
Smallest2.0 GB
GGUF
MO
model f16
Model · Avvis
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model 1B fine tuned
Model · lucious66
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
Q ai model
Model · Kiwchauat
Params3.88B
Context32K
Q4_K_M4.4 GB
GGUF
MO
model2
Model · jam06452
Params4.02B
Context40K
Smallest4.3 GB
ReasoningTool use
MO
model deep2
Model · n0rmis
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use

Keep browsing