Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
Model1
Model · Lyes930
Params7.62B
Context32K
Smallest8.1 GB
Tool use
MO
Ft_model2
Model · bzx123
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
MO
model
Model · Simone999111
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
Ft 1.5B 105k Wo v5 Model
Model · front-less
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MO
model legal
Model · abodizx05
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · tomtomasgreen
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MO
model
Model · Noxus09
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MO
model3d 2048 multi enh 2
Model · fqb
Params3.3B
Context128K
Smallest2.4 GB
Tool use
MO
AM model together
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · iacrun85HF
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · cjw1244
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model address Parcing
Model · HOS-IN
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
model gguf ner
Model · anish12
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
MO
Model_Q4_K_M
Model · vnyaryan
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model_hindi_merged_q4_k_m
Model · sanjay782
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MO
model
Model · sanathkumar
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MO
model
Model · khengkok
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MO
model_merged_hindi_latest_16bit_q4_k_m
Model · sanjay782
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MO
model test
Model · liuxx839yeah
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · erpsarang
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
GGUFT24
Model · Kaballas
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model
Model · daredevil279
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Ft 1.5B 105k Wo v9 Model
Model · front-less
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MO
my model
Model · fengyunhai
Params1.78B
Context128K
Smallest1.9 GB
Tool use
MO
model
Model · darkjwr
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model
Model · aryax0x
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MO
model
Model · oswaldosc
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MO
Model 2
Model · seantilley
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model 007 13b v2
Model · actionpace
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
AM model ll T
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing