Model GGUF models

1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MO
model
Model · nurichisan
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
T35Model
Model · Kaballas
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
os ta model
Model · fanwuzhi
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · cy0j
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · SyedDawood
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · tanaikkeong
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · keepcool1001
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
MOdel2
Model · qq0823
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MO
model
Model · Stev93
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model
Model · yosriku
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MO
model
Model · scmagic77
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model_merged_hindi_latest_16bit_q8_0
Model · sanjay782
Params8.54B
Context8K
Smallest9.1 GB
GGUF
MO
model
Model · iamwei
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MO
model
Model · AD9190
Params8.03B
Context128K
Smallest16.1 GB
GGUF
MO
model Q4 K M
Model · CRWU1
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model
Model · Patarapoom
Params11.9B
Context—
Smallest6.8 GB
GGUF
MO
model low Q4 K M
Model · fabian6567
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MO
model q4 k
Model · rajeshisnepali
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MO
model2
Model · MrSolace
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MO
model
Model · zhangjian0606
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MO
Model1
Model · xyksaa
Params3.09B
Context32K
Smallest3.3 GB
Tool use
MO
Model_Test
Model · niels32167
Params596M
Context32K
Smallest0.6 GB
GGUF
MO
model5 sft 16bit
Model · jerrycheng233
Params29.9B
Context198K
Smallest10.0 GB
GGUF
MO
Model5
Model · sebastianbachmaier
Params529M
Context2K
Smallest1.1 GB
Tool use
MO
model1
Model · Nemesispro
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MO
model
Model · Neopix
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model
Model · AndyTB
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
model jenkins
Model · abdullah00111
Params3.21B
Context128K
Smallest6.4 GB
Tool use
MO
model
Model · Karthik5
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
model
Model · MahendraMedapati27
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing