Model GGUF models
1010 GGUF models in the Model family, quantized by 754 uploaders. Sizes run from 13M to 69B parameters. The longest trained context is 1024K tokens.
MO
model
Model · nurichisan
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
T35Model
Model · Kaballas
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
os ta model
Model · fanwuzhi
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · cy0j
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · SyedDawood
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · tanaikkeong
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · keepcool1001
Params8.03B
Context128K
Smallest16.1 GB
MO
MOdel2
Model · qq0823
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · Stev93
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
model
Model · yosriku
Params7.25B
Context32K
Q4_K_M4.4 GB
MO
model
Model · scmagic77
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model_merged_hindi_latest_16bit_q8_0
Model · sanjay782
Params8.54B
Context8K
Smallest9.1 GB
MO
model
Model · iamwei
Params8.03B
Context128K
Smallest8.5 GB
MO
model
Model · AD9190
Params8.03B
Context128K
Smallest16.1 GB
MO
model Q4 K M
Model · CRWU1
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model
Model · Patarapoom
Params11.9B
Context—
Smallest6.8 GB
MO
model low Q4 K M
Model · fabian6567
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model q4 k
Model · rajeshisnepali
Params7.62B
Context128K
Q4_K_M4.7 GB
MO
model2
Model · MrSolace
Params3.09B
Context32K
Smallest3.3 GB
MO
model
Model · zhangjian0606
Params1.54B
Context32K
Q4_K_M1.0 GB
MO
Model1
Model · xyksaa
Params3.09B
Context32K
Smallest3.3 GB
MO
Model_Test
Model · niels32167
Params596M
Context32K
Smallest0.6 GB
MO
model5 sft 16bit
Model · jerrycheng233
Params29.9B
Context198K
Smallest10.0 GB
MO
Model5
Model · sebastianbachmaier
Params529M
Context2K
Smallest1.1 GB
MO
model1
Model · Nemesispro
Params3.21B
Context128K
Smallest3.4 GB
MO
model
Model · Neopix
Params1.24B
Context128K
Smallest1.3 GB
MO
model
Model · AndyTB
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
model jenkins
Model · abdullah00111
Params3.21B
Context128K
Smallest6.4 GB
MO
model
Model · Karthik5
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
model
Model · MahendraMedapati27
Params7.25B
Context32K
Q4_K_M4.4 GB