Marco GGUF models
121 GGUF models in the Marco family, quantized by 40 uploaders. Sizes run from 4M to 17.4B parameters. The longest trained context is 128K tokens.
MA
ms marco MiniLM L6 v2 gguf q8 0
Marco · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
MA
ms marco TinyBERT L2 v2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
MA
Marco o1 abliterated Q8 0
Marco · Eagalon
Params7.62B
Context32K
Smallest8.1 GB
MA
Marco o1 IQ4 NL
Marco · JustMahiro
Params7.62B
Context32K
Smallest4.4 GB
MA
ms marco MiniLM L2 v2 Q8 0
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
MA
Marco Mini Instruct
Marco · gopi87
Params17.3B
Context32K
Smallest12.3 GB
MA
ms marco MiniLM L6 v2 gguf f16
Marco · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
MA
Marco Mini Instruct
Marco · Disya
Params17.3B
Context32K
Smallest9.8 GB
MA
Marco Mini Instruct
Marco · Gardenia8866
Params17.3B
Context32K
Smallest18.4 GB
MA
Marco o1 abliterated Q8 0
Marco · kabachuha
Params7.62B
Context32K
Smallest8.1 GB
MA
ms marco TinyBERT L2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
MA
Marco o1 abliterated Q2 K
Marco · Hjgugugjhuhjggg
Params7.62B
Context32K
Smallest3.0 GB
MA
ms marco MiniLM L2 v2 F16
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
MA
ms marco TinyBERT L2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
MA
Marco o1 Q8 0
Marco · Aashraf995
Params7.62B
Context32K
Smallest8.1 GB
MA
ms marco MiniLM L6 v2 gguf q4 k m
Marco · keisuke-miyako
Params23M
Context512
Q4_K_M0.0 GB
MA
ms marco TinyBERT L2 v2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
MA
ms marco MiniLM L4 v2 Q8 0
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
MA
Marco o1 abliterated Q4 K M
Marco · EntropyYue
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
ms marco MiniLM L12 v2 F16
Marco · sinjab
Params33M
Context512
Smallest0.1 GB
MA
ms marco TinyBERT L4 F16
Marco · sinjab
Params14M
Context512
Smallest0.0 GB
MA
Marco o1
Marco · Sri-Vigneshwar-DJ
Params7.62B
Context32K
Smallest15.2 GB
MA
ms marco MiniLM L12 v2 Q8 0
Marco · sinjab
Params33M
Context512
Smallest0.0 GB
MA
Marco o1 SILLY
Marco · ZeroWw
Params7.62B
Context32K
Smallest9.1 GB
MA
ms marco TinyBERT L2 v2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
MA
ms marco MiniLM L2 v2 Q4 K M
Marco · sinjab
Params16M
Context512
Q4_K_M0.0 GB
MA
Marco o1 Q4 K M
Marco · waltervix
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
ms marco TinyBERT L6 F16
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
MA
ms marco TinyBERT L6 Q8 0
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
MA
Marco o1 Q4 K M
Marco · farpluto
Params7.62B
Context32K
Q4_K_M4.7 GB