Marco GGUF models

121 GGUF models in the Marco family, quantized by 40 uploaders. Sizes run from 4M to 17.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
ms marco MiniLM L6 v2 gguf q8 0
Marco · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
Coding
MA
ms marco TinyBERT L2 v2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
Marco o1 abliterated Q8 0
Marco · Eagalon
Params7.62B
Context32K
Smallest8.1 GB
GGUF
MA
Marco o1 IQ4 NL
Marco · JustMahiro
Params7.62B
Context32K
Smallest4.4 GB
GGUF
MA
ms marco MiniLM L2 v2 Q8 0
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
CodingEmbedding
MA
Marco Mini Instruct
Marco · gopi87
Params17.3B
Context32K
Smallest12.3 GB
ReasoningTool use
MA
ms marco MiniLM L6 v2 gguf f16
Marco · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
Coding
MA
Marco Mini Instruct
Marco · Disya
Params17.3B
Context32K
Smallest9.8 GB
ReasoningTool use
MA
Marco Mini Instruct
Marco · Gardenia8866
Params17.3B
Context32K
Smallest18.4 GB
ReasoningTool use
MA
Marco o1 abliterated Q8 0
Marco · kabachuha
Params7.62B
Context32K
Smallest8.1 GB
GGUF
MA
ms marco TinyBERT L2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
MA
Marco o1 abliterated Q2 K
Marco · Hjgugugjhuhjggg
Params7.62B
Context32K
Smallest3.0 GB
GGUF
MA
ms marco MiniLM L2 v2 F16
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco TinyBERT L2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
Marco o1 Q8 0
Marco · Aashraf995
Params7.62B
Context32K
Smallest8.1 GB
GGUF
MA
ms marco MiniLM L6 v2 gguf q4 k m
Marco · keisuke-miyako
Params23M
Context512
Q4_K_M0.0 GB
Coding
MA
ms marco TinyBERT L2 v2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco MiniLM L4 v2 Q8 0
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
CodingEmbedding
MA
Marco o1 abliterated Q4 K M
Marco · EntropyYue
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
ms marco MiniLM L12 v2 F16
Marco · sinjab
Params33M
Context512
Smallest0.1 GB
CodingEmbedding
MA
ms marco TinyBERT L4 F16
Marco · sinjab
Params14M
Context512
Smallest0.0 GB
CodingEmbedding
MA
Marco o1
Marco · Sri-Vigneshwar-DJ
Params7.62B
Context32K
Smallest15.2 GB
GGUF
MA
ms marco MiniLM L12 v2 Q8 0
Marco · sinjab
Params33M
Context512
Smallest0.0 GB
CodingEmbedding
MA
Marco o1 SILLY
Marco · ZeroWw
Params7.62B
Context32K
Smallest9.1 GB
GGUF
MA
ms marco TinyBERT L2 v2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco MiniLM L2 v2 Q4 K M
Marco · sinjab
Params16M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
Marco o1 Q4 K M
Marco · waltervix
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
ms marco TinyBERT L6 F16
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
CodingEmbedding
MA
ms marco TinyBERT L6 Q8 0
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
CodingEmbedding
MA
Marco o1 Q4 K M
Marco · farpluto
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing