Marco GGUF models
121 GGUF models in the Marco family, quantized by 40 uploaders. Sizes run from 4M to 17.4B parameters. The longest trained context is 128K tokens.
MA
AIDC-AI/Marco-LLM-ES
Marco · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
MA
Marco 01 slerp3 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
ms marco MiniLM L4 v2
Marco · mradermacher
Params19M
Context512
Q4_K_M0.0 GB
MA
Marco 01 slerp1 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Marco o1 Q8 0
Marco · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
MA
ms marco MiniLM L6 v2 F16
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
MA
Marco 01 slerp2 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
R Marco polo
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Marco LLM AR V3
Marco · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
MA
AIDC AI Marco o1
Marco · neody
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Marco o1 Q4 K M
Marco · Aldaris
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Marco o1 Q5 K M
Marco · Angelo233
Params7.62B
Context32K
Smallest5.4 GB
MA
Marco 01 slerp7 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
ms marco MiniLM L6 v2 Q8 0
Marco · toolittlecakes
Params23M
Context512
Smallest0.0 GB
MA
Marco 01 slerp6 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
ms marco TinyBERT L2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
MA
ms marco MiniLM L6 v2 Q4 K M
Marco · sinjab
Params23M
Context512
Q4_K_M0.0 GB
MA
Marco o1 Q6 K
Marco · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest6.3 GB
MA
Marco o1
Marco · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
MA
Marco Mini Instruct
Marco · gopi87
Params17.3B
Context32K
Smallest18.4 GB
MA
Marco Nano Instruct
Marco · Disya
Params8B
Context32K
Smallest7.2 GB
MA
ms marco MiniLM L12 v2 Q4 K M
Marco · sinjab
Params33M
Context512
Q4_K_M0.0 GB
MA
Marco o1 Q2 K
Marco · Hjgugugjhuhjggg
Params7.62B
Context32K
Smallest3.0 GB
MA
ms marco MiniLM L4 v2 Q4 K M
Marco · sinjab
Params19M
Context512
Q4_K_M0.0 GB
MA
AIDC AI Marco LLM AR V2
Marco · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
MA
Marco o1 IQ3 XXS
Marco · performanceoptician
Params7.62B
Context32K
Smallest3.1 GB
MA
Marco o1 Q4 K M
Marco · YorkieOH10
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Marco o1 Q4 K M
Marco · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Marco o1 Q8 0
Marco · ysn-rfd
Params7.62B
Context32K
Smallest8.1 GB
MA
ms marco MiniLM L4 v2 F16
Marco · sinjab
Params19M
Context512
Smallest0.0 GB