Marco GGUF models

121 GGUF models in the Marco family, quantized by 40 uploaders. Sizes run from 4M to 17.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MA
AIDC-AI/Marco-LLM-ES
Marco · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MA
Marco 01 slerp3 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
ms marco MiniLM L4 v2
Marco · mradermacher
Params19M
Context512
Q4_K_M0.0 GB
Coding
MA
Marco 01 slerp1 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Marco o1 Q8 0
Marco · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest8.1 GB
GGUF
MA
ms marco MiniLM L6 v2 F16
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
MA
Marco 01 slerp2 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
R Marco polo
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Marco LLM AR V3
Marco · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
MA
AIDC AI Marco o1
Marco · neody
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Marco o1 Q4 K M
Marco · Aldaris
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Marco o1 Q5 K M
Marco · Angelo233
Params7.62B
Context32K
Smallest5.4 GB
GGUF
MA
Marco 01 slerp7 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
ms marco MiniLM L6 v2 Q8 0
Marco · toolittlecakes
Params23M
Context512
Smallest0.0 GB
Coding
MA
Marco 01 slerp6 7B
Marco · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
ms marco TinyBERT L2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco MiniLM L6 v2 Q4 K M
Marco · sinjab
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
Marco o1 Q6 K
Marco · Lucy-in-the-Sky
Params7.62B
Context32K
Smallest6.3 GB
GGUF
MA
Marco o1
Marco · ZeroWw
Params7.62B
Context32K
Smallest5.1 GB
GGUF
MA
Marco Mini Instruct
Marco · gopi87
Params17.3B
Context32K
Smallest18.4 GB
ReasoningTool use
MA
Marco Nano Instruct
Marco · Disya
Params8B
Context32K
Smallest7.2 GB
ReasoningTool use
MA
ms marco MiniLM L12 v2 Q4 K M
Marco · sinjab
Params33M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
Marco o1 Q2 K
Marco · Hjgugugjhuhjggg
Params7.62B
Context32K
Smallest3.0 GB
GGUF
MA
ms marco MiniLM L4 v2 Q4 K M
Marco · sinjab
Params19M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
AIDC AI Marco LLM AR V2
Marco · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
MA
Marco o1 IQ3 XXS
Marco · performanceoptician
Params7.62B
Context32K
Smallest3.1 GB
GGUF
MA
Marco o1 Q4 K M
Marco · YorkieOH10
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Marco o1 Q4 K M
Marco · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Marco o1 Q8 0
Marco · ysn-rfd
Params7.62B
Context32K
Smallest8.1 GB
GGUF
MA
ms marco MiniLM L4 v2 F16
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
CodingEmbedding

Keep browsing