Trinity GGUF models

83 GGUF models in the Trinity family, quantized by 28 uploaders. Sizes run from 6.1B to 399B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TR
Trinity 13B
Trinity · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TR
trinity gpt distill Q8 0
Trinity · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TR
Trinity Large Base i1
Trinity · mradermacher
Params399B
Context256K
Smallest0.5 GB
GGUF
TR
trinity v1
Trinity · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TR
trinity nano base fic
Trinity · bouncy72
Params6.12B
Context128K
Q4_K_M3.8 GB
Tool use
TR
Trinity Mini Base Pre Anneal
Trinity · lyraaaa
Params26.1B
Context4K
Q4_K_M15.8 GB
GGUF
TR
trinity exuberant opus3 Q8 0
Trinity · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TR
Trinity Nano Bee Claude v2
Trinity · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TR
Trinity Nano Bee Claude
Trinity · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TR
Trinity Nano Preview
Trinity · Edge-Quant
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
TR
trinity nano base
Trinity · darthceltic85
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TR
Trinity Mini Base Pre Anneal
Trinity · lyraaaa
Params26.1B
Context4K
Smallest27.8 GB
GGUF
TR
Trinity 13B
Trinity · yee-nah
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TR
Trinity_Notus-xb
Trinity · powermove72
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
TR
Trinity Nano Base Pre Anneal
Trinity · from-our-page
Params6.12B
Context4K
Smallest6.5 GB
GGUF
TR
Trinity Nano Preview W4A16
Trinity · erenyeager-1
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
TR
Trinity Mini Base
Trinity · lyraaaa
Params26.1B
Context128K
Q4_K_M15.8 GB
GGUF
TR
Trinity 33B v1.0
Trinity · LoneStriker
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
TR
Trinity Mini
Trinity · noctrex
Params26.1B
Context128K
Smallest15.0 GB
ReasoningTool use
TR
feature interpreter Q 8
Trinity · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TR
Trinity Mini FP8 Block
Trinity · AIgotahole
Params26.1B
Context128K
Q4_K_M15.8 GB
GGUF
TR
Trinity Large Thinking
Trinity · milkowski
Params399B
Context256K
Smallest216.3 GB
ReasoningTool use
TR
trinity nano starlight v0.5 Q8 0
Trinity · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
GGUF

Keep browsing