The GGUF models
116 GGUF models in the The family, quantized by 33 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1000K tokens.
TH
The Archivist
The · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
TH
OmegaDirective 70B 6Q Merged
The · Babsie
Params70.6B
Context128K
Smallest57.9 GB
TH
CasAuTabom24BcmlKaajtmentKaa12816
The · UniLLMer
Params23.6B
Context32K
Q4_K_M14.3 GB
TH
the extra cursed
The · BeaverAI
Params22.2B
Context128K
Smallest12.7 GB
TH
The Shamanic 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
TH
THE ARCHITECT V2 FINAL
The · ShiroOnigami23
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
The Dirt V1
The · YGV
Params8.03B
Context128K
Q4_K_M4.9 GB
TH
The Eternal 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
TH
To the end of this earth MN 12B
The · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
TH
The Omega Directive M 12B v1.0
The · EggsyIsTheSaint
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
The_Elder v2
The · Ishymoto
Params1.1B
Context2K
Smallest1.2 GB
TH
The Omega Abomination M 24B v1.1 MLX
The · EggsyIsTheSaint
Params23.6B
Context32K
Smallest13.4 GB
TH
The Enlightened 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
TH
NesysEngineV2.1TEST
The · nesymerp1
Params23.6B
Context128K
Smallest13.5 GB
TH
The_Elder
The · Ishymoto
Params1.1B
Context2K
Q4_K_M0.7 GB
TH
The Omega Directive 12B EVISCERATED FT
The · SuperbEmphasis
Params10.6B
Context1000K
Smallest11.3 GB
TH
The PII Detection System
The · Sanjay1905
Params1.24B
Context128K
Smallest2.5 GB
TH
The Omega Directive 12B EVISCERATED FT Stage2
The · SuperbEmphasis
Params10.6B
Context1000K
Smallest8.7 GB
TH
On the Strange Lands MN 12B Q4 K M
The · RedSQID
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
The Omega Directive 24B Unslop v2.0 Q6K
The · Maboilgrande
Params23.6B
Context128K
Smallest19.3 GB
TH
The_Creeping_Darkness X2 16B
The · MrDevolver
Params16.3B
Context128K
Smallest9.4 GB
TH
the legacy
The · malFlexion
Params1.24B
Context128K
Smallest1.3 GB
TH
Gm4 31B The DECKARD HERETIC Thinking it i1
The · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
TH
Gm4 31B The Deckards Brain i1
The · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
TH
To the end of this earth MN 12B
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
To the end of this earth MN 12B i1
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB