The GGUF models

116 GGUF models in the The family, quantized by 33 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TH
The Archivist
The · lyraaaa
Params6.12B
Context128K
Smallest6.5 GB
Tool use
TH
OmegaDirective 70B 6Q Merged
The · Babsie
Params70.6B
Context128K
Smallest57.9 GB
RoleplayTool use
TH
CasAuTabom24BcmlKaajtmentKaa12816
The · UniLLMer
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
TH
the extra cursed
The · BeaverAI
Params22.2B
Context128K
Smallest12.7 GB
Tool use
TH
The Shamanic 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
GGUF
TH
THE ARCHITECT V2 FINAL
The · ShiroOnigami23
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
The Dirt V1
The · YGV
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TH
The Eternal 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
GGUF
TH
To the end of this earth MN 12B
The · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
TH
The Omega Directive M 12B v1.0
The · EggsyIsTheSaint
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
TH
The_Elder v2
The · Ishymoto
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TH
The Omega Abomination M 24B v1.1 MLX
The · EggsyIsTheSaint
Params23.6B
Context32K
Smallest13.4 GB
Roleplay
TH
The Enlightened 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
GGUF
TH
NesysEngineV2.1TEST
The · nesymerp1
Params23.6B
Context128K
Smallest13.5 GB
GGUF
TH
The_Elder
The · Ishymoto
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TH
The Omega Directive 12B EVISCERATED FT
The · SuperbEmphasis
Params10.6B
Context1000K
Smallest11.3 GB
GGUF
TH
The PII Detection System
The · Sanjay1905
Params1.24B
Context128K
Smallest2.5 GB
GGUF
TH
The Omega Directive 12B EVISCERATED FT Stage2
The · SuperbEmphasis
Params10.6B
Context1000K
Smallest8.7 GB
GGUF
TH
On the Strange Lands MN 12B Q4 K M
The · RedSQID
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
The Omega Directive 24B Unslop v2.0 Q6K
The · Maboilgrande
Params23.6B
Context128K
Smallest19.3 GB
GGUF
TH
The_Creeping_Darkness X2 16B
The · MrDevolver
Params16.3B
Context128K
Smallest9.4 GB
GGUF
TH
the legacy
The · malFlexion
Params1.24B
Context128K
Smallest1.3 GB
Tool use
TH
Gm4 31B The DECKARD HERETIC Thinking it i1
The · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool use
TH
Gm4 31B The Deckards Brain i1
The · ineosnexus
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool use
TH
To the end of this earth MN 12B
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
To the end of this earth MN 12B i1
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing