The GGUF models

116 GGUF models in the The family, quantized by 33 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TH
L3.3 The Omega Directive 70B Unslop v2.1 Heretic
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The Omega Abomination M 12B v1.0
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
TH
The Omega Directive 12B EVISCERATED FT
The · mradermacher
Params10.6B
Context1000K
Q4_K_M6.5 GB
GGUF
TH
The_Darkness 12B
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
MS3.2 The Omega Directive 24B Unslop v2.1
The · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
TH
On the Strange Lands MN 12B i1
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
L3.3 The Omega Directive 70B Unslop v2.0 Heretic
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
MS3.2 The Omega Directive 24B Unslop v2.0
The · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
TH
The Omega Legion L 70B v1.0
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
TH
The Functionary 12B
The · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
TH
The True Abomination 24B
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
The_techer
The · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
TH
H the eighth 8B LINEAR i1
The · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
L3.3 The Omega Directive 70B Unslop v2.1
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The Omega Directive L 70B v1.0
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The Omega Directive M 24B v1.0
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
The Omega Concession M 24B v1.0
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
The Damn Train 8B Model Stock i1
The · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TH
H the eighth 8B LINEAR
The · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
The Omega Directive M 36B v1.0
The · mradermacher
Params36.9B
Context32K
Q4_K_M22.4 GB
Roleplay
TH
The Omega Directive L 70B v1.0
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The_Darkside 16.6B
The · mradermacher
Params16.6B
Context1000K
Q4_K_M10.1 GB
GGUF
TH
The Omega Directive M 22B v1.0
The · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
RoleplayTool use
TH
The Omega Directive M 12B v1.0
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
TH
The Omega Directive 12B EVISCERATED FT
The · mradermacher
Params10.6B
Context1000K
Q4_K_M6.5 GB
GGUF
TH
The_Dealer 3.2 1B
The · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
TH
the sleepy scientist
The · Evoke3962
Params10M
Context32K
Q4_K_M0.4 GB
GGUF
TH
The Creeping Darkness X2 16B
The · Bumoch
Params2M
Context—
Smallest0.0 GB
GGUF
TH
The Omega Abomination M 24B v1.1
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
The True Abomination 24B
The · Casual-Autopsy
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay

Keep browsing