The GGUF models

116 GGUF models in the The family, quantized by 33 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TH
The_Croupier 3.2 1B
The · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
TH
L3.3 The Omega Directive 70B Unslop v2.0 Heretic
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The Omega Directive M 24B v1.1
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
L3.3 The Omega Directive 70B Unslop v2.0
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
the largest model ever on hf
The · GGUFGuy
Params—
Context—
Smallest0.0 GB
GGUF
TH
The Omega Directive M 24B v1.0
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
The Omega Directive M 36B v1.0
The · mradermacher
Params36.9B
Context32K
Q4_K_M22.4 GB
Roleplay
TH
the soft delerizome machine a thousand guattaris fourth of plateaus once
The · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
TH
the soft scum delerizome machine a thousand guattaris
The · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
TH
Gospel
The · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
TH
The_Creeping_Darkness X2 16B
The · mradermacher
Params16.3B
Context128K
Q4_K_M9.9 GB
Tool use
TH
The_Dead_Ripper 3.2 1B
The · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TH
The Philosopher Zephyr 7B
The · noctrex
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
The Omega Directive M 22B v1.0
The · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
RoleplayTool use
TH
H the eighth 8B LINEAR
The · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
The_Darkness 12B
The · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
the largest
The · wop
Params—
Context—
Smallest0.0 GB
GGUF
TH
The Damn Train 8B Model Stock
The · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TH
The Teacher V 2
The · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
TH
The Omega Concession M 24B v1.0
The · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
TH
the veil 12b
The · gary23w
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
TH
The_Darkside 16.6B
The · mradermacher
Params16.6B
Context1000K
Q4_K_M10.1 GB
GGUF
TH
The Omega Abomination L 70B v1.0
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The Omega Concession M 24B v1.0
The · fl-15
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
TH
The Truth Teller 1 Q8 0
The · HigherMind
Params7.25B
Context32K
Smallest7.7 GB
GGUF
TH
THE ENEMY CAN LEARN YOU
The · user052
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
TH
MS3.2 The Omega Directive 24B Unslop v2.1
The · ReadyArt
Params23.6B
Context128K
Smallest26.3 GB
Roleplay
TH
Mn 12b The Yapper
The · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
TH
L3.3 The Omega Directive 70B Unslop v2.1 Heretic
The · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
TH
The-Trinity-Coder-7B
The · faceradix
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoning

Keep browsing