GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
TheDrummer Behemoth 123B v2.1 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
GGUF
LL
NaniDAO Llama 3.3 70B Instruct ablated iMat CF
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b Nemeslices V1.4 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b FreeFaller R1 V1.21 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
Llama 3.1 70b Nemdohertess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Trojka V2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b SmarTricks v1.60 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.3 70B Instruct
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
NE
NeverSleep MiquMaid v2 70B iMat
Neversleep · NexesQuants
Params69B
Context32K
Smallest14.5 GB
GGUF
LL
Llama 3.x 70b Tess Athene 128K v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Flipper 0.36 Tess Dolphin 128K v1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.1 70b Nemhertess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Hexagon Purple V2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b DarkDonkey v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
TH
TheDrummer_Fallen Command A 111B v1
Thedrummer · NexesQuants
Params111B
Context256K
Smallest118.0 GB
GGUF
LL
Llama 3.x 70b Athoblumicreacalmtess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.1 70b Nemotachtess iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b BetsyTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.1 70b Luminoblivion CW V1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
TH
TheDrummer Behemoth 123B v2.2 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
GGUF
ST
Steelskull L3.3 Damascus R1 bf16 iMat CQ
Steelskull · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
ReasoningTool use
LL
Llama 3.x 70b Nethesis V1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b SmarTricks V1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
Llama 3.x 70b Tess Dolphin 128K v1.21 CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Trojka V2.5 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b SmarTricks v1.61 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
ST
Steelskull L3.3 MS Nevoria 70b bf16 iMat CQ
Steelskull · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
TH
TheSkullery L3.3 Exp Nevoria 70b v0.1 bf16 iMat CQ
Theskullery · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b NegaTessTeaz 0.2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use

Keep browsing