GGUF models by NexesQuants
283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.
TH
TheDrummer Behemoth 123B v2.1 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
LL
NaniDAO Llama 3.3 70B Instruct ablated iMat CF
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b Nemeslices V1.4 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b FreeFaller R1 V1.21 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Nemdohertess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Trojka V2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTricks v1.60 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Hermes 3 Llama 3.1 70B
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.3 70B Instruct
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
NE
NeverSleep MiquMaid v2 70B iMat
Neversleep · NexesQuants
Params69B
Context32K
Smallest14.5 GB
LL
Llama 3.x 70b Tess Athene 128K v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Flipper 0.36 Tess Dolphin 128K v1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Nemhertess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Hexagon Purple V2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b DarkDonkey v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
TH
TheDrummer_Fallen Command A 111B v1
Thedrummer · NexesQuants
Params111B
Context256K
Smallest118.0 GB
LL
Llama 3.x 70b Athoblumicreacalmtess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Nemotachtess iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b BetsyTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Luminoblivion CW V1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
TH
TheDrummer Behemoth 123B v2.2 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
ST
Steelskull L3.3 Damascus R1 bf16 iMat CQ
Steelskull · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b Nethesis V1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTricks V1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Tess Dolphin 128K v1.21 CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Trojka V2.5 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTricks v1.61 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ST
Steelskull L3.3 MS Nevoria 70b bf16 iMat CQ
Steelskull · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
TH
TheSkullery L3.3 Exp Nevoria 70b v0.1 bf16 iMat CQ
Theskullery · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b NegaTessTeaz 0.2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB