GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.x 70b Nemeslices V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.2 1b Odyssea V1.01
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.6 GB
Tool use
LL
Llama 3.x 70b Nether V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
TH
TheDrummer Behemoth 123B v1 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
Tool use
TH
TheDrummer Behemoth 123B v1.1 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
Tool use
LL
Llama 3.2 1b Odyssea V1.01a
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.6 GB
Tool use
LL
SentientAGI_Dobby Unhinged Llama 3.3 70B
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
ST
Steelskull L3.3 Electra R1 70b iMat CQ
Steelskull · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
Llama 3.x 70b FLDx2 L3.3 abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b Evalseuses v2.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
SA
Sao10K_L3.1 70B Hanami X1
Sao · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
TH
TheSkullery L3.1 MS Hytroblated 70B bf16 iMat CQ
Theskullery · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b NegaTessTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b NegerTeaz 0.21 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Tessessence 0.10c iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Triads V2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Doberwhack V1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Nemdohertess v2.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b DonkeyRider v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Electra Legion fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
MI
MiquMaid v2 70B alpha Requant iMat
Miqumaid · NexesQuants
Params69B
Context32K
Smallest18.3 GB
GGUF
CO
c4ai command r plus 2024 04 f16 iMat CQ
Command R · NexesQuants
Params104B
Context128K
Smallest55.2 GB
GGUF
TH
TheDrummer Behemoth 123B v1.2 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
Tool use
LL
Llama 3.x 70b Smarteaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.1 70b Hostess V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.1 70b Hearts V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b NegaTearsTeaz 0.4 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Triads V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.1 70b CreHearTess V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Triads V5 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use

Keep browsing