GGUF models by NexesQuants
283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.
LL
Llama 3.x 70b Nemeslices V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.2 1b Odyssea V1.01
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.6 GB
LL
Llama 3.x 70b Nether V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
TH
TheDrummer Behemoth 123B v1 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
TH
TheDrummer Behemoth 123B v1.1 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
LL
Llama 3.2 1b Odyssea V1.01a
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.6 GB
LL
SentientAGI_Dobby Unhinged Llama 3.3 70B
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
ST
Steelskull L3.3 Electra R1 70b iMat CQ
Steelskull · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b FLDx2 L3.3 abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b Evalseuses v2.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
SA
Sao10K_L3.1 70B Hanami X1
Sao · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
TH
TheSkullery L3.1 MS Hytroblated 70B bf16 iMat CQ
Theskullery · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b NegaTessTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b NegerTeaz 0.21 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Tessessence 0.10c iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Triads V2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Doberwhack V1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Nemdohertess v2.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b DonkeyRider v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Electra Legion fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
MI
MiquMaid v2 70B alpha Requant iMat
Miqumaid · NexesQuants
Params69B
Context32K
Smallest18.3 GB
CO
c4ai command r plus 2024 04 f16 iMat CQ
Command R · NexesQuants
Params104B
Context128K
Smallest55.2 GB
TH
TheDrummer Behemoth 123B v1.2 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
LL
Llama 3.x 70b Smarteaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Hostess V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Hearts V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b NegaTearsTeaz 0.4 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Triads V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b CreHearTess V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Triads V5 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB