GGUF models by NexesQuants
283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.
MI
mistralai_Mixtral 8x22B Instruct v0.1
Mistral · NexesQuants
Params141B
Context64K
Smallest60.3 GB
LL
Llama 3.x 70b Hexagon Purple V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GE
Gemma 3 27b Novision
Gemma · NexesQuants
Params27B
Context128K
Smallest28.7 GB
LL
Llama 3.x 70b SmarTricks V1.30 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Trojka V3 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Tristar V2.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b UnfusedV06 Genelemo fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b FLDx2 Tess3 abliterated fusion norm iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Tristar V1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
NA
Nano_Imp_1B
Nano · NexesQuants
Params1.5B
Context128K
Smallest1.2 GB
LL
Llama 3.1 70b Priestess V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
MI
Mistral Large Instruct 2411 bf16 iMat CQ
Mistral · NexesQuants
Params123B
Context128K
Smallest48.4 GB
LL
Llama 3.x 70b Doppelectra v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
TH
TheDrummer Behemoth 123B v2 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
LL
Llama 3.x 70b Flipper 0.32 Tess Dolphin 128K v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Flipper 0.34 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
CO
c4ai command r plus 08 2024 bf16 iMat CQ
Command R · NexesQuants
Params104B
Context128K
Smallest55.2 GB
LL
Llama 3.x 70b L3.3 calme 2.3 abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b Negative Wayfarer fusion v1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 8b Smarteaz V1.01
Llama · NexesQuants
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.x 70b Tristar V2.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTrident v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
EVA UNIT 01 EVA LLaMA 3.33 70B v0.1 bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
EU
L3 70B Euryale v2.1
Euryale · NexesQuants
Params70.6B
Context8K
Smallest48.1 GB
LL
Llama 3.x 70b FLDx2 L3.3 abliterated fusion norm iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GE
Gemma 3 27b Novision
Gemma · NexesQuants
Params27B
Context128K
Smallest22.2 GB
LL
Llama 3.x 70b SmarTricks v1.55 MS iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b L3.3 Athene 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.1 70b Prologue V1.11 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
MC Llama3.3 Grand Skibidi 70B iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB