GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mistralai_Mixtral 8x22B Instruct v0.1
Mistral · NexesQuants
Params141B
Context64K
Smallest60.3 GB
Tool use
LL
Llama 3.x 70b Hexagon Purple V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
GE
Gemma 3 27b Novision
Gemma · NexesQuants
Params27B
Context128K
Smallest28.7 GB
Vision
LL
Llama 3.x 70b SmarTricks V1.30 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Trojka V3 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Tristar V2.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b UnfusedV06 Genelemo fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.1 70b FLDx2 Tess3 abliterated fusion norm iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Tristar V1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
NA
Nano_Imp_1B
Nano · NexesQuants
Params1.5B
Context128K
Smallest1.2 GB
GGUF
LL
Llama 3.1 70b Priestess V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
MI
Mistral Large Instruct 2411 bf16 iMat CQ
Mistral · NexesQuants
Params123B
Context128K
Smallest48.4 GB
GGUF
LL
Llama 3.x 70b Doppelectra v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
TH
TheDrummer Behemoth 123B v2 bf16 iMat CQ
Thedrummer · NexesQuants
Params123B
Context128K
Smallest44.2 GB
GGUF
LL
Llama 3.x 70b Flipper 0.32 Tess Dolphin 128K v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Flipper 0.34 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
CO
c4ai command r plus 08 2024 bf16 iMat CQ
Command R · NexesQuants
Params104B
Context128K
Smallest55.2 GB
GGUF
LL
Llama 3.x 70b L3.3 calme 2.3 abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.3 70b Negative Wayfarer fusion v1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.1 8b Smarteaz V1.01
Llama · NexesQuants
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
Llama 3.x 70b Tristar V2.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b SmarTrident v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
EVA UNIT 01 EVA LLaMA 3.33 70B v0.1 bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
GGUF
EU
L3 70B Euryale v2.1
Euryale · NexesQuants
Params70.6B
Context8K
Smallest48.1 GB
GGUF
LL
Llama 3.x 70b FLDx2 L3.3 abliterated fusion norm iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
GE
Gemma 3 27b Novision
Gemma · NexesQuants
Params27B
Context128K
Smallest22.2 GB
Vision
LL
Llama 3.x 70b SmarTricks v1.55 MS iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b L3.3 Athene 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.1 70b Prologue V1.11 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
MC Llama3.3 Grand Skibidi 70B iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use

Keep browsing