GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.x 70b Betsy 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b L3.3 NegativeLlama abliterated fusion norm iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b L3.3 Tulu 3 abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
TA
TareksLab L3.3 TRP BASE 80 70B iMat CQ
Tarekslab · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Triads V8 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b L3.3 NegativeLlama abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Dolnemlimwhitessachi v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b DoppelGutenberg L3.3 abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Gutenberg Doppel L3.3 TDRussel Storywriter abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
GE
Gemma 3 4b X Ray Abli Linear v1.01 iMat IKL NXS CQ
Gemma · NexesQuants
Params3.88B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3.3 70b DarkHorse iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b TrinitEva V1.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest52.4 GB
GGUF
LL
Llama 3.3 Nemotron 70B Instruct Lorablated TA v0.10 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
AG
Agatha 111B v1
Agatha · NexesQuants
Params111B
Context256K
Smallest59.6 GB
Tool use
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · NexesQuants
Params49.9B
Context128K
Smallest53.0 GB
GGUF
DA
L3 70B daybreak abliterated v0.4 BF16
Daybreak · NexesQuants
Params70.6B
Context8K
Smallest141.1 GB
GGUF
LL
Llama 3.x 70b SmarTricks 0.41 R1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
Llama 3.2 1b AquaSyn 0.11
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.2 GB
GGUF
LL
Llama 3.x 70b FLDx2 Dolphin 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
GE
Fallen Gemma3 27B v1
Gemma · NexesQuants
Params27B
Context128K
Smallest22.4 GB
GGUF
LL
Huihui ai_Llama 3_1 Nemotron 51B Instruct Abliterated
Llama · NexesQuants
Params51.5B
Context128K
Smallest54.7 GB
Tool use
LL
Llama 3.x 70b TessEva 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.3 70b Wayfarer Negative fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.3 Nemotron 70B Instruct TA 0.10 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
NousResearch Yarn Llama 2 70b 32k iMat
Llama · NexesQuants
Params69B
Context32K
Smallest14.5 GB
GGUF
LL
Llama 3.x 70b Hexagon Fuchsia V1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b SmarTricks v1.70 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
PA
pankajmathur orca mini v9 6 1B instruct Abliterated LPL
Pankajmathur · NexesQuants
Params1.24B
Context128K
Smallest1.3 GB
GGUF
LL
Llama 3.1 70b Tears V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Nemesis V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF

Keep browsing