GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.x 70b TDRussel Storywriter 128K Dop v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
MC Llama3.3 70B Nemotron3.1 Eva0.1 ocypetp bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b Evasion V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b L3.3 DoppelGutenberg abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Doberman V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b FunTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
AL
alchemonaut BoreanGale 70B iMat
Alchemonaut · NexesQuants
Params69B
Context32K
Smallest14.5 GB
GGUF
LL
Llama 3.x 70b JaviTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.2 1b Odyssea V1.01b
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.6 GB
Tool use
LL
Llama 3.x 70b Hexagon Purple V3 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b FallenDonkey iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.3 70b DoppelGanger R1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
Llama 3.x 70b DoppelGutenberg L3.3 abliterated fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b TesserTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Tess Dolphin 128K v1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.3 70b FallenHorse iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
MI
miqu 1 70b iMat IKL CQ
Miqu · NexesQuants
Params69B
Context32K
Smallest21.7 GB
GGUF
LL
Llama 3.3 70b FallenMare iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
DE
DeepSeek V2 Lite Chat
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GGUF
LL
Llama 3.x 70b FreeFaller R1 V1.11 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
mlabonne Llama 3.1 70B Instruct lorablated bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b BetsyTeaz 0.2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.2 1b Synopsys 0.11
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.2 GB
Tool use
LL
Llama 3.3 70b DonkeyRider iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b SmarTricks v1.55 Karcher iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
SA
Sao10K_L3.1 70B Euryale v2.2
Sao · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
GGUF
LL
MC Anubis Llama3.3 70B Nemotron3.1 Eva0.1 stjgmmc bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b Flipper 0.38 Tess Dolphin 128K v1.2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Calme L3.3 abliterated fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b L3.3 Dolphin 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF

Keep browsing