GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.x 70b L3.3 VulpeculHiggs 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b biofallevabigsafetess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b SmarTricks V1.30 flat iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
LLlama 3.x 70b SmarTracks V1.30 flat iMat CQ
Lllama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b Evalseuses v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.3 70b FallenDonkey v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b SmarTricks v1.66 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
DF
dfurman CalmeRys 78B Orpo v0.1 bf16 iMat CQ
Dfurman · NexesQuants
Params78B
Context32K
Smallest53.1 GB
GGUF
SO
Sorceroboros 33b S2A4 Qlora
Sorceroboros · NexesQuants
Params488M
Context—
Smallest2.0 GB
GGUF
LL
Llama 3.x 70b Hexagon Blue V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b Triads V4 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama_3.x_70b_Trojka_V1.5
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Tessessence 0.20a iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest75.0 GB
Tool use

Keep browsing