GGUF models by NexesQuants
283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.
LL
Llama 3.x 70b L3.3 VulpeculHiggs 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b biofallevabigsafetess v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTricks V1.30 flat iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
LLlama 3.x 70b SmarTracks V1.30 flat iMat CQ
Lllama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b Evalseuses v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b FallenDonkey v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTricks v1.66 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
DF
dfurman CalmeRys 78B Orpo v0.1 bf16 iMat CQ
Dfurman · NexesQuants
Params78B
Context32K
Smallest53.1 GB
SO
Sorceroboros 33b S2A4 Qlora
Sorceroboros · NexesQuants
Params488M
Context—
Smallest2.0 GB
LL
Llama 3.x 70b Hexagon Blue V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Triads V4 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama_3.x_70b_Trojka_V1.5
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Tessessence 0.20a iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest75.0 GB