GGUF models by NexesQuants
283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.
LL
Llama 3.x 70b TDRussel Storywriter 128K Dop v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
MC Llama3.3 70B Nemotron3.1 Eva0.1 ocypetp bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b Evasion V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b L3.3 DoppelGutenberg abliterated fusion iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Doberman V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b FunTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
AL
alchemonaut BoreanGale 70B iMat
Alchemonaut · NexesQuants
Params69B
Context32K
Smallest14.5 GB
LL
Llama 3.x 70b JaviTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.2 1b Odyssea V1.01b
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.6 GB
LL
Llama 3.x 70b Hexagon Purple V3 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b FallenDonkey iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b DoppelGanger R1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b DoppelGutenberg L3.3 abliterated fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b TesserTeaz 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Tess Dolphin 128K v1.01 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b FallenHorse iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
MI
miqu 1 70b iMat IKL CQ
Miqu · NexesQuants
Params69B
Context32K
Smallest21.7 GB
LL
Llama 3.3 70b FallenMare iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
LL
Llama 3.x 70b FreeFaller R1 V1.11 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
mlabonne Llama 3.1 70B Instruct lorablated bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b BetsyTeaz 0.2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.2 1b Synopsys 0.11
Llama · NexesQuants
Params1.5B
Context128K
Smallest1.2 GB
LL
Llama 3.3 70b DonkeyRider iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b SmarTricks v1.55 Karcher iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
SA
Sao10K_L3.1 70B Euryale v2.2
Sao · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
MC Anubis Llama3.3 70B Nemotron3.1 Eva0.1 stjgmmc bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b Flipper 0.38 Tess Dolphin 128K v1.2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Calme L3.3 abliterated fusion v2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b L3.3 Dolphin 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB