GGUF models by NexesQuants
283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.
DE
DeepSeek V2 Lite Chat Uncensored Unbiased
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GE
Google_Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · NexesQuants
Params11.8B
Context128K
Smallest23.5 GB
LL
Hermes 2 Theta Llama 3 70B
Llama · NexesQuants
Params70.6B
Context8K
Smallest48.1 GB
LL
Llama 3.3 70B Instruct Abliterated
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
MI
152334H_miqu 1 70b Sf
Miqu · NexesQuants
Params69B
Context32K
Smallest47.9 GB
GE
Mlabonne_Gemma 3 27b It Abliterated
Gemma · NexesQuants
Params27B
Context128K
Smallest19.4 GB
LL
nvidia Llama 3.1 Nemotron 70B Instruct bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
cognitivecomputations dolphin 2.9.1 llama 3 70b iMat CQ
Llama · NexesQuants
Params70.6B
Context8K
Smallest49.6 GB
SA
Sao10K_L3.1 70B Euryale v2.2
Sao · NexesQuants
Params70.6B
Context128K
Smallest34.9 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GE
Gemma 3 4b It Abliterated
Gemma · NexesQuants
Params3.88B
Context128K
Smallest4.1 GB
EL
sophosympatheia_Electranova 70B v1.0
Electranova · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
PH
Phi 3.5 Mini Instruct
Phi · NexesQuants
Params3.82B
Context128K
Smallest4.1 GB
LL
hitachi nlp Llama 3.1 70B FLDx2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
DE
Llama 3.3 70b DeepSeek R1 Dropable V1.01 iMat CQ
DeepSeek · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b DarkMare iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b PentEva FreeEra V1.11 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
New Dawn Llama3 70b 32K v1.0
Llama · NexesQuants
Params70.6B
Context32K
Smallest48.1 GB
MI
Mixtral 8x22B v0.1 iMat
Mistral · NexesQuants
Params141B
Context64K
Smallest30.4 GB
LL
Llama 3.x 70b Smarteaz V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.2 GB
LL
Llama 3.x 70b Hexagon Grey v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama_3.x_70b_L3.3_Dolphin_128K_v1.52
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Nous Hermes 2 Llama 2 70B iMat
Llama · NexesQuants
Params69B
Context4K
Smallest14.5 GB
LL
nbeerbower Llama 3.1 Nemotron lorablated 70B bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b SmarTricks v1.50 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Negative_LLAMA_70B
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
LL
Llama 3.x 70b NegaTess 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Huihui ai_Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.3 70b DarkDonkey iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
LL
Llama 3.x 70b Dolphineva 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB