GGUF models by NexesQuants

283 GGUF models quantized by NexesQuants on Hugging Face. Sizes run from 488M to 141B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V2 Lite Chat Uncensored Unbiased
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GGUF
GE
Google_Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · NexesQuants
Params11.8B
Context128K
Smallest23.5 GB
GGUF
LL
Hermes 2 Theta Llama 3 70B
Llama · NexesQuants
Params70.6B
Context8K
Smallest48.1 GB
Tool use
LL
Llama 3.3 70B Instruct Abliterated
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
MI
152334H_miqu 1 70b Sf
Miqu · NexesQuants
Params69B
Context32K
Smallest47.9 GB
GGUF
GE
Mlabonne_Gemma 3 27b It Abliterated
Gemma · NexesQuants
Params27B
Context128K
Smallest19.4 GB
GGUF
LL
nvidia Llama 3.1 Nemotron 70B Instruct bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
cognitivecomputations dolphin 2.9.1 llama 3 70b iMat CQ
Llama · NexesQuants
Params70.6B
Context8K
Smallest49.6 GB
GGUF
SA
Sao10K_L3.1 70B Euryale v2.2
Sao · NexesQuants
Params70.6B
Context128K
Smallest34.9 GB
GGUF
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · NexesQuants
Params15.7B
Context160K
Smallest16.7 GB
GGUF
GE
Gemma 3 4b It Abliterated
Gemma · NexesQuants
Params3.88B
Context128K
Smallest4.1 GB
GGUF
EL
sophosympatheia_Electranova 70B v1.0
Electranova · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · NexesQuants
Params3.82B
Context128K
Smallest4.1 GB
Coding
LL
hitachi nlp Llama 3.1 70B FLDx2 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
DE
Llama 3.3 70b DeepSeek R1 Dropable V1.01 iMat CQ
DeepSeek · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
Llama 3.3 70b DarkMare iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Tool use
LL
Llama 3.x 70b PentEva FreeEra V1.11 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
ReasoningTool use
LL
New Dawn Llama3 70b 32K v1.0
Llama · NexesQuants
Params70.6B
Context32K
Smallest48.1 GB
GGUF
MI
Mixtral 8x22B v0.1 iMat
Mistral · NexesQuants
Params141B
Context64K
Smallest30.4 GB
GGUF
LL
Llama 3.x 70b Smarteaz V1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.2 GB
Tool use
LL
Llama 3.x 70b Hexagon Grey v1.0 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama_3.x_70b_L3.3_Dolphin_128K_v1.52
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Nous Hermes 2 Llama 2 70B iMat
Llama · NexesQuants
Params69B
Context4K
Smallest14.5 GB
Tool use
LL
nbeerbower Llama 3.1 Nemotron lorablated 70B bf16 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
Tool use
LL
Llama 3.x 70b SmarTricks v1.50 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Negative_LLAMA_70B
Llama · NexesQuants
Params70.6B
Context128K
Smallest48.1 GB
GGUF
LL
Llama 3.x 70b NegaTess 0.1 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Huihui ai_Tess R1 Limerick Llama 3.1 70B Abliterated
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
Reasoning
LL
Llama 3.3 70b DarkDonkey iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF
LL
Llama 3.x 70b Dolphineva 128K v1.02 iMat CQ
Llama · NexesQuants
Params70.6B
Context128K
Smallest49.6 GB
GGUF

Keep browsing