GGUF models by SinpxAI

50 GGUF models quantized by SinpxAI on Hugging Face. Sizes run from 1.1B to 7.51B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama2 7B Chat uncensored
Llama · SinpxAI
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 7B Python
Llama · SinpxAI
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Dolphin Mistral 7B v2.2.1
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin Mistral 7B v2.6
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 7B Instruct
Llama · SinpxAI
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
CodeLlama 7B
Llama · SinpxAI
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Dolphin Mistral 7B v2.0
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin Mistral 7B v2.1
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin 2.8 Mistral 7b v02
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin Mistral 7B v2.6 dpo laser
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyLlama 1.1B Python v0.1
Tinyllama · SinpxAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Dolphin Mistral 7B v2.6 dpo
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · SinpxAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · SinpxAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
OP
OpenChat 3.5
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama2 Chinese 7B Chat
Llama · SinpxAI
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NE
Neural Chat 7B v3.3
Neural · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B alpha
Zephyr · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 6B 200k
Yi · SinpxAI
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
OP
OpenChat 3.5 1210
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
Neural Chat 7B v3.1
Neural · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyLlama 1.1B 1T OpenOrca
Tinyllama · SinpxAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Mistral OpenOrca 7B
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyLlama 2 1B MiniGuanaco
Tinyllama · SinpxAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
OpenBuddy Mistral 7B v17.1 32k
Mistral · SinpxAI
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B beta pl
Zephyr · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenBuddy Zephyr 7B v14.1
Openbuddy · SinpxAI
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 6B Chat
Yi · SinpxAI
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF

About SinpxAI on Hugging Face

SinpxAI has published 50 GGUF models that ggufmodels.com tracks, across families such as Mistral, Tinyllama and Llama. The most downloaded are Llama2 7B Chat uncensored, CodeLlama 7B Python and Dolphin Mistral 7B v2.2.1.

The quants SinpxAI publishes most often are Q8_0 (50), Q6_K (50), Q5_K_S (50) and Q5_K_M (50). Their Q4_K_M files range from 0.7 to 4.6 GB. Parameter counts run from 1.1B to 7.51B, and the longest trained context window is 195K tokens.

Frequently asked questions

What GGUF models has SinpxAI published?

50 models are listed here, mainly from the Mistral, Tinyllama and Llama families. The most downloaded is Llama2 7B Chat uncensored.

Which quants does SinpxAI publish?

The most common are Q8_0 (50 models), Q6_K (50 models), Q5_K_S (50 models) and Q5_K_M (50 models).

Keep browsing