GGUF models by Solshine

41 GGUF models quantized by Solshine on Hugging Face. Sizes run from 134M to 13.3B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
XL
xLAM 7b Fc R
Xlam · Solshine
Params6.91B
Context4K
Smallest2.7 GB
Tool use
IN
Internlm2 Chat 1_8b
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
GGUF
LL
AMD Llama 135m code Q8 0
Llama · Solshine
Params134M
Context2K
Smallest0.1 GB
Coding
MI
Mistral NeMo Minitron 8B Base
Mistral · Solshine
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
IN
Internlm2 Chat 1_8b Sft
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · Solshine
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LL
AMD Llama 135m Q2 K
Llama · Solshine
Params134M
Context2K
Smallest0.1 GB
GGUF
JA
Jais Adapted 7b Chat
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
Coding
TW
TwinLlama 3.1 8B Q4 K M
Twinllama · Solshine
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TW
TwinLlama 3.1 8B Q4 0
Twinllama · Solshine
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MI
Minitron 8B Base
Minitron · Solshine
Params8.27B
Context4K
Q4_K_M5.2 GB
GGUF

Keep browsing