GGUF models by Solshine
41 GGUF models quantized by Solshine on Hugging Face. Sizes run from 134M to 13.3B parameters. The longest trained context is 128K tokens.
XL
xLAM 7b Fc R
Xlam · Solshine
Params6.91B
Context4K
Smallest2.7 GB
IN
Internlm2 Chat 1_8b
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
LL
AMD Llama 135m code Q8 0
Llama · Solshine
Params134M
Context2K
Smallest0.1 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · Solshine
Params8.41B
Context8K
Q4_K_M5.1 GB
IN
Internlm2 Chat 1_8b Sft
InternLM · Solshine
Params1.89B
Context32K
Smallest0.8 GB
LL
Llama 3.1 SuperNova Lite
Llama · Solshine
Params8.03B
Context128K
Smallest8.5 GB
LL
AMD Llama 135m Q2 K
Llama · Solshine
Params134M
Context2K
Smallest0.1 GB
JA
Jais Adapted 7b Chat
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
TW
TwinLlama 3.1 8B Q4 K M
Twinllama · Solshine
Params8.03B
Context128K
Q4_K_M4.9 GB
TW
TwinLlama 3.1 8B Q4 0
Twinllama · Solshine
Params8.03B
Context128K
Smallest4.7 GB
MI
Minitron 8B Base
Minitron · Solshine
Params8.27B
Context4K
Q4_K_M5.2 GB