GGUF models by Aashraf995
37 GGUF models quantized by Aashraf995 on Hugging Face. Sizes run from 494M to 14.8B parameters. The longest trained context is 1024K tokens.
OP
OpenCoder 8B Instruct
Opencoder · Aashraf995
Params7.77B
Context8K
Smallest8.3 GB
OP
OpenCoder 8B Instruct
Opencoder · Aashraf995
Params7.77B
Context8K
Q4_K_M4.7 GB
LL
Skywork O1 Open Llama3.1 8B
Llama · Aashraf995
Params8.03B
Context128K
Smallest6.6 GB
GE
Gemma 2 9b It
Gemma · Aashraf995
Params9.24B
Context8K
Smallest9.8 GB
HO
Homer 7B v0.1
Homer · Aashraf995
Params7.62B
Context128K
Smallest8.1 GB
GE
Gemma 2 9b It SimPO
Gemma · Aashraf995
Params9.24B
Context8K
Smallest9.8 GB
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · Aashraf995
Params14.8B
Context32K
Smallest7.9 GB