GGUF models by Aashraf995

37 GGUF models quantized by Aashraf995 on Hugging Face. Sizes run from 494M to 14.8B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenCoder 8B Instruct
Opencoder · Aashraf995
Params7.77B
Context8K
Smallest8.3 GB
Coding
OP
OpenCoder 8B Instruct
Opencoder · Aashraf995
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
LL
Skywork O1 Open Llama3.1 8B
Llama · Aashraf995
Params8.03B
Context128K
Smallest6.6 GB
Tool use
GE
Gemma 2 9b It
Gemma · Aashraf995
Params9.24B
Context8K
Smallest9.8 GB
GGUF
HO
Homer 7B v0.1
Homer · Aashraf995
Params7.62B
Context128K
Smallest8.1 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · Aashraf995
Params9.24B
Context8K
Smallest9.8 GB
GGUF
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · Aashraf995
Params14.8B
Context32K
Smallest7.9 GB
GGUF

Keep browsing