GGUF models by Ak1104
35 GGUF models quantized by Ak1104 on Hugging Face. Sizes run from 6.74B to 22.2B parameters. The longest trained context is 256K tokens.
ME
Medical_chatbot
Medical · Ak1104
Params8.03B
Context8K
Q4_K_M4.9 GB
RU
RustQA
Rustqa · Ak1104
Params8.03B
Context128K
Q4_K_M4.9 GB
WI
QA_8k_withChapter_PT
Withchapter · Ak1104
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
prompt2
Prompt · Ak1104
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8b Bnb 4bit
Llama · Ak1104
Params8.03B
Context128K
Smallest16.1 GB