GGUF models by Ak1104

35 GGUF models quantized by Ak1104 on Hugging Face. Sizes run from 6.74B to 22.2B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
Medical_chatbot
Medical · Ak1104
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RU
RustQA
Rustqa · Ak1104
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WI
QA_8k_withChapter_PT
Withchapter · Ak1104
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PR
prompt2
Prompt · Ak1104
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8b Bnb 4bit
Llama · Ak1104
Params8.03B
Context128K
Smallest16.1 GB
GGUF

Keep browsing