GGUF models by student-abdullah

34 GGUF models quantized by student-abdullah on Hugging Face. Sizes run from 494M to 8.03B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.2 trial 2 16 bit
Llama · student-abdullah
Params1.24B
Context128K
Smallest2.5 GB
GGUF
LL
llama3.1 medicine fine tuned 5bits
Llama · student-abdullah
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Llama3.2 Trial 6 16 bit
Llama · student-abdullah
Params1.24B
Context128K
Smallest2.5 GB
GGUF
QW
Quantized Qwen 2.5 Coding 0.5B no mlp
Qwen · student-abdullah
Params494M
Context32K
Smallest0.4 GB
Coding

Keep browsing