GGUF models by abubakar-muhammad

37 GGUF models quantized by abubakar-muhammad on Hugging Face. Sizes run from 135M to 3.21B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1b Paper Counterspeech Model 16bit Gguf
Llama · abubakar-muhammad
Params1.24B
Context128K
Smallest2.5 GB
GGUF
LL
Llama 3.2 1b Counterspeech Model Q8_0
Llama · abubakar-muhammad
Params1.24B
Context128K
Smallest1.3 GB
GGUF
SM
SmolLm 135M Paper Counterspeech Model 16bit Gguf
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.3 GB
GGUF
LL
Llama 3.2 1b Paper Counterspeech Model Q4_K_M
Llama · abubakar-muhammad
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
llama 3.2 3b counterspeech model q4 k m
Llama · abubakar-muhammad
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
llama 3.2 3b counterspeech model 16bit
Llama · abubakar-muhammad
Params3.21B
Context128K
Smallest6.4 GB
GGUF
LL
llama 3.2 3b counterspeech model Q8 0
Llama · abubakar-muhammad
Params3.21B
Context128K
Smallest3.4 GB
GGUF

Keep browsing