GGUF models by abubakar-muhammad
37 GGUF models quantized by abubakar-muhammad on Hugging Face. Sizes run from 135M to 3.21B parameters. The longest trained context is 128K tokens.
LL
Llama 3.2 1b Paper Counterspeech Model 16bit Gguf
Llama · abubakar-muhammad
Params1.24B
Context128K
Smallest2.5 GB
LL
Llama 3.2 1b Counterspeech Model Q8_0
Llama · abubakar-muhammad
Params1.24B
Context128K
Smallest1.3 GB
SM
SmolLm 135M Paper Counterspeech Model 16bit Gguf
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.3 GB
LL
Llama 3.2 1b Paper Counterspeech Model Q4_K_M
Llama · abubakar-muhammad
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
llama 3.2 3b counterspeech model q4 k m
Llama · abubakar-muhammad
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
llama 3.2 3b counterspeech model 16bit
Llama · abubakar-muhammad
Params3.21B
Context128K
Smallest6.4 GB
LL
llama 3.2 3b counterspeech model Q8 0
Llama · abubakar-muhammad
Params3.21B
Context128K
Smallest3.4 GB