GGUF models by afrideva
183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.
QW
Qwen2-0.5B
Qwen · afrideva
Params494M
Context128K
Q4_K_M0.4 GB
TA
tau-0.5B
Tau · afrideva
Params620M
Context32K
Q4_K_M0.4 GB
PI
pip-sql-1.3b
Pip · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
ahxt llama2 xs 460M experimental ptbr instruct
Llama · afrideva
Params462M
Context2K
Q4_K_M0.3 GB
MI
MiniChat 2 3B
Minichat · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
MI
Mixtral GQA 400m v2
Mistral · afrideva
Params2.01B
Context4K
Q4_K_M1.2 GB
PH
Phi 3 Context Obedient RAG
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
PI
pip library etl 1.3b
Pip · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
Llama-3-Yggdrasil-8B
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
TeenyTinyLlama 460m
Teenytinyllama · afrideva
Params468M
Context2K
Q4_K_M0.3 GB
MI
japanese mistral 300m instruction
Mistral · afrideva
Params355M
Context4K
Q4_K_M0.2 GB
LL
Llama 160M Chat v1
Llama · afrideva
Params162M
Context2K
Q4_K_M0.1 GB
PH
phi 1 5 dolly instruction polish
Phi · afrideva
Params1.42B
Context2K
Q4_K_M0.9 GB
LL
Mermaid-Llama-3-5B-Pruned
Llama · afrideva
Params5.41B
Context8K
Q4_K_M3.4 GB
TI
TinyLLama v0
Tinyllama · afrideva
Params5M
Context2K
Q4_K_M0.0 GB
GP
gpt2-turkish-128-token
Gpt · afrideva
Params163M
Context1K
Q4_K_M0.1 GB
OR
Orca-2.0-Tau-1.8B
Orca · afrideva
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
llama2 xs 460M experimental
Llama · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
EV
evolvedSeeker 1 3
Evolvedseeker · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
TI
TinyLlama 1.1B intermediate step 1195k token 2.5T
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
MA
Marx 3B V2
Marx · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
LL
zephyr smol llama 100m dpo full
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GE
gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2
Gemma · afrideva
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen2-0.5B-Instruct
Qwen · afrideva
Params494M
Context32K
Q4_K_M0.4 GB
PH
phine 2 v0
Phine · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
HE
Hercules-Mini-1.8B
Hercules · afrideva
Params1.84B
Context32K
Q4_K_M1.2 GB
YI
Yi-1.5-9B-Chat
Yi · afrideva
Params8.83B
Context4K
Q4_K_M5.3 GB
TI
TinyLlama-1.1B-DavidAttenborough
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
AF
African-ultrachat-alpaca
African · afrideva
Params8.54B
Context8K
Q4_K_M5.3 GB
AS
Astrea-RP-v1-3B
Astrea · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB