GGUF models by afrideva
183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.
TI
tinycodellama 1.3b 3k
Tinycodellama · afrideva
Params1.29B
Context2K
Q4_K_M0.8 GB
SM
smartyplats 1.1b v2
Smartyplats · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
AS
Astrohermes-3B
Astrohermes · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
WA
Walter-StableLM-3B
Walter · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
PH
phi 2 LogiCoT finetuned
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
phi 2 chat turkish
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
QW
Qwen2-1.5B-Instruct
Qwen · afrideva
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
verysmol llama v11 KIx2
Llama · afrideva
Params58M
Context1K
Q4_K_M0.0 GB
PH
phi 2 chat
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
LL
zephyr smol llama 100m sft full
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
LL
Smol Llama 101M Chat v1
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
LL
llama 160m
Llama · afrideva
Params162M
Context2K
Q4_K_M0.1 GB
LO
LocutusqueXFelladrin TinyMistral248M Instruct oasst2 chatML V1 DPO V3
Locutusquexfelladrin · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
QW
dolphin-2.9.3-qwen2-0.5b
Qwen · afrideva
Params494M
Context128K
Q4_K_M0.4 GB
PA
palmer 002
Palmer · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
MiniMA 3B
Minima · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
PH
phi 2 psy
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
LL
tiny llama 1.1b chat medical
Llama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
RO
RocketZephyr-3b
Rocketzephyr · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
YI
Yi-1.5-6B-Chat
Yi · afrideva
Params6.06B
Context4K
Q4_K_M3.7 GB
GE
zephyr-7b-gemma-sft-african-ultrachat-200k
Gemma · afrideva
Params8.54B
Context8K
Q4_K_M5.3 GB
PA
palmer x 002
Palmer · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
TinyKAI 3B beta
Tinykai · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
WA
Walter Phi
Walter · afrideva
Params1.41B
Context2K
Q4_K_M0.9 GB
TI
TinyAlpaca v0.1
Tinyalpaca · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
MiniChat 1.5 3B
Minichat · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
PH
phi 2 arxiv physics instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
SM
smol 3b
Smol · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
TI
TinyMistral 248M SFT v3
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
LL
Meta-Llama-3-8B-conceptnet_UsedFor_en_en
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB