GGUF models by afrideva

183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
tinycodellama 1.3b 3k
Tinycodellama · afrideva
Params1.29B
Context2K
Q4_K_M0.8 GB
Coding
SM
smartyplats 1.1b v2
Smartyplats · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AS
Astrohermes-3B
Astrohermes · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
WA
Walter-StableLM-3B
Walter · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
PH
phi 2 LogiCoT finetuned
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
phi 2 chat turkish
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
QW
Qwen2-1.5B-Instruct
Qwen · afrideva
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
verysmol llama v11 KIx2
Llama · afrideva
Params58M
Context1K
Q4_K_M0.0 GB
GGUF
PH
phi 2 chat
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
LL
zephyr smol llama 100m sft full
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Smol Llama 101M Chat v1
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GGUF
LL
llama 160m
Llama · afrideva
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LO
LocutusqueXFelladrin TinyMistral248M Instruct oasst2 chatML V1 DPO V3
Locutusquexfelladrin · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
QW
dolphin-2.9.3-qwen2-0.5b
Qwen · afrideva
Params494M
Context128K
Q4_K_M0.4 GB
Tool use
PA
palmer 002
Palmer · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
MiniMA 3B
Minima · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
PH
phi 2 psy
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
LL
tiny llama 1.1b chat medical
Llama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
RO
RocketZephyr-3b
Rocketzephyr · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · afrideva
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
GE
zephyr-7b-gemma-sft-african-ultrachat-200k
Gemma · afrideva
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
PA
palmer x 002
Palmer · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyKAI 3B beta
Tinykai · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
WA
Walter Phi
Walter · afrideva
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
TI
TinyAlpaca v0.1
Tinyalpaca · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
MiniChat 1.5 3B
Minichat · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
PH
phi 2 arxiv physics instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
SM
smol 3b
Smol · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
TI
TinyMistral 248M SFT v3
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
LL
Meta-Llama-3-8B-conceptnet_UsedFor_en_en
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing