GGUF models by afrideva

183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2-0.5B
Qwen · afrideva
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
TA
tau-0.5B
Tau · afrideva
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
PI
pip-sql-1.3b
Pip · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
ahxt llama2 xs 460M experimental ptbr instruct
Llama · afrideva
Params462M
Context2K
Q4_K_M0.3 GB
GGUF
MI
MiniChat 2 3B
Minichat · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
MI
Mixtral GQA 400m v2
Mistral · afrideva
Params2.01B
Context4K
Q4_K_M1.2 GB
GGUF
PH
Phi 3 Context Obedient RAG
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PI
pip library etl 1.3b
Pip · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
Llama-3-Yggdrasil-8B
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
TeenyTinyLlama 460m
Teenytinyllama · afrideva
Params468M
Context2K
Q4_K_M0.3 GB
GGUF
MI
japanese mistral 300m instruction
Mistral · afrideva
Params355M
Context4K
Q4_K_M0.2 GB
GGUF
LL
Llama 160M Chat v1
Llama · afrideva
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PH
phi 1 5 dolly instruction polish
Phi · afrideva
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
LL
Mermaid-Llama-3-5B-Pruned
Llama · afrideva
Params5.41B
Context8K
Q4_K_M3.4 GB
GGUF
TI
TinyLLama v0
Tinyllama · afrideva
Params5M
Context2K
Q4_K_M0.0 GB
GGUF
GP
gpt2-turkish-128-token
Gpt · afrideva
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
OR
Orca-2.0-Tau-1.8B
Orca · afrideva
Params1.84B
Context32K
Q4_K_M1.2 GB
Coding
LL
llama2 xs 460M experimental
Llama · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
EV
evolvedSeeker 1 3
Evolvedseeker · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
TI
TinyLlama 1.1B intermediate step 1195k token 2.5T
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
MA
Marx 3B V2
Marx · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
LL
zephyr smol llama 100m dpo full
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GGUF
GE
gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2
Gemma · afrideva
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use
QW
Qwen2-0.5B-Instruct
Qwen · afrideva
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
PH
phine 2 v0
Phine · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
HE
Hercules-Mini-1.8B
Hercules · afrideva
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · afrideva
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
TI
TinyLlama-1.1B-DavidAttenborough
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
AF
African-ultrachat-alpaca
African · afrideva
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AS
Astrea-RP-v1-3B
Astrea · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
Roleplay

Keep browsing