GGUF models by afrideva

183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama 1.1B intermediate step 715k 1.5T
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
LL
open llama 3b code instruct 0.1
Llama · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
Coding
TA
tau-0.5B-instruct
Tau · afrideva
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
LL
llama2 xs 460M experimental evol instruct
Llama · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
TI
TinyLlama 1.1B alpaca chat v1.5
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AI
Aira 2 1B1
Aira · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v1
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v2
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinycodellama 1.3b 5k
Tinycodellama · afrideva
Params1.29B
Context2K
Q4_K_M0.8 GB
Coding
MI
MiniChat 3B
Minichat · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
LL
Walter Llama 1B
Llama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
tiny random LlamaForCausalLM
Llama · afrideva
Params2M
Context512
Q4_K_M0.0 GB
GGUF
BU
Buzz-8b-Large-v0.5
Buzz · afrideva
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
DO
dopeyplats 1.1b 2T v1
Dopeyplats · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BL
bloomz Alpaca 560M
Bloomz · afrideva
Params816M
Context2K
Q4_K_M0.6 GB
GGUF
QW
Qwen2-1.5B
Qwen · afrideva
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
GE
gemma-1.1-2b-it_orpo_traslate_en_es_V1
Gemma · afrideva
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TI
TinyLlama 1.1B Chat v0.4 ENG
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MA
malaysian tinyllama 1.1b 16384 instructions
Malaysian · afrideva
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
PI
pip-code-bandit
Pip · afrideva
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
llama2 xs 460M experimental platypus
Llama · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
GI
GIST-all-MiniLM-L6-v2
Gist · afrideva
Params23M
Context512
Q4_K_M0.0 GB
GGUF
LL
Meta-Llama-3-8Bee
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-instrucTrans-enko-8b
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Synthia-v3.5
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
tinyllama colorist v2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
llama3_8b_chat_brainstorm
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
tiny random BloomForCausalLM
Tiny · afrideva
Params—
Context7
Q4_K_M0.0 GB
GGUF
LL
Llama-3-8b-Cosmopedia-japanese
Llama · afrideva
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FE
Ferret-3B
Ferret · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF

Keep browsing