GGUF models by afrideva

183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyMistral 248M Alpaca
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
TI
TinyLlama 1.1B intermediate step 1431k 3T
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
LL
smol llama 220M bees internal
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
TI
TinyLlama 1.1B intermediate step 955k token 2T guanaco
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B step 2T lr 5 5ep oasst1 top1 instruct V1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
bling sheared llama 1.3b 0.1
Llama · afrideva
Params1.35B
Context4K
Q4_K_M0.9 GB
GGUF
LL
Llama 2 7b chat igbo yoruba 2024 04 12 23 35 37
Llama · afrideva
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
smol llama 101M midjourney messages
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GGUF
LL
bling sheared llama 2.7b 0.1
Llama · afrideva
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
PH
phi 2 sft dpo gpt4 en ep1
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
MA
malaysian tinyllama 1.1b 16k instructions
Malaysian · afrideva
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v3 8k
Tinyllama · afrideva
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF
PH
Phi 3 mini 128k instruct function
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AS
Astridboros-3B
Astridboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
smol llama 220M openhermes
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
Tool use
MP
mpt-3b-8k-instruct
Mpt · afrideva
Params3.63B
Context8K
Q4_K_M2.3 GB
GGUF
PH
phi 2
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v0
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
PH
Bioinspired Phi 3 mini 4k
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 2 code instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
phi 2 sft alpaca gpt4 en ep1
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
TI
TinyMistral 248M SFT v4
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
AS
Astrorocketboros-3B
Astrorocketboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
BL
bloom 560m
Bloom · afrideva
Params816M
Context1K
Q4_K_M0.6 GB
Coding
LL
open llama 3b v2 instruct
Llama · afrideva
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
NE
NeuralReyna-Mini-1.8B-v0.3
Neuralreyna · afrideva
Params1.84B
Context32K
Q4_K_M1.2 GB
Tool use
PH
dolphin 2 6 phi 2 oasst2 chatML V2
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
EC
Echo-3B
Echo · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
GP
GPT-NeoX-1.3B-viet-final
Gpt · afrideva
Params1.46B
Context2K
Q4_K_M0.9 GB
GGUF
LL
tiny llama miniguanaco 1.5T
Llama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing