GGUF models by afrideva
183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.
TI
TinyLlama 1.1B intermediate step 715k 1.5T airoboros 3.1 V2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
TinyLlama 1.1B 2T lr 2e 4 3ep dolly 15k instruct v1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
smol llama 101M GQA python
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
TI
tinyllama python
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
LL
smol llama 220M GQA
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
ST
stablelm-2-zephyr-1_6b
Stablelm · afrideva
Params1.64B
Context4K
Q4_K_M1.0 GB
BE
beecoder 220M python
Beecoder · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
DI
Dimensity-3B
Dimensity · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
SM
smartyplats 1.1b v1
Smartyplats · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
YO
yoruba-embedding-model
Yoruba · afrideva
Params109M
Context512
Q4_K_M0.1 GB
MI
Mixtral_AI_TheAncient
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
phi 2 meditron
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
MI
Mixtral_AI_MasterTron
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyMistral 248M Evol Instruct
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
AI
airoboros-3b-3p0
Airoboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
TE
TeenyTinyLlama 160m
Teenytinyllama · afrideva
Params162M
Context2K
Q4_K_M0.1 GB
LL
smol llama 220M open instruct
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
TI
TinyLlama 3T 1.1bee
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
IN
InstructWise 462M
Instructwise · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
LL
llama2 xs 460M uncensored
Llama · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
RE
refusal
Refusal · afrideva
Params1.1B
Context8K
Q4_K_M0.7 GB
MI
minima 3b layla v2
Minima · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
LL
smol llama 101M GQA
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
PH
Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.3 GB
PR
no prompt 1.3b
Prompt · afrideva
Params1.35B
Context4K
Q4_K_M0.9 GB
LL
Tiny Llama openhermes 1.1B step 715k 1.5T
Llama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
TI
TinyLlama con creative writing v0.2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 68M Chat v1
Llama · afrideva
Params68M
Context2K
Q4_K_M0.0 GB
ST
stablelm-3b-4e1t
Stablelm · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
TI
TinyLlama 1.1B intermediate step 715k 1.5T lr 5 4epochs oasst1 top1 instruct V1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB