GGUF models by afrideva

183 GGUF models quantized by afrideva on Hugging Face. Sizes run from 2M to 8.83B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama 1.1B intermediate step 715k 1.5T airoboros 3.1 V2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B 2T lr 2e 4 3ep dolly 15k instruct v1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
smol llama 101M GQA python
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GGUF
TI
tinyllama python
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
LL
smol llama 220M GQA
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · afrideva
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
BE
beecoder 220M python
Beecoder · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
Coding
DI
Dimensity-3B
Dimensity · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
SM
smartyplats 1.1b v1
Smartyplats · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
YO
yoruba-embedding-model
Yoruba · afrideva
Params109M
Context512
Q4_K_M0.1 GB
Embedding
MI
Mixtral_AI_TheAncient
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
phi 2 meditron
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
MI
Mixtral_AI_MasterTron
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyMistral 248M Evol Instruct
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
AI
airoboros-3b-3p0
Airoboros · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
TE
TeenyTinyLlama 160m
Teenytinyllama · afrideva
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LL
smol llama 220M open instruct
Llama · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
TI
TinyLlama 3T 1.1bee
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
IN
InstructWise 462M
Instructwise · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
LL
llama2 xs 460M uncensored
Llama · afrideva
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
RE
refusal
Refusal · afrideva
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF
MI
minima 3b layla v2
Minima · afrideva
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
LL
smol llama 101M GQA
Llama · afrideva
Params101M
Context1K
Q4_K_M0.1 GB
GGUF
PH
Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.3 GB
CodingTool use
PR
no prompt 1.3b
Prompt · afrideva
Params1.35B
Context4K
Q4_K_M0.9 GB
GGUF
LL
Tiny Llama openhermes 1.1B step 715k 1.5T
Llama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
TI
TinyLlama con creative writing v0.2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 68M Chat v1
Llama · afrideva
Params68M
Context2K
Q4_K_M0.0 GB
GGUF
ST
stablelm-3b-4e1t
Stablelm · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
TI
TinyLlama 1.1B intermediate step 715k 1.5T lr 5 4epochs oasst1 top1 instruct V1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing