GGUF models by Aryanne
54 GGUF models quantized by Aryanne on Hugging Face. Sizes run from 1.1B to 32.8B parameters. The longest trained context is 128K tokens.
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
SH
sheared silicon10p
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.3 GB
WI
Wizard Orca 3B
Wizard · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
Sheared LLaMA 2.7B
Llama · Aryanne
Params2.7B
Context4K
Smallest1.1 GB
OR
Orca Mini 3B
Orca · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
OP
OpenLlama 3B v2 WizardEvol Instruct v2
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
OP
OpenLlama Platypus 3B
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
Llama 2 4B
Llama · Aryanne
Params3.5B
Context4K
Smallest1.5 GB
OP
OpenLlama.v2 3B Lamini Orca Evol qlora
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
YU
YuE s1 7B anneal en cot Q6 K
Yue · Aryanne
Params6.22B
Context16K
Smallest5.1 GB
BE
Bean 3B ggml and
Bean · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
Flan Open Llama 3B
Llama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
TI
TinyLlama MiniGuanaco 1.1B 1.5T
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
PL
9b plus tie13
Plus · Aryanne
Params8.99B
Context32K
Smallest5.1 GB
CA
CalderaAI Hexoteric 7B F16
Calderaai · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
LL
Bling Sheared Llama 1.3B 0.1
Llama · Aryanne
Params1.35B
Context4K
Smallest0.8 GB
LL
llamatest
Llama · Aryanne
Params8.03B
Context8K
Smallest4.7 GB
MI
Mistral 7B Instruct v0.2 sliced 24 layer Q3 K M
Mistral · Aryanne
Params5.5B
Context32K
Smallest2.7 GB
SH
SHBA Q6 K
Shba · Aryanne
Params8.03B
Context128K
Smallest6.6 GB
DI
diabolic6045 ELN AOC CAIN Q8 0
Diabolic · Aryanne
Params1.24B
Context128K
Smallest1.3 GB
NE
testv2 Q6 K
Neuraldaredevil · Aryanne
Params8.03B
Context128K
Smallest6.6 GB
LL
Bling Sheared Llama 2.7B 0.1
Llama · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
SH
ShortKing 3B v0.2
Shortking · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
SH
Shearedplats 2.7B v1
Shearedplats · Aryanne
Params2.7B
Context4K
Q4_K_M1.6 GB