GGUF models by Aryanne

54 GGUF models quantized by Aryanne on Hugging Face. Sizes run from 1.1B to 32.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
SH
sheared silicon10p
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.3 GB
GGUF
WI
Wizard Orca 3B
Wizard · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Sheared LLaMA 2.7B
Llama · Aryanne
Params2.7B
Context4K
Smallest1.1 GB
GGUF
OR
Orca Mini 3B
Orca · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
OP
OpenLlama 3B v2 WizardEvol Instruct v2
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
OP
OpenLlama Platypus 3B
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Llama 2 4B
Llama · Aryanne
Params3.5B
Context4K
Smallest1.5 GB
GGUF
OP
OpenLlama.v2 3B Lamini Orca Evol qlora
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
YU
YuE s1 7B anneal en cot Q6 K
Yue · Aryanne
Params6.22B
Context16K
Smallest5.1 GB
GGUF
BE
Bean 3B ggml and
Bean · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Flan Open Llama 3B
Llama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
TI
TinyLlama MiniGuanaco 1.1B 1.5T
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
GGUF
PL
9b plus tie13
Plus · Aryanne
Params8.99B
Context32K
Smallest5.1 GB
GGUF
CA
CalderaAI Hexoteric 7B F16
Calderaai · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
GGUF
LL
Bling Sheared Llama 1.3B 0.1
Llama · Aryanne
Params1.35B
Context4K
Smallest0.8 GB
GGUF
LL
llamatest
Llama · Aryanne
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
MI
Mistral 7B Instruct v0.2 sliced 24 layer Q3 K M
Mistral · Aryanne
Params5.5B
Context32K
Smallest2.7 GB
GGUF
SH
SHBA Q6 K
Shba · Aryanne
Params8.03B
Context128K
Smallest6.6 GB
GGUF
DI
diabolic6045 ELN AOC CAIN Q8 0
Diabolic · Aryanne
Params1.24B
Context128K
Smallest1.3 GB
GGUF
NE
testv2 Q6 K
Neuraldaredevil · Aryanne
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
Bling Sheared Llama 2.7B 0.1
Llama · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
SH
ShortKing 3B v0.2
Shortking · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
Coding
SH
Shearedplats 2.7B v1
Shearedplats · Aryanne
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF

Keep browsing