GGUF models by Aryanne

54 GGUF models quantized by Aryanne on Hugging Face. Sizes run from 1.1B to 32.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Open StarLake Swap 7B
Mistral · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
Tool use
BA
MedWest 7B
Base · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MA
Mamba gpt 3B v4 ggml and
Mamba · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Sheared LLaMA 1.3B
Llama · Aryanne
Params1.35B
Context4K
Smallest0.8 GB
GGUF
MI
YarnLake Swap 7B
Mistral · Aryanne
Params7.24B
Context128K
Smallest3.5 GB
Coding
BA
Basilisk 4B
Basilisk · Aryanne
Params3.5B
Context4K
Q4_K_M2.1 GB
GGUF
MI
Mistral 3B Instruct v0.2 init
Mistral · Aryanne
Params2.81B
Context32K
Smallest1.4 GB
GGUF
TI
TinyLlama 1.1B 1T OpenOrca
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
TI
TinyAiroboros 1.1B 2.2.1
Tinyairoboros · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
GGUF
SE
WestSenzu Swap 7B
Senzu · Aryanne
Params7.24B
Context32K
Smallest3.5 GB
GGUF
ER
ereb test
Ereb · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
TI
TinyllamaMix 1.1B
Tinyllamamix · Aryanne
Params1.1B
Context32K
Smallest1.2 GB
GGUF
SH
sheared plus westlake normal
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
TI
TinyLlama 1.1B Chat v0.2
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
PI
Westest 7B
Piano · Aryanne
Params7.24B
Context32K
Smallest3.5 GB
GGUF
AS
Astrid 3B
Astrid · Aryanne
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
CA
Calypso 3B alpha v2
Calypso · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
OP
MixSwap
Open · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
GGUF
TI
TinyLlama 1.1B step 720K 1510B
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
NO
nois
Nois · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
MO
MommyGPT 3B
Mommygpt · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
QW
QwentileSwap
Qwen · Aryanne
Params32.8B
Context32K
Smallest18.8 GB
ReasoningTool use
OM
OmegLLaMA 3B ggml and
Omegllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
DE
Deacon 3B
Deacon · Aryanne
Params3.43B
Context8K
Smallest2.0 GB
GGUF
WI
WizardLM 2 7B Q4 K M
Wizardlm · Aryanne
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
sheared plus westlake nearest 50 75p
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
LL
tesssst Q6 K
Llama · Aryanne
Params8.03B
Context128K
Smallest6.6 GB
GGUF
OP
Open LLongMA 3B
Open · Aryanne
Params3.43B
Context8K
Smallest2.0 GB
GGUF
SH
sheared plus westlake 50 75p
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.5 GB
GGUF
TI
TinyLlama 1.1B step 480K 1007B
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding

About Aryanne on Hugging Face

Aryanne has published 54 GGUF models that ggufmodels.com tracks, across families such as Llama, Tinyllama and Sheared. The most downloaded are Open StarLake Swap 7B, MedWest 7B and Mamba gpt 3B v4 ggml and.

The quants Aryanne publishes most often are Q4_0 (32), F16 (17), Q5_0 (16) and Q4_1 (15). Their Q4_K_M files range from 1.6 to 4.4 GB. Parameter counts run from 1.1B to 32.8B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has Aryanne published?

54 models are listed here, mainly from the Llama, Tinyllama and Sheared families. The most downloaded is Open StarLake Swap 7B.

Which quants does Aryanne publish?

The most common are Q4_0 (32 models), F16 (17 models), Q5_0 (16 models) and Q4_1 (15 models).

Keep browsing