GGUF models by aashish1904

39 GGUF models quantized by aashish1904 on Hugging Face. Sizes run from 752M to 32.5B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
Chronos Divergence 33B Q8 0
Chronos · aashish1904
Params32.5B
Context16K
Smallest34.6 GB
Roleplay
MI
Mistral Small Instruct 2409
Mistral · aashish1904
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Smallest1.0 GB
Tool use
CH
Chronos Divergence 33B Q2 K
Chronos · aashish1904
Params32.5B
Context16K
Smallest12.0 GB
Roleplay
CE
L3.1 Celestial Stone 2x8B Q4 K M
Celestial · aashish1904
Params13.7B
Context128K
Q4_K_M8.3 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · aashish1904
Params2.61B
Context8K
Smallest1.2 GB
GGUF
CH
Chronos Divergence 33B Q4 K M
Chronos · aashish1904
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
CE
L3.1 Celestial Stone 2x8B Q2 K
Celestial · aashish1904
Params13.7B
Context128K
Smallest5.2 GB
GGUF
CE
L3.1 Celestial Stone 2x8B Q8 0
Celestial · aashish1904
Params13.7B
Context128K
Smallest14.5 GB
GGUF

Keep browsing