GGUF models by aashish1904
39 GGUF models quantized by aashish1904 on Hugging Face. Sizes run from 752M to 32.5B parameters. The longest trained context is 1000K tokens.
CH
Chronos Divergence 33B Q8 0
Chronos · aashish1904
Params32.5B
Context16K
Smallest34.6 GB
MI
Mistral Small Instruct 2409
Mistral · aashish1904
Params22.2B
Context128K
Q4_K_M13.3 GB
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Smallest1.0 GB
CH
Chronos Divergence 33B Q2 K
Chronos · aashish1904
Params32.5B
Context16K
Smallest12.0 GB
CE
L3.1 Celestial Stone 2x8B Q4 K M
Celestial · aashish1904
Params13.7B
Context128K
Q4_K_M8.3 GB
GE
Gemma 2 2b Jpn It
Gemma · aashish1904
Params2.61B
Context8K
Smallest1.2 GB
CH
Chronos Divergence 33B Q4 K M
Chronos · aashish1904
Params32.5B
Context16K
Q4_K_M19.6 GB
CE
L3.1 Celestial Stone 2x8B Q2 K
Celestial · aashish1904
Params13.7B
Context128K
Smallest5.2 GB
CE
L3.1 Celestial Stone 2x8B Q8 0
Celestial · aashish1904
Params13.7B
Context128K
Smallest14.5 GB