GGUF models by calcuis
50 GGUF models quantized by calcuis on Hugging Face. Sizes run from 123M to 20.4B parameters. The longest trained context is 128K tokens.
LL
llava
LLaVA · calcuis
Params6.74B
Context4K
Q4_K_M4.1 GB
ST
sd3.5 large turbo
Stable · calcuis
Params8.15B
Context—
Smallest4.8 GB
DI
dia
Dia · calcuis
Params1.61B
Context—
Smallest2.6 GB
MI
openaudio
Mini · calcuis
Params695M
Context—
Q4_K_M1.0 GB
PH
Phi 3 Mini 128k Instruct
Phi · calcuis
Params3.82B
Context128K
Q4_K_M2.2 GB
CO
cosmos
Cosmos · calcuis
Params7.24B
Context—
Q4_K_M4.1 GB
MO
mochi
Mochi · calcuis
Params10B
Context—
Q4_K_M5.6 GB
AU
aura
Auraflow · calcuis
Params6.86B
Context—
Q4_K_M4.0 GB
OL
olmo
OLMo · calcuis
Params6.89B
Context4K
Q4_K_M4.2 GB
CA
cat encoder
Cat · calcuis
Params2.61B
Context—
Smallest0.4 GB
KO
vauxz3d
Kohaku · calcuis
Params2.57B
Context—
Q4_K_M1.5 GB
KO
koji
Koji · calcuis
Params860M
Context—
Q4_K_M0.5 GB
LL
Openmath2
Llama · calcuis
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
chat
Chat · calcuis
Params3.43B
Context2K
Smallest2.0 GB
ME
medi mini
Medi · calcuis
Params6.74B
Context4K
Smallest3.3 GB
LA
lam2 mini
Lam · calcuis
Params6.74B
Context4K
Smallest3.3 GB
CO
code mini
Code · calcuis
Params6.74B
Context16K
Smallest3.3 GB
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · calcuis
Params1.1B
Context2K
Smallest0.6 GB
PH
phi2 mini
Phi · calcuis
Params2.78B
Context2K
Smallest1.5 GB
LA
law mini
Law · calcuis
Params6.74B
Context4K
Smallest3.3 GB