GGUF models by calcuis

50 GGUF models quantized by calcuis on Hugging Face. Sizes run from 123M to 20.4B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llava
LLaVA · calcuis
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
ST
sd3.5 large turbo
Stable · calcuis
Params8.15B
Context—
Smallest4.8 GB
GGUF
DI
dia
Dia · calcuis
Params1.61B
Context—
Smallest2.6 GB
GGUF
MI
openaudio
Mini · calcuis
Params695M
Context—
Q4_K_M1.0 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · calcuis
Params3.82B
Context128K
Q4_K_M2.2 GB
GGUF
CO
cosmos
Cosmos · calcuis
Params7.24B
Context—
Q4_K_M4.1 GB
GGUF
MO
mochi
Mochi · calcuis
Params10B
Context—
Q4_K_M5.6 GB
GGUF
AU
aura
Auraflow · calcuis
Params6.86B
Context—
Q4_K_M4.0 GB
GGUF
OL
olmo
OLMo · calcuis
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
CA
cat encoder
Cat · calcuis
Params2.61B
Context—
Smallest0.4 GB
GGUF
KO
vauxz3d
Kohaku · calcuis
Params2.57B
Context—
Q4_K_M1.5 GB
GGUF
KO
koji
Koji · calcuis
Params860M
Context—
Q4_K_M0.5 GB
GGUF
LL
Openmath2
Llama · calcuis
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CH
chat
Chat · calcuis
Params3.43B
Context2K
Smallest2.0 GB
GGUF
ME
medi mini
Medi · calcuis
Params6.74B
Context4K
Smallest3.3 GB
GGUF
LA
lam2 mini
Lam · calcuis
Params6.74B
Context4K
Smallest3.3 GB
GGUF
CO
code mini
Code · calcuis
Params6.74B
Context16K
Smallest3.3 GB
Coding
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · calcuis
Params1.1B
Context2K
Smallest0.6 GB
GGUF
PH
phi2 mini
Phi · calcuis
Params2.78B
Context2K
Smallest1.5 GB
GGUF
LA
law mini
Law · calcuis
Params6.74B
Context4K
Smallest3.3 GB
GGUF

Keep browsing