GGUF models by macadeliccc
42 GGUF models quantized by macadeliccc on Hugging Face. Sizes run from 3.21B to 69B parameters. The longest trained context is 195K tokens.
SO
SOLAR 2x10.7B truthy dpo
Solar · macadeliccc
Params19.2B
Context4K
Smallest7.1 GB
PI
piccolo math 2x7b
Piccolo · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
SA
samantha 1.1 MBX 7B
Samantha · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
polyglot 4x7b
Polyglot · macadeliccc
Params24.2B
Context32K
Smallest25.7 GB
MI
mixtral instruct 0.1 laser
Mistral · macadeliccc
Params46.7B
Context32K
Smallest12.3 GB
SO
SOLAR math 2x10.7b v0.2
Solar · macadeliccc
Params19.2B
Context4K
Q4_K_M11.6 GB
HE
HermesLake 7B dare ties
Hermeslake · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
OM
OmniCorso 7B
Omnicorso · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
Polyglot 8x7b v0.1
Polyglot · macadeliccc
Params46.7B
Context32K
Smallest49.6 GB
SM
SmaugDolphin 60B
Smaugdolphin · macadeliccc
Params60.8B
Context195K
Smallest16.2 GB
PI
piccolo 2x7b
Piccolo · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
OR
Orca SOLAR 4x10.7b
Orca · macadeliccc
Params36.1B
Context4K
Q4_K_M21.8 GB