GGUF models by macadeliccc

42 GGUF models quantized by macadeliccc on Hugging Face. Sizes run from 3.21B to 69B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
SOLAR 2x10.7B truthy dpo
Solar · macadeliccc
Params19.2B
Context4K
Smallest7.1 GB
GGUF
PI
piccolo math 2x7b
Piccolo · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
SA
samantha 1.1 MBX 7B
Samantha · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PO
polyglot 4x7b
Polyglot · macadeliccc
Params24.2B
Context32K
Smallest25.7 GB
GGUF
MI
mixtral instruct 0.1 laser
Mistral · macadeliccc
Params46.7B
Context32K
Smallest12.3 GB
GGUF
SO
SOLAR math 2x10.7b v0.2
Solar · macadeliccc
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
HE
HermesLake 7B dare ties
Hermeslake · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OM
OmniCorso 7B
Omnicorso · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PO
Polyglot 8x7b v0.1
Polyglot · macadeliccc
Params46.7B
Context32K
Smallest49.6 GB
GGUF
SM
SmaugDolphin 60B
Smaugdolphin · macadeliccc
Params60.8B
Context195K
Smallest16.2 GB
GGUF
PI
piccolo 2x7b
Piccolo · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
OR
Orca SOLAR 4x10.7b
Orca · macadeliccc
Params36.1B
Context4K
Q4_K_M21.8 GB
GGUF

Keep browsing