GGUF models by adamksn
34 GGUF models quantized by adamksn on Hugging Face. Sizes run from 7.24B to 12.9B parameters. The longest trained context is 128K tokens.
NE
Garrulus 7B
Neuralmarcoro · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes 3 Llama 3.1 8B
Llama · adamksn
Params8.03B
Context128K
Smallest3.2 GB
AL
MonarchLake 7B
Alphamonarch · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
MU
multi verse model 7B
Multi · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB