GGUF models by mudler
92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.
LL
llama-3-llamilitary
Llama · mudler
Params8.03B
Context8K
Q4_K_M4.9 GB
CE
L3 8B Celeste V1.2 Q4 K M
Celeste · mudler
Params8.03B
Context8K
Q4_K_M4.9 GB