GGUF models by mudler

92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama-3-llamilitary
Llama · mudler
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CE
L3 8B Celeste V1.2 Q4 K M
Celeste · mudler
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing