GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
QwQ 32B Preview
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use

Keep browsing