GGUF models by RCorvalan
35 GGUF models quantized by RCorvalan on Hugging Face. Sizes run from 3.82B to 32.8B parameters. The longest trained context is 986K tokens.
OL
OLMo 2 1124 13B Instruct
OLMo · RCorvalan
Params13.7B
Context4K
Q4_K_M8.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · RCorvalan
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
QwQ 32B
Qwen · RCorvalan
Params32.8B
Context128K
Smallest12.3 GB
OL
OLMo 2 1124 7B Instruct Q6 K
OLMo · RCorvalan
Params7.3B
Context4K
Smallest6.0 GB
OL
OLMo 2 1124 7B Instruct Q8 0
OLMo · RCorvalan
Params7.3B
Context4K
Smallest7.8 GB