GGUF models by elichen-skymizer
91 GGUF models quantized by elichen-skymizer on Hugging Face. Sizes run from 596M to 30.5B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 1.5B
Qwen · elichen-skymizer
Params1.54B
Context128K
Smallest1.1 GB
QW
Qwen3 4B Thinking 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Smallest2.9 GB
QW
Qwen3 4B Thinking 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Smallest4.3 GB
QW
Qwen2.5 1.5B
Qwen · elichen-skymizer
Params1.54B
Context128K
Smallest1.3 GB
LL
Llama 3.1 8B Instruct
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · elichen-skymizer
Params3.21B
Context128K
Smallest3.4 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · elichen-skymizer
Params1.78B
Context128K
Smallest1.3 GB
QW
Qwen3 0.6B Base
Qwen · elichen-skymizer
Params596M
Context32K
Smallest0.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest8.5 GB
LL
Llama 3.2 3B Instruct
Llama · elichen-skymizer
Params3.21B
Context128K
Smallest1.7 GB
LL
Llama 3.2 1B Instruct
Llama · elichen-skymizer
Params1.24B
Context128K
Smallest1.0 GB
GE
Gemma 3 1b Pt
Gemma · elichen-skymizer
Params1B
Context32K
Smallest0.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · elichen-skymizer
Params1.78B
Context128K
Smallest1.9 GB
QW
Qwen3 4B Instruct 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Smallest2.9 GB
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest1.0 GB
LL
Llama 3.2 1B Instruct
Llama · elichen-skymizer
Params1.24B
Context128K
Smallest1.3 GB
LL
Llama 3.1 8B Instruct
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest5.7 GB
QW
Qwen3 0.6B Base
Qwen · elichen-skymizer
Params596M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · elichen-skymizer
Params30.5B
Context256K
Smallest25.1 GB
QW
Qwen3 4B Instruct 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Smallest2.1 GB
QW
Qwen2.5 1.5B
Qwen · elichen-skymizer
Params1.54B
Context128K
Smallest0.8 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · elichen-skymizer
Params1.78B
Context128K
Smallest1.5 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · elichen-skymizer
Params30.5B
Context256K
Smallest21.7 GB
LL
Llama 3.1 8B Instruct
Llama · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B
Llama · elichen-skymizer
Params3.21B
Context128K
Smallest2.3 GB
LL
Llama 3.1 8B Instruct
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest4.0 GB
LL
Llama 3.1 8B Instruct
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest6.6 GB
QW
Qwen3 4B Instruct 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Smallest3.3 GB