GGUF models by elichen-skymizer

91 GGUF models quantized by elichen-skymizer on Hugging Face. Sizes run from 596M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3 4B Instruct 2507
Qwen · elichen-skymizer
Params4.02B
Context256K
Smallest4.3 GB
ReasoningTool use
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest3.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · elichen-skymizer
Params1.78B
Context128K
Smallest0.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest6.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
QW
Qwen3 0.6B Base
Qwen · elichen-skymizer
Params596M
Context32K
Smallest0.5 GB
ReasoningTool use
QW
Qwen3 30B A3B Instruct 2507
Qwen · elichen-skymizer
Params30.5B
Context256K
Smallest21.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest4.0 GB
ReasoningTool use
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest5.5 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · elichen-skymizer
Params30.5B
Context256K
Smallest25.1 GB
ReasoningTool use
QW
Qwen3 30B A3B Thinking 2507
Qwen · elichen-skymizer
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
LL
Llama 3.2 3B Instruct
Llama · elichen-skymizer
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest4.7 GB
GGUF
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest6.6 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · elichen-skymizer
Params1.54B
Context128K
Smallest1.6 GB
Tool use
LL
Llama 3.2 3B
Llama · elichen-skymizer
Params3.21B
Context128K
Smallest2.6 GB
GGUF
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest1.4 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · elichen-skymizer
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest4.0 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · elichen-skymizer
Params1.24B
Context128K
Smallest0.7 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · elichen-skymizer
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
LL
Llama 3.1 8B
Llama · elichen-skymizer
Params8.03B
Context128K
Smallest5.7 GB
GGUF
LL
Llama 3.2 3B
Llama · elichen-skymizer
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3.2 3B
Llama · elichen-skymizer
Params3.21B
Context128K
Smallest1.7 GB
GGUF
QW
Qwen3 0.6B Base
Qwen · elichen-skymizer
Params596M
Context32K
Smallest0.3 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · elichen-skymizer
Params1.24B
Context128K
Smallest0.9 GB
Tool use
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest7.1 GB
GGUF

Keep browsing