GGUF models by taronaeo

34 GGUF models quantized by taronaeo on Hugging Face. Sizes run from 23M to 32.2B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.2 3B BE
Granite · taronaeo
Params3.66B
Context—
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Q4_K_M1.0 GB
GGUF
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GGUF
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
GGUF
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny BE
Granite · taronaeo
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
Granite 4.0 3B Vision BE
Granite · taronaeo
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GR
Granite Vision 4.1 4B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.2 30B BE
Granite · taronaeo
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
GGUF
QW
Qwen2.5 3B Instruct BE
Qwen · taronaeo
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GR
Granite 3.0 1B A400M Instruct BE
Granite · taronaeo
Params1.33B
Context4K
Q4_K_M0.8 GB
GGUF
GR
Granite 4.1 3B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
QW
Qwen3.5 4B BE
Qwen · taronaeo
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
LL
Llama 3.2 3B Instruct BE
Llama · taronaeo
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Granite 4.0 H Micro BE
Granite · taronaeo
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.5 0.8B BE
Qwen · taronaeo
Params773M
Context256K
Q4_K_M0.5 GB
GGUF
GR
Granite 4.0 Micro BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
QW
Qwen3.5 2B BE
Qwen · taronaeo
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5 9B BE
Qwen · taronaeo
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 1.5B Instruct BE
Qwen · taronaeo
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B BE
DeepSeek · taronaeo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B BE
DeepSeek · taronaeo
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
AL
all MiniLM L6 v2 BE
All · taronaeo
Params23M
Context512
Q4_K_M0.0 GB
GGUF

About taronaeo on Hugging Face

taronaeo has published 34 GGUF models that ggufmodels.com tracks, across families such as Granite, Qwen and Llama. The most downloaded are Granite 4.2 3B BE, Granite 4.0 1B BE and Granite 4.0 350M BE.

The quants taronaeo publishes most often are Q8_0 (33), Q6_K (32), Q4_K_S (32) and Q4_K_M (32). Their Q4_K_M files range from 0.0 to 19.5 GB. Parameter counts run from 23M to 32.2B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has taronaeo published?

34 models are listed here, mainly from the Granite, Qwen and Llama families. The most downloaded is Granite 4.2 3B BE.

Which quants does taronaeo publish?

The most common are Q8_0 (33 models), Q6_K (32 models), Q4_K_S (32 models) and Q4_K_M (32 models).

Keep browsing