GGUF models by tatsuyaaaaaaa

76 GGUF models quantized by tatsuyaaaaaaa on Hugging Face. Sizes run from 268M to 34.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 4b It
Gemma · tatsuyaaaaaaa
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3 Reranker 0.6B
Qwen · tatsuyaaaaaaa
Params596M
Context40K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
LF
LFM2.5 1.2B Instruct
Lfm · tatsuyaaaaaaa
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
GE
Gemma 3n E4B It
Gemma · tatsuyaaaaaaa
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
QW
Qwen3 VL 2B Instruct
Qwen · tatsuyaaaaaaa
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
GR
Granite 4.0 H Tiny
Granite · tatsuyaaaaaaa
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
LF
LFM2 2.6B
Lfm · tatsuyaaaaaaa
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
QW
Qwen2.5 7B Instruct
Qwen · tatsuyaaaaaaa
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen3 8B
Qwen · tatsuyaaaaaaa
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LF
LFM2 350M
Lfm · tatsuyaaaaaaa
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
GP
Gpt Oss Safeguard 20b
gpt-oss · tatsuyaaaaaaa
Params20.9B
Context128K
Smallest12.1 GB
Tool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tatsuyaaaaaaa
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
GR
Granite 4.0 H Micro Base
Granite · tatsuyaaaaaaa
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
RA
RakutenAI 2.0 Mini Instruct
Rakutenai · tatsuyaaaaaaa
Params1.53B
Context128K
Q4_K_M0.9 GB
GGUF
LF
LFM2 700M
Lfm · tatsuyaaaaaaa
Params742M
Context125K
Q4_K_M0.5 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · tatsuyaaaaaaa
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
QW
Qwen3.5 0.8B JP
Qwen · tatsuyaaaaaaa
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
shisa-v2-qwen2.5-7b
Qwen · tatsuyaaaaaaa
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GE
Gemma 3n E2B It
Gemma · tatsuyaaaaaaa
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
QW
shisa v2.1 qwen3 8b
Qwen · tatsuyaaaaaaa
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
Granite 4.0 Micro Base
Granite · tatsuyaaaaaaa
Params3.4B
Context1024K
Q4_K_M2.1 GB
GGUF
DE
suzume llama 3 8B japanese
DeepSeek · tatsuyaaaaaaa
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
QW
ELYZA Shortcut 1.0 Qwen 7B
Qwen · tatsuyaaaaaaa
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · tatsuyaaaaaaa
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 Swallow 8B CPT v0.2
Qwen · tatsuyaaaaaaa
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
ABEJA Qwen2.5 7b Japanese v0.1
Qwen · tatsuyaaaaaaa
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MU
multilingual e5 large
Multilingual · tatsuyaaaaaaa
Params559M
Context512
Q4_K_M0.4 GB
GGUF
QW
Qwen3 Swallow 8B SFT v0.2
Qwen · tatsuyaaaaaaa
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · tatsuyaaaaaaa
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
SM
SmolVLM2 2.2B Instruct
Smolvlm · tatsuyaaaaaaa
Params1.81B
Context8K
Q4_K_M1.1 GB
GGUF

Keep browsing