GGUF models by saidutta69

81 GGUF models quantized by saidutta69 on Hugging Face. Sizes run from 135M to 14.8B parameters. The longest trained context is 986K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen3 4B Instruct 2507 heretic
Qwen · saidutta69
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
QW
Qwen2.5 Coder 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingRoleplayTool use
LF
LFM2.5 1.2B Instruct heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 Distill Qwen 7B Heretic
DeepSeek · saidutta69
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MI
MiniCPM5 1B Heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct heretic
Llama · saidutta69
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
SM
SmolLM2 1.7B Instruct heretic
SmolLM · saidutta69
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen2.5 VL 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context125K
Q4_K_M1.9 GB
RoleplayVision
GR
granite 4.1 3b heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
RoleplayTool use
QW
Qwen3 VL 8B Instruct heretic
Qwen · saidutta69
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
LF
LFM3 1.7B Base heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
LF
LFM2.5 350M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningRoleplayTool use
EU
EuroLLM 1.7B Instruct heretic
Eurollm · saidutta69
Params1.66B
Context4K
Smallest3.3 GB
GGUF
LF
LFM2.5 VL 3B heretic
Lfm · saidutta69
Params2.7B
Context32K
Q4_K_M1.7 GB
CodingReasoningTool use
QW
VibeThinker 3B heretic
Qwen · saidutta69
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
SM
SmolLM2 360M Instruct heretic
SmolLM · saidutta69
Params362M
Context8K
Q4_K_M0.3 GB
Roleplay
LF
LFM2.5 1.2B Thinking heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
SM
SmolLM3 3B heretic
SmolLM · saidutta69
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningRoleplayTool use
CL
clef flash heretic
Clef · saidutta69
Params8.95B
Context256K
Smallest17.9 GB
ReasoningTool useVision
QW
Qwen3 4B Thinking heretic
Qwen · saidutta69
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
LF
LFM2.5 230M heretic
Lfm · saidutta69
Params230M
Context125K
Q4_K_M0.2 GB
ReasoningRoleplayTool use
QW
Qwen2.5 VL 7B Instruct heretic
Qwen · saidutta69
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LF
LFM2.5 VL 450M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool useVision
MI
Ministral 8B Instruct heretic
Mistral · saidutta69
Params8.02B
Context32K
Q4_K_M4.9 GB
RoleplayTool use
QW
Qwen2.5 7B Instruct 1M heretic
Qwen · saidutta69
Params7.62B
Context986K
Q4_K_M4.7 GB
RoleplayTool use
GE
gemma 4 12B it heretic
Gemma · saidutta69
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
EU
EuroLLM 9B Instruct heretic
Eurollm · saidutta69
Params9.15B
Context4K
Q4_K_M5.6 GB
Roleplay
SM
SmolLM2 135M Instruct heretic
SmolLM · saidutta69
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
QW
Qwen3.5 2B Heretic
Qwen · saidutta69
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use

Keep browsing