GGUF models by saidutta69

81 GGUF models quantized by saidutta69 on Hugging Face. Sizes run from 135M to 14.8B parameters. The longest trained context is 986K tokens.

Most downloadedNewestLargestLongest contextSmallest
AP
Apertus 8B Instruct heretic
Apertus · saidutta69
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningRoleplayTool use
LF
LFM2.5 2.6B heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
CO
c4ai command r7b 12 2024 heretic
Command R · saidutta69
Params8.03B
Context129K
Q4_K_M5.1 GB
RoleplayTool use
MI
RaceBench MiniCPM5 heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
FR
FrogNano 4B heretic
Frognano · saidutta69
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningRoleplay
QW
Qwen3.5 9B Heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GE
Gemma 3 4b It Heretic
Gemma · saidutta69
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GR
granite 4.1 8b heretic
Granite · saidutta69
Params8.38B
Context128K
Q4_K_M5.1 GB
RoleplayTool use
GE
Gemma 3 12b It Heretic
Gemma · saidutta69
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3 06b
Qwen · saidutta69
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen3 VL 4B Instruct heretic
Qwen · saidutta69
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
GE
Gemma 3 1b It Heretic
Gemma · saidutta69
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
YI
Yi 1.5 9B Chat 16K Heretic
Yi · saidutta69
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
QW
Qwen2.5 14B Instruct Heretic
Qwen · saidutta69
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LF
LFM3 1.7B Claude Fable5.1
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
MI
RaceBench MiniCPM5
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
LF
LFM3 1.7B Claude Fable5.1 heretic ara
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
MI
MiniCPM5 2B
MiniCPM · saidutta69
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
GH
Ghosty 7B
Ghosty · saidutta69
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LF
LFM3 1.7B heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
LF
LFM3 VL 2B heretic
Lfm · saidutta69
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
QW
Qwen3.5 4B heretic
Qwen · saidutta69
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision

Keep browsing