GGUF models by saidutta69
81 GGUF models quantized by saidutta69 on Hugging Face. Sizes run from 135M to 14.8B parameters. The longest trained context is 986K tokens.
AP
Apertus 8B Instruct heretic
Apertus · saidutta69
Params8.05B
Context64K
Q4_K_M5.1 GB
LF
LFM2.5 2.6B heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
CO
c4ai command r7b 12 2024 heretic
Command R · saidutta69
Params8.03B
Context129K
Q4_K_M5.1 GB
MI
RaceBench MiniCPM5 heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
FR
FrogNano 4B heretic
Frognano · saidutta69
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 9B Heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 3 4b It Heretic
Gemma · saidutta69
Params3.88B
Context128K
Q4_K_M2.5 GB
GR
granite 4.1 8b heretic
Granite · saidutta69
Params8.38B
Context128K
Q4_K_M5.1 GB
GE
Gemma 3 12b It Heretic
Gemma · saidutta69
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3 06b
Qwen · saidutta69
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 VL 4B Instruct heretic
Qwen · saidutta69
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
Gemma 3 1b It Heretic
Gemma · saidutta69
Params1B
Context32K
Q4_K_M0.8 GB
YI
Yi 1.5 9B Chat 16K Heretic
Yi · saidutta69
Params8.83B
Context16K
Q4_K_M5.3 GB
QW
Qwen2.5 14B Instruct Heretic
Qwen · saidutta69
Params14.8B
Context32K
Q4_K_M9.0 GB
LF
LFM3 1.7B Claude Fable5.1
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
MI
RaceBench MiniCPM5
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
LF
LFM3 1.7B Claude Fable5.1 heretic ara
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
MI
MiniCPM5 2B
MiniCPM · saidutta69
Params2.52B
Context128K
Q4_K_M1.6 GB
GH
Ghosty 7B
Ghosty · saidutta69
Params7.62B
Context32K
Q4_K_M4.7 GB
LF
LFM3 1.7B heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
LF
LFM3 VL 2B heretic
Lfm · saidutta69
Params1.73B
Context125K
Q4_K_M1.1 GB
QW
Qwen3.5 4B heretic
Qwen · saidutta69
Params4.21B
Context256K
Q4_K_M2.7 GB