GGUF models by saidutta69
81 GGUF models quantized by saidutta69 on Hugging Face. Sizes run from 135M to 14.8B parameters. The longest trained context is 986K tokens.
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 4B Instruct 2507 heretic
Qwen · saidutta69
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen2.5 Coder 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB
LF
LFM2.5 1.2B Instruct heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
DE
DeepSeek R1 Distill Qwen 7B Heretic
DeepSeek · saidutta69
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
MiniCPM5 1B Heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
LL
Llama 3.2 1B Instruct heretic
Llama · saidutta69
Params1.24B
Context128K
Q4_K_M0.8 GB
SM
SmolLM2 1.7B Instruct heretic
SmolLM · saidutta69
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
Qwen2.5 VL 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context125K
Q4_K_M1.9 GB
GR
granite 4.1 3b heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
Qwen3 VL 8B Instruct heretic
Qwen · saidutta69
Params8.19B
Context256K
Q4_K_M5.0 GB
LF
LFM3 1.7B Base heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
LF
LFM2.5 350M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
EU
EuroLLM 1.7B Instruct heretic
Eurollm · saidutta69
Params1.66B
Context4K
Smallest3.3 GB
LF
LFM2.5 VL 3B heretic
Lfm · saidutta69
Params2.7B
Context32K
Q4_K_M1.7 GB
QW
VibeThinker 3B heretic
Qwen · saidutta69
Params3.09B
Context128K
Q4_K_M1.9 GB
SM
SmolLM2 360M Instruct heretic
SmolLM · saidutta69
Params362M
Context8K
Q4_K_M0.3 GB
LF
LFM2.5 1.2B Thinking heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
SM
SmolLM3 3B heretic
SmolLM · saidutta69
Params3.08B
Context64K
Q4_K_M1.9 GB
CL
clef flash heretic
Clef · saidutta69
Params8.95B
Context256K
Smallest17.9 GB
QW
Qwen3 4B Thinking heretic
Qwen · saidutta69
Params4.02B
Context256K
Q4_K_M2.5 GB
LF
LFM2.5 230M heretic
Lfm · saidutta69
Params230M
Context125K
Q4_K_M0.2 GB
QW
Qwen2.5 VL 7B Instruct heretic
Qwen · saidutta69
Params7.62B
Context125K
Q4_K_M4.7 GB
LF
LFM2.5 VL 450M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
MI
Ministral 8B Instruct heretic
Mistral · saidutta69
Params8.02B
Context32K
Q4_K_M4.9 GB
QW
Qwen2.5 7B Instruct 1M heretic
Qwen · saidutta69
Params7.62B
Context986K
Q4_K_M4.7 GB
GE
gemma 4 12B it heretic
Gemma · saidutta69
Params11.9B
Context256K
Q4_K_M7.4 GB
EU
EuroLLM 9B Instruct heretic
Eurollm · saidutta69
Params9.15B
Context4K
Q4_K_M5.6 GB
SM
SmolLM2 135M Instruct heretic
SmolLM · saidutta69
Params135M
Context8K
Q4_K_M0.1 GB
QW
Qwen3.5 2B Heretic
Qwen · saidutta69
Params1.88B
Context256K
Q4_K_M1.3 GB