GGUF models by ermiaazarkhalili
112 GGUF models quantized by ermiaazarkhalili on Hugging Face. Sizes run from 354M to 14.8B parameters. The longest trained context is 256K tokens.
QW
Qwen3 8B SFT Claude Opus Reasoning Unsloth
Qwen · ermiaazarkhalili
Params8.19B
Context40K
Q4_K_M5.0 GB
CA
Carnice 9B Function Calling xLAM Unsloth
Carnice · ermiaazarkhalili
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 0.8B SFT Claude Opus Reasoning
Qwen · ermiaazarkhalili
Params752M
Context256K
Q4_K_M0.5 GB
AG
Agents A1 4B SFT Fable5 Glint
Agents · ermiaazarkhalili
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma4 E2B Function Calling xLAM Unsloth
Gemma · ermiaazarkhalili
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen3 4B Function Calling xLAM Unsloth
Qwen · ermiaazarkhalili
Params4.02B
Context40K
Q4_K_M2.5 GB
LF
LFM2 700M GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params742M
Context125K
Q4_K_M0.5 GB
FA
FastContext 4B SFT base SFT Claude Opus Reasoning Unsloth
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
FA
FastContext 4B RL base SFT Claude Opus Reasoning Unsloth
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 8B Function Calling xLAM Unsloth
Qwen · ermiaazarkhalili
Params8.19B
Context40K
Q4_K_M5.0 GB
LF
LFM2.5 2.6B SFT Fable5
Lfm · ermiaazarkhalili
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
Qwen3.5 0.8B Function Calling xLAM
Qwen · ermiaazarkhalili
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5 4B SFT Fable5
Qwen · ermiaazarkhalili
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen2.5 0.5B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 1.5B SFT UltraChat
Qwen · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Qwen3 4B SFT Claude Opus Reasoning Unsloth
Qwen · ermiaazarkhalili
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen2.5 3B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
LFM2.5 VL 450M SFT Fable5 Glint
Lfm · ermiaazarkhalili
Params354M
Context125K
Q4_K_M0.2 GB
LF
LFM2.5 350M SFT Fable5 Glint
Lfm · ermiaazarkhalili
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwen3 8B SFT Fable5
Qwen · ermiaazarkhalili
Params8.19B
Context40K
Q4_K_M5.0 GB
FA
FastContext 4B SFT base Function Calling xLAM Unsloth
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 2B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5 0.5B SFT OpenHermes 2.5 100
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
MI
MiniCPM5 1B SFT Fable5 Glint
MiniCPM · ermiaazarkhalili
Params1.08B
Context128K
Q4_K_M0.7 GB
LF
LFM2.5 2.6B SFT Fable5 Glint
Lfm · ermiaazarkhalili
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
Qwen3.5 2B SFT Fable5
Qwen · ermiaazarkhalili
Params1.94B
Context256K
Q4_K_M1.3 GB
LF
LFM2 350M GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params354M
Context125K
Q4_K_M0.2 GB
LF
LFM2.5 1.2B SFT Fable5 Glint
Lfm · ermiaazarkhalili
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
MiniCPM5 1B SFT Fable5
MiniCPM · ermiaazarkhalili
Params1.08B
Context128K
Q4_K_M0.7 GB
GE
Gemma4 E4B SFT Fable5 Glint
Gemma · ermiaazarkhalili
Params7.52B
Context128K
Q4_K_M5.3 GB