GGUF models by ermiaazarkhalili
112 GGUF models quantized by ermiaazarkhalili on Hugging Face. Sizes run from 354M to 14.8B parameters. The longest trained context is 256K tokens.
LF
LFM2.5 350M SFT Claude Opus Reasoning Unsloth
Lfm · ermiaazarkhalili
Params354M
Context125K
Q4_K_M0.2 GB
GE
Gemma4 E4B SFT Fable5
Gemma · ermiaazarkhalili
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
Qwen2.5 7B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params7.62B
Context32K
Q4_K_M4.7 GB
FA
FastContext 4B RL base Function Calling xLAM Unsloth
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
FA
FastContext 4B RL base SFT Fable5 Glint
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.5 9B SFT Fable5
Qwen · ermiaazarkhalili
Params8.95B
Context256K
Q4_K_M5.6 GB
LF
LFM2.5 VL 1.6B SFT Fable5 Glint
Lfm · ermiaazarkhalili
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen3.5 2B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params1.88B
Context256K
Q4_K_M1.3 GB
GE
Gemma4 E2B SFT Fable5
Gemma · ermiaazarkhalili
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen2.5 14B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Gemma4 E4B Function Calling xLAM Unsloth
Gemma · ermiaazarkhalili
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.5 2B Function Calling xLAM
Qwen · ermiaazarkhalili
Params1.88B
Context256K
Q4_K_M1.3 GB
GE
Gemma4 E2B SFT Fable5 Glint
Gemma · ermiaazarkhalili
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen3 4B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 4B SFT Fable5
Qwen · ermiaazarkhalili
Params4.02B
Context40K
Q4_K_M2.5 GB
FA
FastContext 4B RL base SFT Fable5
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.5 0.8B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 0.6B SFT UltraChat
Qwen · ermiaazarkhalili
Params596M
Context32K
Q4_K_M0.4 GB
LL
Llama 3.2 1B Instruct Function Calling xLAM
Llama · ermiaazarkhalili
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Qwen2.5 3B GRPO NuminaMath 100K
Qwen · ermiaazarkhalili
Params3.09B
Context32K
Q4_K_M1.9 GB
CA
Carnice 9B SFT Fable5 Glint
Carnice · ermiaazarkhalili
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite 4.1 3B SFT Fable5
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
CA
Carnice 9B SFT Fable5
Carnice · ermiaazarkhalili
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 4B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params4.21B
Context256K
Q4_K_M2.7 GB
FA
FastContext 4B SFT base SFT Fable5
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
OL
Olmo 3 7B SFT Fable5
OLMo · ermiaazarkhalili
Params7.3B
Context64K
Q4_K_M4.5 GB
LL
Llama 3.2 3B Instruct Function Calling xLAM
Llama · ermiaazarkhalili
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.2 3B Instruct GRPO NuminaMath 10K
Llama · ermiaazarkhalili
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3 1.7B SFT UltraChat
Qwen · ermiaazarkhalili
Params1.72B
Context32K
Q4_K_M1.1 GB
GR
Granite 4.1 8B SFT Fable5
Granite · ermiaazarkhalili
Params8.79B
Context128K
Q4_K_M5.3 GB