GGUF models by ermiaazarkhalili

112 GGUF models quantized by ermiaazarkhalili on Hugging Face. Sizes run from 354M to 14.8B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 1.2B Instruct GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
QW
Qwen3 8B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
VI
VibeThinker 3B SFT Fable5 Glint
Vibethinker · ermiaazarkhalili
Params3.09B
Context128K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 1.5B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
FA
FastContext 4B SFT base SFT Fable5 Glint
Fastcontext · ermiaazarkhalili
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
SM
SmolLM3 3B GRPO NuminaMath 10K
SmolLM · ermiaazarkhalili
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
QW
Qwen3 0.6B GRPO NuminaMath 100K
Qwen · ermiaazarkhalili
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GR
Granite 4.1 3B SFT Fable5 Glint
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
LL
Llama 3 8B Instruct Function Calling xLAM
Llama · ermiaazarkhalili
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 4B SFT UltraChat
Qwen · ermiaazarkhalili
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
QW
qwen2.5 7b instruct trl sft ChartQA
Qwen · ermiaazarkhalili
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 0.5B SFT UltraChat
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3 1.7B GRPO NuminaMath 10K
Qwen · ermiaazarkhalili
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
GR
Granite 4.1 8B SFT Fable5 Glint
Granite · ermiaazarkhalili
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
QW
Qwen3.5 9B SFT Fable5 Glint
Qwen · ermiaazarkhalili
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
reasoning gym chain sum qwen3 0 6b grpo model
Qwen · ermiaazarkhalili
Params596M
Context40K
Q4_K_M0.4 GB
Reasoning
QW
Qwen2.5 7B SFT Capybara
Qwen · ermiaazarkhalili
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
OpenMath Nemotron 1.5B GRPO NuminaMath 10K
Nemotron · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
reasoning gym chain sum qwen3 1 7b grpo
Qwen · ermiaazarkhalili
Params1.72B
Context40K
Q4_K_M1.1 GB
Reasoning
LL
Llama 3.1 8B Instruct Function Calling xLAM
Llama · ermiaazarkhalili
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite 4.0 micro GRPO NuminaMath 20K
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
QW
Qwen2.5 3B SFT UltraChat
Qwen · ermiaazarkhalili
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use

Keep browsing