GGUF models by ysn-rfd
149 GGUF models quantized by ysn-rfd on Hugging Face. Sizes run from 7M to 40.2B parameters. The longest trained context is 501K tokens.
CA
calme-3.3-instruct-3b
Calme · ysn-rfd
Params3.09B
Context32K
Smallest1.8 GB
QW
Qwen2.5 0.5B Instruct
Qwen · ysn-rfd
Params494M
Context32K
Smallest0.5 GB
GP
Gpt2 Xl
Gpt · ysn-rfd
Params1.56B
Context1K
Q4_K_M1.1 GB
PE
Persian to English Translation mT5 V1 Q8 0
Persian · ysn-rfd
Params582M
Context512
Smallest0.6 GB
SM
SmolLM 1.7B
SmolLM · ysn-rfd
Params1.71B
Context2K
Smallest1.8 GB
OP
Open RS3 Q8 0
Open · ysn-rfd
Params1.78B
Context128K
Smallest1.9 GB
OP
OpenELM 3B Instruct
Openelm · ysn-rfd
Params3.04B
Context2K
Smallest1.7 GB
XL
xLAM 1b Fc R
Xlam · ysn-rfd
Params1.35B
Context16K
Smallest0.8 GB
GE
Gemma 3 4b It
Gemma · ysn-rfd
Params3.88B
Context128K
Smallest4.1 GB
GP
gpt oss 4.2b specialized all pruned moe only 4 experts Q8 0
gpt-oss · ysn-rfd
Params4.19B
Context128K
Smallest4.5 GB
GP
gpt oss 4.2b specialized harmful pruned moe only 4 experts Q8 0
gpt-oss · ysn-rfd
Params4.19B
Context128K
Smallest4.5 GB
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest3.9 GB
LL
CodeLlama 7b Python Hf
Llama · ysn-rfd
Params6.74B
Context16K
Smallest2.5 GB
OP
OpenELM 3B Instruct
Openelm · ysn-rfd
Params3.04B
Context2K
Smallest1.2 GB
TI
TinySwallow 1.5B Instruct
Tinyswallow · ysn-rfd
Params1.54B
Context32K
Smallest1.6 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · ysn-rfd
Params3.09B
Context32K
Smallest3.3 GB
FA
gpt4all falcon Q2 K
Falcon · ysn-rfd
Params7.22B
Context2K
Smallest3.9 GB
TI
TinyLlama_v1.1_math_code
Tinyllama · ysn-rfd
Params1.1B
Context2K
Smallest0.6 GB
PE
PersianMind-v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Q4_K_M4.1 GB
GP
gpt2 Q2 K
Gpt · ysn-rfd
Params163M
Context1K
Smallest0.1 GB
CH
Chargen v2
Chargen · ysn-rfd
Params7.24B
Context32K
Smallest4.1 GB
WI
WizardLM 7B Uncensored
Wizardlm · ysn-rfd
Params6.74B
Context2K
Smallest7.2 GB
AC
AceInstruct 7B
Aceinstruct · ysn-rfd
Params7.62B
Context128K
Smallest4.4 GB
OP
OpenELM 3B Instruct
Openelm · ysn-rfd
Params3.04B
Context2K
Smallest3.2 GB
WI
WizardLM 7B Uncensored
Wizardlm · ysn-rfd
Params6.74B
Context2K
Q4_K_M4.1 GB
ST
Stablelm Zephyr 3b
Stablelm · ysn-rfd
Params2.8B
Context4K
Q4_K_M1.7 GB
TI
TinyMistral 248M v2.5
Tinymistral · ysn-rfd
Params248M
Context32K
Smallest0.2 GB
GE
Gemma 3 4b It Qat Int4 Unquantized
Gemma · ysn-rfd
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · ysn-rfd
Params7.62B
Context32K
Smallest8.1 GB
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Q4_K_M2.4 GB