GGUF models by ysn-rfd

149 GGUF models quantized by ysn-rfd on Hugging Face. Sizes run from 7M to 40.2B parameters. The longest trained context is 501K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · ysn-rfd
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
BE
beecoder 220M python Q8 0
Beecoder · ysn-rfd
Params218M
Context2K
Smallest0.2 GB
Coding
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest7.2 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · ysn-rfd
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · ysn-rfd
Params7.3B
Context4K
Smallest4.2 GB
GGUF
TE
text2image prompt generator
Text · ysn-rfd
Params163M
Context1K
Smallest0.3 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · ysn-rfd
Params2.8B
Context4K
Smallest3.0 GB
GGUF
ST
Stable Code Instruct 3b
Stable · ysn-rfd
Params2.8B
Context16K
Smallest3.0 GB
Coding
WI
WizardLM 7B Uncensored
Wizardlm · ysn-rfd
Params6.74B
Context2K
Smallest4.7 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest4.2 GB
GGUF
DI
Distilgpt2
Distilgpt · ysn-rfd
Params121M
Context1K
Smallest0.1 GB
GGUF
OL
OlympicCoder 7B
Olympiccoder · ysn-rfd
Params7.62B
Context32K
Smallest4.4 GB
CodingReasoningTool use
WI
WizardLM 7B Uncensored
Wizardlm · ysn-rfd
Params6.74B
Context2K
Smallest3.8 GB
GGUF
LL
Open_Llama_3B
Llama · ysn-rfd
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
TE
text2image prompt generator Q8 0
Text · ysn-rfd
Params163M
Context1K
Smallest0.2 GB
GGUF
GP
Gpt2 Xl
Gpt · ysn-rfd
Params1.64B
Context1K
Smallest0.9 GB
GGUF
MA
Marco o1 Q8 0
Marco · ysn-rfd
Params7.62B
Context32K
Smallest8.1 GB
GGUF
TI
TinyDolphin 2.8 1.1b Q8 0
Tinydolphin · ysn-rfd
Params1.1B
Context4K
Smallest1.2 GB
CodingTool use
GP
Gpt2 Xl
Gpt · ysn-rfd
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest2.7 GB
GGUF
OP
OpenELM 450M Instruct
Openelm · ysn-rfd
Params457M
Context2K
Smallest0.5 GB
GGUF
WI
WizardLM 7B Uncensored
Wizardlm · ysn-rfd
Params6.74B
Context2K
Smallest4.8 GB
GGUF
LL
Open_Llama_3B_V2
Llama · ysn-rfd
Params3.43B
Context2K
Smallest2.0 GB
Coding
LI
Ling Coder Lite
Ling · ysn-rfd
Params16.8B
Context4K
Smallest17.9 GB
Coding
DA
H2O Danube3 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest2.3 GB
GGUF
ZE
zeta
Zeta · ysn-rfd
Params7.62B
Context32K
Smallest8.1 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · ysn-rfd
Params7.62B
Context32K
Smallest4.4 GB
Tool use
TI
TinyLlama_v1.1_math_code
Tinyllama · ysn-rfd
Params1.1B
Context2K
Smallest1.2 GB
Coding
OP
openchat 3.5
Openchat · ysn-rfd
Params7.24B
Context8K
Smallest4.1 GB
Coding
DA
H2O Danube3.1 4b Chat
Danube · ysn-rfd
Params3.96B
Context8K
Smallest2.3 GB
GGUF

Keep browsing