GGUF models by ysn-rfd

149 GGUF models quantized by ysn-rfd on Hugging Face. Sizes run from 7M to 40.2B parameters. The longest trained context is 501K tokens.

Most downloadedNewestLargestLongest contextSmallest
YS
ysnrfd fa persian slm 3m
Ysnrfd · ysn-rfd
Params163M
Context1K
Smallest0.2 GB
Coding
WI
WizardLM 7B Uncensored
Wizardlm · ysn-rfd
Params6.74B
Context2K
Smallest5.5 GB
GGUF
GE
Gemma 3 4b It Qat Int4 Unquantized
Gemma · ysn-rfd
Params3.88B
Context128K
Smallest4.1 GB
Vision
RE
ReaderLM v2 Q8 0
Readerlm · ysn-rfd
Params1.54B
Context501K
Smallest1.6 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · ysn-rfd
Params1.71B
Context8K
Smallest1.8 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · ysn-rfd
Params2.8B
Context4K
Smallest1.1 GB
GGUF
FI
Fibonacci_Test_Release
Fibonacci · ysn-rfd
Params7.25B
Context32K
Smallest7.7 GB
GGUF
NS
NSFW_DPO_Noromaid-7b
Nsfw · ysn-rfd
Params7.24B
Context32K
Smallest4.1 GB
Roleplay
BA
T5 V1_1 Base
Base · ysn-rfd
Params248M
Context512
Smallest0.3 GB
GGUF
GP
gpt2 Q8 0
Gpt · ysn-rfd
Params163M
Context1K
Smallest0.2 GB
GGUF
NS
NSFW DPO Noromaid 7b
Nsfw · ysn-rfd
Params7.24B
Context32K
Smallest5.0 GB
Roleplay
MI
openchat-3.5-0106
Mistral · ysn-rfd
Params7.24B
Context8K
Smallest7.7 GB
GGUF
FI
Fibonacci_Test_Release
Fibonacci · ysn-rfd
Params7.25B
Context32K
Smallest2.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · ysn-rfd
Params1.1B
Context2K
Smallest1.2 GB
Coding
PR
Promt generator Q8 0
Promt · ysn-rfd
Params559M
Context2K
Smallest0.6 GB
GGUF
OP
OpenELM 1_1B Instruct
Openelm · ysn-rfd
Params1.08B
Context2K
Smallest1.1 GB
GGUF
CA
causal language modeling Q2 K
Causal · ysn-rfd
Params121M
Context1K
Smallest0.1 GB
GGUF
CA
causal language modeling Q4 K M
Causal · ysn-rfd
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · ysn-rfd
Params7.25B
Context32K
Smallest4.1 GB
Tool use
FI
Fibonacci_Test_Release
Fibonacci · ysn-rfd
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GP
gpt oss 10.8b specialized all pruned moe only 15 experts Q8 0
gpt-oss · ysn-rfd
Params10.8B
Context128K
Smallest11.5 GB
GGUF
BL
Bloom 560m RLHF SD2 Prompter
Bloom · ysn-rfd
Params559M
Context2K
Smallest0.6 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · ysn-rfd
Params1.1B
Context2K
Smallest0.4 GB
Coding
BA
BADMISTRAL 1.5B
Badmistral · ysn-rfd
Params1.55B
Context8K
Smallest1.7 GB
GGUF
OP
openchat 3.5 Q8 0
Openchat · ysn-rfd
Params7.24B
Context8K
Smallest7.7 GB
Coding
AT
Athena R3 1.5B Q8 0
Athena · ysn-rfd
Params1.78B
Context128K
Smallest1.9 GB
Tool use
GP
Gpt2 Medium
Gpt · ysn-rfd
Params406M
Context1K
Smallest0.2 GB
GGUF
GP
Gpt2 Large
Gpt · ysn-rfd
Params838M
Context1K
Smallest0.3 GB
GGUF
DE
DeepScaleR 1.5B Preview
Deepscaler · ysn-rfd
Params1.78B
Context128K
Smallest1.9 GB
Tool use

Keep browsing