RW

RWKV6 3B Chn UnlimitedRP mini chat

RwkvGGUF by btaskelUpdated 2025-03-09
Download on Hugging Face
Parameters3.1B
Context1024K
Layers32
Architecturerwkv6
Smallest quant1.9 GB
Quick answer

RWKV6 3B Chn UnlimitedRP mini chat needs about 2.6 GB of memory at Q4_K_S (a 1.9 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 1.9 GB (Q4_K_S) to 3.4 GB (Q8_0).

RWKV6 3B Chn UnlimitedRP mini chat – a 3.1B parameter chat model for unlimited role‑playing

RWKV6 3B Chn UnlimitedRP mini chat is a 3.1B parameter model trained on 1,048,576 context tokens. It is tuned for chat and role‑playing, with a focus on unlimited RP and ERP tasks. The model is released under the apache-2.0 license.

Good at

  • Unlimited role‑playing
  • Chatting in Chinese
  • ERPs with controlled detail

Limits

  • No vision support
  • Requires large context for best performance
  • License is apache-2.0

Best for

  • Chatbots needing deep role‑play
  • Interactive storytelling
  • ERPs with limited sexual content

Who it’s for. Developers building chat applications that require extensive role‑playing capabilities. The model is suitable for users who want a Chinese‑language chat model with a large context window and a permissive license.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q4_K_S1.9 GB 2.6 GB
Fits Get file →
Q8_03.4 GB 4.3 GB
Fits Get file →

For 8 GB VRAM use the Q4_K_S quantization (file size 1.92 GB, estimated 2.6 GB memory at 8 k context). For higher VRAM budgets, Q8_0 (3.41 GB, 4.3 GB memory) offers better precision. Memory estimates are approximate.

What GPU do you need for RWKV6 3B Chn UnlimitedRP mini chat?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is Q4_K_S (1.9 GB file, about 2.6 GB in use).
  • 6 GB VRAM: the best quant that fits is Q8_0 (3.4 GB file, about 4.3 GB in use).

Which RWKV6 3B Chn UnlimitedRP mini chat quant should you choose?

Q4_K_S (1.9 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturerwkv6
Parameters3.1B
Layers32
Trained context1,048,576 tokens

Source

Quantized bybtaskel
FamilyRwkv
Licenseapache-2.0
Downloads (HF)918
Last updated2025-03-09

Frequently asked questions about RWKV6 3B Chn UnlimitedRP mini chat

How much VRAM does RWKV6 3B Chn UnlimitedRP mini chat need?

About 2.6 GB at Q4_K_S with an 8K context window. That is the 1.9 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run RWKV6 3B Chn UnlimitedRP mini chat on an 8 GB GPU?

Yes, with Q8_0: the 3.4 GB file needs about 4.3 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of RWKV6 3B Chn UnlimitedRP mini chat GGUF?

It depends on the quant: Q4_K_S is 1.9 GB, Q8_0 is 3.4 GB.

What context length does RWKV6 3B Chn UnlimitedRP mini chat support?

The GGUF header lists a trained context length of 1,048,576 tokens (1024K).

Where can I download RWKV6 3B Chn UnlimitedRP mini chat GGUF?

The files are on Hugging Face in the btaskel/RWKV6-3B-Chn-UnlimitedRP-mini-chat-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does RWKV6 3B Chn UnlimitedRP mini chat use?

Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, the Q4_K_S quantization requires about 2.6 GB memory at 8 k context, fitting within 8 GB VRAM.

Does the model support vision tasks?

No, the model has no vision capability.

What license applies to this model?

The model is released under the apache-2.0 license.

Similar models

Browse all →

More from btaskel

All by btaskel →

More Rwkv models

All Rwkv →

Other tiny models

All tiny models →