QW

jev student 4b yizao

QwenGGUF by vincentzhouUpdated 2026-09-29
Download on Hugging Face
Parameters4.21B
Context256K
Layers33
Architectureqwen35
Smallest quant4.5 GB
Quick answer

jev student 4b yizao needs about 6.1 GB of memory at Q8_0 (a 4.5 GB file) with an 8K context window, so it fits on a 8 GB GPU. Longer context needs more: at 32K tokens the KV cache alone adds about 4.4 GB.

Jev Student 4B Yizao – a distilled Qwen3.5 decision model for exam question classification

Jev Student 4B Yizao is a 4.21 B parameter model distilled from Qwen3.5‑4B‑Base. It reads exam questions and outputs a single token classification using a restricted softmax. The model is trained on 14,151 samples and fine‑tuned with LoRA.

Good at

  • Reasoning on exam content
  • Tool‑based inference
  • Single‑token classification

Limits

  • Domain limited to four exam subjects
  • No precise calculation or multi‑step reasoning
  • Requires confidence gating and human review

Best for

  • Exam question routing
  • Automated grading support
  • Rapid decision‑making in education

Who it’s for. Developers building educational tools that need fast, single‑token decisions on exam content. The model is suitable for Chinese‑language applications in the four specified subjects.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q8_04.5 GB 6.1 GB
Fits Get file →

The only available quant is Q8_0, file size 4.48 GB. It requires about 6.1 GB of VRAM at 8 k context. For 8 GB VRAM, Q8_0 is the only viable option. For larger VRAM budgets, the same quant can be used without change.

What GPU do you need for jev student 4b yizao?

These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: the best quant that fits is Q8_0 (4.5 GB file, about 6.1 GB in use).

Which jev student 4b yizao quant should you choose?

Q8_0 (4.5 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen35
Parameters4.21B
Layers33
Trained context262,144 tokens
KV cache (fp16)132 KB per token

Source

Quantized byvincentzhou
FamilyQwen
Licenseapache-2.0
Downloads (HF)304
Last updated2026-09-29

Frequently asked questions about jev student 4b yizao

How much VRAM does jev student 4b yizao need?

About 6.1 GB at Q8_0 with an 8K context window. That is the 4.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run jev student 4b yizao on an 8 GB GPU?

Yes, with Q8_0: the 4.5 GB file needs about 6.1 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of jev student 4b yizao GGUF?

It depends on the quant: Q8_0 is 4.5 GB.

What context length does jev student 4b yizao support?

The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 1.1 GB at 8K and 4.4 GB at 32K.

Where can I download jev student 4b yizao GGUF?

The files are on Hugging Face in the vincentzhou/jev-student-4b-yizao repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does jev student 4b yizao use?

Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run Jev Student 4B Yizao on 8 GB VRAM?

Yes, the Q8_0 quant requires about 6.1 GB of VRAM at 8 k context, which fits within an 8 GB GPU.

Does this model support vision inputs?

No, Jev Student 4B Yizao is a text‑only decision model and does not process vision data.

Is the model suitable for multi‑step reasoning?

No, the model is not designed for precise calculation or multi‑step reasoning; it outputs a single token classification.

Other GGUFs of Qwen3.5-4B-Base

Similar models

Browse all →

More Qwen models

All Qwen →

Other small models

All small models →