bielik 4.5b v3 matura history sft2 needs about 2.6 GB of memory at IQ3_XXS (a 1.9 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 6 quants, from 0.0 GB to 9.5 GB (BF16).
Bielik‑4.5B‑v3 matura history SFT model
Bielik‑4.5B‑v3 matura history SFT v2 is a 4.76 billion‑parameter model fine‑tuned on Polish extended‑level history matura tasks. It is part of the SlayerLab "Mały, ale wariat" hackathon and achieves at least 35 % on the team evaluator. The model is released under Apache‑2.0.
Good at
- Fine‑tuned for Polish history matura tasks
- Smallest file that scores 35 % on evaluator
- Supports OpenAI‑compatible API via llama‑server
Limits
- No vision support
- Requires at least 8 k context for estimates
- License is Apache‑2.0
Best for
- Polish history exam preparation
- Educational content generation
- Low‑resource inference
Who it’s for. Developers building educational tools for Polish history or researchers needing a small, fine‑tuned model for matura‑style tasks. The model is suitable for environments with limited GPU memory.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.0 GB | 0.5 GB | Fits | Get file → | |
| IQ2_M | 1.6 GB | 2.3 GB | Fits | Get file → | |
| IQ3_XXS | 1.9 GB | 2.6 GB | Fits | Get file → | |
| Q3_K_M | 2.3 GB | 3.1 GB | Fits | Get file → | |
| IQ4_XS | 2.6 GB | 3.4 GB | Fits | Get file → | |
| BF16 | 9.5 GB | 11.2 GB | Too big | Get file → |
For 8 GB VRAM, use IQ3_XXS (1.85 GB file, 2.6 GB memory at 8 k context). For 4 GB VRAM, IQ2_M (1.62 GB file, 2.3 GB memory). For 16 GB VRAM, BF16 (9.52 GB file, 11.2 GB memory).
What GPU do you need for bielik 4.5b v3 matura history sft2?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is IQ4_XS (2.6 GB file, about 3.4 GB in use).
- 6 GB VRAM: the best quant that fits is IQ4_XS (2.6 GB file, about 3.4 GB in use).
- 8 GB VRAM: the best quant that fits is IQ4_XS (2.6 GB file, about 3.4 GB in use).
- 12 GB VRAM: the best quant that fits is BF16 (9.5 GB file, about 11.2 GB in use).
Which bielik 4.5b v3 matura history sft2 quant should you choose?
IQ3_XXS (1.9 GB) is the middle option in this repository. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.
If memory is tight, the smallest file is the first one in the table at 0.0 GB, with the quality trade-offs that come with fewer bits.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about bielik 4.5b v3 matura history sft2
How much VRAM does bielik 4.5b v3 matura history sft2 need?
About 2.6 GB at IQ3_XXS with an 8K context window. That is the 1.9 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run bielik 4.5b v3 matura history sft2 on an 8 GB GPU?
Yes, with IQ4_XS: the 2.6 GB file needs about 3.4 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of bielik 4.5b v3 matura history sft2 GGUF?
It depends on the quant: file is 0.0 GB, IQ2_M is 1.6 GB, IQ3_XXS is 1.9 GB, Q3_K_M is 2.3 GB, IQ4_XS is 2.6 GB, BF16 is 9.5 GB.
Where can I download bielik 4.5b v3 matura history sft2 GGUF?
The files are on Hugging Face in the SlayerLab/bielik-4.5b-v3-matura-history-sft2 repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does bielik 4.5b v3 matura history sft2 use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the IQ3_XXS quant uses about 2.6 GB memory at 8 k context, fitting within 8 GB VRAM.
Does the model support vision tasks?
No, the model has no vision capabilities.
What license applies to this model?
The model is released under the Apache‑2.0 license.