LightOnOCR 3 1B Historic German Handwriting needs about 2.1 GB of memory at Q8_0 (a 0.6 GB file) with an 8K context window, so it fits on a 4 GB GPU.
LightOnOCR 3 1B Historic German Handwriting – OCR for 19th‑century German scripts
LightOnOCR 3 1B is a fine‑tuned OCR model for historic German handwriting. It outputs text exactly as written, preserving spelling, punctuation and formatting. The model uses the Qwen3 architecture and supports vision tasks such as bounding boxes and image descriptions.
Good at
- OCR of historic German Kurrent and Latin‑script pages
- Preserving original spelling and formatting
- Handling tables, receipts, forms and charts
Limits
- No vision support beyond OCR
- Requires 8k context for full page processing
- License is cc‑by‑sa‑4.0
Best for
- Digitising 19th‑century German manuscripts
- Transcribing handwritten minutes and diaries
- Extracting data from historic forms
Who it’s for. Researchers and archivists working with historic German documents. The model is suitable for projects that need accurate transcription of handwritten pages without line segmentation.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q8_0 | 0.6 GB | 2.1 GB | Fits | Get file → |
The only available quant is Q8_0, file size 0.64 GB. It requires approximately 2.1 GB of VRAM at 8k context. For 8 GB VRAM systems, Q8_0 is suitable. No smaller quant is provided.
What GPU do you need for LightOnOCR 3 1B Historic German Handwriting?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is Q8_0 (0.6 GB file, about 2.1 GB in use).
Which LightOnOCR 3 1B Historic German Handwriting quant should you choose?
Q8_0 (0.6 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about LightOnOCR 3 1B Historic German Handwriting
How much VRAM does LightOnOCR 3 1B Historic German Handwriting need?
About 2.1 GB at Q8_0 with an 8K context window. That is the 0.6 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run LightOnOCR 3 1B Historic German Handwriting on an 8 GB GPU?
Yes, with Q8_0: the 0.6 GB file needs about 2.1 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of LightOnOCR 3 1B Historic German Handwriting GGUF?
It depends on the quant: Q8_0 is 0.6 GB.
What context length does LightOnOCR 3 1B Historic German Handwriting support?
The GGUF header lists a trained context length of 16,384 tokens (16K). The KV cache grows with the context you use: about 0.9 GB at 8K and 1.9 GB at 16K.
Where can I download LightOnOCR 3 1B Historic German Handwriting GGUF?
The files are on Hugging Face in the b-straub/LightOnOCR-3-1B-Historic-German-Handwriting repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does LightOnOCR 3 1B Historic German Handwriting use?
Hugging Face lists the license as cc-by-sa-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run LightOnOCR 3 1B on 8 GB VRAM?
Yes, the Q8_0 quant uses about 2.1 GB of VRAM at 8k context, leaving room for other processes.
Does the model support other languages?
The model is trained on German Kurrent and Latin‑script handwriting; other languages are not supported.
What license applies to this model?
The model is released under cc‑by‑sa‑4.0, allowing research and commercial use with attribution.