Ling 3.0 flash Sante Uncensored needs about 77.5 GB of memory at IQ3_S (a 61.1 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 2 quants, from 61.1 GB (IQ3_S) to 78.1 GB (IQ4_XS). Longer context needs more: at 32K tokens the KV cache alone adds about 63.5 GB.
127B‑parameter medical LLM with MoE and long‑context support
Ling‑3.0‑flash‑Sante Uncensored is a 127B‑parameter medical model built on the Ling family. It uses a hybrid‑linear MoE architecture and supports up to 262144 context tokens. The model is released under the MIT license and is tuned for reasoning and tool use.
Good at
- Medical reasoning
- Tool‑assisted workflows
- Long‑document analysis
Limits
- No vision support
- Uncensored output may lack safety filters
- Requires human review for medical use
Best for
- Healthcare research
- Tool‑integrated agent pipelines
- Multi‑step medical analysis
Who it’s for. Researchers and developers needing a large medical LLM for advanced reasoning and tool integration. The model is not a medical device and should not replace professional medical advice.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| IQ3_S | 61.1 GB (2 parts) | 77.5 GB | Too big | Get file → | |
| IQ4_XS | 78.1 GB (2 parts) | 94.5 GB | Too big | Get file → |
For 80 GB VRAM, use IQ3_S (61.09 GB file, ~77.5 GB memory at 8 k context). For 100 GB VRAM, use IQ4_XS (78.12 GB file, ~94.5 GB memory at 8 k context). Memory estimates are approximate.
What GPU do you need for Ling 3.0 flash Sante Uncensored?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: no quant fits at an 8K context.
- 32 GB VRAM: no quant fits at an 8K context.
- 48 GB VRAM: no quant fits at an 8K context.
Which Ling 3.0 flash Sante Uncensored quant should you choose?
IQ3_S (61.1 GB) is the middle option in this repository. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Ling 3.0 flash Sante Uncensored
How much VRAM does Ling 3.0 flash Sante Uncensored need?
About 77.5 GB at IQ3_S with an 8K context window. That is the 61.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Ling 3.0 flash Sante Uncensored on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 77.5 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Ling 3.0 flash Sante Uncensored GGUF?
It depends on the quant: IQ3_S is 61.1 GB, IQ4_XS is 78.1 GB.
What context length does Ling 3.0 flash Sante Uncensored support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 15.9 GB at 8K and 63.5 GB at 32K.
Where can I download Ling 3.0 flash Sante Uncensored GGUF?
The files are on Hugging Face in the AtomicChat/Ling-3.0-flash-Sante-Uncensored-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Ling 3.0 flash Sante Uncensored use?
Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
No. The smallest quant requires 61.09 GB file size and ~77.5 GB memory at 8 k context, far exceeding 8 GB.
Does this model support image input?
No. The model has no vision capabilities.
Is the model safe for medical decision making?
The model is uncensored and requires human oversight; it is not a medical device.