Ling GGUF models

219 GGUF models in the Ling family, quantized by 70 uploaders. Sizes run from 4M to 1000B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LI
Ling 3.0 Tiny
Ling · bloomer010
Params7.89B
Context128K
Q4_K_M4.8 GB
Coding
LI
Ling 3.0 Flash
Ling · AtomicChat
Params124B
Context128K
Q4_K_M75.3 GB
ReasoningTool use
LI
Ling 3.0 Flash Dspark
Ling · bloomer010
Params127B
Context256K
Q4_K_M0.7 GB
GGUF
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
Reasoning
LI
Ling 3.0 Tiny
Ling · bartowski
Params7.89B
Context128K
Q4_K_M4.9 GB
GGUF
LI
Ling-3.0-tiny
Ling · inclusionAI
Params7.9B
Context128K
Q4_K_M4.8 GB
GGUF
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
Vision
LI
Ling-3.0-flash-Sante
Ling · AtomicChat
Params127B
Context256K
Smallest35.7 GB
ReasoningTool use
LI
Ling 3.0 tiny abliterated APEX
Ling · SC117
Params7.9B
Context128K
Smallest3.4 GB
GGUF
LI
Ling 3.0 tiny
Ling · NANI-Nithin
Params7.89B
Context128K
Q4_K_M4.8 GB
Reasoning
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
Vision
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GGUF
LI
Ling Flash 2.0
Ling · bartowski
Params103B
Context32K
Q4_K_M62.6 GB
GGUF
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
Tool use
LI
Ling 3.0 flash abliterated APEX
Ling · SC117
Params127B
Context256K
Smallest60.4 GB
Reasoning
LI
Ling 3.1 Flash
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
GGUF
LI
Ling-3.1-flash
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
ReasoningTool use
LI
Ling 3.0 Flash Heretic
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
GGUF
LI
Ling 3.0 flash VL
Ling · bloomer010
Params124B
Context256K
Q4_K_M0.7 GB
Vision
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
ReasoningTool use
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.9B
Context128K
Q4_K_M4.8 GB
Reasoning
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
ReasoningTool use
LI
Ling Mini 2.0
Ling · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
LI
Ling 3.0 flash Sante Uncensored
Ling · AtomicChat
Params127B
Context256K
Smallest61.1 GB
ReasoningTool use
LI
Ling-3.0-tiny-base-30T
Ling · FriskyFennec
Params8.2B
Context8K
Q4_K_M5.0 GB
GGUF
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
Reasoning
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
LI
Ling-3.0-flash
Ling · inclusionAI
Params127B
Context256K
Q4_K_M77.0 GB
GGUF
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
GGUF
LI
Ling Lite 0415
Ling · bartowski
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF

About the Ling GGUF models

Ling is represented on ggufmodels.com by 219 GGUF models, quantized by 70 uploaders on Hugging Face. The most downloaded are Ling 3.0 Tiny, Ling 3.0 Flash and Ling 3.0 Flash Dspark. Parameter counts run from 4M to 1000B, and the longest trained context window is 256K tokens.

A Q4_K_M file of a Ling model is between 0.7 to 608.4 GB, which is the quant most people start with. Most files come from mradermacher (49), Manojb (34) and kingjones777 (13). The quants you will meet most often are Q4_K_M (116), Q5_K_M (101), Q6_K (86) and Q3_K_M (86), where the number is how many models offer that quant.

Frequently asked questions

Which Ling GGUF should I download?

The most downloaded Ling GGUF here is Ling 3.0 Tiny. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Ling model need?

Q4_K_M files of Ling models on this site range from 0.7 to 608.4 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Ling GGUF files come from?

The most common quantizers here are mradermacher, Manojb and kingjones777. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing