MO

moondream2 multiformat

MoondreamGGUF by Serkan007Updated 2026-05-14
Download on Hugging Face
Parameters—
Context—
Layers—
Architecture—
Smallest quant0.0 GB
Quick answer

moondream2 multiformat needs about 0.5 GB of memory at Q4_K_M (a 0.0 GB file) with an 8K context window, so it fits on a 4 GB GPU.

Moondream2 Multiformat – a coding‑focused GGUF model

Moondream2 Multiformat is a lightweight GGUF model released under Apache‑2.0. It is optimized for code generation tasks and is available in a single Q4_K_M quantization. The model is small enough to fit on modest hardware.

Good at

  • Code generation
  • Syntax‑aware responses
  • Fast inference

Limits

  • No vision support
  • Limited context length (8k tokens)
  • Requires 0.5 GB VRAM at 8k context

Best for

  • Writing scripts
  • Debugging assistance
  • Learning programming concepts

Who it’s for. Developers and students who need a quick, low‑memory model for coding tasks. The model is suitable for local deployment on machines with limited GPU resources.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q4_K_M0.0 GB 0.5 GB
Fits Get file →

The only available quant is Q4_K_M, which uses about 0.5 GB of VRAM at 8k context. This is suitable for 8 GB or larger GPUs. If you have less VRAM, consider a lower‑precision quant, but it is not provided here.

What GPU do you need for moondream2 multiformat?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is Q4_K_M (0.0 GB file, about 0.5 GB in use).

Which moondream2 multiformat quant should you choose?

Q4_K_M is the usual starting point for moondream2 multiformat: it balances file size and quality well. Here it is a 0.0 GB file.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Source

Quantized bySerkan007
FamilyMoondream
Licenseapache-2.0
Downloads (HF)73,203
Last updated2026-05-14

Frequently asked questions about moondream2 multiformat

How much VRAM does moondream2 multiformat need?

About 0.5 GB at Q4_K_M with an 8K context window. That is the 0.0 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run moondream2 multiformat on an 8 GB GPU?

Yes, with Q4_K_M: the 0.0 GB file needs about 0.5 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of moondream2 multiformat GGUF?

It depends on the quant: Q4_K_M is 0.0 GB.

Where can I download moondream2 multiformat GGUF?

The files are on Hugging Face in the Serkan007/moondream2-multiformat repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does moondream2 multiformat use?

Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run Moondream2 Multiformat on 8 GB VRAM?

Yes, the Q4_K_M quant uses approximately 0.5 GB of VRAM at 8k context, so it fits comfortably on an 8 GB GPU.

Does this model support image inputs?

No, Moondream2 Multiformat does not have vision capabilities.

What license applies to this model?

The model is released under the Apache‑2.0 license.

More from Serkan007

All by Serkan007 →

More Moondream models

All Moondream →