MU

multiagent orchestrator

MultiagentGGUF by erukudeUpdated 2025-12-08
Download on Hugging Face
Parameters45M
Context—
Layers—
Architecturellama
Smallest quant0.1 GB
Quick answer

multiagent orchestrator needs about 0.6 GB of memory at its main file (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU.

Small planning & coordination model for multi‑agent systems

The multiagent orchestrator is a compact Llama‑based model designed to act as a conductor for AI agents and tools. It processes a task state and an agent/tool registry, outputting the next action as strict JSON. It is not a general chatbot.

Good at

  • Planning and coordination
  • JSON action generation
  • Agent orchestration

Limits

  • No general chatbot capability
  • No vision support
  • Requires external loop for execution

Best for

  • Multi‑agent pipelines
  • Tool‑using systems
  • Researcher‑coder agent coordination

Who it’s for. Developers building multi‑agent or tool‑using systems who need a lightweight controller to decide next actions. The model is ideal for research and prototyping environments where a central brain is required.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.1 GB 0.6 GB
Fits Get file →

The only available quant is unknown, file size 0.09 GB. It requires about 0.6 GB of VRAM at 8 k context. For 8 GB VRAM, this model fits comfortably. No other quant options are listed.

What GPU do you need for multiagent orchestrator?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).

Specifications

Architecture from the GGUF header

Architecturellama
Parameters45M

Source

Quantized byerukude
Licenseapache-2.0
Downloads (HF)2,272
Last updated2025-12-08

Frequently asked questions about multiagent orchestrator

How much VRAM does multiagent orchestrator need?

About 0.6 GB at its main file with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run multiagent orchestrator on an 8 GB GPU?

Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of multiagent orchestrator GGUF?

It depends on the quant: file is 0.1 GB.

Where can I download multiagent orchestrator GGUF?

The files are on Hugging Face in the erukude/multiagent-orchestrator repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does multiagent orchestrator use?

Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, it requires approximately 0.6 GB of VRAM at 8 k context, well within an 8 GB limit.

Does it support vision?

No, the model has no vision capability.

What license does it use?

The model is released under the Apache‑2.0 license.

Similar models

Browse all →

More from erukude

All by erukude →

Other tiny models

All tiny models →