multiagent orchestrator needs about 0.6 GB of memory at its main file (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU.
Small planning & coordination model for multi‑agent systems
The multiagent orchestrator is a compact Llama‑based model designed to act as a conductor for AI agents and tools. It processes a task state and an agent/tool registry, outputting the next action as strict JSON. It is not a general chatbot.
Good at
- Planning and coordination
- JSON action generation
- Agent orchestration
Limits
- No general chatbot capability
- No vision support
- Requires external loop for execution
Best for
- Multi‑agent pipelines
- Tool‑using systems
- Researcher‑coder agent coordination
Who it’s for. Developers building multi‑agent or tool‑using systems who need a lightweight controller to decide next actions. The model is ideal for research and prototyping environments where a central brain is required.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.1 GB | 0.6 GB | Fits | Get file → |
The only available quant is unknown, file size 0.09 GB. It requires about 0.6 GB of VRAM at 8 k context. For 8 GB VRAM, this model fits comfortably. No other quant options are listed.
What GPU do you need for multiagent orchestrator?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about multiagent orchestrator
How much VRAM does multiagent orchestrator need?
About 0.6 GB at its main file with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run multiagent orchestrator on an 8 GB GPU?
Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of multiagent orchestrator GGUF?
It depends on the quant: file is 0.1 GB.
Where can I download multiagent orchestrator GGUF?
The files are on Hugging Face in the erukude/multiagent-orchestrator repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does multiagent orchestrator use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, it requires approximately 0.6 GB of VRAM at 8 k context, well within an 8 GB limit.
Does it support vision?
No, the model has no vision capability.
What license does it use?
The model is released under the Apache‑2.0 license.