fluid-speech-mini needs about 0.9 GB of memory at its main file (a 0.3 GB file) with an 8K context window, so it fits on a 4 GB GPU.
Fluid Speech Mini – lightweight English speech‑to‑text for phones and laptops
Fluid Speech Mini is a 0.627B parameter model built for dictation. It matches Parakeet Ultra on English ASR benchmarks and keeps the correct speaker when background voices are present. The GGUF build is 0.35 GB and runs with about 0.9 GB of RAM on 8k context.
Good at
- Real‑time dictation
- Speaker‑aware transcription
- English ASR accuracy
Limits
- Requires 0.9 GB RAM at 8k context
- No vision support
- CC‑BY‑4.0 license
Best for
- Phone dictation apps
- Laptop transcription tools
- Low‑latency speech‑to‑text
Who it’s for. Developers building lightweight English speech‑to‑text on Windows or Linux. The model runs in parakeet.cpp and is suitable for mobile or desktop environments where memory is limited.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.3 GB | 0.9 GB | Fits | Get file → |
The only available quant is the default GGUF file, 0.35 GB. It needs roughly 0.9 GB of RAM with 8k context. For tighter budgets, no other quantizations are provided.
What GPU do you need for fluid-speech-mini?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.3 GB file, about 0.9 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about fluid-speech-mini
How much VRAM does fluid-speech-mini need?
About 0.9 GB at its main file with an 8K context window. That is the 0.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run fluid-speech-mini on an 8 GB GPU?
Yes, with the smaller files: the 0.3 GB file needs about 0.9 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of fluid-speech-mini GGUF?
It depends on the quant: file is 0.3 GB.
Where can I download fluid-speech-mini GGUF?
The files are on Hugging Face in the FluidVoice-Labs/fluid-speech-mini-gguf repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does fluid-speech-mini use?
Hugging Face lists the license as cc-by-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the 0.35 GB GGUF file requires about 0.9 GB of RAM at 8k context, well within 8 GB.
Does it support languages other than English?
No, the model has no supported languages listed.
Is the model free to use?
Yes, it is licensed under CC‑BY‑4.0, allowing free use with attribution.