PA

fluid-speech-mini

ParakeetGGUF by FluidVoice-LabsUpdated 2026-10-13
Download on Hugging Face
Parameters627M
Context—
Layers—
Architectureparakeet
Smallest quant0.3 GB
Quick answer

fluid-speech-mini needs about 0.9 GB of memory at its main file (a 0.3 GB file) with an 8K context window, so it fits on a 4 GB GPU.

Fluid Speech Mini – lightweight English speech‑to‑text for phones and laptops

Fluid Speech Mini is a 0.627B parameter model built for dictation. It matches Parakeet Ultra on English ASR benchmarks and keeps the correct speaker when background voices are present. The GGUF build is 0.35 GB and runs with about 0.9 GB of RAM on 8k context.

Good at

  • Real‑time dictation
  • Speaker‑aware transcription
  • English ASR accuracy

Limits

  • Requires 0.9 GB RAM at 8k context
  • No vision support
  • CC‑BY‑4.0 license

Best for

  • Phone dictation apps
  • Laptop transcription tools
  • Low‑latency speech‑to‑text

Who it’s for. Developers building lightweight English speech‑to‑text on Windows or Linux. The model runs in parakeet.cpp and is suitable for mobile or desktop environments where memory is limited.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.3 GB 0.9 GB
Fits Get file →

The only available quant is the default GGUF file, 0.35 GB. It needs roughly 0.9 GB of RAM with 8k context. For tighter budgets, no other quantizations are provided.

What GPU do you need for fluid-speech-mini?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.3 GB file, about 0.9 GB in use).

Specifications

Architecture from the GGUF header

Architectureparakeet
Parameters627M

Source

Quantized byFluidVoice-Labs
FamilyParakeet
Licensecc-by-4.0
Downloads (HF)1,620
Last updated2026-10-13

Frequently asked questions about fluid-speech-mini

How much VRAM does fluid-speech-mini need?

About 0.9 GB at its main file with an 8K context window. That is the 0.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run fluid-speech-mini on an 8 GB GPU?

Yes, with the smaller files: the 0.3 GB file needs about 0.9 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of fluid-speech-mini GGUF?

It depends on the quant: file is 0.3 GB.

Where can I download fluid-speech-mini GGUF?

The files are on Hugging Face in the FluidVoice-Labs/fluid-speech-mini-gguf repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does fluid-speech-mini use?

Hugging Face lists the license as cc-by-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, the 0.35 GB GGUF file requires about 0.9 GB of RAM at 8k context, well within 8 GB.

Does it support languages other than English?

No, the model has no supported languages listed.

Is the model free to use?

Yes, it is licensed under CC‑BY‑4.0, allowing free use with attribution.

Other GGUFs of parakeet-ultra

Similar models

Browse all →

More from FluidVoice-Labs

All by FluidVoice-Labs →

More Parakeet models

All Parakeet →

Other tiny models

All tiny models →