SeamlessM4T

by Meta AI

Meta's speech-to-text + speech-to-speech + text-to-speech model, 100 languages.

Category
Open source
License
NOASSERTION
Stars
★ 11.8k
Last push
2026-04-08
Pricing
free
Platforms
Linux, GPU

What it is

SeamlessM4T is Meta's "do everything with speech" foundation model. Good for projects that need transcription + translation in the same pass, particularly for languages Whisper covers poorly. Check the license — the research license rules out commercial deployment without separate permission.

Best for: Cross-lingual transcription and translation in one model, especially low-resource languages.
Watch out for: Research license (non-commercial for v1); heavier runtime than Whisper; docs assume fairseq familiarity.

Install / use

pip install fairseq2  # then load SeamlessM4T v2

Features

Speaker diarizationNo
Word-level timestampsNo
Streaming / real-timeYes
Languages supported100
HIPAA eligibleNo

Links

GitHub repo ↗

Alternatives

OpenAI Whisper
OpenAI

The reference open-source multilingual ASR model from OpenAI.

OSS · MIT ★ 98.1k
whisper.cpp
Georgi Gerganov

C/C++ port of Whisper — runs on anything, from a Raspberry Pi to Apple Silicon.

OSS · MIT ★ 48.8k
faster-whisper
SYSTRAN

4× faster than reference Whisper using CTranslate2 — production sweet spot.

OSS · MIT ★ 22.3k

Whipscribe is a managed faster-whisper + whisperX service. If you want transcripts without running infrastructure, we're one click away.

Try Whipscribe →