EnCodec

by Meta AI

Neural audio codec — used by SeamlessM4T + many speech-LMs.

TL;DR

Neural audio codec — used by SeamlessM4T + many speech-LMs.

Best for token-level audio I/O for speech-LMs and codec-based ASR. Pricing: free.

Category
Open source
License
—
Stars
—
Last push
—
Pricing
free
Platforms
Linux

What it is

A high-fidelity neural audio codec. MIT.

Best for: Token-level audio I/O for speech-LMs and codec-based ASR.
Watch out for: Codec, not transcription.

Install / use

pip install encodec

Features

Speaker diarizationNo
Word-level timestampsYes
Streaming / real-timeNo
Languages supported1
HIPAA eligibleNo

EnCodec vs Whipscribe

FeatureEnCodecWhipscribe
CategoryOpen sourceTranscription APIs
Pricingfreefree beta
Speaker diarizationNoYes
Word timestampsYesYes
StreamingNoNo
Languages199
PlatformsLinuxWeb, API, MCP

Alternatives to EnCodec

OpenAI Whisper
OpenAI

The reference open-source multilingual ASR model from OpenAI.

OSS · MIT ★ 98.1k
whisper.cpp
Georgi Gerganov

C/C++ port of Whisper — runs on anything, from a Raspberry Pi to Apple Silicon.

OSS · MIT ★ 48.8k
faster-whisper
SYSTRAN

4× faster than reference Whisper using CTranslate2 — production sweet spot.

OSS · MIT ★ 22.3k

Whipscribe is a managed faster-whisper + whisperX service. If you want transcripts without running infrastructure, paste a URL or drop a file in the form below — you'll have a transcript in seconds.