Home›How often speech models invent text

How often speech models invent text

A hallucination study from production transcripts: what the artifacts are, how often they appear, and in which languages.

What this measures

Speech models sometimes write text that was never said: a phrase repeated dozens of times over silence, subtitle credits learned from training data, a run of filler where nothing was spoken. We run a deterministic detector over every transcript and then a second check that decides whether to keep, trim or remove each flagged span. This page reports the detector over the last 90 days of finished transcripts (2,851 of them), by the language the engine detected. Method on how we test; the detector's thresholds are the ones in production.

Since the cleaning pass went live, of 61 transcripts it examined, 32.8 % had at least one segment removed or trimmed after the second check.

By language

"Flagged transcripts" had at least one suspicious span; "flagged segments" is the share of segments the detector marked. Languages with fewer than ten transcripts in the window are not shown.

LanguageTranscriptsAudio hoursFlagged transcriptsFlagged segments
English1,3681376.127.7 %0.22 %
Filipino / Tagalog6033.668.3 %0.89 %
Spanish4551.042.2 %0.22 %
Hindi316.841.9 %2.63 %
Portuguese2822.025.0 %0.09 %
Russian2823.125.0 %0.08 %
Chinese2721.751.9 %0.27 %
French2519.824.0 %0.1 %
German1713.011.8 %0.09 %
Japanese157.160.0 %0.4 %
Norwegian (Nynorsk, as detected)125.958.3 %4.98 %
Tamil122.866.7 %0.76 %
Arabic103.970.0 %1.93 %
az101.520.0 %0.4 %

What the artifacts look like

ArtifactSpans flagged
The same segment twice in a row
Two consecutive segments with identical text; usually a decoding hiccup at a chunk boundary.
2,355
A phrase repeated many times
The model gets stuck on a phrase and emits it eight, twenty, fifty times; happens on silence, music beds and long pauses.
709
Subtitle credits that were never spoken
'Subtitles by …', 'Thanks for watching' and their equivalents in other languages, learned from subtitle training data.
220
A segment in the wrong script
A single segment in a script neither neighbour uses.
49
A long run with almost no distinct words
Twenty or more tokens with under a quarter distinct; filler where there was no speech.
38

Examples, as removed

Real spans the second check removed, shortened; the original transcript is kept and the removed span shows in the detailed view.

Why we publish it

An accuracy percentage without its failure modes is not useful. These are the failure modes, with their frequency, from production, refreshed monthly. Quote them with the date.

Related measurements

Accuracy and speed on public test sets: benchmark. What people send in a month: what people transcribe. Method: how we test.