Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Data

Must read


Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool. In this work, we investigate and use pseudo-labeling for a recently proposed novel setup: joint transcription and translation of speech, which suffers from an absence of sufficient parallel data resources. We show that under such data-deficient circumstances, the unlabeled data can significantly vary in domain from the supervised data, which results in pseudo-label quality degradation. We investigate two categories of remedies that require no additional supervision and target the domain mismatch: pseudo-label filtering and data augmentation. We show that pseudo-label analysis and processing in this way results in additional gains on top of the vanilla pseudo-labeling setup providing a total improvement of up to 0.4% absolute WER and 2.1 BLEU points for En–De and 0.6% absolute WER and 2.2 BLEU points for En-Zh.



Source link

More articles

- Advertisement -

Startup

Netflix, Viacom18 & Disney+Hotstar Mull Legal Challenge Against New Anti-Tobacco Rules

Viacom18, Netflix, Amazon and Disney+Hotstar privately discussed a possible legal challenge against the new norms OTT streaming platforms contended that the new mandates...
- Advertisement -

Latest article