How well can ASR technology understand foreign-accented speech?

• Autor(a) principal: Souza, Hanna Kivisto de
• Data de Publicação: 2022
• Outros Autores: Gottardi, William
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Trabalhos em Lingüística Aplicada (Online)
• Texto Completo: https://periodicos.sbu.unicamp.br/ojs/index.php/tla/article/view/8668782
• topic: Inteligibilidade; Reconhecimento automático da fala; Desenvolvimento de pronúncia em LE; Aprendizagem autônoma; Intelligibility; L2 Pronunciation Development; Automatic speech recognition; Autonomous learning; Comprensibilidad; Reconocimiento automático de voz; Desarrollo de la pronunciación en LE; Aprendiz autónomo

Following the Covid-19 pandemic, digital technology is more present in classrooms than ever. Automatic Speech Recognition (ASR) offers interesting possibilities for language learners to produce more output in a foreign language (FL). ASR is especially suited for autonomous pronunciation learning when used as a dictation tool that transcribes the learner's speech (McCROCKLIN, 2016). However, ASR tools are trained with monolingual native speakers in mind, not reflecting the global reality of English speakers. Consequently, the present study examined how well two ASR-based dictation tools understand foreign-accented speech, and which FL speech features cause intelligibility breakdowns. English speech samples of 15 Brazilian Portuguese and 15 Spanish speakers were obtained from an online database (WEINBERGER, 2015) and submitted to two ASR dictation tools: Microsoft Word and VoiceNotebook. The resulting transcriptions were manually inspected, coded and categorized. The results show that overall intelligibility was high for both tools. However, many features of normal FL speech, such as vowel and consonant substitution, caused the ASR dictation tools to misinterpret the message leading to communication breakdowns. The results are discussed from a pedagogical viewpoint.