Automatic speech recognition, with large vocabulary, robustness, independence of speaker and multilingual processing

• Autor(a) principal: Caon, Daniel Régis Sarmento
• Data de Publicação: 2010
• Tipo de documento: Dissertação
• Idioma: eng
• Título da fonte: Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)
• Texto Completo: http://repositorio.ufes.br/handle/10/6390
• topic: Automatic speech recognition; Hidden Markov models; Acoustic modeling; HTK; Julius; K-Fold; Processamento de sinais de fala; Modelos ocultos de Markov; Modelagem acústica; Ciência da Computação; Processamento de sinais; Interfaces de usuário (Sistema de computador); Reconhecimento automático da voz; Sistemas de reconhecimento de padrões; 004

This work aims to provide automatic cognitive assistance via speech interface, to the elderly who live alone, at risk situation. Distress expressions and voice commands are part of the target vocabulary for speech recognition. Throughout the work, the large vocabulary continuous speech recognition system Julius is used in conjunction with the Hidden Markov Model Toolkit (HTK). The system Julius has its main features described, including its modification. This modification is part of the contribution which is in this work, including the detection of distress expressions ( situations of speech which suggest emergency). Four different languages were provided as target for recognition: French, Dutch, Spanish and English. In this same sequence of languages (determined by data availability and the local of scenarios for the integration of systems) theoretical studies and experiments were conducted to solve the need of working with each new configuration. This work includes studies of the French and Dutch languages. Initial experiments (in French) were made with adaptation of hidden Markov models and were analyzed by cross validation. In order to perform a new demonstration in Dutch, acoustic and language models were built and the system was integrated with other auxiliary modules (such as voice activity detector and the dialogue system). Results of speech recognition after acoustic adaptation to a specific speaker (and the creation of language models for a specific scenario to demonstrate the system) showed 86.39 % accuracy rate of sentence for the Dutch acoustic models. The same data shows 94.44 % semantical accuracy rate of sentence.