O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
Autor(a) principal: | |
---|---|
Data de Publicação: | 2014 |
Outros Autores: | , , , , |
Tipo de documento: | Artigo |
Idioma: | eng por |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://dx.doi.org/10.1590/2317-1782/20142014068 http://hdl.handle.net/11449/131047 |
Resumo: | To investigate the effect of perceptual inter-judge agreement of hypernasality on velopharyngeal (VP) closure prediction. Two logistic regression models were developed aiming to verify the possibility of predicting the VP closure using the following characteristics: rating of VP closure (adequate, borderline, inadequate), determined by the pressure-flow technique, degree of hypernasality (absent, mild, moderate, severe), and the presence/absence of nasal air emission and nasal rustle determined perceptually by three experienced speech language pathologists. In the first model, 100 speech samples with a moderate agreement rate of hypernasality (kappa coefficient: 0.41) were used. In the second model, 43 speech samples with a perfect agreement among judges were included. The χ²-test was used to compare the models (p≤0.05). In the first model, 65 of the 100 samples were rated in the correct VP closure category, with 42 adequate and 23 inadequate. The borderline VP closure was not predicted. The second model rated 31 of the 43 samples in the correct category, with 21 adequate VP closure, 5 in the borderline VP closure, and 5 inadequate. There was no difference (p=0.526) between the two models. However, the second model showed a higher proportion of accuracy (7%) than the first one, and it has also predicted the borderline VP closure. These results showed the importance of high index of inter-judge agreement when using subjective parameters of speech evaluation, especially when compared to an instrumental evaluation. This suggests the need for strategies for training and calibration of judges in the perceptual judgment to improve the reliability of auditory-perceptual assessment. |
id |
UNSP_2b960abb8718d349e1b914bf87fde11e |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/131047 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da falaImpact of inter-judge agreement on perceptual judgment of nasalitySpeechCleft palateVelopharyngeal insufficiencyReproducibility of resultsRhinomanometryFalaFissura palatinaInsuficiência velofaríngeaReprodutibilidade dos testesRinomanometriaTo investigate the effect of perceptual inter-judge agreement of hypernasality on velopharyngeal (VP) closure prediction. Two logistic regression models were developed aiming to verify the possibility of predicting the VP closure using the following characteristics: rating of VP closure (adequate, borderline, inadequate), determined by the pressure-flow technique, degree of hypernasality (absent, mild, moderate, severe), and the presence/absence of nasal air emission and nasal rustle determined perceptually by three experienced speech language pathologists. In the first model, 100 speech samples with a moderate agreement rate of hypernasality (kappa coefficient: 0.41) were used. In the second model, 43 speech samples with a perfect agreement among judges were included. The χ²-test was used to compare the models (p≤0.05). In the first model, 65 of the 100 samples were rated in the correct VP closure category, with 42 adequate and 23 inadequate. The borderline VP closure was not predicted. The second model rated 31 of the 43 samples in the correct category, with 21 adequate VP closure, 5 in the borderline VP closure, and 5 inadequate. There was no difference (p=0.526) between the two models. However, the second model showed a higher proportion of accuracy (7%) than the first one, and it has also predicted the borderline VP closure. These results showed the importance of high index of inter-judge agreement when using subjective parameters of speech evaluation, especially when compared to an instrumental evaluation. This suggests the need for strategies for training and calibration of judges in the perceptual judgment to improve the reliability of auditory-perceptual assessment.Objetivo: Investigar o efeito da concordância entre diferentes avaliadores no julgamento perceptivo da hipernasalidade na previsão do fechamento velofaríngeo (FVF). Métodos: Dois modelos de regressão logística foram desenvolvidos com o objetivo de se prever o FVF utilizando as seguintes características: FVF (adequado, marginal e inadequado), determinado pela técnica fluxo-pressão, grau da hipernasalidade (ausente, leve, moderado, grave) e a presença/ausência de emissão de ar nasal e ronco nasal, determinados perceptivamente por três fonoaudiólogas experientes. O primeiro modelo foi composto de 100 amostras de fala com índice de concordância moderado para a hipernasalidade (coeficiente kappa: 0,41) e o segundo, de 43 amostras com concordância total entre os avaliadores. O teste do χ2 foi utilizado para comparar os modelos (p≤0,05). Resultados: No primeiro modelo, 65 das 100 amostras foram classificadas na categoria correta de FVF, sendo 42 adequado e 23 inadequado. O FVF marginal não foi previsto. O segundo modelo classificou 31 das 43 amostras na categoria correta, sendo 21 FVF adequado, 5 marginal e 5 inadequado. Não houve diferença (p=0,526) entre os dois modelos. No entanto, o segundo mostrou proporção de acerto mais alta (7%) do que o primeiro modelo, além de ter conseguido prever o FVF marginal. Conclusão: Esses resultados mostram a importância da concordância total entre diferentes avaliadores quando se utilizam parâmetros subjetivos de avaliação da fala, especialmente quando comparados com a avaliação instrumental, e sugerem a necessidade de estratégias para o treinamento e calibração de avaliadores no julgamento perceptivo a fim de aumentar a confiabilidade da avaliação perceptivo-auditiva da fala.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Hospital de Reabilitação de Anomalias Craniofaciais, Universidade de São Paulo (USP), Bauru, SP, BrasilFaculdade de Odontologia de Bauru (FOB), Universidade de São Paulo (USP), Bauru, SP, BrasilUniversidade Estadual Paulista (UNESP), Bauru, SP, BrasilUniversidade Estadual Paulista (UNESP), Bauru, SP, BrasilUniversidade de São Paulo (USP)Universidade Estadual Paulista (Unesp)Scarmagnani, Rafaeli HigaOliveira, Adriana Cristina de Almeida Santos Furlan deFukushiro, Ana PaulaSalgado, Manoel Henrique [UNESP]Trindade, Inge Elly KiemleYamashita, Renata Paciello2015-12-07T15:31:09Z2015-12-07T15:31:09Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article357-359application/pdfapplication/pdfhttp://dx.doi.org/10.1590/2317-1782/20142014068Codas, v. 26, n. 5, p. 357-359, 2014.2317-1782http://hdl.handle.net/11449/13104710.1590/2317-1782/20142014068S2317-17822014000500357S2317-17822014000500357-en.pdfS2317-17822014000500357-pt.pdf820709238993118825388067PubMedreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengporCodas0,267info:eu-repo/semantics/openAccess2024-06-28T13:18:09Zoai:repositorio.unesp.br:11449/131047Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T19:16:34.034970Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala Impact of inter-judge agreement on perceptual judgment of nasality |
title |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala |
spellingShingle |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala Scarmagnani, Rafaeli Higa Speech Cleft palate Velopharyngeal insufficiency Reproducibility of results Rhinomanometry Fala Fissura palatina Insuficiência velofaríngea Reprodutibilidade dos testes Rinomanometria |
title_short |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala |
title_full |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala |
title_fullStr |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala |
title_full_unstemmed |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala |
title_sort |
O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala |
author |
Scarmagnani, Rafaeli Higa |
author_facet |
Scarmagnani, Rafaeli Higa Oliveira, Adriana Cristina de Almeida Santos Furlan de Fukushiro, Ana Paula Salgado, Manoel Henrique [UNESP] Trindade, Inge Elly Kiemle Yamashita, Renata Paciello |
author_role |
author |
author2 |
Oliveira, Adriana Cristina de Almeida Santos Furlan de Fukushiro, Ana Paula Salgado, Manoel Henrique [UNESP] Trindade, Inge Elly Kiemle Yamashita, Renata Paciello |
author2_role |
author author author author author |
dc.contributor.none.fl_str_mv |
Universidade de São Paulo (USP) Universidade Estadual Paulista (Unesp) |
dc.contributor.author.fl_str_mv |
Scarmagnani, Rafaeli Higa Oliveira, Adriana Cristina de Almeida Santos Furlan de Fukushiro, Ana Paula Salgado, Manoel Henrique [UNESP] Trindade, Inge Elly Kiemle Yamashita, Renata Paciello |
dc.subject.por.fl_str_mv |
Speech Cleft palate Velopharyngeal insufficiency Reproducibility of results Rhinomanometry Fala Fissura palatina Insuficiência velofaríngea Reprodutibilidade dos testes Rinomanometria |
topic |
Speech Cleft palate Velopharyngeal insufficiency Reproducibility of results Rhinomanometry Fala Fissura palatina Insuficiência velofaríngea Reprodutibilidade dos testes Rinomanometria |
description |
To investigate the effect of perceptual inter-judge agreement of hypernasality on velopharyngeal (VP) closure prediction. Two logistic regression models were developed aiming to verify the possibility of predicting the VP closure using the following characteristics: rating of VP closure (adequate, borderline, inadequate), determined by the pressure-flow technique, degree of hypernasality (absent, mild, moderate, severe), and the presence/absence of nasal air emission and nasal rustle determined perceptually by three experienced speech language pathologists. In the first model, 100 speech samples with a moderate agreement rate of hypernasality (kappa coefficient: 0.41) were used. In the second model, 43 speech samples with a perfect agreement among judges were included. The χ²-test was used to compare the models (p≤0.05). In the first model, 65 of the 100 samples were rated in the correct VP closure category, with 42 adequate and 23 inadequate. The borderline VP closure was not predicted. The second model rated 31 of the 43 samples in the correct category, with 21 adequate VP closure, 5 in the borderline VP closure, and 5 inadequate. There was no difference (p=0.526) between the two models. However, the second model showed a higher proportion of accuracy (7%) than the first one, and it has also predicted the borderline VP closure. These results showed the importance of high index of inter-judge agreement when using subjective parameters of speech evaluation, especially when compared to an instrumental evaluation. This suggests the need for strategies for training and calibration of judges in the perceptual judgment to improve the reliability of auditory-perceptual assessment. |
publishDate |
2014 |
dc.date.none.fl_str_mv |
2014 2015-12-07T15:31:09Z 2015-12-07T15:31:09Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1590/2317-1782/20142014068 Codas, v. 26, n. 5, p. 357-359, 2014. 2317-1782 http://hdl.handle.net/11449/131047 10.1590/2317-1782/20142014068 S2317-17822014000500357 S2317-17822014000500357-en.pdf S2317-17822014000500357-pt.pdf 8207092389931188 25388067 |
url |
http://dx.doi.org/10.1590/2317-1782/20142014068 http://hdl.handle.net/11449/131047 |
identifier_str_mv |
Codas, v. 26, n. 5, p. 357-359, 2014. 2317-1782 10.1590/2317-1782/20142014068 S2317-17822014000500357 S2317-17822014000500357-en.pdf S2317-17822014000500357-pt.pdf 8207092389931188 25388067 |
dc.language.iso.fl_str_mv |
eng por |
language |
eng por |
dc.relation.none.fl_str_mv |
Codas 0,267 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
357-359 application/pdf application/pdf |
dc.source.none.fl_str_mv |
PubMed reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1808129044550516736 |