O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala

Detalhes bibliográficos
Autor(a) principal: Scarmagnani, Rafaeli Higa
Data de Publicação: 2014
Outros Autores: Oliveira, Adriana Cristina de Almeida Santos Furlan de, Fukushiro, Ana Paula, Salgado, Manoel Henrique [UNESP], Trindade, Inge Elly Kiemle, Yamashita, Renata Paciello
Tipo de documento: Artigo
Idioma: eng
por
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1590/2317-1782/20142014068
http://hdl.handle.net/11449/131047
Resumo: To investigate the effect of perceptual inter-judge agreement of hypernasality on velopharyngeal (VP) closure prediction. Two logistic regression models were developed aiming to verify the possibility of predicting the VP closure using the following characteristics: rating of VP closure (adequate, borderline, inadequate), determined by the pressure-flow technique, degree of hypernasality (absent, mild, moderate, severe), and the presence/absence of nasal air emission and nasal rustle determined perceptually by three experienced speech language pathologists. In the first model, 100 speech samples with a moderate agreement rate of hypernasality (kappa coefficient: 0.41) were used. In the second model, 43 speech samples with a perfect agreement among judges were included. The χ²-test was used to compare the models (p≤0.05). In the first model, 65 of the 100 samples were rated in the correct VP closure category, with 42 adequate and 23 inadequate. The borderline VP closure was not predicted. The second model rated 31 of the 43 samples in the correct category, with 21 adequate VP closure, 5 in the borderline VP closure, and 5 inadequate. There was no difference (p=0.526) between the two models. However, the second model showed a higher proportion of accuracy (7%) than the first one, and it has also predicted the borderline VP closure. These results showed the importance of high index of inter-judge agreement when using subjective parameters of speech evaluation, especially when compared to an instrumental evaluation. This suggests the need for strategies for training and calibration of judges in the perceptual judgment to improve the reliability of auditory-perceptual assessment.
id UNSP_2b960abb8718d349e1b914bf87fde11e
oai_identifier_str oai:repositorio.unesp.br:11449/131047
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da falaImpact of inter-judge agreement on perceptual judgment of nasalitySpeechCleft palateVelopharyngeal insufficiencyReproducibility of resultsRhinomanometryFalaFissura palatinaInsuficiência velofaríngeaReprodutibilidade dos testesRinomanometriaTo investigate the effect of perceptual inter-judge agreement of hypernasality on velopharyngeal (VP) closure prediction. Two logistic regression models were developed aiming to verify the possibility of predicting the VP closure using the following characteristics: rating of VP closure (adequate, borderline, inadequate), determined by the pressure-flow technique, degree of hypernasality (absent, mild, moderate, severe), and the presence/absence of nasal air emission and nasal rustle determined perceptually by three experienced speech language pathologists. In the first model, 100 speech samples with a moderate agreement rate of hypernasality (kappa coefficient: 0.41) were used. In the second model, 43 speech samples with a perfect agreement among judges were included. The χ²-test was used to compare the models (p≤0.05). In the first model, 65 of the 100 samples were rated in the correct VP closure category, with 42 adequate and 23 inadequate. The borderline VP closure was not predicted. The second model rated 31 of the 43 samples in the correct category, with 21 adequate VP closure, 5 in the borderline VP closure, and 5 inadequate. There was no difference (p=0.526) between the two models. However, the second model showed a higher proportion of accuracy (7%) than the first one, and it has also predicted the borderline VP closure. These results showed the importance of high index of inter-judge agreement when using subjective parameters of speech evaluation, especially when compared to an instrumental evaluation. This suggests the need for strategies for training and calibration of judges in the perceptual judgment to improve the reliability of auditory-perceptual assessment.Objetivo: Investigar o efeito da concordância entre diferentes avaliadores no julgamento perceptivo da hipernasalidade na previsão do fechamento velofaríngeo (FVF). Métodos: Dois modelos de regressão logística foram desenvolvidos com o objetivo de se prever o FVF utilizando as seguintes características: FVF (adequado, marginal e inadequado), determinado pela técnica fluxo-pressão, grau da hipernasalidade (ausente, leve, moderado, grave) e a presença/ausência de emissão de ar nasal e ronco nasal, determinados perceptivamente por três fonoaudiólogas experientes. O primeiro modelo foi composto de 100 amostras de fala com índice de concordância moderado para a hipernasalidade (coeficiente kappa: 0,41) e o segundo, de 43 amostras com concordância total entre os avaliadores. O teste do χ2 foi utilizado para comparar os modelos (p≤0,05). Resultados: No primeiro modelo, 65 das 100 amostras foram classificadas na categoria correta de FVF, sendo 42 adequado e 23 inadequado. O FVF marginal não foi previsto. O segundo modelo classificou 31 das 43 amostras na categoria correta, sendo 21 FVF adequado, 5 marginal e 5 inadequado. Não houve diferença (p=0,526) entre os dois modelos. No entanto, o segundo mostrou proporção de acerto mais alta (7%) do que o primeiro modelo, além de ter conseguido prever o FVF marginal. Conclusão: Esses resultados mostram a importância da concordância total entre diferentes avaliadores quando se utilizam parâmetros subjetivos de avaliação da fala, especialmente quando comparados com a avaliação instrumental, e sugerem a necessidade de estratégias para o treinamento e calibração de avaliadores no julgamento perceptivo a fim de aumentar a confiabilidade da avaliação perceptivo-auditiva da fala.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Hospital de Reabilitação de Anomalias Craniofaciais, Universidade de São Paulo (USP), Bauru, SP, BrasilFaculdade de Odontologia de Bauru (FOB), Universidade de São Paulo (USP), Bauru, SP, BrasilUniversidade Estadual Paulista (UNESP), Bauru, SP, BrasilUniversidade Estadual Paulista (UNESP), Bauru, SP, BrasilUniversidade de São Paulo (USP)Universidade Estadual Paulista (Unesp)Scarmagnani, Rafaeli HigaOliveira, Adriana Cristina de Almeida Santos Furlan deFukushiro, Ana PaulaSalgado, Manoel Henrique [UNESP]Trindade, Inge Elly KiemleYamashita, Renata Paciello2015-12-07T15:31:09Z2015-12-07T15:31:09Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article357-359application/pdfapplication/pdfhttp://dx.doi.org/10.1590/2317-1782/20142014068Codas, v. 26, n. 5, p. 357-359, 2014.2317-1782http://hdl.handle.net/11449/13104710.1590/2317-1782/20142014068S2317-17822014000500357S2317-17822014000500357-en.pdfS2317-17822014000500357-pt.pdf820709238993118825388067PubMedreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengporCodas0,267info:eu-repo/semantics/openAccess2024-06-28T13:18:09Zoai:repositorio.unesp.br:11449/131047Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T19:16:34.034970Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
Impact of inter-judge agreement on perceptual judgment of nasality
title O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
spellingShingle O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
Scarmagnani, Rafaeli Higa
Speech
Cleft palate
Velopharyngeal insufficiency
Reproducibility of results
Rhinomanometry
Fala
Fissura palatina
Insuficiência velofaríngea
Reprodutibilidade dos testes
Rinomanometria
title_short O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
title_full O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
title_fullStr O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
title_full_unstemmed O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
title_sort O impacto da concordância entre avaliadores no julgamento perceptivo da nasalidade da fala
author Scarmagnani, Rafaeli Higa
author_facet Scarmagnani, Rafaeli Higa
Oliveira, Adriana Cristina de Almeida Santos Furlan de
Fukushiro, Ana Paula
Salgado, Manoel Henrique [UNESP]
Trindade, Inge Elly Kiemle
Yamashita, Renata Paciello
author_role author
author2 Oliveira, Adriana Cristina de Almeida Santos Furlan de
Fukushiro, Ana Paula
Salgado, Manoel Henrique [UNESP]
Trindade, Inge Elly Kiemle
Yamashita, Renata Paciello
author2_role author
author
author
author
author
dc.contributor.none.fl_str_mv Universidade de São Paulo (USP)
Universidade Estadual Paulista (Unesp)
dc.contributor.author.fl_str_mv Scarmagnani, Rafaeli Higa
Oliveira, Adriana Cristina de Almeida Santos Furlan de
Fukushiro, Ana Paula
Salgado, Manoel Henrique [UNESP]
Trindade, Inge Elly Kiemle
Yamashita, Renata Paciello
dc.subject.por.fl_str_mv Speech
Cleft palate
Velopharyngeal insufficiency
Reproducibility of results
Rhinomanometry
Fala
Fissura palatina
Insuficiência velofaríngea
Reprodutibilidade dos testes
Rinomanometria
topic Speech
Cleft palate
Velopharyngeal insufficiency
Reproducibility of results
Rhinomanometry
Fala
Fissura palatina
Insuficiência velofaríngea
Reprodutibilidade dos testes
Rinomanometria
description To investigate the effect of perceptual inter-judge agreement of hypernasality on velopharyngeal (VP) closure prediction. Two logistic regression models were developed aiming to verify the possibility of predicting the VP closure using the following characteristics: rating of VP closure (adequate, borderline, inadequate), determined by the pressure-flow technique, degree of hypernasality (absent, mild, moderate, severe), and the presence/absence of nasal air emission and nasal rustle determined perceptually by three experienced speech language pathologists. In the first model, 100 speech samples with a moderate agreement rate of hypernasality (kappa coefficient: 0.41) were used. In the second model, 43 speech samples with a perfect agreement among judges were included. The χ²-test was used to compare the models (p≤0.05). In the first model, 65 of the 100 samples were rated in the correct VP closure category, with 42 adequate and 23 inadequate. The borderline VP closure was not predicted. The second model rated 31 of the 43 samples in the correct category, with 21 adequate VP closure, 5 in the borderline VP closure, and 5 inadequate. There was no difference (p=0.526) between the two models. However, the second model showed a higher proportion of accuracy (7%) than the first one, and it has also predicted the borderline VP closure. These results showed the importance of high index of inter-judge agreement when using subjective parameters of speech evaluation, especially when compared to an instrumental evaluation. This suggests the need for strategies for training and calibration of judges in the perceptual judgment to improve the reliability of auditory-perceptual assessment.
publishDate 2014
dc.date.none.fl_str_mv 2014
2015-12-07T15:31:09Z
2015-12-07T15:31:09Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1590/2317-1782/20142014068
Codas, v. 26, n. 5, p. 357-359, 2014.
2317-1782
http://hdl.handle.net/11449/131047
10.1590/2317-1782/20142014068
S2317-17822014000500357
S2317-17822014000500357-en.pdf
S2317-17822014000500357-pt.pdf
8207092389931188
25388067
url http://dx.doi.org/10.1590/2317-1782/20142014068
http://hdl.handle.net/11449/131047
identifier_str_mv Codas, v. 26, n. 5, p. 357-359, 2014.
2317-1782
10.1590/2317-1782/20142014068
S2317-17822014000500357
S2317-17822014000500357-en.pdf
S2317-17822014000500357-pt.pdf
8207092389931188
25388067
dc.language.iso.fl_str_mv eng
por
language eng
por
dc.relation.none.fl_str_mv Codas
0,267
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 357-359
application/pdf
application/pdf
dc.source.none.fl_str_mv PubMed
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129044550516736