Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson
Autor(a) principal: | |
---|---|
Data de Publicação: | 2023 |
Tipo de documento: | Dissertação |
Idioma: | por |
Título da fonte: | Biblioteca Digital de Teses e Dissertações da UFMA |
Texto Completo: | https://tedebc.ufma.br/jspui/handle/tede/tede/5131 |
Resumo: | Objective: This study aimed to evaluate the test-retest and interrater reliability of the 2-minute Step Test (2MST) and its validation in the population with Parkinson's disease (PD). Materials and methods: Two previously trained examiners applied the 2MST in two different moments, with an interval of 7 to 14 days between them. In addition, clinical measurements of PD were carried out using the following instruments: Berg Balance Scale (BBS), Unified PD Rating Scale (UPDRS), Hoehn and Yahr Scale (HY), gait speed and cadence, test sitting and standing up 5 times (TSS5T) and Timed Up and Go (TUG). Regarding statistical analysis, the intraclass correlation coefficient was used to measure reliability and the Pearson and Spearman correlation coefficients were used to correlate TME2 with other clinical tests (significance level assumed to be 5%). The agreement between the measurement taken at the time and the measurement recorded later via video was assessed via Bland-Altman graphs. Results: The 2MST showed high test-retest reliability (intraclass correlation coefficient [ICC] = 0.80, standard error of measurement [SEM] = 10.59, minimum detectable difference [MDD] = 29.35), as well as interexaminer ( ICC = 0.93, SEM = 4.49, MMD = 12.46). There was acceptable agreement between assessments made with in-person and video examiners, through analysis of Bland-Altman graphs. All instruments showed a statistically significant correlation with 2MST, except HY and TSS5T. A correlation magnitude above 0.50 was found between 2MST and gait speed, and a correlation magnitude between 0.30 and 0.50 with EEB, gait cadence, UPDRS and TUG, thus confirming the construct validity. Conclusion: The 2MST proved to be a highly reliable tool for evaluating functional capacity in patients with PD, with the construct validity also being proven based on its correlation with gait speed and cadence, UPDRS, EEB and TUG. |
id |
UFMA_24e546493e001be731588764ca621738 |
---|---|
oai_identifier_str |
oai:tede2:tede/5131 |
network_acronym_str |
UFMA |
network_name_str |
Biblioteca Digital de Teses e Dissertações da UFMA |
repository_id_str |
2131 |
spelling |
DIBAI FILHO, Almir Vieirahttp://lattes.cnpq.br/1144110354316280DIBAI FILHO, Almir Vieirahttp://lattes.cnpq.br/1144110354316280GAMBASSI, Bruno Bavarescohttp://lattes.cnpq.br/1144110354316280SILVA, Soraia Micaelahttp://lattes.cnpq.br/3795036706844374CORRÊA, Clynton Lourençohttp://lattes.cnpq.br/4816882323293632http://lattes.cnpq.br/4287869179538524SANTOS, Marina Genari Murad Carolino dos2024-02-06T12:29:49Z2023-12-14SANTOS, Marina Genari Murad Carolino dos. Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson. 2023. 74 f. Dissertação (Programa de Pós-Graduacao em Educação Física) - Universidade Federal do Maranhão, São Luís, 2023.https://tedebc.ufma.br/jspui/handle/tede/tede/5131Objective: This study aimed to evaluate the test-retest and interrater reliability of the 2-minute Step Test (2MST) and its validation in the population with Parkinson's disease (PD). Materials and methods: Two previously trained examiners applied the 2MST in two different moments, with an interval of 7 to 14 days between them. In addition, clinical measurements of PD were carried out using the following instruments: Berg Balance Scale (BBS), Unified PD Rating Scale (UPDRS), Hoehn and Yahr Scale (HY), gait speed and cadence, test sitting and standing up 5 times (TSS5T) and Timed Up and Go (TUG). Regarding statistical analysis, the intraclass correlation coefficient was used to measure reliability and the Pearson and Spearman correlation coefficients were used to correlate TME2 with other clinical tests (significance level assumed to be 5%). The agreement between the measurement taken at the time and the measurement recorded later via video was assessed via Bland-Altman graphs. Results: The 2MST showed high test-retest reliability (intraclass correlation coefficient [ICC] = 0.80, standard error of measurement [SEM] = 10.59, minimum detectable difference [MDD] = 29.35), as well as interexaminer ( ICC = 0.93, SEM = 4.49, MMD = 12.46). There was acceptable agreement between assessments made with in-person and video examiners, through analysis of Bland-Altman graphs. All instruments showed a statistically significant correlation with 2MST, except HY and TSS5T. A correlation magnitude above 0.50 was found between 2MST and gait speed, and a correlation magnitude between 0.30 and 0.50 with EEB, gait cadence, UPDRS and TUG, thus confirming the construct validity. Conclusion: The 2MST proved to be a highly reliable tool for evaluating functional capacity in patients with PD, with the construct validity also being proven based on its correlation with gait speed and cadence, UPDRS, EEB and TUG.Objetivo: Este estudo se propôs a avaliar a confiabilidade do teste-reteste e interexaminadores do Teste de Marcha Estacionária de 2 minutos (TME2) e sua validação na população com doença de Parkinson (DP). Materiais e métodos: Dois examinadores previamente treinados aplicaram o TME2 em dois momentos, com intervalo de 7 a 14 dias entre eles. Além disso, foram realizadas mensurações clínicas da DP por meio dos seguintes instrumentos: Escala de Equilíbrio de Berg (EEB), Escala Unificada de Avaliação da DP (UPDRS), Escala de Hoehn e Yahr (HY), velocidade e cadência da marcha, teste de sentar e levantar 5 vezes (TSL5) e Timed Up and Go (TUG). Com relação à análise estatística, foi empregado o coeficiente de correlação intraclasse para mensurar a confiabilidade e o coeficiente de correlação de Pearson e de Spearman para correlacionar o TME2 aos demais testes clínicos (nível de significância assumido de 5%). A concordância entre a medida realizada no momento e a medida registrada posteriormente por vídeo foi avaliada via Bland-Altman. Resultados: O TME2 mostrou confiabilidade alta no teste-reteste (coeficiente de correlação intraclasse [CCI] = 0.80, erro padrão da medida [EPM] = 10,59, diferença mínima detectável [DMD] = 29,35), assim como interexaminadores (CCI = 0.93, EPM = 4,49, DMD = 12,46). Houve concordância aceitável entre as avaliações feitas com examinadores presenciais e através de vídeo, mediante análise dos gráficos de Bland-Altman. Todos os instrumentos apresentaram correlação estatisticamente significativa com o TME2, exceto HY e TSL5. Foi encontrada uma magnitude de correlação acima de 0,50 entre o TME2 e a velocidade da marcha, e uma magnitude de correlação entre 0,30 e 0,50 com EEB, cadência da marcha, UPDRS e TUG, confirmando assim a validade de construto. Conclusão: O TME2 mostrou-se uma ferramenta de alta confiabilidade para avaliação da capacidade funcional em pacientes com DP, sendo também comprovada a validade do construto a partir da sua correlação com velocidade e cadência da marcha, UPDRS, EEB e TUG.Submitted by Daniella Santos (daniella.santos@ufma.br) on 2024-02-06T12:29:49Z No. of bitstreams: 1 MarinaSantos.pdf: 1087505 bytes, checksum: bc92e94b4b862487d663a376f38d1806 (MD5)Made available in DSpace on 2024-02-06T12:29:49Z (GMT). No. of bitstreams: 1 MarinaSantos.pdf: 1087505 bytes, checksum: bc92e94b4b862487d663a376f38d1806 (MD5) Previous issue date: 2023-12-14application/pdfporUniversidade Federal do MaranhãoPROGRAMA DE PÓS-GRADUACAO EM EDUCAÇÃO FÍSICAUFMABrasilDEPARTAMENTO DE EDUCAÇÃO FÍSICA/CCBSreprodutibilidade dos testes;confiabilidade;capacidade funcional;doença de Parkinson;test reproducibility;reliability;functional capacity;Parkinson's disease.Educação FísicaConfiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de ParkinsonReliability and validation of the 2-minute stationary gait test in individuals with Parkinson's diseaseinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFMAinstname:Universidade Federal do Maranhão (UFMA)instacron:UFMAORIGINALMarinaSantos.pdfMarinaSantos.pdfapplication/pdf1087505http://tedebc.ufma.br:8080/bitstream/tede/5131/2/MarinaSantos.pdfbc92e94b4b862487d663a376f38d1806MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82255http://tedebc.ufma.br:8080/bitstream/tede/5131/1/license.txt97eeade1fce43278e63fe063657f8083MD51tede/51312024-02-06 09:29:49.122oai:tede2:tede/5131IExJQ0VOw4dBIERFIERJU1RSSUJVScOHw4NPIE7Dg08tRVhDTFVTSVZBCgpDb20gYSBhcHJlc2VudGHDp8OjbyBkZXN0YSBsaWNlbsOnYSxvIGF1dG9yIChlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvciBjb25jZWRlIMOgIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRvIE1hcmFuaMOjbyAoVUZNQSkgbyBkaXJlaXRvIG7Do28tZXhjbHVzaXZvIGRlIHJlcHJvZHV6aXIsIHRyYWR1emlyIChjb25mb3JtZSBkZWZpbmlkbyBhYmFpeG8pLCBlL291IGRpc3RyaWJ1aXIgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIChpbmNsdWluZG8gbyByZXN1bW8pIHBvciB0b2RvIG8gbXVuZG8gbm8gZm9ybWF0byBpbXByZXNzbyBlIGVsZXRyw7RuaWNvIGUgZW0gcXVhbHF1ZXIgbWVpbywgaW5jbHVpbmRvIG9zIGZvcm1hdG9zIMOhdWRpbyBvdSB2w61kZW8uCgpWb2PDqiBjb25jb3JkYSBxdWUgYSBVRk1BIHBvZGUsIHNlbSBhbHRlcmFyIG8gY29udGXDumRvLCB0cmFuc3BvciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBhIFVGTUEgcG9kZSBtYW50ZXIgbWFpcyBkZSB1bWEgY8OzcGlhIGRlIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gcGFyYSBmaW5zIGRlIHNlZ3VyYW7Dp2EsIGJhY2stdXAgZSBwcmVzZXJ2YcOnw6NvLgoKVm9jw6ogZGVjbGFyYSBxdWUgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIMOpIG9yaWdpbmFsIGUgcXVlIHZvY8OqIHRlbSBvIHBvZGVyIGRlIGNvbmNlZGVyIG9zIGRpcmVpdG9zIGNvbnRpZG9zIG5lc3RhIGxpY2Vuw6dhLiBWb2PDqiB0YW1iw6ltIGRlY2xhcmEgcXVlIG8gZGVww7NzaXRvIGRhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gbsOjbywgcXVlIHNlamEgZGUgc2V1IGNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3XDqW0uCgpDYXNvIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiBkZWNsYXJhIHF1ZSBvYnRldmUgYSBwZXJtaXNzw6NvIGlycmVzdHJpdGEgZG8gZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIHBhcmEgY29uY2VkZXIgw6AgVUZNQSBvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgbmVzdGEgbGljZW7Dp2EsIGUgcXVlIGVzc2UgbWF0ZXJpYWwgZGUgcHJvcHJpZWRhZGUgZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBvcmEgZGVwb3NpdGFkYS4KCkNBU08gQSBURVNFIE9VIERJU1NFUlRBw4fDg08gT1JBIERFUE9TSVRBREEgVEVOSEEgU0lETyBSRVNVTFRBRE8gREUgVU0gUEFUUk9Dw41OSU8gT1UgQVBPSU8gREUgVU1BIEFHw4pOQ0lBIERFIEZPTUVOVE8gT1UgT1VUUk8gT1JHQU5JU01PIFFVRSBOw4NPIFNFSkEgQSBVRk1BLCBWT0PDiiBERUNMQVJBIFFVRSBSRVNQRUlUT1UgVE9ET1MgRSBRVUFJU1FVRVIgRElSRUlUT1MgREUgUkVWSVPDg08gQ09NTyBUQU1Cw4lNIEFTIERFTUFJUyBPQlJJR0HDh8OVRVMgRVhJR0lEQVMgUE9SIENPTlRSQVRPIE9VIEFDT1JETy4KCkEgVUZNQSBzZSBjb21wcm9tZXRlIGEgaWRlbnRpZmljYXIgY2xhcmFtZW50ZSBvIHNldSBub21lIG91IG8ocykgbm9tZShzKSBkbyhzKSBkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbywgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBhbMOpbSBkYXF1ZWxhcyBjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgoKRGVjbGFyYSB0YW1iw6ltIHF1ZSB0b2RhcyBhcyBhZmlsaWHDp8O1ZXMgY29ycG9yYXRpdmFzIG91IGluc3RpdHVjaW9uYWlzIGUgdG9kYXMgYXMgZm9udGVzIGRlIGFwb2lvIGZpbmFuY2Vpcm8gYW8gdHJhYmFsaG8gZXN0w6NvIGRldmlkYW1lbnRlIGNpdGFkYXMgb3UgbWVuY2lvbmFkYXMgZSBjZXJ0aWZpY2EgcXVlIG7Do28gaMOhIG5lbmh1bSBpbnRlcmVzc2UgY29tZXJjaWFsIG91IGFzc29jaWF0aXZvIHF1ZSByZXByZXNlbnRlIGNvbmZsaXRvIGRlIGludGVyZXNzZSBlbSBjb25leMOjbyBjb20gbyB0cmFiYWxobyBzdWJtZXRpZG8uCgoKCgoKCgo=Biblioteca Digital de Teses e Dissertaçõeshttps://tedebc.ufma.br/jspui/PUBhttp://tedebc.ufma.br:8080/oai/requestrepositorio@ufma.br||repositorio@ufma.bropendoar:21312024-02-06T12:29:49Biblioteca Digital de Teses e Dissertações da UFMA - Universidade Federal do Maranhão (UFMA)false |
dc.title.por.fl_str_mv |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
dc.title.alternative.eng.fl_str_mv |
Reliability and validation of the 2-minute stationary gait test in individuals with Parkinson's disease |
title |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
spellingShingle |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson SANTOS, Marina Genari Murad Carolino dos reprodutibilidade dos testes; confiabilidade; capacidade funcional; doença de Parkinson; test reproducibility; reliability; functional capacity; Parkinson's disease. Educação Física |
title_short |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
title_full |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
title_fullStr |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
title_full_unstemmed |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
title_sort |
Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson |
author |
SANTOS, Marina Genari Murad Carolino dos |
author_facet |
SANTOS, Marina Genari Murad Carolino dos |
author_role |
author |
dc.contributor.advisor1.fl_str_mv |
DIBAI FILHO, Almir Vieira |
dc.contributor.advisor1Lattes.fl_str_mv |
http://lattes.cnpq.br/1144110354316280 |
dc.contributor.referee1.fl_str_mv |
DIBAI FILHO, Almir Vieira |
dc.contributor.referee1Lattes.fl_str_mv |
http://lattes.cnpq.br/1144110354316280 |
dc.contributor.referee2.fl_str_mv |
GAMBASSI, Bruno Bavaresco |
dc.contributor.referee2Lattes.fl_str_mv |
http://lattes.cnpq.br/1144110354316280 |
dc.contributor.referee3.fl_str_mv |
SILVA, Soraia Micaela |
dc.contributor.referee3Lattes.fl_str_mv |
http://lattes.cnpq.br/3795036706844374 |
dc.contributor.referee4.fl_str_mv |
CORRÊA, Clynton Lourenço |
dc.contributor.referee4Lattes.fl_str_mv |
http://lattes.cnpq.br/4816882323293632 |
dc.contributor.authorLattes.fl_str_mv |
http://lattes.cnpq.br/4287869179538524 |
dc.contributor.author.fl_str_mv |
SANTOS, Marina Genari Murad Carolino dos |
contributor_str_mv |
DIBAI FILHO, Almir Vieira DIBAI FILHO, Almir Vieira GAMBASSI, Bruno Bavaresco SILVA, Soraia Micaela CORRÊA, Clynton Lourenço |
dc.subject.por.fl_str_mv |
reprodutibilidade dos testes; confiabilidade; capacidade funcional; doença de Parkinson; test reproducibility; reliability; functional capacity; Parkinson's disease. |
topic |
reprodutibilidade dos testes; confiabilidade; capacidade funcional; doença de Parkinson; test reproducibility; reliability; functional capacity; Parkinson's disease. Educação Física |
dc.subject.cnpq.fl_str_mv |
Educação Física |
description |
Objective: This study aimed to evaluate the test-retest and interrater reliability of the 2-minute Step Test (2MST) and its validation in the population with Parkinson's disease (PD). Materials and methods: Two previously trained examiners applied the 2MST in two different moments, with an interval of 7 to 14 days between them. In addition, clinical measurements of PD were carried out using the following instruments: Berg Balance Scale (BBS), Unified PD Rating Scale (UPDRS), Hoehn and Yahr Scale (HY), gait speed and cadence, test sitting and standing up 5 times (TSS5T) and Timed Up and Go (TUG). Regarding statistical analysis, the intraclass correlation coefficient was used to measure reliability and the Pearson and Spearman correlation coefficients were used to correlate TME2 with other clinical tests (significance level assumed to be 5%). The agreement between the measurement taken at the time and the measurement recorded later via video was assessed via Bland-Altman graphs. Results: The 2MST showed high test-retest reliability (intraclass correlation coefficient [ICC] = 0.80, standard error of measurement [SEM] = 10.59, minimum detectable difference [MDD] = 29.35), as well as interexaminer ( ICC = 0.93, SEM = 4.49, MMD = 12.46). There was acceptable agreement between assessments made with in-person and video examiners, through analysis of Bland-Altman graphs. All instruments showed a statistically significant correlation with 2MST, except HY and TSS5T. A correlation magnitude above 0.50 was found between 2MST and gait speed, and a correlation magnitude between 0.30 and 0.50 with EEB, gait cadence, UPDRS and TUG, thus confirming the construct validity. Conclusion: The 2MST proved to be a highly reliable tool for evaluating functional capacity in patients with PD, with the construct validity also being proven based on its correlation with gait speed and cadence, UPDRS, EEB and TUG. |
publishDate |
2023 |
dc.date.issued.fl_str_mv |
2023-12-14 |
dc.date.accessioned.fl_str_mv |
2024-02-06T12:29:49Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
SANTOS, Marina Genari Murad Carolino dos. Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson. 2023. 74 f. Dissertação (Programa de Pós-Graduacao em Educação Física) - Universidade Federal do Maranhão, São Luís, 2023. |
dc.identifier.uri.fl_str_mv |
https://tedebc.ufma.br/jspui/handle/tede/tede/5131 |
identifier_str_mv |
SANTOS, Marina Genari Murad Carolino dos. Confiabilidade e validação do teste de marcha estacionária de 2 minutos em indivíduos com doença de Parkinson. 2023. 74 f. Dissertação (Programa de Pós-Graduacao em Educação Física) - Universidade Federal do Maranhão, São Luís, 2023. |
url |
https://tedebc.ufma.br/jspui/handle/tede/tede/5131 |
dc.language.iso.fl_str_mv |
por |
language |
por |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Universidade Federal do Maranhão |
dc.publisher.program.fl_str_mv |
PROGRAMA DE PÓS-GRADUACAO EM EDUCAÇÃO FÍSICA |
dc.publisher.initials.fl_str_mv |
UFMA |
dc.publisher.country.fl_str_mv |
Brasil |
dc.publisher.department.fl_str_mv |
DEPARTAMENTO DE EDUCAÇÃO FÍSICA/CCBS |
publisher.none.fl_str_mv |
Universidade Federal do Maranhão |
dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da UFMA instname:Universidade Federal do Maranhão (UFMA) instacron:UFMA |
instname_str |
Universidade Federal do Maranhão (UFMA) |
instacron_str |
UFMA |
institution |
UFMA |
reponame_str |
Biblioteca Digital de Teses e Dissertações da UFMA |
collection |
Biblioteca Digital de Teses e Dissertações da UFMA |
bitstream.url.fl_str_mv |
http://tedebc.ufma.br:8080/bitstream/tede/5131/2/MarinaSantos.pdf http://tedebc.ufma.br:8080/bitstream/tede/5131/1/license.txt |
bitstream.checksum.fl_str_mv |
bc92e94b4b862487d663a376f38d1806 97eeade1fce43278e63fe063657f8083 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 |
repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da UFMA - Universidade Federal do Maranhão (UFMA) |
repository.mail.fl_str_mv |
repositorio@ufma.br||repositorio@ufma.br |
_version_ |
1809926219190239232 |