Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito

Detalhes bibliográficos
Autor(a) principal: Altmann, Raira Fernanda
Data de Publicação: 2019
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Manancial - Repositório Digital da UFSM
Texto Completo: http://repositorio.ufsm.br/handle/1/25668
Resumo: The objective of this study was to adapt the M1-Alpha and to search for content validity evidence. The process of adaptation of the instrument was divided into four steps. Step 1: Three language and speech therapists, two of whom were experts on aphasiology and one, a master's student in human communication disorders, analyzed the instruments M1-Alpha (only available for research and for some clinicians), the Montreal-Toulouse Language Assessment Battery for Aphasia-BR (MTL-BR) and MTL-BR version B (not marketed), to check for possible needs for modifications and select the stimuli to compose the instrument being adapted. Step 2: Twenty-eight non-expert judges analyzed the representativeness of 65 drawings. When necessary, the judges could make suggestions for improvements. Step 3: Five judges, who are experts on assessment of aphasia, determined whether the pictorial stimuli were adequate while four other judges, experts on linguistics and phonological acquisition, determined if the words, pseudowords and sentences were appropriate. As in Step 2, the expert judges were instructed to suggest modifications when necessary Step 4: This step was divided into pilot study 1 and pilot study 2, both with healthy individuals. After modifications suggested by the judges, the first draft of the instrument was designed and then applied to the sample of pilot study 1, composed of seven individuals. Based on pilot study 1, punctuation errors and inadequacies of some stimuli could be identified. After the adjustments required, the latest version of the protocol M1-Alpha was designed and then called MTL-BR Brief. The instrument was applied to 63 individuals from pilot study 2. Analysis of data from steps 1 and 4 was descriptive. For step 2, index of agreement among judges was determined using simple percentage agreement. The results of the expert judges were analyzed by calculating the content validity ratio while the first-order agreement coefficient (AC1 statistic) of Gwet was used to check for the correlation between expert judges. After analysis of the instruments (Step 1), 65 figures were designed and redesigned and then analyzed by non-expert raters (Step 2), and 60 of them showed more than 80% agreement. After adjustments, they were analyzed by the expert judges (Step 3); all 23 words, pseudo words and phrases were considered to be appropriate, while 22 out of the 66 pictorial stimuli required changes. Subsequently, they were analyzed by the same expert judges, and there was high agreement AC1= 0,98 [IC=0,96-1]. On the basis of the pilot studies (Step 4), some errors were found and then corrected to produce the latest version of the instrument. In conclusion, satisfactory content validity could be achieved in the adaptation of the M1-Alpha test, originating the MTL-BR Brief Battery.
id UFSM-20_666191020b22cbd9806ea2e0974f5550
oai_identifier_str oai:repositorio.ufsm.br:1/25668
network_acronym_str UFSM-20
network_name_str Manancial - Repositório Digital da UFSM
repository_id_str 3913
spelling 2022-07-27T18:07:16Z2022-07-27T18:07:16Z2019-07-19http://repositorio.ufsm.br/handle/1/25668The objective of this study was to adapt the M1-Alpha and to search for content validity evidence. The process of adaptation of the instrument was divided into four steps. Step 1: Three language and speech therapists, two of whom were experts on aphasiology and one, a master's student in human communication disorders, analyzed the instruments M1-Alpha (only available for research and for some clinicians), the Montreal-Toulouse Language Assessment Battery for Aphasia-BR (MTL-BR) and MTL-BR version B (not marketed), to check for possible needs for modifications and select the stimuli to compose the instrument being adapted. Step 2: Twenty-eight non-expert judges analyzed the representativeness of 65 drawings. When necessary, the judges could make suggestions for improvements. Step 3: Five judges, who are experts on assessment of aphasia, determined whether the pictorial stimuli were adequate while four other judges, experts on linguistics and phonological acquisition, determined if the words, pseudowords and sentences were appropriate. As in Step 2, the expert judges were instructed to suggest modifications when necessary Step 4: This step was divided into pilot study 1 and pilot study 2, both with healthy individuals. After modifications suggested by the judges, the first draft of the instrument was designed and then applied to the sample of pilot study 1, composed of seven individuals. Based on pilot study 1, punctuation errors and inadequacies of some stimuli could be identified. After the adjustments required, the latest version of the protocol M1-Alpha was designed and then called MTL-BR Brief. The instrument was applied to 63 individuals from pilot study 2. Analysis of data from steps 1 and 4 was descriptive. For step 2, index of agreement among judges was determined using simple percentage agreement. The results of the expert judges were analyzed by calculating the content validity ratio while the first-order agreement coefficient (AC1 statistic) of Gwet was used to check for the correlation between expert judges. After analysis of the instruments (Step 1), 65 figures were designed and redesigned and then analyzed by non-expert raters (Step 2), and 60 of them showed more than 80% agreement. After adjustments, they were analyzed by the expert judges (Step 3); all 23 words, pseudo words and phrases were considered to be appropriate, while 22 out of the 66 pictorial stimuli required changes. Subsequently, they were analyzed by the same expert judges, and there was high agreement AC1= 0,98 [IC=0,96-1]. On the basis of the pilot studies (Step 4), some errors were found and then corrected to produce the latest version of the instrument. In conclusion, satisfactory content validity could be achieved in the adaptation of the M1-Alpha test, originating the MTL-BR Brief Battery.Este estudo teve como objetivo adaptar o instrumento M1-Alpha e buscar evidências de validade de conteúdo. O processo de adaptação do instrumento foi dividido em quatro etapas. Etapa 1: Três fonoaudiólogas, sendo duas especialistas em afasiologia e uma mestranda em distúrbios da comunicação humana, realizaram a análise dos instrumentos M1-Alpha (disponível apenas para pesquisa e para alguns clínicos), Bateria Montreal-Toulouse de Avaliação de Linguagem (MTL-BR) e MTL-BR versão B (não comercializada), a fim de verificar possíveis necessidades de modificações e selecionar os estímulos que iriam compor o instrumento em adaptação. Etapa 2: Vinte e oito juízes não especialistas verificaram a representatividade de 65 desenhos. Quando necessário, os juízes realizaram sugestões de melhorias. Etapa 3: Cinco juízes especialistas em avaliação das afasias determinaram se os estímulos pictográficos eram adequados e outros quatro juízes especialistas em linguística e aquisição fonológica determinaram se as palavras, pseudopalavras e frases estavam adequadas. Assim como na Etapa 2, os juízes especialistas foram orientados a sugerir modificações quando necessárias. Etapa 4: Essa etapa foi dividida em Estudo Piloto 1 e Estudo Piloto 2, ambos com indivíduos saudáveis. Após modificações sugeridas pelos juízes, obteve-se a primeira versão do instrumento, aplicada na amostra do Estudo Piloto 1, composta por sete indivíduos. A partir do Estudo Piloto 1, pôde-se identificar erros de pontuação e inadequações de alguns estímulos. Após as adequações necessárias, obteve-se a última versão do protocolo M1-Alpha, denominado Bateria Montreal Toulouse de Avaliação da Linguagem versão Breve (MTL-BR Breve). O instrumento foi aplicado em 63 indivíduos do Estudo Piloto 2. A análise de dados das Etapas 1 e 4 foi descritiva. Para a Etapa 2, foi verificado o índice de concordância entre juízes a partir da concordância percentual simples. Os resultados dos juízes especialistas foram analisados pelo cálculo da Razão de Validade de Conteúdo e, para verificar a concordância entre juízes especialistas, foi utilizado o cálculo estatístico first-order agreement coefficient (AC1) de Gwet. Após a análise dos instrumentos (Etapa 1), 65 figuras foram desenhadas, redesenhadas, passaram por análise de juízes não especialistas (Etapa 2) e 60 delas apresentaram concordância superior a 80%. Após as adequações, foi realizada a análise com juízes especialistas (Etapa 3), em que todas as 23 palavras, pseudopalavras e frases foram consideradas adequadas. Dos 66 estímulos pictográficos julgados, 22 necessitaram de modificações e, posteriormente, foram analisados pelos mesmos juízes especialistas, verificando alta concordância AC1= 0,98 [IC=0,96-1]. A partir dos estudos pilotos (Etapa 4), foram observados e corrigidos alguns erros e, então, obteve-se a última versão do instrumento. Concluiu-se que foi possível obter validade de conteúdo satisfatória na adaptação do teste M1-Alpha, originando a Bateria MTL-BR Breve.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPESFundação de Amparo à Pesquisa do Estado do Rio Grande do Sul - FAPERGSporUniversidade Federal de Santa MariaCentro de Ciências da SaúdePrograma de Pós-Graduação em Distúrbios da Comunicação HumanaUFSMBrasilFonoaudiologiaAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessAvaliaçãoLinguagemAfasiaAdultoIdosoAssessmentLanguageAphasiaAdultsElderlyCNPQ::CIENCIAS DA SAUDE::FONOAUDIOLOGIAAdaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leitoAdaptation of protocol M1-Alpha for bedside assessment of languageinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisPagliarin, Karina Carlessohttp://lattes.cnpq.br/8613213743222996Ortiz, Karin ZazoBarreto, Simone dos SantosKeske-Soares, Marciahttp://lattes.cnpq.br/1580463958824711Altmann, Raira Fernanda40070000000360060060060060060038fee46f-2abe-4479-a985-b9bddb31d1e5ead56f8f-efb9-4e36-a068-de0f1068113a1db52afb-379e-49f5-873c-788ce2e9552251fd334d-1559-4da8-8eae-bc790f97778f9978a70d-d7a1-4f0e-a8a6-74b5d347938breponame:Manancial - Repositório Digital da UFSMinstname:Universidade Federal de Santa Maria (UFSM)instacron:UFSMCC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805http://repositorio.ufsm.br/bitstream/1/25668/2/license_rdf4460e5956bc1d1639be9ae6146a50347MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-81956http://repositorio.ufsm.br/bitstream/1/25668/3/license.txt2f0571ecee68693bd5cd3f17c1e075dfMD53ORIGINALDIS_PPGDCH_2019_ALTMANN_RAIRA.pdfDIS_PPGDCH_2019_ALTMANN_RAIRA.pdfDissertação de Mestradoapplication/pdf1518100http://repositorio.ufsm.br/bitstream/1/25668/1/DIS_PPGDCH_2019_ALTMANN_RAIRA.pdf19576c09cc75ca41c685eb7bc61e6d4aMD511/256682022-07-27 15:07:16.497oai:repositorio.ufsm.br:1/25668TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgw6AgVW5pdmVyc2lkYWRlCkZlZGVyYWwgZGUgU2FudGEgTWFyaWEgKFVGU00pIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyLCAgdHJhZHV6aXIgKGNvbmZvcm1lIGRlZmluaWRvIGFiYWl4byksIGUvb3UKZGlzdHJpYnVpciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gKGluY2x1aW5kbyBvIHJlc3VtbykgcG9yIHRvZG8gbyBtdW5kbyBubyBmb3JtYXRvIGltcHJlc3NvIGUgZWxldHLDtG5pY28gZQplbSBxdWFscXVlciBtZWlvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFVGU00gcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbwpwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgVUZTTSBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgYSBzdWEgdGVzZSBvdQpkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcwpuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0byBkYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG7Do28sIHF1ZSBzZWphIGRlIHNldQpjb25oZWNpbWVudG8sIGluZnJpbmdlIGRpcmVpdG9zIGF1dG9yYWlzIGRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6oKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFVGU00Kb3MgZGlyZWl0b3MgYXByZXNlbnRhZG9zIG5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlCmlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIG91IG5vIGNvbnRlw7pkbyBkYSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gb3JhIGRlcG9zaXRhZGEuCgpDQVNPIEEgVEVTRSBPVSBESVNTRVJUQcOHw4NPIE9SQSBERVBPU0lUQURBIFRFTkhBIFNJRE8gUkVTVUxUQURPIERFIFVNIFBBVFJPQ8ONTklPIE9VCkFQT0lPIERFIFVNQSBBR8OKTkNJQSBERSBGT01FTlRPIE9VIE9VVFJPIE9SR0FOSVNNTyBRVUUgTsODTyBTRUpBIEEgVUZTTQosIFZPQ8OKIERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJU8ODTyBDT01PClRBTULDiU0gQVMgREVNQUlTIE9CUklHQcOHw5VFUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBVRlNNIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUgKHMpIG91IG8ocykgbm9tZShzKSBkbyhzKQpkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbywgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBhbMOpbSBkYXF1ZWxhcwpjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgoKRepositório Institucionalhttp://repositorio.ufsm.br/PUBhttp://repositorio.ufsm.br/oai/requestopendoar:39132022-07-27T18:07:16Manancial - Repositório Digital da UFSM - Universidade Federal de Santa Maria (UFSM)false
dc.title.por.fl_str_mv Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
dc.title.alternative.eng.fl_str_mv Adaptation of protocol M1-Alpha for bedside assessment of language
title Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
spellingShingle Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
Altmann, Raira Fernanda
Avaliação
Linguagem
Afasia
Adulto
Idoso
Assessment
Language
Aphasia
Adults
Elderly
CNPQ::CIENCIAS DA SAUDE::FONOAUDIOLOGIA
title_short Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
title_full Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
title_fullStr Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
title_full_unstemmed Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
title_sort Adaptação do protocolo M1-Alpha para a avaliação da linguagem à beira do leito
author Altmann, Raira Fernanda
author_facet Altmann, Raira Fernanda
author_role author
dc.contributor.advisor1.fl_str_mv Pagliarin, Karina Carlesso
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/8613213743222996
dc.contributor.advisor-co1.fl_str_mv Ortiz, Karin Zazo
dc.contributor.referee1.fl_str_mv Barreto, Simone dos Santos
dc.contributor.referee2.fl_str_mv Keske-Soares, Marcia
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/1580463958824711
dc.contributor.author.fl_str_mv Altmann, Raira Fernanda
contributor_str_mv Pagliarin, Karina Carlesso
Ortiz, Karin Zazo
Barreto, Simone dos Santos
Keske-Soares, Marcia
dc.subject.por.fl_str_mv Avaliação
Linguagem
Afasia
Adulto
Idoso
topic Avaliação
Linguagem
Afasia
Adulto
Idoso
Assessment
Language
Aphasia
Adults
Elderly
CNPQ::CIENCIAS DA SAUDE::FONOAUDIOLOGIA
dc.subject.eng.fl_str_mv Assessment
Language
Aphasia
Adults
Elderly
dc.subject.cnpq.fl_str_mv CNPQ::CIENCIAS DA SAUDE::FONOAUDIOLOGIA
description The objective of this study was to adapt the M1-Alpha and to search for content validity evidence. The process of adaptation of the instrument was divided into four steps. Step 1: Three language and speech therapists, two of whom were experts on aphasiology and one, a master's student in human communication disorders, analyzed the instruments M1-Alpha (only available for research and for some clinicians), the Montreal-Toulouse Language Assessment Battery for Aphasia-BR (MTL-BR) and MTL-BR version B (not marketed), to check for possible needs for modifications and select the stimuli to compose the instrument being adapted. Step 2: Twenty-eight non-expert judges analyzed the representativeness of 65 drawings. When necessary, the judges could make suggestions for improvements. Step 3: Five judges, who are experts on assessment of aphasia, determined whether the pictorial stimuli were adequate while four other judges, experts on linguistics and phonological acquisition, determined if the words, pseudowords and sentences were appropriate. As in Step 2, the expert judges were instructed to suggest modifications when necessary Step 4: This step was divided into pilot study 1 and pilot study 2, both with healthy individuals. After modifications suggested by the judges, the first draft of the instrument was designed and then applied to the sample of pilot study 1, composed of seven individuals. Based on pilot study 1, punctuation errors and inadequacies of some stimuli could be identified. After the adjustments required, the latest version of the protocol M1-Alpha was designed and then called MTL-BR Brief. The instrument was applied to 63 individuals from pilot study 2. Analysis of data from steps 1 and 4 was descriptive. For step 2, index of agreement among judges was determined using simple percentage agreement. The results of the expert judges were analyzed by calculating the content validity ratio while the first-order agreement coefficient (AC1 statistic) of Gwet was used to check for the correlation between expert judges. After analysis of the instruments (Step 1), 65 figures were designed and redesigned and then analyzed by non-expert raters (Step 2), and 60 of them showed more than 80% agreement. After adjustments, they were analyzed by the expert judges (Step 3); all 23 words, pseudo words and phrases were considered to be appropriate, while 22 out of the 66 pictorial stimuli required changes. Subsequently, they were analyzed by the same expert judges, and there was high agreement AC1= 0,98 [IC=0,96-1]. On the basis of the pilot studies (Step 4), some errors were found and then corrected to produce the latest version of the instrument. In conclusion, satisfactory content validity could be achieved in the adaptation of the M1-Alpha test, originating the MTL-BR Brief Battery.
publishDate 2019
dc.date.issued.fl_str_mv 2019-07-19
dc.date.accessioned.fl_str_mv 2022-07-27T18:07:16Z
dc.date.available.fl_str_mv 2022-07-27T18:07:16Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://repositorio.ufsm.br/handle/1/25668
url http://repositorio.ufsm.br/handle/1/25668
dc.language.iso.fl_str_mv por
language por
dc.relation.cnpq.fl_str_mv 400700000003
dc.relation.confidence.fl_str_mv 600
600
600
600
600
600
dc.relation.authority.fl_str_mv 38fee46f-2abe-4479-a985-b9bddb31d1e5
ead56f8f-efb9-4e36-a068-de0f1068113a
1db52afb-379e-49f5-873c-788ce2e95522
51fd334d-1559-4da8-8eae-bc790f97778f
9978a70d-d7a1-4f0e-a8a6-74b5d347938b
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Santa Maria
Centro de Ciências da Saúde
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Distúrbios da Comunicação Humana
dc.publisher.initials.fl_str_mv UFSM
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Fonoaudiologia
publisher.none.fl_str_mv Universidade Federal de Santa Maria
Centro de Ciências da Saúde
dc.source.none.fl_str_mv reponame:Manancial - Repositório Digital da UFSM
instname:Universidade Federal de Santa Maria (UFSM)
instacron:UFSM
instname_str Universidade Federal de Santa Maria (UFSM)
instacron_str UFSM
institution UFSM
reponame_str Manancial - Repositório Digital da UFSM
collection Manancial - Repositório Digital da UFSM
bitstream.url.fl_str_mv http://repositorio.ufsm.br/bitstream/1/25668/2/license_rdf
http://repositorio.ufsm.br/bitstream/1/25668/3/license.txt
http://repositorio.ufsm.br/bitstream/1/25668/1/DIS_PPGDCH_2019_ALTMANN_RAIRA.pdf
bitstream.checksum.fl_str_mv 4460e5956bc1d1639be9ae6146a50347
2f0571ecee68693bd5cd3f17c1e075df
19576c09cc75ca41c685eb7bc61e6d4a
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Manancial - Repositório Digital da UFSM - Universidade Federal de Santa Maria (UFSM)
repository.mail.fl_str_mv
_version_ 1794523962394279936