IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis

Detalhes bibliográficos
Autor(a) principal: FRAZÃO, Kastney Albuquerque
Data de Publicação: 2021
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Biblioteca Digital de Teses e Dissertações da UFMA
Texto Completo: https://tedebc.ufma.br/jspui/handle/tede/tede/4437
Resumo: Digital educational games for mobile devices have become increasingly present in educa tional environments, where they have gained a lot of relevance in the educational and professional training of many people. These software are present in online app stores, where there is a specific place for their users to review the apps in the catalogs. Despite all the benefits that digital educational games have; these software still have quality problems pointed out by users. Problems in various areas, such as: the usability and functionality of the games; little adherence to the proposal and gameplay; besides, difficulty in supporting and mobility of games on users’ mobile devices. Several technologies for evaluating software have been proposed; however, there is still a need for research development to evaluate specific digital educational games for the mobile platform, while supporting software engineers in detecting defects in the evaluated games. This master’s thesis proposes an inspection checklist for the evaluation of digital educational games for mobile devices called IC-MEG, a support tool called TIMEG was also developed to provide support to the developed checklist; these technologies were developed to support development teams in evaluating their mobile digital educational games. We evaluated the acceptance of IC-MEG and TIMEG from the perspective of novice software engineers in an experimental study. When compared to mGBL and PHEG, other checklists in the literature, the results showed that the IC-MEG was perceived as useful and more complete. In addition, software engineers found the TIMEG tool useful and easy to understand, while suggesting improving its report to make it easier to understand and increase its use. The results of the experimental study indicated users’ satisfaction in reporting their experience with the IC-MEG checklist, while members of the development team agreed with the usefulness of the TIMEG report and its suggestions for improvement. By providing inspection support, we intend to support software engineers in the detection of defects in digital educational games for mobile devices developed, thus increasing their quality and acceptance in the market.
id UFMA_3107875de1c581ea50ec520f389d0a4f
oai_identifier_str oai:tede2:tede/4437
network_acronym_str UFMA
network_name_str Biblioteca Digital de Teses e Dissertações da UFMA
repository_id_str 2131
spelling RIVERO CABREJOS, Luis Jorge Enriquehttp://lattes.cnpq.br/8534667641706692SANTOS, Davi Viana doshttp://lattes.cnpq.br/9297257833779277RIVERO CABREJOS, Luis Jorge Enriquehttp://lattes.cnpq.br/8534667641706692SANTOS, Davi Viana doshttp://lattes.cnpq.br/9297257833779277BRAZ JUNIOR, Geraldohttp://lattes.cnpq.br/8287861610873629MARQUES, Anna Beatriz dos Santoshttp://lattes.cnpq.br/5522150204610320http://lattes.cnpq.br/0259072196137901FRAZÃO, Kastney Albuquerque2022-12-14T18:06:25Z2021-09-28FRAZÃO, Kastney Albuquerque. IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis. 2021. 103 f. Dissertação( Programa de Pós-graduação em Ciência da Computação/CCET) - Universidade Federal do Maranhão, São Luís, 2021.https://tedebc.ufma.br/jspui/handle/tede/tede/4437Digital educational games for mobile devices have become increasingly present in educa tional environments, where they have gained a lot of relevance in the educational and professional training of many people. These software are present in online app stores, where there is a specific place for their users to review the apps in the catalogs. Despite all the benefits that digital educational games have; these software still have quality problems pointed out by users. Problems in various areas, such as: the usability and functionality of the games; little adherence to the proposal and gameplay; besides, difficulty in supporting and mobility of games on users’ mobile devices. Several technologies for evaluating software have been proposed; however, there is still a need for research development to evaluate specific digital educational games for the mobile platform, while supporting software engineers in detecting defects in the evaluated games. This master’s thesis proposes an inspection checklist for the evaluation of digital educational games for mobile devices called IC-MEG, a support tool called TIMEG was also developed to provide support to the developed checklist; these technologies were developed to support development teams in evaluating their mobile digital educational games. We evaluated the acceptance of IC-MEG and TIMEG from the perspective of novice software engineers in an experimental study. When compared to mGBL and PHEG, other checklists in the literature, the results showed that the IC-MEG was perceived as useful and more complete. In addition, software engineers found the TIMEG tool useful and easy to understand, while suggesting improving its report to make it easier to understand and increase its use. The results of the experimental study indicated users’ satisfaction in reporting their experience with the IC-MEG checklist, while members of the development team agreed with the usefulness of the TIMEG report and its suggestions for improvement. By providing inspection support, we intend to support software engineers in the detection of defects in digital educational games for mobile devices developed, thus increasing their quality and acceptance in the market.Jogos educacionais digitais para dispositivos móveis se tornaram cada vez mais presentes em ambientes educacionais, onde ganharam muita relevância na formação educacional e profissional de várias pessoas. Esses softwares estão presentes nas lojas de aplicativos online, onde existe um lugar específico para que seus usuários possam avaliá-los. Apesar de todos os benefícios que os jogos educacionais digitais têm, estes softwares ainda apresentam problemas de qualidade apontados pelos usuários, como: a falta de usabilidade e as funcionalidades dos jogos; pouca adesão da proposta e da jogabilidade; além de, dificuldade de suporte e mobilidade dos jogos nos dispositivos móveis dos usuários. Várias tecnologias para avaliar software foram propostas. No entanto, ainda existe a necessidade de tecnologias para avaliar jogos educacionais digitais específicos para a plataforma móvel, e apoiar ao mesmo tempo os engenheiros de software na detecção de defeitos dos jogos avaliados. Esta dissertação de mestrado propõe um checklist de inspeção para a avaliação de jogos educacionais digitais para dispositivos móveis chamada IC-MEG. Também foi desenvolvida uma ferramenta de apoio chamada TIMEG para fornecer apoio ao checklist desenvolvido. As tecnologias foram desenvolvidas para apoiar equipes de desenvolvimentos na avaliação de seus jogos educacionais digitais móveis. A aceitação do IC-MEG e TIMEG foi avaliada do ponto de vista de engenheiros de software iniciantes em um estudo experimental. Quando comparado ao mGBL e PHEG, outros checklists existentes na literatura, os resultados mostraram que o IC-MEG foi percebido como útil e mais completo. Além disso, os engenheiros de software consideraram a ferramenta TIMEG útil e fácil de entender, ao mesmo tempo que sugeriram melhorar seu relatório de defeitos para facilitar sua compreensão e aumentar seu uso. Os resultados do estudo experimental indicaram a satisfação dos participantes ao executar uma avaliação com o checklist IC-MEG, enquanto os membros da equipe de desenvolvimento concordaram com a utilidade do relatório TIMEG e suas sugestões de melhorias. Ao fornecer apoio para a inspeção, pretende-se apoiar os engenheiros de software na detecção de defeitos em jogos educacionais digitais para dispositivos móveis desenvolvidos, aumentando assim a sua qualidade e aceitação no mercado.Submitted by Maria Aparecida (cidazen@gmail.com) on 2022-12-14T18:06:25Z No. of bitstreams: 1 Kastney Albuquerque Frazãovec.pdf: 33259492 bytes, checksum: 0657ac19e306ab5c4373e172d71dc47a (MD5)Made available in DSpace on 2022-12-14T18:06:25Z (GMT). No. of bitstreams: 1 Kastney Albuquerque Frazãovec.pdf: 33259492 bytes, checksum: 0657ac19e306ab5c4373e172d71dc47a (MD5) Previous issue date: 2021-09-28application/pdfporUniversidade Federal do MaranhãoPROGRAMA DE PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO/CCETUFMABrasilDEPARTAMENTO DE INFORMÁTICA/CCETChecklist de Inspeção;Jogos Educacionais Digitais;Aplicativos Móveis;Análise de ComentáriosMobile Educational Games;Inspection Checklist;Mobile Applications;Review analysisModelos Analíticos e de SimulaçãoIC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas MóveisIC-MEG: A Specific Checklist for the Evaluation of Digital Educational Games on Mobile Platformsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFMAinstname:Universidade Federal do Maranhão (UFMA)instacron:UFMAORIGINALKastney Albuquerque Frazãovec.pdfKastney Albuquerque Frazãovec.pdfapplication/pdf33259492http://tedebc.ufma.br:8080/bitstream/tede/4437/2/Kastney+Albuquerque+Fraz%C3%A3ovec.pdf0657ac19e306ab5c4373e172d71dc47aMD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82255http://tedebc.ufma.br:8080/bitstream/tede/4437/1/license.txt97eeade1fce43278e63fe063657f8083MD51tede/44372022-12-14 15:06:25.451oai:tede2:tede/4437IExJQ0VOw4dBIERFIERJU1RSSUJVScOHw4NPIE7Dg08tRVhDTFVTSVZBCgpDb20gYSBhcHJlc2VudGHDp8OjbyBkZXN0YSBsaWNlbsOnYSxvIGF1dG9yIChlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvciBjb25jZWRlIMOgIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRvIE1hcmFuaMOjbyAoVUZNQSkgbyBkaXJlaXRvIG7Do28tZXhjbHVzaXZvIGRlIHJlcHJvZHV6aXIsIHRyYWR1emlyIChjb25mb3JtZSBkZWZpbmlkbyBhYmFpeG8pLCBlL291IGRpc3RyaWJ1aXIgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIChpbmNsdWluZG8gbyByZXN1bW8pIHBvciB0b2RvIG8gbXVuZG8gbm8gZm9ybWF0byBpbXByZXNzbyBlIGVsZXRyw7RuaWNvIGUgZW0gcXVhbHF1ZXIgbWVpbywgaW5jbHVpbmRvIG9zIGZvcm1hdG9zIMOhdWRpbyBvdSB2w61kZW8uCgpWb2PDqiBjb25jb3JkYSBxdWUgYSBVRk1BIHBvZGUsIHNlbSBhbHRlcmFyIG8gY29udGXDumRvLCB0cmFuc3BvciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBhIFVGTUEgcG9kZSBtYW50ZXIgbWFpcyBkZSB1bWEgY8OzcGlhIGRlIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gcGFyYSBmaW5zIGRlIHNlZ3VyYW7Dp2EsIGJhY2stdXAgZSBwcmVzZXJ2YcOnw6NvLgoKVm9jw6ogZGVjbGFyYSBxdWUgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIMOpIG9yaWdpbmFsIGUgcXVlIHZvY8OqIHRlbSBvIHBvZGVyIGRlIGNvbmNlZGVyIG9zIGRpcmVpdG9zIGNvbnRpZG9zIG5lc3RhIGxpY2Vuw6dhLiBWb2PDqiB0YW1iw6ltIGRlY2xhcmEgcXVlIG8gZGVww7NzaXRvIGRhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gbsOjbywgcXVlIHNlamEgZGUgc2V1IGNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3XDqW0uCgpDYXNvIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiBkZWNsYXJhIHF1ZSBvYnRldmUgYSBwZXJtaXNzw6NvIGlycmVzdHJpdGEgZG8gZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIHBhcmEgY29uY2VkZXIgw6AgVUZNQSBvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgbmVzdGEgbGljZW7Dp2EsIGUgcXVlIGVzc2UgbWF0ZXJpYWwgZGUgcHJvcHJpZWRhZGUgZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBvcmEgZGVwb3NpdGFkYS4KCkNBU08gQSBURVNFIE9VIERJU1NFUlRBw4fDg08gT1JBIERFUE9TSVRBREEgVEVOSEEgU0lETyBSRVNVTFRBRE8gREUgVU0gUEFUUk9Dw41OSU8gT1UgQVBPSU8gREUgVU1BIEFHw4pOQ0lBIERFIEZPTUVOVE8gT1UgT1VUUk8gT1JHQU5JU01PIFFVRSBOw4NPIFNFSkEgQSBVRk1BLCBWT0PDiiBERUNMQVJBIFFVRSBSRVNQRUlUT1UgVE9ET1MgRSBRVUFJU1FVRVIgRElSRUlUT1MgREUgUkVWSVPDg08gQ09NTyBUQU1Cw4lNIEFTIERFTUFJUyBPQlJJR0HDh8OVRVMgRVhJR0lEQVMgUE9SIENPTlRSQVRPIE9VIEFDT1JETy4KCkEgVUZNQSBzZSBjb21wcm9tZXRlIGEgaWRlbnRpZmljYXIgY2xhcmFtZW50ZSBvIHNldSBub21lIG91IG8ocykgbm9tZShzKSBkbyhzKSBkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbywgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBhbMOpbSBkYXF1ZWxhcyBjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgoKRGVjbGFyYSB0YW1iw6ltIHF1ZSB0b2RhcyBhcyBhZmlsaWHDp8O1ZXMgY29ycG9yYXRpdmFzIG91IGluc3RpdHVjaW9uYWlzIGUgdG9kYXMgYXMgZm9udGVzIGRlIGFwb2lvIGZpbmFuY2Vpcm8gYW8gdHJhYmFsaG8gZXN0w6NvIGRldmlkYW1lbnRlIGNpdGFkYXMgb3UgbWVuY2lvbmFkYXMgZSBjZXJ0aWZpY2EgcXVlIG7Do28gaMOhIG5lbmh1bSBpbnRlcmVzc2UgY29tZXJjaWFsIG91IGFzc29jaWF0aXZvIHF1ZSByZXByZXNlbnRlIGNvbmZsaXRvIGRlIGludGVyZXNzZSBlbSBjb25leMOjbyBjb20gbyB0cmFiYWxobyBzdWJtZXRpZG8uCgoKCgoKCgo=Biblioteca Digital de Teses e Dissertaçõeshttps://tedebc.ufma.br/jspui/PUBhttp://tedebc.ufma.br:8080/oai/requestrepositorio@ufma.br||repositorio@ufma.bropendoar:21312022-12-14T18:06:25Biblioteca Digital de Teses e Dissertações da UFMA - Universidade Federal do Maranhão (UFMA)false
dc.title.por.fl_str_mv IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
dc.title.alternative.eng.fl_str_mv IC-MEG: A Specific Checklist for the Evaluation of Digital Educational Games on Mobile Platforms
title IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
spellingShingle IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
FRAZÃO, Kastney Albuquerque
Checklist de Inspeção;
Jogos Educacionais Digitais;
Aplicativos Móveis;
Análise de Comentários
Mobile Educational Games;
Inspection Checklist;
Mobile Applications;
Review analysis
Modelos Analíticos e de Simulação
title_short IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
title_full IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
title_fullStr IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
title_full_unstemmed IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
title_sort IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis
author FRAZÃO, Kastney Albuquerque
author_facet FRAZÃO, Kastney Albuquerque
author_role author
dc.contributor.advisor1.fl_str_mv RIVERO CABREJOS, Luis Jorge Enrique
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/8534667641706692
dc.contributor.advisor-co1.fl_str_mv SANTOS, Davi Viana dos
dc.contributor.advisor-co1Lattes.fl_str_mv http://lattes.cnpq.br/9297257833779277
dc.contributor.referee1.fl_str_mv RIVERO CABREJOS, Luis Jorge Enrique
dc.contributor.referee1Lattes.fl_str_mv http://lattes.cnpq.br/8534667641706692
dc.contributor.referee2.fl_str_mv SANTOS, Davi Viana dos
dc.contributor.referee2Lattes.fl_str_mv http://lattes.cnpq.br/9297257833779277
dc.contributor.referee3.fl_str_mv BRAZ JUNIOR, Geraldo
dc.contributor.referee3Lattes.fl_str_mv http://lattes.cnpq.br/8287861610873629
dc.contributor.referee4.fl_str_mv MARQUES, Anna Beatriz dos Santos
dc.contributor.referee4Lattes.fl_str_mv http://lattes.cnpq.br/5522150204610320
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/0259072196137901
dc.contributor.author.fl_str_mv FRAZÃO, Kastney Albuquerque
contributor_str_mv RIVERO CABREJOS, Luis Jorge Enrique
SANTOS, Davi Viana dos
RIVERO CABREJOS, Luis Jorge Enrique
SANTOS, Davi Viana dos
BRAZ JUNIOR, Geraldo
MARQUES, Anna Beatriz dos Santos
dc.subject.por.fl_str_mv Checklist de Inspeção;
Jogos Educacionais Digitais;
Aplicativos Móveis;
Análise de Comentários
topic Checklist de Inspeção;
Jogos Educacionais Digitais;
Aplicativos Móveis;
Análise de Comentários
Mobile Educational Games;
Inspection Checklist;
Mobile Applications;
Review analysis
Modelos Analíticos e de Simulação
dc.subject.eng.fl_str_mv Mobile Educational Games;
Inspection Checklist;
Mobile Applications;
Review analysis
dc.subject.cnpq.fl_str_mv Modelos Analíticos e de Simulação
description Digital educational games for mobile devices have become increasingly present in educa tional environments, where they have gained a lot of relevance in the educational and professional training of many people. These software are present in online app stores, where there is a specific place for their users to review the apps in the catalogs. Despite all the benefits that digital educational games have; these software still have quality problems pointed out by users. Problems in various areas, such as: the usability and functionality of the games; little adherence to the proposal and gameplay; besides, difficulty in supporting and mobility of games on users’ mobile devices. Several technologies for evaluating software have been proposed; however, there is still a need for research development to evaluate specific digital educational games for the mobile platform, while supporting software engineers in detecting defects in the evaluated games. This master’s thesis proposes an inspection checklist for the evaluation of digital educational games for mobile devices called IC-MEG, a support tool called TIMEG was also developed to provide support to the developed checklist; these technologies were developed to support development teams in evaluating their mobile digital educational games. We evaluated the acceptance of IC-MEG and TIMEG from the perspective of novice software engineers in an experimental study. When compared to mGBL and PHEG, other checklists in the literature, the results showed that the IC-MEG was perceived as useful and more complete. In addition, software engineers found the TIMEG tool useful and easy to understand, while suggesting improving its report to make it easier to understand and increase its use. The results of the experimental study indicated users’ satisfaction in reporting their experience with the IC-MEG checklist, while members of the development team agreed with the usefulness of the TIMEG report and its suggestions for improvement. By providing inspection support, we intend to support software engineers in the detection of defects in digital educational games for mobile devices developed, thus increasing their quality and acceptance in the market.
publishDate 2021
dc.date.issued.fl_str_mv 2021-09-28
dc.date.accessioned.fl_str_mv 2022-12-14T18:06:25Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv FRAZÃO, Kastney Albuquerque. IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis. 2021. 103 f. Dissertação( Programa de Pós-graduação em Ciência da Computação/CCET) - Universidade Federal do Maranhão, São Luís, 2021.
dc.identifier.uri.fl_str_mv https://tedebc.ufma.br/jspui/handle/tede/tede/4437
identifier_str_mv FRAZÃO, Kastney Albuquerque. IC-MEG: Um Checklist Específico para Avaliação de Jogos Educacionais Digitais em Plataformas Móveis. 2021. 103 f. Dissertação( Programa de Pós-graduação em Ciência da Computação/CCET) - Universidade Federal do Maranhão, São Luís, 2021.
url https://tedebc.ufma.br/jspui/handle/tede/tede/4437
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Federal do Maranhão
dc.publisher.program.fl_str_mv PROGRAMA DE PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO/CCET
dc.publisher.initials.fl_str_mv UFMA
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv DEPARTAMENTO DE INFORMÁTICA/CCET
publisher.none.fl_str_mv Universidade Federal do Maranhão
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFMA
instname:Universidade Federal do Maranhão (UFMA)
instacron:UFMA
instname_str Universidade Federal do Maranhão (UFMA)
instacron_str UFMA
institution UFMA
reponame_str Biblioteca Digital de Teses e Dissertações da UFMA
collection Biblioteca Digital de Teses e Dissertações da UFMA
bitstream.url.fl_str_mv http://tedebc.ufma.br:8080/bitstream/tede/4437/2/Kastney+Albuquerque+Fraz%C3%A3ovec.pdf
http://tedebc.ufma.br:8080/bitstream/tede/4437/1/license.txt
bitstream.checksum.fl_str_mv 0657ac19e306ab5c4373e172d71dc47a
97eeade1fce43278e63fe063657f8083
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFMA - Universidade Federal do Maranhão (UFMA)
repository.mail.fl_str_mv repositorio@ufma.br||repositorio@ufma.br
_version_ 1809926210822602752