Caracterização de desafios e estratégias de teste para sistemas adaptativos

Detalhes bibliográficos
Autor(a) principal: Siqueira, Bento Rafael
Data de Publicação: 2016
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Repositório Institucional da UFSCAR
Texto Completo: https://repositorio.ufscar.br/handle/ufscar/8816
Resumo: Context: Traditional testing approaches, considering the context of Adaptive Systems (ASs), have been evaluated incipiently and superficially with respect to their effectiveness in identifying faults. It is very clear the challenge of guaranteeing the correctness of ASs, due to the adaptive properties of these systems. Thus, the following question raises: how to characterise adequately and broadly the difficulties for testing ASs? There is not an approach that is driven by challenges found in the literature. Goals: In this work, we analysed and characterised the challenges faced by the testing activity when applied to ASSs. By characterising the challenges, we investigated testing strategies based on them. Methodology: In order to achieve the goals, we performed the following steps: (i) characterising the state-of-art of testing of ASs, using a Systematic Literature Review (SLR); (ii) investigating the challenges in source codes of real ASs that are available online in source code repositories; (iii) defining the testing strategy named T, based on the characterised challenges; (iv) defining the testing strategy T* based on the challenges and comprised by three testing approaches; (v) evaluating the effectiveness of the strategies T and T*; and (vi) investigating the challenges along the application of T and T*. Results: the main results were: (i) a characterisation of fine-grained and coarse-grained challenges for testing ASs; and (ii) two testing strategies based on such challenges. We evaluated the strategies by running an exploratory study which encompassed one AS and both testing strategies. Conclusion: The characterisation of challenges supported the definition and execution of the testing strategies. These strategies were able to reduce the impact of the challenges and to identify faults in the AS.
id SCAR_208e605c36b7d4b158aae5d69553bb3f
oai_identifier_str oai:repositorio.ufscar.br:ufscar/8816
network_acronym_str SCAR
network_name_str Repositório Institucional da UFSCAR
repository_id_str 4322
spelling Siqueira, Bento RafaelFerrari, Fabiano Cutigihttp://lattes.cnpq.br/3154345471250570http://lattes.cnpq.br/3238780932820205c61205c3-ccc7-4a9d-9071-b36cffb00b652017-06-01T19:49:40Z2017-06-01T19:49:40Z2016-06-30SIQUEIRA, Bento Rafael. Caracterização de desafios e estratégias de teste para sistemas adaptativos. 2016. Dissertação (Mestrado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2016. Disponível em: https://repositorio.ufscar.br/handle/ufscar/8816.https://repositorio.ufscar.br/handle/ufscar/8816Context: Traditional testing approaches, considering the context of Adaptive Systems (ASs), have been evaluated incipiently and superficially with respect to their effectiveness in identifying faults. It is very clear the challenge of guaranteeing the correctness of ASs, due to the adaptive properties of these systems. Thus, the following question raises: how to characterise adequately and broadly the difficulties for testing ASs? There is not an approach that is driven by challenges found in the literature. Goals: In this work, we analysed and characterised the challenges faced by the testing activity when applied to ASSs. By characterising the challenges, we investigated testing strategies based on them. Methodology: In order to achieve the goals, we performed the following steps: (i) characterising the state-of-art of testing of ASs, using a Systematic Literature Review (SLR); (ii) investigating the challenges in source codes of real ASs that are available online in source code repositories; (iii) defining the testing strategy named T, based on the characterised challenges; (iv) defining the testing strategy T* based on the challenges and comprised by three testing approaches; (v) evaluating the effectiveness of the strategies T and T*; and (vi) investigating the challenges along the application of T and T*. Results: the main results were: (i) a characterisation of fine-grained and coarse-grained challenges for testing ASs; and (ii) two testing strategies based on such challenges. We evaluated the strategies by running an exploratory study which encompassed one AS and both testing strategies. Conclusion: The characterisation of challenges supported the definition and execution of the testing strategies. These strategies were able to reduce the impact of the challenges and to identify faults in the AS.Contexto: Abordagens de teste tradicionais sao ainda incipientes e superficialmente avaliadas quanto a sua efetividade em revelar defeitos em Sistemas Adaptativos (SAs). E nítido o desafio de garantir a corretude de SAs levando-se em consideração as características de adaptacao desses sistemas, culminando na seguinte pergunta: como caracterizar adequadamente, de forma abrangente, as dificuldades para se testar SAs? Na literatura nao foi encontrada qualquer estrategia de teste que seja guiada por desafios de teste caracterizados. Objetivos: Neste trabalho buscou-se compreender e caracterizar os desafios impostos a atividade de teste de SAs. Uma vez caracterizados, os desafios, propos-se investigar estrategias de teste baseadas nestes desafios. Metodologia: Para atingir o objetivo seguiram-se as etapas: (i) caracterizacao do estado da arte por meio de uma Revisao Sistematica (RS); (ii) investigacao da existencia de desafios de teste em SAs presentes em repositórios de código-fonte; (iii) definho de uma estrategia de teste, denominada T, com base nos desafios caracterizados da RS; (iv) definicao de uma estrategia de teste combinada, denominada T*, composta por três abordagens de teste; (v) avaliaçao da efetividade das estrategias T e T*; e, por fim, (vi) investigacao da presença dos desafios nos SAs analisados, por meio das estrategias T e T*. Resultados: Os principais resultados foram: (i) uma caraterizacao de desafios para o teste de SAs; e (ii) e uma definicao de estrategias de teste baseadas nos desafios caracterizados. A avaliacao foi realizada com a aplicacao de um estudo exploratório, utilizando um SA, de uma estrategia de teste somente baseada em desafios (T) e de uma estrategia de teste baseada em desafios combinada com outras abordagens (T*), a fim de comparar os resultados de ambas as estrategias. Conclusão: A caracterizacao dos desafios auxiliou na definicao e execucao de estrategias de teste, as quais mitigaram os desafios presentes nos SAs e puderam identificar defeitos.Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)porUniversidade Federal de São CarlosCâmpus São CarlosPrograma de Pós-Graduação em Ciência da Computação - PPGCCUFSCarSistemas adaptativosTeste de softwareDesafios de testeSistemas sensíveis ao contextoAdaptive systemsSoftware testingTesting challengesContext-aware systemsCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOCaracterização de desafios e estratégias de teste para sistemas adaptativosinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisOnline6006006b0a8934-16f6-40c0-95e1-34d73ec115c8info:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFSCARinstname:Universidade Federal de São Carlos (UFSCAR)instacron:UFSCARORIGINALDissBRS.pdfDissBRS.pdfapplication/pdf3255630https://repositorio.ufscar.br/bitstream/ufscar/8816/1/DissBRS.pdfe4d94f1ee923813cfd91e76e992dbfa8MD51LICENSElicense.txtlicense.txttext/plain; charset=utf-81957https://repositorio.ufscar.br/bitstream/ufscar/8816/2/license.txtae0398b6f8b235e40ad82cba6c50031dMD52TEXTDissBRS.pdf.txtDissBRS.pdf.txtExtracted texttext/plain359497https://repositorio.ufscar.br/bitstream/ufscar/8816/3/DissBRS.pdf.txt8c8e27af564b1cfd7c555784b9d7060dMD53THUMBNAILDissBRS.pdf.jpgDissBRS.pdf.jpgIM Thumbnailimage/jpeg4036https://repositorio.ufscar.br/bitstream/ufscar/8816/4/DissBRS.pdf.jpg68297393bfd1539dd161f1766413c01bMD54ufscar/88162023-09-18 18:31:24.17oai:repositorio.ufscar.br:ufscar/8816TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgw6AgVW5pdmVyc2lkYWRlCkZlZGVyYWwgZGUgU8OjbyBDYXJsb3MgbyBkaXJlaXRvIG7Do28tZXhjbHVzaXZvIGRlIHJlcHJvZHV6aXIsICB0cmFkdXppciAoY29uZm9ybWUgZGVmaW5pZG8gYWJhaXhvKSwgZS9vdQpkaXN0cmlidWlyIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyAoaW5jbHVpbmRvIG8gcmVzdW1vKSBwb3IgdG9kbyBvIG11bmRvIG5vIGZvcm1hdG8gaW1wcmVzc28gZSBlbGV0csO0bmljbyBlCmVtIHF1YWxxdWVyIG1laW8sIGluY2x1aW5kbyBvcyBmb3JtYXRvcyDDoXVkaW8gb3UgdsOtZGVvLgoKVm9jw6ogY29uY29yZGEgcXVlIGEgVUZTQ2FyIHBvZGUsIHNlbSBhbHRlcmFyIG8gY29udGXDumRvLCB0cmFuc3BvciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28KcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBhIFVGU0NhciBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgYSBzdWEgdGVzZSBvdQpkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcwpuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0byBkYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG7Do28sIHF1ZSBzZWphIGRlIHNldQpjb25oZWNpbWVudG8sIGluZnJpbmdlIGRpcmVpdG9zIGF1dG9yYWlzIGRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6oKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFVGU0NhcgpvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgbmVzdGEgbGljZW7Dp2EsIGUgcXVlIGVzc2UgbWF0ZXJpYWwgZGUgcHJvcHJpZWRhZGUgZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUKaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBvcmEgZGVwb3NpdGFkYS4KCkNBU08gQSBURVNFIE9VIERJU1NFUlRBw4fDg08gT1JBIERFUE9TSVRBREEgVEVOSEEgU0lETyBSRVNVTFRBRE8gREUgVU0gUEFUUk9Dw41OSU8gT1UKQVBPSU8gREUgVU1BIEFHw4pOQ0lBIERFIEZPTUVOVE8gT1UgT1VUUk8gT1JHQU5JU01PIFFVRSBOw4NPIFNFSkEgQSBVRlNDYXIsClZPQ8OKIERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJU8ODTyBDT01PClRBTULDiU0gQVMgREVNQUlTIE9CUklHQcOHw5VFUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBVRlNDYXIgc2UgY29tcHJvbWV0ZSBhIGlkZW50aWZpY2FyIGNsYXJhbWVudGUgbyBzZXUgbm9tZSAocykgb3UgbyhzKSBub21lKHMpIGRvKHMpCmRldGVudG9yKGVzKSBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzCmNvbmNlZGlkYXMgcG9yIGVzdGEgbGljZW7Dp2EuCg==Repositório InstitucionalPUBhttps://repositorio.ufscar.br/oai/requestopendoar:43222023-09-18T18:31:24Repositório Institucional da UFSCAR - Universidade Federal de São Carlos (UFSCAR)false
dc.title.por.fl_str_mv Caracterização de desafios e estratégias de teste para sistemas adaptativos
title Caracterização de desafios e estratégias de teste para sistemas adaptativos
spellingShingle Caracterização de desafios e estratégias de teste para sistemas adaptativos
Siqueira, Bento Rafael
Sistemas adaptativos
Teste de software
Desafios de teste
Sistemas sensíveis ao contexto
Adaptive systems
Software testing
Testing challenges
Context-aware systems
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
title_short Caracterização de desafios e estratégias de teste para sistemas adaptativos
title_full Caracterização de desafios e estratégias de teste para sistemas adaptativos
title_fullStr Caracterização de desafios e estratégias de teste para sistemas adaptativos
title_full_unstemmed Caracterização de desafios e estratégias de teste para sistemas adaptativos
title_sort Caracterização de desafios e estratégias de teste para sistemas adaptativos
author Siqueira, Bento Rafael
author_facet Siqueira, Bento Rafael
author_role author
dc.contributor.authorlattes.por.fl_str_mv http://lattes.cnpq.br/3238780932820205
dc.contributor.author.fl_str_mv Siqueira, Bento Rafael
dc.contributor.advisor1.fl_str_mv Ferrari, Fabiano Cutigi
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/3154345471250570
dc.contributor.authorID.fl_str_mv c61205c3-ccc7-4a9d-9071-b36cffb00b65
contributor_str_mv Ferrari, Fabiano Cutigi
dc.subject.por.fl_str_mv Sistemas adaptativos
Teste de software
Desafios de teste
Sistemas sensíveis ao contexto
topic Sistemas adaptativos
Teste de software
Desafios de teste
Sistemas sensíveis ao contexto
Adaptive systems
Software testing
Testing challenges
Context-aware systems
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
dc.subject.eng.fl_str_mv Adaptive systems
Software testing
Testing challenges
Context-aware systems
dc.subject.cnpq.fl_str_mv CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
description Context: Traditional testing approaches, considering the context of Adaptive Systems (ASs), have been evaluated incipiently and superficially with respect to their effectiveness in identifying faults. It is very clear the challenge of guaranteeing the correctness of ASs, due to the adaptive properties of these systems. Thus, the following question raises: how to characterise adequately and broadly the difficulties for testing ASs? There is not an approach that is driven by challenges found in the literature. Goals: In this work, we analysed and characterised the challenges faced by the testing activity when applied to ASSs. By characterising the challenges, we investigated testing strategies based on them. Methodology: In order to achieve the goals, we performed the following steps: (i) characterising the state-of-art of testing of ASs, using a Systematic Literature Review (SLR); (ii) investigating the challenges in source codes of real ASs that are available online in source code repositories; (iii) defining the testing strategy named T, based on the characterised challenges; (iv) defining the testing strategy T* based on the challenges and comprised by three testing approaches; (v) evaluating the effectiveness of the strategies T and T*; and (vi) investigating the challenges along the application of T and T*. Results: the main results were: (i) a characterisation of fine-grained and coarse-grained challenges for testing ASs; and (ii) two testing strategies based on such challenges. We evaluated the strategies by running an exploratory study which encompassed one AS and both testing strategies. Conclusion: The characterisation of challenges supported the definition and execution of the testing strategies. These strategies were able to reduce the impact of the challenges and to identify faults in the AS.
publishDate 2016
dc.date.issued.fl_str_mv 2016-06-30
dc.date.accessioned.fl_str_mv 2017-06-01T19:49:40Z
dc.date.available.fl_str_mv 2017-06-01T19:49:40Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv SIQUEIRA, Bento Rafael. Caracterização de desafios e estratégias de teste para sistemas adaptativos. 2016. Dissertação (Mestrado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2016. Disponível em: https://repositorio.ufscar.br/handle/ufscar/8816.
dc.identifier.uri.fl_str_mv https://repositorio.ufscar.br/handle/ufscar/8816
identifier_str_mv SIQUEIRA, Bento Rafael. Caracterização de desafios e estratégias de teste para sistemas adaptativos. 2016. Dissertação (Mestrado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2016. Disponível em: https://repositorio.ufscar.br/handle/ufscar/8816.
url https://repositorio.ufscar.br/handle/ufscar/8816
dc.language.iso.fl_str_mv por
language por
dc.relation.confidence.fl_str_mv 600
600
dc.relation.authority.fl_str_mv 6b0a8934-16f6-40c0-95e1-34d73ec115c8
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de São Carlos
Câmpus São Carlos
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Ciência da Computação - PPGCC
dc.publisher.initials.fl_str_mv UFSCar
publisher.none.fl_str_mv Universidade Federal de São Carlos
Câmpus São Carlos
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFSCAR
instname:Universidade Federal de São Carlos (UFSCAR)
instacron:UFSCAR
instname_str Universidade Federal de São Carlos (UFSCAR)
instacron_str UFSCAR
institution UFSCAR
reponame_str Repositório Institucional da UFSCAR
collection Repositório Institucional da UFSCAR
bitstream.url.fl_str_mv https://repositorio.ufscar.br/bitstream/ufscar/8816/1/DissBRS.pdf
https://repositorio.ufscar.br/bitstream/ufscar/8816/2/license.txt
https://repositorio.ufscar.br/bitstream/ufscar/8816/3/DissBRS.pdf.txt
https://repositorio.ufscar.br/bitstream/ufscar/8816/4/DissBRS.pdf.jpg
bitstream.checksum.fl_str_mv e4d94f1ee923813cfd91e76e992dbfa8
ae0398b6f8b235e40ad82cba6c50031d
8c8e27af564b1cfd7c555784b9d7060d
68297393bfd1539dd161f1766413c01b
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFSCAR - Universidade Federal de São Carlos (UFSCAR)
repository.mail.fl_str_mv
_version_ 1802136322726428672