Caracterização de desafios e estratégias de teste para sistemas adaptativos
Autor(a) principal: | |
---|---|
Data de Publicação: | 2016 |
Tipo de documento: | Dissertação |
Idioma: | por |
Título da fonte: | Repositório Institucional da UFSCAR |
Texto Completo: | https://repositorio.ufscar.br/handle/ufscar/8816 |
Resumo: | Context: Traditional testing approaches, considering the context of Adaptive Systems (ASs), have been evaluated incipiently and superficially with respect to their effectiveness in identifying faults. It is very clear the challenge of guaranteeing the correctness of ASs, due to the adaptive properties of these systems. Thus, the following question raises: how to characterise adequately and broadly the difficulties for testing ASs? There is not an approach that is driven by challenges found in the literature. Goals: In this work, we analysed and characterised the challenges faced by the testing activity when applied to ASSs. By characterising the challenges, we investigated testing strategies based on them. Methodology: In order to achieve the goals, we performed the following steps: (i) characterising the state-of-art of testing of ASs, using a Systematic Literature Review (SLR); (ii) investigating the challenges in source codes of real ASs that are available online in source code repositories; (iii) defining the testing strategy named T, based on the characterised challenges; (iv) defining the testing strategy T* based on the challenges and comprised by three testing approaches; (v) evaluating the effectiveness of the strategies T and T*; and (vi) investigating the challenges along the application of T and T*. Results: the main results were: (i) a characterisation of fine-grained and coarse-grained challenges for testing ASs; and (ii) two testing strategies based on such challenges. We evaluated the strategies by running an exploratory study which encompassed one AS and both testing strategies. Conclusion: The characterisation of challenges supported the definition and execution of the testing strategies. These strategies were able to reduce the impact of the challenges and to identify faults in the AS. |
id |
SCAR_208e605c36b7d4b158aae5d69553bb3f |
---|---|
oai_identifier_str |
oai:repositorio.ufscar.br:ufscar/8816 |
network_acronym_str |
SCAR |
network_name_str |
Repositório Institucional da UFSCAR |
repository_id_str |
4322 |
spelling |
Siqueira, Bento RafaelFerrari, Fabiano Cutigihttp://lattes.cnpq.br/3154345471250570http://lattes.cnpq.br/3238780932820205c61205c3-ccc7-4a9d-9071-b36cffb00b652017-06-01T19:49:40Z2017-06-01T19:49:40Z2016-06-30SIQUEIRA, Bento Rafael. Caracterização de desafios e estratégias de teste para sistemas adaptativos. 2016. Dissertação (Mestrado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2016. Disponível em: https://repositorio.ufscar.br/handle/ufscar/8816.https://repositorio.ufscar.br/handle/ufscar/8816Context: Traditional testing approaches, considering the context of Adaptive Systems (ASs), have been evaluated incipiently and superficially with respect to their effectiveness in identifying faults. It is very clear the challenge of guaranteeing the correctness of ASs, due to the adaptive properties of these systems. Thus, the following question raises: how to characterise adequately and broadly the difficulties for testing ASs? There is not an approach that is driven by challenges found in the literature. Goals: In this work, we analysed and characterised the challenges faced by the testing activity when applied to ASSs. By characterising the challenges, we investigated testing strategies based on them. Methodology: In order to achieve the goals, we performed the following steps: (i) characterising the state-of-art of testing of ASs, using a Systematic Literature Review (SLR); (ii) investigating the challenges in source codes of real ASs that are available online in source code repositories; (iii) defining the testing strategy named T, based on the characterised challenges; (iv) defining the testing strategy T* based on the challenges and comprised by three testing approaches; (v) evaluating the effectiveness of the strategies T and T*; and (vi) investigating the challenges along the application of T and T*. Results: the main results were: (i) a characterisation of fine-grained and coarse-grained challenges for testing ASs; and (ii) two testing strategies based on such challenges. We evaluated the strategies by running an exploratory study which encompassed one AS and both testing strategies. Conclusion: The characterisation of challenges supported the definition and execution of the testing strategies. These strategies were able to reduce the impact of the challenges and to identify faults in the AS.Contexto: Abordagens de teste tradicionais sao ainda incipientes e superficialmente avaliadas quanto a sua efetividade em revelar defeitos em Sistemas Adaptativos (SAs). E nítido o desafio de garantir a corretude de SAs levando-se em consideração as características de adaptacao desses sistemas, culminando na seguinte pergunta: como caracterizar adequadamente, de forma abrangente, as dificuldades para se testar SAs? Na literatura nao foi encontrada qualquer estrategia de teste que seja guiada por desafios de teste caracterizados. Objetivos: Neste trabalho buscou-se compreender e caracterizar os desafios impostos a atividade de teste de SAs. Uma vez caracterizados, os desafios, propos-se investigar estrategias de teste baseadas nestes desafios. Metodologia: Para atingir o objetivo seguiram-se as etapas: (i) caracterizacao do estado da arte por meio de uma Revisao Sistematica (RS); (ii) investigacao da existencia de desafios de teste em SAs presentes em repositórios de código-fonte; (iii) definho de uma estrategia de teste, denominada T, com base nos desafios caracterizados da RS; (iv) definicao de uma estrategia de teste combinada, denominada T*, composta por três abordagens de teste; (v) avaliaçao da efetividade das estrategias T e T*; e, por fim, (vi) investigacao da presença dos desafios nos SAs analisados, por meio das estrategias T e T*. Resultados: Os principais resultados foram: (i) uma caraterizacao de desafios para o teste de SAs; e (ii) e uma definicao de estrategias de teste baseadas nos desafios caracterizados. A avaliacao foi realizada com a aplicacao de um estudo exploratório, utilizando um SA, de uma estrategia de teste somente baseada em desafios (T) e de uma estrategia de teste baseada em desafios combinada com outras abordagens (T*), a fim de comparar os resultados de ambas as estrategias. Conclusão: A caracterizacao dos desafios auxiliou na definicao e execucao de estrategias de teste, as quais mitigaram os desafios presentes nos SAs e puderam identificar defeitos.Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)porUniversidade Federal de São CarlosCâmpus São CarlosPrograma de Pós-Graduação em Ciência da Computação - PPGCCUFSCarSistemas adaptativosTeste de softwareDesafios de testeSistemas sensíveis ao contextoAdaptive systemsSoftware testingTesting challengesContext-aware systemsCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOCaracterização de desafios e estratégias de teste para sistemas adaptativosinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisOnline6006006b0a8934-16f6-40c0-95e1-34d73ec115c8info:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFSCARinstname:Universidade Federal de São Carlos (UFSCAR)instacron:UFSCARORIGINALDissBRS.pdfDissBRS.pdfapplication/pdf3255630https://repositorio.ufscar.br/bitstream/ufscar/8816/1/DissBRS.pdfe4d94f1ee923813cfd91e76e992dbfa8MD51LICENSElicense.txtlicense.txttext/plain; charset=utf-81957https://repositorio.ufscar.br/bitstream/ufscar/8816/2/license.txtae0398b6f8b235e40ad82cba6c50031dMD52TEXTDissBRS.pdf.txtDissBRS.pdf.txtExtracted texttext/plain359497https://repositorio.ufscar.br/bitstream/ufscar/8816/3/DissBRS.pdf.txt8c8e27af564b1cfd7c555784b9d7060dMD53THUMBNAILDissBRS.pdf.jpgDissBRS.pdf.jpgIM Thumbnailimage/jpeg4036https://repositorio.ufscar.br/bitstream/ufscar/8816/4/DissBRS.pdf.jpg68297393bfd1539dd161f1766413c01bMD54ufscar/88162023-09-18 18:31:24.17oai:repositorio.ufscar.br:ufscar/8816TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgw6AgVW5pdmVyc2lkYWRlCkZlZGVyYWwgZGUgU8OjbyBDYXJsb3MgbyBkaXJlaXRvIG7Do28tZXhjbHVzaXZvIGRlIHJlcHJvZHV6aXIsICB0cmFkdXppciAoY29uZm9ybWUgZGVmaW5pZG8gYWJhaXhvKSwgZS9vdQpkaXN0cmlidWlyIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyAoaW5jbHVpbmRvIG8gcmVzdW1vKSBwb3IgdG9kbyBvIG11bmRvIG5vIGZvcm1hdG8gaW1wcmVzc28gZSBlbGV0csO0bmljbyBlCmVtIHF1YWxxdWVyIG1laW8sIGluY2x1aW5kbyBvcyBmb3JtYXRvcyDDoXVkaW8gb3UgdsOtZGVvLgoKVm9jw6ogY29uY29yZGEgcXVlIGEgVUZTQ2FyIHBvZGUsIHNlbSBhbHRlcmFyIG8gY29udGXDumRvLCB0cmFuc3BvciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28KcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBhIFVGU0NhciBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgYSBzdWEgdGVzZSBvdQpkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcwpuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0byBkYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG7Do28sIHF1ZSBzZWphIGRlIHNldQpjb25oZWNpbWVudG8sIGluZnJpbmdlIGRpcmVpdG9zIGF1dG9yYWlzIGRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6oKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFVGU0NhcgpvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgbmVzdGEgbGljZW7Dp2EsIGUgcXVlIGVzc2UgbWF0ZXJpYWwgZGUgcHJvcHJpZWRhZGUgZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUKaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBvcmEgZGVwb3NpdGFkYS4KCkNBU08gQSBURVNFIE9VIERJU1NFUlRBw4fDg08gT1JBIERFUE9TSVRBREEgVEVOSEEgU0lETyBSRVNVTFRBRE8gREUgVU0gUEFUUk9Dw41OSU8gT1UKQVBPSU8gREUgVU1BIEFHw4pOQ0lBIERFIEZPTUVOVE8gT1UgT1VUUk8gT1JHQU5JU01PIFFVRSBOw4NPIFNFSkEgQSBVRlNDYXIsClZPQ8OKIERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJU8ODTyBDT01PClRBTULDiU0gQVMgREVNQUlTIE9CUklHQcOHw5VFUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBVRlNDYXIgc2UgY29tcHJvbWV0ZSBhIGlkZW50aWZpY2FyIGNsYXJhbWVudGUgbyBzZXUgbm9tZSAocykgb3UgbyhzKSBub21lKHMpIGRvKHMpCmRldGVudG9yKGVzKSBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzCmNvbmNlZGlkYXMgcG9yIGVzdGEgbGljZW7Dp2EuCg==Repositório InstitucionalPUBhttps://repositorio.ufscar.br/oai/requestopendoar:43222023-09-18T18:31:24Repositório Institucional da UFSCAR - Universidade Federal de São Carlos (UFSCAR)false |
dc.title.por.fl_str_mv |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
title |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
spellingShingle |
Caracterização de desafios e estratégias de teste para sistemas adaptativos Siqueira, Bento Rafael Sistemas adaptativos Teste de software Desafios de teste Sistemas sensíveis ao contexto Adaptive systems Software testing Testing challenges Context-aware systems CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO |
title_short |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
title_full |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
title_fullStr |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
title_full_unstemmed |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
title_sort |
Caracterização de desafios e estratégias de teste para sistemas adaptativos |
author |
Siqueira, Bento Rafael |
author_facet |
Siqueira, Bento Rafael |
author_role |
author |
dc.contributor.authorlattes.por.fl_str_mv |
http://lattes.cnpq.br/3238780932820205 |
dc.contributor.author.fl_str_mv |
Siqueira, Bento Rafael |
dc.contributor.advisor1.fl_str_mv |
Ferrari, Fabiano Cutigi |
dc.contributor.advisor1Lattes.fl_str_mv |
http://lattes.cnpq.br/3154345471250570 |
dc.contributor.authorID.fl_str_mv |
c61205c3-ccc7-4a9d-9071-b36cffb00b65 |
contributor_str_mv |
Ferrari, Fabiano Cutigi |
dc.subject.por.fl_str_mv |
Sistemas adaptativos Teste de software Desafios de teste Sistemas sensíveis ao contexto |
topic |
Sistemas adaptativos Teste de software Desafios de teste Sistemas sensíveis ao contexto Adaptive systems Software testing Testing challenges Context-aware systems CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO |
dc.subject.eng.fl_str_mv |
Adaptive systems Software testing Testing challenges Context-aware systems |
dc.subject.cnpq.fl_str_mv |
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO |
description |
Context: Traditional testing approaches, considering the context of Adaptive Systems (ASs), have been evaluated incipiently and superficially with respect to their effectiveness in identifying faults. It is very clear the challenge of guaranteeing the correctness of ASs, due to the adaptive properties of these systems. Thus, the following question raises: how to characterise adequately and broadly the difficulties for testing ASs? There is not an approach that is driven by challenges found in the literature. Goals: In this work, we analysed and characterised the challenges faced by the testing activity when applied to ASSs. By characterising the challenges, we investigated testing strategies based on them. Methodology: In order to achieve the goals, we performed the following steps: (i) characterising the state-of-art of testing of ASs, using a Systematic Literature Review (SLR); (ii) investigating the challenges in source codes of real ASs that are available online in source code repositories; (iii) defining the testing strategy named T, based on the characterised challenges; (iv) defining the testing strategy T* based on the challenges and comprised by three testing approaches; (v) evaluating the effectiveness of the strategies T and T*; and (vi) investigating the challenges along the application of T and T*. Results: the main results were: (i) a characterisation of fine-grained and coarse-grained challenges for testing ASs; and (ii) two testing strategies based on such challenges. We evaluated the strategies by running an exploratory study which encompassed one AS and both testing strategies. Conclusion: The characterisation of challenges supported the definition and execution of the testing strategies. These strategies were able to reduce the impact of the challenges and to identify faults in the AS. |
publishDate |
2016 |
dc.date.issued.fl_str_mv |
2016-06-30 |
dc.date.accessioned.fl_str_mv |
2017-06-01T19:49:40Z |
dc.date.available.fl_str_mv |
2017-06-01T19:49:40Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
SIQUEIRA, Bento Rafael. Caracterização de desafios e estratégias de teste para sistemas adaptativos. 2016. Dissertação (Mestrado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2016. Disponível em: https://repositorio.ufscar.br/handle/ufscar/8816. |
dc.identifier.uri.fl_str_mv |
https://repositorio.ufscar.br/handle/ufscar/8816 |
identifier_str_mv |
SIQUEIRA, Bento Rafael. Caracterização de desafios e estratégias de teste para sistemas adaptativos. 2016. Dissertação (Mestrado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2016. Disponível em: https://repositorio.ufscar.br/handle/ufscar/8816. |
url |
https://repositorio.ufscar.br/handle/ufscar/8816 |
dc.language.iso.fl_str_mv |
por |
language |
por |
dc.relation.confidence.fl_str_mv |
600 600 |
dc.relation.authority.fl_str_mv |
6b0a8934-16f6-40c0-95e1-34d73ec115c8 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.publisher.none.fl_str_mv |
Universidade Federal de São Carlos Câmpus São Carlos |
dc.publisher.program.fl_str_mv |
Programa de Pós-Graduação em Ciência da Computação - PPGCC |
dc.publisher.initials.fl_str_mv |
UFSCar |
publisher.none.fl_str_mv |
Universidade Federal de São Carlos Câmpus São Carlos |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UFSCAR instname:Universidade Federal de São Carlos (UFSCAR) instacron:UFSCAR |
instname_str |
Universidade Federal de São Carlos (UFSCAR) |
instacron_str |
UFSCAR |
institution |
UFSCAR |
reponame_str |
Repositório Institucional da UFSCAR |
collection |
Repositório Institucional da UFSCAR |
bitstream.url.fl_str_mv |
https://repositorio.ufscar.br/bitstream/ufscar/8816/1/DissBRS.pdf https://repositorio.ufscar.br/bitstream/ufscar/8816/2/license.txt https://repositorio.ufscar.br/bitstream/ufscar/8816/3/DissBRS.pdf.txt https://repositorio.ufscar.br/bitstream/ufscar/8816/4/DissBRS.pdf.jpg |
bitstream.checksum.fl_str_mv |
e4d94f1ee923813cfd91e76e992dbfa8 ae0398b6f8b235e40ad82cba6c50031d 8c8e27af564b1cfd7c555784b9d7060d 68297393bfd1539dd161f1766413c01b |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Repositório Institucional da UFSCAR - Universidade Federal de São Carlos (UFSCAR) |
repository.mail.fl_str_mv |
|
_version_ |
1802136322726428672 |