Investigation of similarity-based test case selection for specification-based regression testing.

Detalhes bibliográficos
Autor(a) principal: OLIVEIRA NETO, Francisco Gomes de.
Data de Publicação: 2014
Tipo de documento: Tese
Idioma: eng
Título da fonte: Biblioteca Digital de Teses e Dissertações da UFCG
Texto Completo: http://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360
Resumo: uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.
id UFCG_65dc6c0f0c8f58f35db4f6b28c89119a
oai_identifier_str oai:localhost:riufcg/360
network_acronym_str UFCG
network_name_str Biblioteca Digital de Teses e Dissertações da UFCG
repository_id_str 4851
spelling Investigation of similarity-based test case selection for specification-based regression testing.Engenharia de softwareModel-Based Testing (MBT)Automatic Model GenerationSpecification-Based Regression TestingSimilarityApproachforRegression TestingTeste de regressãoTeste de softwareCiência da Computação.uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.During software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.Universidade Federal de Campina GrandeBrasilCentro de Engenharia Elétrica e Informática - CEEIPÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃOUFCGMACHADO, Patrícia Duarte de Lima.MACHADO, P. D. L.http://lattes.cnpq.br/2495918356675019CARTAXO, Emanuela Gadelha.ARANHA, Eduardo Henrique da Silva.MASSONI, Tiago Lima.SIMÃO, Adenildo da Silva.OLIVEIRA NETO, Francisco Gomes de.2014-07-302018-04-10T20:00:05Z2018-04-102018-04-10T20:00:05Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesishttp://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: http://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360enginfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFCGinstname:Universidade Federal de Campina Grande (UFCG)instacron:UFCG2022-03-14T19:42:58Zoai:localhost:riufcg/360Biblioteca Digital de Teses e Dissertaçõeshttp://bdtd.ufcg.edu.br/PUBhttp://dspace.sti.ufcg.edu.br:8080/oai/requestbdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.bropendoar:48512022-03-14T19:42:58Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)false
dc.title.none.fl_str_mv Investigation of similarity-based test case selection for specification-based regression testing.
title Investigation of similarity-based test case selection for specification-based regression testing.
spellingShingle Investigation of similarity-based test case selection for specification-based regression testing.
OLIVEIRA NETO, Francisco Gomes de.
Engenharia de software
Model-Based Testing (MBT)
Automatic Model Generation
Specification-Based Regression Testing
SimilarityApproachforRegression Testing
Teste de regressão
Teste de software
Ciência da Computação.
title_short Investigation of similarity-based test case selection for specification-based regression testing.
title_full Investigation of similarity-based test case selection for specification-based regression testing.
title_fullStr Investigation of similarity-based test case selection for specification-based regression testing.
title_full_unstemmed Investigation of similarity-based test case selection for specification-based regression testing.
title_sort Investigation of similarity-based test case selection for specification-based regression testing.
author OLIVEIRA NETO, Francisco Gomes de.
author_facet OLIVEIRA NETO, Francisco Gomes de.
author_role author
dc.contributor.none.fl_str_mv MACHADO, Patrícia Duarte de Lima.
MACHADO, P. D. L.
http://lattes.cnpq.br/2495918356675019
CARTAXO, Emanuela Gadelha.
ARANHA, Eduardo Henrique da Silva.
MASSONI, Tiago Lima.
SIMÃO, Adenildo da Silva.
dc.contributor.author.fl_str_mv OLIVEIRA NETO, Francisco Gomes de.
dc.subject.por.fl_str_mv Engenharia de software
Model-Based Testing (MBT)
Automatic Model Generation
Specification-Based Regression Testing
SimilarityApproachforRegression Testing
Teste de regressão
Teste de software
Ciência da Computação.
topic Engenharia de software
Model-Based Testing (MBT)
Automatic Model Generation
Specification-Based Regression Testing
SimilarityApproachforRegression Testing
Teste de regressão
Teste de software
Ciência da Computação.
description uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.
publishDate 2014
dc.date.none.fl_str_mv 2014-07-30
2018-04-10T20:00:05Z
2018-04-10
2018-04-10T20:00:05Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360
OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: http://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360
url http://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360
identifier_str_mv OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: http://dspace.sti.ufcg.edu.br:8080/jspui/handle/riufcg/360
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Campina Grande
Brasil
Centro de Engenharia Elétrica e Informática - CEEI
PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
UFCG
publisher.none.fl_str_mv Universidade Federal de Campina Grande
Brasil
Centro de Engenharia Elétrica e Informática - CEEI
PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
UFCG
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFCG
instname:Universidade Federal de Campina Grande (UFCG)
instacron:UFCG
instname_str Universidade Federal de Campina Grande (UFCG)
instacron_str UFCG
institution UFCG
reponame_str Biblioteca Digital de Teses e Dissertações da UFCG
collection Biblioteca Digital de Teses e Dissertações da UFCG
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)
repository.mail.fl_str_mv bdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.br
_version_ 1809744349257269248