A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
Autor(a) principal: | |
---|---|
Data de Publicação: | 2018 |
Tipo de documento: | Tese |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UFPE |
Texto Completo: | https://repositorio.ufpe.br/handle/123456789/32145 |
Resumo: | Inspired by the promising results of Evidence Based Medicine (EBM), Evidence Based Software Engineering (EBSE) was introduced more than one decade ago. One of EBSE’s main goal is to integrate the best research evidence with Software Engineering (SE) practice. However, some claim Secondary Studies (SSs) — one of the main products of EBSE — lack connection with SE practice. To better understand this claim, the first contribution of this thesis is an analysis on how SSs are related to problems faced in SE practice. We introduced a coverage technique to compare topics investigated by SSs and issues practitioners report in Stack Exchange Q&A websites. We could observe a low coverage (15.6%), which corroborates with the claims about lack of connection between SSs and SE practice. Motivated by the findings of our first contribution, and inspired by recent advances in EBM, we propose a model to transfer knowledge from SSs to SE practice. The model adhere to two of the most prominent approaches proposed in EBM: Rapid Reviews (a lightweight research method that focus on understanding practitioners problems, and mitigating them with evidence delivered in a timely manner), and Evidence Briefings (one-page documents summarizing the main findings of an empirical study). To evaluate the EBs, we created 12 of them based on one SS each, and conducted two surveys. One with the authors of the SSs, and other with practitioners that reported issues considered as covered by the SSs. Both practitioners (32) and researchers (7), positively evaluated the EBs. We also invited authors of papers published in four SE conferences to create EBs of their papers. We conducted another survey to evaluate their perceptions. The positive results show that EBs can play a role as a transfer medium transferring knowledge from research to SE practice. To evaluate the applicability of RRs in a real context, we conducted two RRs in two software companies. The problems reported by the practitioners were due to low customer collaboration (Company 1) and low team motivation (Company 2). Following RRs strategies, we searched for evidence that might help to mitigate the problems, synthesized the results, and introduced the findings to practitioners through EBs. Through a series of interviews, we evaluated the practitioners perceptions about the introduction of RRs to support decision-making. Our results show that practitioners are rather positive about RRs. In summary, and based on the positive results we obtained with the six empirical studies we conducted, we believe the model we proposed to transfer knowledge based on RRs and EBs has a promising future as an alternative to make research closer to SE practice. |
id |
UFPE_2abbdfe7613ad8e748ed77c1f2ea6b9e |
---|---|
oai_identifier_str |
oai:repositorio.ufpe.br:123456789/32145 |
network_acronym_str |
UFPE |
network_name_str |
Repositório Institucional da UFPE |
repository_id_str |
2221 |
spelling |
CARTAXO, Bruno Falcão de Souzahttp://lattes.cnpq.br/3125607007070020http://lattes.cnpq.br/6456667887502521SOARES, Sérgio Castelo BrancoPINTO, Gustavo Henrique Lima2019-09-02T22:01:56Z2019-09-02T22:01:56Z2018-05-11https://repositorio.ufpe.br/handle/123456789/32145Inspired by the promising results of Evidence Based Medicine (EBM), Evidence Based Software Engineering (EBSE) was introduced more than one decade ago. One of EBSE’s main goal is to integrate the best research evidence with Software Engineering (SE) practice. However, some claim Secondary Studies (SSs) — one of the main products of EBSE — lack connection with SE practice. To better understand this claim, the first contribution of this thesis is an analysis on how SSs are related to problems faced in SE practice. We introduced a coverage technique to compare topics investigated by SSs and issues practitioners report in Stack Exchange Q&A websites. We could observe a low coverage (15.6%), which corroborates with the claims about lack of connection between SSs and SE practice. Motivated by the findings of our first contribution, and inspired by recent advances in EBM, we propose a model to transfer knowledge from SSs to SE practice. The model adhere to two of the most prominent approaches proposed in EBM: Rapid Reviews (a lightweight research method that focus on understanding practitioners problems, and mitigating them with evidence delivered in a timely manner), and Evidence Briefings (one-page documents summarizing the main findings of an empirical study). To evaluate the EBs, we created 12 of them based on one SS each, and conducted two surveys. One with the authors of the SSs, and other with practitioners that reported issues considered as covered by the SSs. Both practitioners (32) and researchers (7), positively evaluated the EBs. We also invited authors of papers published in four SE conferences to create EBs of their papers. We conducted another survey to evaluate their perceptions. The positive results show that EBs can play a role as a transfer medium transferring knowledge from research to SE practice. To evaluate the applicability of RRs in a real context, we conducted two RRs in two software companies. The problems reported by the practitioners were due to low customer collaboration (Company 1) and low team motivation (Company 2). Following RRs strategies, we searched for evidence that might help to mitigate the problems, synthesized the results, and introduced the findings to practitioners through EBs. Through a series of interviews, we evaluated the practitioners perceptions about the introduction of RRs to support decision-making. Our results show that practitioners are rather positive about RRs. In summary, and based on the positive results we obtained with the six empirical studies we conducted, we believe the model we proposed to transfer knowledge based on RRs and EBs has a promising future as an alternative to make research closer to SE practice.CNPqCAPESHá mais de uma década a Engenharia de Software Baseada em Evidência (ESBE) foi introduzida, inspirada nos resultados promissores da Medicina Baseada em Evidência (MBE). Um dos principais objetivos da ESBE é integrar as melhores evidências com a prática da Engenharia de Software (ES). No entanto, alguns pesquisadores afirmam que estudos secundários – um dos principais produtos da ESBE – apresentam uma falta de conexão com a prática da ES. A primeira contribuição dessa tese é analisar como estudos secundários se relacionam com os problemas enfrentados na prática. Definimos uma técnica de análise de cobertura que permite comparar os tópicos investigados pelos estudos secundários com os problemas reportados pelos profissionais da prática em websites da plataforma Stack Exchange. Podemos observar que a baixa taxa cobertura (15.6%) corrobora com argumentos no sentido da falta de conexão dos estudos secundários com a prática de ES. Inspirados em avanços recentes da MBE, propusemos um modelo para transferir conhecimento de estudos secundários para a prática. O modelo adere a dois conceitos que tem ganhado notoriedade na MBE: as Rapid Reviews (RRs), que são métodos que focam em entender e mitigar os problemas dos profissionais da prática fornecendo evidências científicas em tempo hábil; bem como os Evidence Briefings (EBs), que são documentos de uma página que resumem as principais evidências de um estudo empírico. Para avaliar os EBs, criamos 12 deles baseados em um estudo secundário cada e conduzimos dois surveys. Um survey com os autores (7) dos estudos secundários, e outro com profissionais (32) que reportaram problemas cobertos pelos estudos secundários. Também convidamos os autores de artigos publicados em quatro conferências para criar EBs dos seus artigos e através de um terceiro survey avaliamos suas percepções. Os resultados positivos mostraram que os EBs podem ter um papel importante como meio de transferência de conhecimento. Para avaliar a aplicabilidade de RRs, conduzimos duas delas em duas empresas de software. Os problemas reportados estavam relacionados à baixa colaboração do cliente (Empresa 1) e a baixa motivação da equipe (Empresa 2). Buscamos por evidências que pudessem mitigar os problemas, sintetizamos essas evidências e apresentamos os resultados aos profissionais por meio de EBs. Em uma série de entrevistas avaliamos as percepções dos profissionais sobre o uso de RRs. A percepção dos profissionais foi majoritariamente positiva. Visto os resultados positivos, acreditamos que o modelo de transferência de conhecimento que propusemos, baseado em RRs e EBs, pode aproximar a pesquisa da prática da ES.engUniversidade Federal de PernambucoPrograma de Pos Graduacao em Ciencia da ComputacaoUFPEBrasilAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessEngenharia de softwareRevisões sistemáticasA model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefingsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisdoutoradoreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPETHUMBNAILTESE Bruno Falcão de Souza Cartaxo.pdf.jpgTESE Bruno Falcão de Souza Cartaxo.pdf.jpgGenerated Thumbnailimage/jpeg1227https://repositorio.ufpe.br/bitstream/123456789/32145/5/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.jpgf0d56897d85beb2607b1d8f2aa93782aMD55ORIGINALTESE Bruno Falcão de Souza Cartaxo.pdfTESE Bruno Falcão de Souza Cartaxo.pdfapplication/pdf3917780https://repositorio.ufpe.br/bitstream/123456789/32145/1/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdfdbbd2d54c0f907e9d1f59fb272c8263aMD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8811https://repositorio.ufpe.br/bitstream/123456789/32145/2/license_rdfe39d27027a6cc9cb039ad269a5db8e34MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82311https://repositorio.ufpe.br/bitstream/123456789/32145/3/license.txt4b8a02c7f2818eaf00dcf2260dd5eb08MD53TEXTTESE Bruno Falcão de Souza Cartaxo.pdf.txtTESE Bruno Falcão de Souza Cartaxo.pdf.txtExtracted texttext/plain427872https://repositorio.ufpe.br/bitstream/123456789/32145/4/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.txt231b05d07304c637923568f71721b756MD54123456789/321452019-10-26 00:10:32.432oai:repositorio.ufpe.br:123456789/32145TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUmVwb3NpdMOzcmlvIEluc3RpdHVjaW9uYWwgKFJJKSBkZXZlIGNvbmNlZGVyLCDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBQZXJuYW1idWNvIChVRlBFKSwgdW1hIExpY2Vuw6dhIGRlIERpc3RyaWJ1acOnw6NvIE7Do28gRXhjbHVzaXZhIHBhcmEgbWFudGVyIGUgdG9ybmFyIGFjZXNzw612ZWlzIG9zIHNldXMgZG9jdW1lbnRvcywgZW0gZm9ybWF0byBkaWdpdGFsLCBuZXN0ZSByZXBvc2l0w7NyaW8uCgpDb20gYSBjb25jZXNzw6NvIGRlc3RhIGxpY2Vuw6dhIG7Do28gZXhjbHVzaXZhLCBvIGRlcG9zaXRhbnRlIG1hbnTDqW0gdG9kb3Mgb3MgZGlyZWl0b3MgZGUgYXV0b3IuCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwoKTGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKCkFvIGNvbmNvcmRhciBjb20gZXN0YSBsaWNlbsOnYSBlIGFjZWl0w6EtbGEsIHZvY8OqIChhdXRvciBvdSBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMpOgoKYSkgRGVjbGFyYSBxdWUgY29uaGVjZSBhIHBvbMOtdGljYSBkZSBjb3B5cmlnaHQgZGEgZWRpdG9yYSBkbyBzZXUgZG9jdW1lbnRvOwpiKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGUgYWNlaXRhIGFzIERpcmV0cml6ZXMgcGFyYSBvIFJlcG9zaXTDs3JpbyBJbnN0aXR1Y2lvbmFsIGRhIFVGUEU7CmMpIENvbmNlZGUgw6AgVUZQRSBvIGRpcmVpdG8gbsOjbyBleGNsdXNpdm8gZGUgYXJxdWl2YXIsIHJlcHJvZHV6aXIsIGNvbnZlcnRlciAoY29tbyBkZWZpbmlkbyBhIHNlZ3VpciksIGNvbXVuaWNhciBlL291IGRpc3RyaWJ1aXIsIG5vIFJJLCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIG91dHJvIG1laW87CmQpIERlY2xhcmEgcXVlIGF1dG9yaXphIGEgVUZQRSBhIGFycXVpdmFyIG1haXMgZGUgdW1hIGPDs3BpYSBkZXN0ZSBkb2N1bWVudG8gZSBjb252ZXJ0w6otbG8sIHNlbSBhbHRlcmFyIG8gc2V1IGNvbnRlw7pkbywgcGFyYSBxdWFscXVlciBmb3JtYXRvIGRlIGZpY2hlaXJvLCBtZWlvIG91IHN1cG9ydGUsIHBhcmEgZWZlaXRvcyBkZSBzZWd1cmFuw6dhLCBwcmVzZXJ2YcOnw6NvIChiYWNrdXApIGUgYWNlc3NvOwplKSBEZWNsYXJhIHF1ZSBvIGRvY3VtZW50byBzdWJtZXRpZG8gw6kgbyBzZXUgdHJhYmFsaG8gb3JpZ2luYWwgZSBxdWUgZGV0w6ltIG8gZGlyZWl0byBkZSBjb25jZWRlciBhIHRlcmNlaXJvcyBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBhIGVudHJlZ2EgZG8gZG9jdW1lbnRvIG7Do28gaW5mcmluZ2Ugb3MgZGlyZWl0b3MgZGUgb3V0cmEgcGVzc29hIG91IGVudGlkYWRlOwpmKSBEZWNsYXJhIHF1ZSwgbm8gY2FzbyBkbyBkb2N1bWVudG8gc3VibWV0aWRvIGNvbnRlciBtYXRlcmlhbCBkbyBxdWFsIG7Do28gZGV0w6ltIG9zIGRpcmVpdG9zIGRlCmF1dG9yLCBvYnRldmUgYSBhdXRvcml6YcOnw6NvIGlycmVzdHJpdGEgZG8gcmVzcGVjdGl2byBkZXRlbnRvciBkZXNzZXMgZGlyZWl0b3MgcGFyYSBjZWRlciDDoApVRlBFIG9zIGRpcmVpdG9zIHJlcXVlcmlkb3MgcG9yIGVzdGEgTGljZW7Dp2EgZSBhdXRvcml6YXIgYSB1bml2ZXJzaWRhZGUgYSB1dGlsaXrDoS1sb3MgbGVnYWxtZW50ZS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBlc3NlIG1hdGVyaWFsIGN1am9zIGRpcmVpdG9zIHPDo28gZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3UgY29udGXDumRvIGRvIGRvY3VtZW50byBlbnRyZWd1ZTsKZykgU2UgbyBkb2N1bWVudG8gZW50cmVndWUgw6kgYmFzZWFkbyBlbSB0cmFiYWxobyBmaW5hbmNpYWRvIG91IGFwb2lhZG8gcG9yIG91dHJhIGluc3RpdHVpw6fDo28gcXVlIG7Do28gYSBVRlBFLMKgZGVjbGFyYSBxdWUgY3VtcHJpdSBxdWFpc3F1ZXIgb2JyaWdhw6fDtWVzIGV4aWdpZGFzIHBlbG8gcmVzcGVjdGl2byBjb250cmF0byBvdSBhY29yZG8uCgpBIFVGUEUgaWRlbnRpZmljYXLDoSBjbGFyYW1lbnRlIG8ocykgbm9tZShzKSBkbyhzKSBhdXRvciAoZXMpIGRvcyBkaXJlaXRvcyBkbyBkb2N1bWVudG8gZW50cmVndWUgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBwYXJhIGFsw6ltIGRvIHByZXZpc3RvIG5hIGFsw61uZWEgYykuCg==Repositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212019-10-26T03:10:32Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false |
dc.title.pt_BR.fl_str_mv |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
title |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
spellingShingle |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings CARTAXO, Bruno Falcão de Souza Engenharia de software Revisões sistemáticas |
title_short |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
title_full |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
title_fullStr |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
title_full_unstemmed |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
title_sort |
A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings |
author |
CARTAXO, Bruno Falcão de Souza |
author_facet |
CARTAXO, Bruno Falcão de Souza |
author_role |
author |
dc.contributor.authorLattes.pt_BR.fl_str_mv |
http://lattes.cnpq.br/3125607007070020 |
dc.contributor.advisorLattes.pt_BR.fl_str_mv |
http://lattes.cnpq.br/6456667887502521 |
dc.contributor.author.fl_str_mv |
CARTAXO, Bruno Falcão de Souza |
dc.contributor.advisor1.fl_str_mv |
SOARES, Sérgio Castelo Branco |
dc.contributor.advisor-co1.fl_str_mv |
PINTO, Gustavo Henrique Lima |
contributor_str_mv |
SOARES, Sérgio Castelo Branco PINTO, Gustavo Henrique Lima |
dc.subject.por.fl_str_mv |
Engenharia de software Revisões sistemáticas |
topic |
Engenharia de software Revisões sistemáticas |
description |
Inspired by the promising results of Evidence Based Medicine (EBM), Evidence Based Software Engineering (EBSE) was introduced more than one decade ago. One of EBSE’s main goal is to integrate the best research evidence with Software Engineering (SE) practice. However, some claim Secondary Studies (SSs) — one of the main products of EBSE — lack connection with SE practice. To better understand this claim, the first contribution of this thesis is an analysis on how SSs are related to problems faced in SE practice. We introduced a coverage technique to compare topics investigated by SSs and issues practitioners report in Stack Exchange Q&A websites. We could observe a low coverage (15.6%), which corroborates with the claims about lack of connection between SSs and SE practice. Motivated by the findings of our first contribution, and inspired by recent advances in EBM, we propose a model to transfer knowledge from SSs to SE practice. The model adhere to two of the most prominent approaches proposed in EBM: Rapid Reviews (a lightweight research method that focus on understanding practitioners problems, and mitigating them with evidence delivered in a timely manner), and Evidence Briefings (one-page documents summarizing the main findings of an empirical study). To evaluate the EBs, we created 12 of them based on one SS each, and conducted two surveys. One with the authors of the SSs, and other with practitioners that reported issues considered as covered by the SSs. Both practitioners (32) and researchers (7), positively evaluated the EBs. We also invited authors of papers published in four SE conferences to create EBs of their papers. We conducted another survey to evaluate their perceptions. The positive results show that EBs can play a role as a transfer medium transferring knowledge from research to SE practice. To evaluate the applicability of RRs in a real context, we conducted two RRs in two software companies. The problems reported by the practitioners were due to low customer collaboration (Company 1) and low team motivation (Company 2). Following RRs strategies, we searched for evidence that might help to mitigate the problems, synthesized the results, and introduced the findings to practitioners through EBs. Through a series of interviews, we evaluated the practitioners perceptions about the introduction of RRs to support decision-making. Our results show that practitioners are rather positive about RRs. In summary, and based on the positive results we obtained with the six empirical studies we conducted, we believe the model we proposed to transfer knowledge based on RRs and EBs has a promising future as an alternative to make research closer to SE practice. |
publishDate |
2018 |
dc.date.issued.fl_str_mv |
2018-05-11 |
dc.date.accessioned.fl_str_mv |
2019-09-02T22:01:56Z |
dc.date.available.fl_str_mv |
2019-09-02T22:01:56Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
format |
doctoralThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://repositorio.ufpe.br/handle/123456789/32145 |
url |
https://repositorio.ufpe.br/handle/123456789/32145 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
Attribution-NonCommercial-NoDerivs 3.0 Brazil http://creativecommons.org/licenses/by-nc-nd/3.0/br/ info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Attribution-NonCommercial-NoDerivs 3.0 Brazil http://creativecommons.org/licenses/by-nc-nd/3.0/br/ |
eu_rights_str_mv |
openAccess |
dc.publisher.none.fl_str_mv |
Universidade Federal de Pernambuco |
dc.publisher.program.fl_str_mv |
Programa de Pos Graduacao em Ciencia da Computacao |
dc.publisher.initials.fl_str_mv |
UFPE |
dc.publisher.country.fl_str_mv |
Brasil |
publisher.none.fl_str_mv |
Universidade Federal de Pernambuco |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UFPE instname:Universidade Federal de Pernambuco (UFPE) instacron:UFPE |
instname_str |
Universidade Federal de Pernambuco (UFPE) |
instacron_str |
UFPE |
institution |
UFPE |
reponame_str |
Repositório Institucional da UFPE |
collection |
Repositório Institucional da UFPE |
bitstream.url.fl_str_mv |
https://repositorio.ufpe.br/bitstream/123456789/32145/5/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.jpg https://repositorio.ufpe.br/bitstream/123456789/32145/1/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf https://repositorio.ufpe.br/bitstream/123456789/32145/2/license_rdf https://repositorio.ufpe.br/bitstream/123456789/32145/3/license.txt https://repositorio.ufpe.br/bitstream/123456789/32145/4/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.txt |
bitstream.checksum.fl_str_mv |
f0d56897d85beb2607b1d8f2aa93782a dbbd2d54c0f907e9d1f59fb272c8263a e39d27027a6cc9cb039ad269a5db8e34 4b8a02c7f2818eaf00dcf2260dd5eb08 231b05d07304c637923568f71721b756 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE) |
repository.mail.fl_str_mv |
attena@ufpe.br |
_version_ |
1802310593246396416 |