A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings

Detalhes bibliográficos
Autor(a) principal: CARTAXO, Bruno Falcão de Souza
Data de Publicação: 2018
Tipo de documento: Tese
Idioma: eng
Título da fonte: Repositório Institucional da UFPE
Texto Completo: https://repositorio.ufpe.br/handle/123456789/32145
Resumo: Inspired by the promising results of Evidence Based Medicine (EBM), Evidence Based Software Engineering (EBSE) was introduced more than one decade ago. One of EBSE’s main goal is to integrate the best research evidence with Software Engineering (SE) practice. However, some claim Secondary Studies (SSs) — one of the main products of EBSE — lack connection with SE practice. To better understand this claim, the first contribution of this thesis is an analysis on how SSs are related to problems faced in SE practice. We introduced a coverage technique to compare topics investigated by SSs and issues practitioners report in Stack Exchange Q&A websites. We could observe a low coverage (15.6%), which corroborates with the claims about lack of connection between SSs and SE practice. Motivated by the findings of our first contribution, and inspired by recent advances in EBM, we propose a model to transfer knowledge from SSs to SE practice. The model adhere to two of the most prominent approaches proposed in EBM: Rapid Reviews (a lightweight research method that focus on understanding practitioners problems, and mitigating them with evidence delivered in a timely manner), and Evidence Briefings (one-page documents summarizing the main findings of an empirical study). To evaluate the EBs, we created 12 of them based on one SS each, and conducted two surveys. One with the authors of the SSs, and other with practitioners that reported issues considered as covered by the SSs. Both practitioners (32) and researchers (7), positively evaluated the EBs. We also invited authors of papers published in four SE conferences to create EBs of their papers. We conducted another survey to evaluate their perceptions. The positive results show that EBs can play a role as a transfer medium transferring knowledge from research to SE practice. To evaluate the applicability of RRs in a real context, we conducted two RRs in two software companies. The problems reported by the practitioners were due to low customer collaboration (Company 1) and low team motivation (Company 2). Following RRs strategies, we searched for evidence that might help to mitigate the problems, synthesized the results, and introduced the findings to practitioners through EBs. Through a series of interviews, we evaluated the practitioners perceptions about the introduction of RRs to support decision-making. Our results show that practitioners are rather positive about RRs. In summary, and based on the positive results we obtained with the six empirical studies we conducted, we believe the model we proposed to transfer knowledge based on RRs and EBs has a promising future as an alternative to make research closer to SE practice.
id UFPE_2abbdfe7613ad8e748ed77c1f2ea6b9e
oai_identifier_str oai:repositorio.ufpe.br:123456789/32145
network_acronym_str UFPE
network_name_str Repositório Institucional da UFPE
repository_id_str 2221
spelling CARTAXO, Bruno Falcão de Souzahttp://lattes.cnpq.br/3125607007070020http://lattes.cnpq.br/6456667887502521SOARES, Sérgio Castelo BrancoPINTO, Gustavo Henrique Lima2019-09-02T22:01:56Z2019-09-02T22:01:56Z2018-05-11https://repositorio.ufpe.br/handle/123456789/32145Inspired by the promising results of Evidence Based Medicine (EBM), Evidence Based Software Engineering (EBSE) was introduced more than one decade ago. One of EBSE’s main goal is to integrate the best research evidence with Software Engineering (SE) practice. However, some claim Secondary Studies (SSs) — one of the main products of EBSE — lack connection with SE practice. To better understand this claim, the first contribution of this thesis is an analysis on how SSs are related to problems faced in SE practice. We introduced a coverage technique to compare topics investigated by SSs and issues practitioners report in Stack Exchange Q&A websites. We could observe a low coverage (15.6%), which corroborates with the claims about lack of connection between SSs and SE practice. Motivated by the findings of our first contribution, and inspired by recent advances in EBM, we propose a model to transfer knowledge from SSs to SE practice. The model adhere to two of the most prominent approaches proposed in EBM: Rapid Reviews (a lightweight research method that focus on understanding practitioners problems, and mitigating them with evidence delivered in a timely manner), and Evidence Briefings (one-page documents summarizing the main findings of an empirical study). To evaluate the EBs, we created 12 of them based on one SS each, and conducted two surveys. One with the authors of the SSs, and other with practitioners that reported issues considered as covered by the SSs. Both practitioners (32) and researchers (7), positively evaluated the EBs. We also invited authors of papers published in four SE conferences to create EBs of their papers. We conducted another survey to evaluate their perceptions. The positive results show that EBs can play a role as a transfer medium transferring knowledge from research to SE practice. To evaluate the applicability of RRs in a real context, we conducted two RRs in two software companies. The problems reported by the practitioners were due to low customer collaboration (Company 1) and low team motivation (Company 2). Following RRs strategies, we searched for evidence that might help to mitigate the problems, synthesized the results, and introduced the findings to practitioners through EBs. Through a series of interviews, we evaluated the practitioners perceptions about the introduction of RRs to support decision-making. Our results show that practitioners are rather positive about RRs. In summary, and based on the positive results we obtained with the six empirical studies we conducted, we believe the model we proposed to transfer knowledge based on RRs and EBs has a promising future as an alternative to make research closer to SE practice.CNPqCAPESHá mais de uma década a Engenharia de Software Baseada em Evidência (ESBE) foi introduzida, inspirada nos resultados promissores da Medicina Baseada em Evidência (MBE). Um dos principais objetivos da ESBE é integrar as melhores evidências com a prática da Engenharia de Software (ES). No entanto, alguns pesquisadores afirmam que estudos secundários – um dos principais produtos da ESBE – apresentam uma falta de conexão com a prática da ES. A primeira contribuição dessa tese é analisar como estudos secundários se relacionam com os problemas enfrentados na prática. Definimos uma técnica de análise de cobertura que permite comparar os tópicos investigados pelos estudos secundários com os problemas reportados pelos profissionais da prática em websites da plataforma Stack Exchange. Podemos observar que a baixa taxa cobertura (15.6%) corrobora com argumentos no sentido da falta de conexão dos estudos secundários com a prática de ES. Inspirados em avanços recentes da MBE, propusemos um modelo para transferir conhecimento de estudos secundários para a prática. O modelo adere a dois conceitos que tem ganhado notoriedade na MBE: as Rapid Reviews (RRs), que são métodos que focam em entender e mitigar os problemas dos profissionais da prática fornecendo evidências científicas em tempo hábil; bem como os Evidence Briefings (EBs), que são documentos de uma página que resumem as principais evidências de um estudo empírico. Para avaliar os EBs, criamos 12 deles baseados em um estudo secundário cada e conduzimos dois surveys. Um survey com os autores (7) dos estudos secundários, e outro com profissionais (32) que reportaram problemas cobertos pelos estudos secundários. Também convidamos os autores de artigos publicados em quatro conferências para criar EBs dos seus artigos e através de um terceiro survey avaliamos suas percepções. Os resultados positivos mostraram que os EBs podem ter um papel importante como meio de transferência de conhecimento. Para avaliar a aplicabilidade de RRs, conduzimos duas delas em duas empresas de software. Os problemas reportados estavam relacionados à baixa colaboração do cliente (Empresa 1) e a baixa motivação da equipe (Empresa 2). Buscamos por evidências que pudessem mitigar os problemas, sintetizamos essas evidências e apresentamos os resultados aos profissionais por meio de EBs. Em uma série de entrevistas avaliamos as percepções dos profissionais sobre o uso de RRs. A percepção dos profissionais foi majoritariamente positiva. Visto os resultados positivos, acreditamos que o modelo de transferência de conhecimento que propusemos, baseado em RRs e EBs, pode aproximar a pesquisa da prática da ES.engUniversidade Federal de PernambucoPrograma de Pos Graduacao em Ciencia da ComputacaoUFPEBrasilAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessEngenharia de softwareRevisões sistemáticasA model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefingsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisdoutoradoreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPETHUMBNAILTESE Bruno Falcão de Souza Cartaxo.pdf.jpgTESE Bruno Falcão de Souza Cartaxo.pdf.jpgGenerated Thumbnailimage/jpeg1227https://repositorio.ufpe.br/bitstream/123456789/32145/5/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.jpgf0d56897d85beb2607b1d8f2aa93782aMD55ORIGINALTESE Bruno Falcão de Souza Cartaxo.pdfTESE Bruno Falcão de Souza Cartaxo.pdfapplication/pdf3917780https://repositorio.ufpe.br/bitstream/123456789/32145/1/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdfdbbd2d54c0f907e9d1f59fb272c8263aMD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8811https://repositorio.ufpe.br/bitstream/123456789/32145/2/license_rdfe39d27027a6cc9cb039ad269a5db8e34MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82311https://repositorio.ufpe.br/bitstream/123456789/32145/3/license.txt4b8a02c7f2818eaf00dcf2260dd5eb08MD53TEXTTESE Bruno Falcão de Souza Cartaxo.pdf.txtTESE Bruno Falcão de Souza Cartaxo.pdf.txtExtracted texttext/plain427872https://repositorio.ufpe.br/bitstream/123456789/32145/4/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.txt231b05d07304c637923568f71721b756MD54123456789/321452019-10-26 00:10:32.432oai:repositorio.ufpe.br:123456789/32145TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUmVwb3NpdMOzcmlvIEluc3RpdHVjaW9uYWwgKFJJKSBkZXZlIGNvbmNlZGVyLCDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBQZXJuYW1idWNvIChVRlBFKSwgdW1hIExpY2Vuw6dhIGRlIERpc3RyaWJ1acOnw6NvIE7Do28gRXhjbHVzaXZhIHBhcmEgbWFudGVyIGUgdG9ybmFyIGFjZXNzw612ZWlzIG9zIHNldXMgZG9jdW1lbnRvcywgZW0gZm9ybWF0byBkaWdpdGFsLCBuZXN0ZSByZXBvc2l0w7NyaW8uCgpDb20gYSBjb25jZXNzw6NvIGRlc3RhIGxpY2Vuw6dhIG7Do28gZXhjbHVzaXZhLCBvIGRlcG9zaXRhbnRlIG1hbnTDqW0gdG9kb3Mgb3MgZGlyZWl0b3MgZGUgYXV0b3IuCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwoKTGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKCkFvIGNvbmNvcmRhciBjb20gZXN0YSBsaWNlbsOnYSBlIGFjZWl0w6EtbGEsIHZvY8OqIChhdXRvciBvdSBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMpOgoKYSkgRGVjbGFyYSBxdWUgY29uaGVjZSBhIHBvbMOtdGljYSBkZSBjb3B5cmlnaHQgZGEgZWRpdG9yYSBkbyBzZXUgZG9jdW1lbnRvOwpiKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGUgYWNlaXRhIGFzIERpcmV0cml6ZXMgcGFyYSBvIFJlcG9zaXTDs3JpbyBJbnN0aXR1Y2lvbmFsIGRhIFVGUEU7CmMpIENvbmNlZGUgw6AgVUZQRSBvIGRpcmVpdG8gbsOjbyBleGNsdXNpdm8gZGUgYXJxdWl2YXIsIHJlcHJvZHV6aXIsIGNvbnZlcnRlciAoY29tbyBkZWZpbmlkbyBhIHNlZ3VpciksIGNvbXVuaWNhciBlL291IGRpc3RyaWJ1aXIsIG5vIFJJLCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIG91dHJvIG1laW87CmQpIERlY2xhcmEgcXVlIGF1dG9yaXphIGEgVUZQRSBhIGFycXVpdmFyIG1haXMgZGUgdW1hIGPDs3BpYSBkZXN0ZSBkb2N1bWVudG8gZSBjb252ZXJ0w6otbG8sIHNlbSBhbHRlcmFyIG8gc2V1IGNvbnRlw7pkbywgcGFyYSBxdWFscXVlciBmb3JtYXRvIGRlIGZpY2hlaXJvLCBtZWlvIG91IHN1cG9ydGUsIHBhcmEgZWZlaXRvcyBkZSBzZWd1cmFuw6dhLCBwcmVzZXJ2YcOnw6NvIChiYWNrdXApIGUgYWNlc3NvOwplKSBEZWNsYXJhIHF1ZSBvIGRvY3VtZW50byBzdWJtZXRpZG8gw6kgbyBzZXUgdHJhYmFsaG8gb3JpZ2luYWwgZSBxdWUgZGV0w6ltIG8gZGlyZWl0byBkZSBjb25jZWRlciBhIHRlcmNlaXJvcyBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBhIGVudHJlZ2EgZG8gZG9jdW1lbnRvIG7Do28gaW5mcmluZ2Ugb3MgZGlyZWl0b3MgZGUgb3V0cmEgcGVzc29hIG91IGVudGlkYWRlOwpmKSBEZWNsYXJhIHF1ZSwgbm8gY2FzbyBkbyBkb2N1bWVudG8gc3VibWV0aWRvIGNvbnRlciBtYXRlcmlhbCBkbyBxdWFsIG7Do28gZGV0w6ltIG9zIGRpcmVpdG9zIGRlCmF1dG9yLCBvYnRldmUgYSBhdXRvcml6YcOnw6NvIGlycmVzdHJpdGEgZG8gcmVzcGVjdGl2byBkZXRlbnRvciBkZXNzZXMgZGlyZWl0b3MgcGFyYSBjZWRlciDDoApVRlBFIG9zIGRpcmVpdG9zIHJlcXVlcmlkb3MgcG9yIGVzdGEgTGljZW7Dp2EgZSBhdXRvcml6YXIgYSB1bml2ZXJzaWRhZGUgYSB1dGlsaXrDoS1sb3MgbGVnYWxtZW50ZS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBlc3NlIG1hdGVyaWFsIGN1am9zIGRpcmVpdG9zIHPDo28gZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3UgY29udGXDumRvIGRvIGRvY3VtZW50byBlbnRyZWd1ZTsKZykgU2UgbyBkb2N1bWVudG8gZW50cmVndWUgw6kgYmFzZWFkbyBlbSB0cmFiYWxobyBmaW5hbmNpYWRvIG91IGFwb2lhZG8gcG9yIG91dHJhIGluc3RpdHVpw6fDo28gcXVlIG7Do28gYSBVRlBFLMKgZGVjbGFyYSBxdWUgY3VtcHJpdSBxdWFpc3F1ZXIgb2JyaWdhw6fDtWVzIGV4aWdpZGFzIHBlbG8gcmVzcGVjdGl2byBjb250cmF0byBvdSBhY29yZG8uCgpBIFVGUEUgaWRlbnRpZmljYXLDoSBjbGFyYW1lbnRlIG8ocykgbm9tZShzKSBkbyhzKSBhdXRvciAoZXMpIGRvcyBkaXJlaXRvcyBkbyBkb2N1bWVudG8gZW50cmVndWUgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBwYXJhIGFsw6ltIGRvIHByZXZpc3RvIG5hIGFsw61uZWEgYykuCg==Repositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212019-10-26T03:10:32Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false
dc.title.pt_BR.fl_str_mv A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
title A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
spellingShingle A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
CARTAXO, Bruno Falcão de Souza
Engenharia de software
Revisões sistemáticas
title_short A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
title_full A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
title_fullStr A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
title_full_unstemmed A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
title_sort A model to transfer knowledge from research to software engineering practice based on rapid reviews and evidence briefings
author CARTAXO, Bruno Falcão de Souza
author_facet CARTAXO, Bruno Falcão de Souza
author_role author
dc.contributor.authorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/3125607007070020
dc.contributor.advisorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/6456667887502521
dc.contributor.author.fl_str_mv CARTAXO, Bruno Falcão de Souza
dc.contributor.advisor1.fl_str_mv SOARES, Sérgio Castelo Branco
dc.contributor.advisor-co1.fl_str_mv PINTO, Gustavo Henrique Lima
contributor_str_mv SOARES, Sérgio Castelo Branco
PINTO, Gustavo Henrique Lima
dc.subject.por.fl_str_mv Engenharia de software
Revisões sistemáticas
topic Engenharia de software
Revisões sistemáticas
description Inspired by the promising results of Evidence Based Medicine (EBM), Evidence Based Software Engineering (EBSE) was introduced more than one decade ago. One of EBSE’s main goal is to integrate the best research evidence with Software Engineering (SE) practice. However, some claim Secondary Studies (SSs) — one of the main products of EBSE — lack connection with SE practice. To better understand this claim, the first contribution of this thesis is an analysis on how SSs are related to problems faced in SE practice. We introduced a coverage technique to compare topics investigated by SSs and issues practitioners report in Stack Exchange Q&A websites. We could observe a low coverage (15.6%), which corroborates with the claims about lack of connection between SSs and SE practice. Motivated by the findings of our first contribution, and inspired by recent advances in EBM, we propose a model to transfer knowledge from SSs to SE practice. The model adhere to two of the most prominent approaches proposed in EBM: Rapid Reviews (a lightweight research method that focus on understanding practitioners problems, and mitigating them with evidence delivered in a timely manner), and Evidence Briefings (one-page documents summarizing the main findings of an empirical study). To evaluate the EBs, we created 12 of them based on one SS each, and conducted two surveys. One with the authors of the SSs, and other with practitioners that reported issues considered as covered by the SSs. Both practitioners (32) and researchers (7), positively evaluated the EBs. We also invited authors of papers published in four SE conferences to create EBs of their papers. We conducted another survey to evaluate their perceptions. The positive results show that EBs can play a role as a transfer medium transferring knowledge from research to SE practice. To evaluate the applicability of RRs in a real context, we conducted two RRs in two software companies. The problems reported by the practitioners were due to low customer collaboration (Company 1) and low team motivation (Company 2). Following RRs strategies, we searched for evidence that might help to mitigate the problems, synthesized the results, and introduced the findings to practitioners through EBs. Through a series of interviews, we evaluated the practitioners perceptions about the introduction of RRs to support decision-making. Our results show that practitioners are rather positive about RRs. In summary, and based on the positive results we obtained with the six empirical studies we conducted, we believe the model we proposed to transfer knowledge based on RRs and EBs has a promising future as an alternative to make research closer to SE practice.
publishDate 2018
dc.date.issued.fl_str_mv 2018-05-11
dc.date.accessioned.fl_str_mv 2019-09-02T22:01:56Z
dc.date.available.fl_str_mv 2019-09-02T22:01:56Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://repositorio.ufpe.br/handle/123456789/32145
url https://repositorio.ufpe.br/handle/123456789/32145
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.publisher.program.fl_str_mv Programa de Pos Graduacao em Ciencia da Computacao
dc.publisher.initials.fl_str_mv UFPE
dc.publisher.country.fl_str_mv Brasil
publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFPE
instname:Universidade Federal de Pernambuco (UFPE)
instacron:UFPE
instname_str Universidade Federal de Pernambuco (UFPE)
instacron_str UFPE
institution UFPE
reponame_str Repositório Institucional da UFPE
collection Repositório Institucional da UFPE
bitstream.url.fl_str_mv https://repositorio.ufpe.br/bitstream/123456789/32145/5/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.jpg
https://repositorio.ufpe.br/bitstream/123456789/32145/1/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf
https://repositorio.ufpe.br/bitstream/123456789/32145/2/license_rdf
https://repositorio.ufpe.br/bitstream/123456789/32145/3/license.txt
https://repositorio.ufpe.br/bitstream/123456789/32145/4/TESE%20Bruno%20Falc%c3%a3o%20de%20Souza%20Cartaxo.pdf.txt
bitstream.checksum.fl_str_mv f0d56897d85beb2607b1d8f2aa93782a
dbbd2d54c0f907e9d1f59fb272c8263a
e39d27027a6cc9cb039ad269a5db8e34
4b8a02c7f2818eaf00dcf2260dd5eb08
231b05d07304c637923568f71721b756
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)
repository.mail.fl_str_mv attena@ufpe.br
_version_ 1802310593246396416