Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap

Detalhes bibliográficos
Autor(a) principal: Sousa, Luis de
Data de Publicação: 2021
Outros Autores: Pinto, Isabel R., Clemente, Felippe, Gouvêa Maciel, G.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10451/45934
Resumo: Abstract Purpose This article presents focus groups as a method to enhance questionnaire design to frame and test items for a mass survey on corruption and austerity in democracy. Such methodology lacks systematization when it comes to the description of implementation procedures and the discussion of effective contribution to the development of survey questions on sensitive topics. The objective of this article is to contribute to the specialized literature on corruption by offering a novel focus group approach and a roadmap to guide researchers in the field when using this methodology to develop questionnaire items. This hands-on guide can be adaptable to other (survey) studies on issues prone to social desirability bias. Design/methodology/approach This article proposes an innovative multi-technique (short questionnaire, visual stimuli and exploratory discussion with expert moderation) focus group approach to collect informal impressions about corruption and austerity. By developing a focus group design through the combination of different research techniques, the authors were able to triangulate reflexive, spontaneous and interactive qualitative bottom-up information about individual perceptions and reactions to sensitive topics. By describing how to implement these groups, other than discussing what type of qualitative information can be extracted from these discussions and to what effect, the authors seek to present a hands-on guide that can be replicated and adapted to similar studies. This roadmap will help researchers to test individual perceptions and reactions to sensitive topics through the use of tailored focus groups in order to enhance the quality of survey questionnaires prior to engaging in a high-cost fieldwork. Findings The article concludes that the adoption of the multi-technique focus group approach to requalify and test questions for a nationwide survey gives us a better understanding of the many ethical dilemmas individuals confront when thinking about and expressing their views on sensitive topics prone to social desirability bias. The proposed multi-technique focus group approach proved to be effective to engage participants during sessions and to obtain relevant and unanticipated information for the development of new questionnaire items and the reviewing of old ones. Research limitations/implications Implementing Focus Group (FG) in regions with different cultural traditions and levels of development and contrasting the perceptions, values and attitudes of two generations, with different formative backgrounds is not an easy task. In order to secure the adequate number and type of participants, the Focus Group were organized in close collaboration with four higher education institutions and two lifelong learning programs where the sessions took place. Participation was voluntary and consented, in accordance with the applicable legislation and standards for social research. Practical implications The article presents an accessible and adaptable roadmap to researchers working in the field of corruption studies as well as anticorruption government agencies and CSOs interested in enhancing the quality of survey questionnaires on sensitive topics target of social desirability before engaging in a high-cost fieldwork and to describe relevant information that can be extracted from the discussions held. Social implications Most cross-country surveys on corruption tend to use basic/traditional measures to assess the phenomenon, such as questions on extension, acceptability and/or experience. They take almost for granted that people have the same understanding of this complex construct, which may not hold true, as the focus group discussions illustrate. The three-stage focus group design aims to improve the quality of a survey design regarding people's attitudes, perceptions and experiences of corruption in democracy, by contributing to the development of new questions that tap into the relationship between social condemnation and the individual's socio-economic conditions. Originality/value The article provides a low-cost combination of qualitative-oriented (questionnaire development through focus groups) with a quantitative-oriented research tool (mass survey implementation) to meet mixed-method research objectives and enhance the ability to capture several “non-statistical” dimensions of complex social phenomena that are often neglected when a single-methodology approach is used.
id RCAP_dab5e16f9282ffead995e532d470310a
oai_identifier_str oai:repositorio.ul.pt:10451/45934
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmapFocus groupsSurvey designImplementation roadmapQualitative methodsAbstract Purpose This article presents focus groups as a method to enhance questionnaire design to frame and test items for a mass survey on corruption and austerity in democracy. Such methodology lacks systematization when it comes to the description of implementation procedures and the discussion of effective contribution to the development of survey questions on sensitive topics. The objective of this article is to contribute to the specialized literature on corruption by offering a novel focus group approach and a roadmap to guide researchers in the field when using this methodology to develop questionnaire items. This hands-on guide can be adaptable to other (survey) studies on issues prone to social desirability bias. Design/methodology/approach This article proposes an innovative multi-technique (short questionnaire, visual stimuli and exploratory discussion with expert moderation) focus group approach to collect informal impressions about corruption and austerity. By developing a focus group design through the combination of different research techniques, the authors were able to triangulate reflexive, spontaneous and interactive qualitative bottom-up information about individual perceptions and reactions to sensitive topics. By describing how to implement these groups, other than discussing what type of qualitative information can be extracted from these discussions and to what effect, the authors seek to present a hands-on guide that can be replicated and adapted to similar studies. This roadmap will help researchers to test individual perceptions and reactions to sensitive topics through the use of tailored focus groups in order to enhance the quality of survey questionnaires prior to engaging in a high-cost fieldwork. Findings The article concludes that the adoption of the multi-technique focus group approach to requalify and test questions for a nationwide survey gives us a better understanding of the many ethical dilemmas individuals confront when thinking about and expressing their views on sensitive topics prone to social desirability bias. The proposed multi-technique focus group approach proved to be effective to engage participants during sessions and to obtain relevant and unanticipated information for the development of new questionnaire items and the reviewing of old ones. Research limitations/implications Implementing Focus Group (FG) in regions with different cultural traditions and levels of development and contrasting the perceptions, values and attitudes of two generations, with different formative backgrounds is not an easy task. In order to secure the adequate number and type of participants, the Focus Group were organized in close collaboration with four higher education institutions and two lifelong learning programs where the sessions took place. Participation was voluntary and consented, in accordance with the applicable legislation and standards for social research. Practical implications The article presents an accessible and adaptable roadmap to researchers working in the field of corruption studies as well as anticorruption government agencies and CSOs interested in enhancing the quality of survey questionnaires on sensitive topics target of social desirability before engaging in a high-cost fieldwork and to describe relevant information that can be extracted from the discussions held. Social implications Most cross-country surveys on corruption tend to use basic/traditional measures to assess the phenomenon, such as questions on extension, acceptability and/or experience. They take almost for granted that people have the same understanding of this complex construct, which may not hold true, as the focus group discussions illustrate. The three-stage focus group design aims to improve the quality of a survey design regarding people's attitudes, perceptions and experiences of corruption in democracy, by contributing to the development of new questions that tap into the relationship between social condemnation and the individual's socio-economic conditions. Originality/value The article provides a low-cost combination of qualitative-oriented (questionnaire development through focus groups) with a quantitative-oriented research tool (mass survey implementation) to meet mixed-method research objectives and enhance the ability to capture several “non-statistical” dimensions of complex social phenomena that are often neglected when a single-methodology approach is used.EmeraldRepositório da Universidade de LisboaSousa, Luis dePinto, Isabel R.Clemente, FelippeGouvêa Maciel, G.2021-01-26T16:59:57Z20212021-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10451/45934engde Sousa, Luis, Pinto, Isabel, Clemente, Felippe, Maciel, Gustavo (2021). Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap. Qualitative Research Journal, 21 (3), 304-319 (Published online 22 December 2020)1443-988310.1108/QRJ-09-2020-0110info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-11-08T16:47:59Zoai:repositorio.ul.pt:10451/45934Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T21:58:15.836507Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
title Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
spellingShingle Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
Sousa, Luis de
Focus groups
Survey design
Implementation roadmap
Qualitative methods
title_short Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
title_full Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
title_fullStr Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
title_full_unstemmed Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
title_sort Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap
author Sousa, Luis de
author_facet Sousa, Luis de
Pinto, Isabel R.
Clemente, Felippe
Gouvêa Maciel, G.
author_role author
author2 Pinto, Isabel R.
Clemente, Felippe
Gouvêa Maciel, G.
author2_role author
author
author
dc.contributor.none.fl_str_mv Repositório da Universidade de Lisboa
dc.contributor.author.fl_str_mv Sousa, Luis de
Pinto, Isabel R.
Clemente, Felippe
Gouvêa Maciel, G.
dc.subject.por.fl_str_mv Focus groups
Survey design
Implementation roadmap
Qualitative methods
topic Focus groups
Survey design
Implementation roadmap
Qualitative methods
description Abstract Purpose This article presents focus groups as a method to enhance questionnaire design to frame and test items for a mass survey on corruption and austerity in democracy. Such methodology lacks systematization when it comes to the description of implementation procedures and the discussion of effective contribution to the development of survey questions on sensitive topics. The objective of this article is to contribute to the specialized literature on corruption by offering a novel focus group approach and a roadmap to guide researchers in the field when using this methodology to develop questionnaire items. This hands-on guide can be adaptable to other (survey) studies on issues prone to social desirability bias. Design/methodology/approach This article proposes an innovative multi-technique (short questionnaire, visual stimuli and exploratory discussion with expert moderation) focus group approach to collect informal impressions about corruption and austerity. By developing a focus group design through the combination of different research techniques, the authors were able to triangulate reflexive, spontaneous and interactive qualitative bottom-up information about individual perceptions and reactions to sensitive topics. By describing how to implement these groups, other than discussing what type of qualitative information can be extracted from these discussions and to what effect, the authors seek to present a hands-on guide that can be replicated and adapted to similar studies. This roadmap will help researchers to test individual perceptions and reactions to sensitive topics through the use of tailored focus groups in order to enhance the quality of survey questionnaires prior to engaging in a high-cost fieldwork. Findings The article concludes that the adoption of the multi-technique focus group approach to requalify and test questions for a nationwide survey gives us a better understanding of the many ethical dilemmas individuals confront when thinking about and expressing their views on sensitive topics prone to social desirability bias. The proposed multi-technique focus group approach proved to be effective to engage participants during sessions and to obtain relevant and unanticipated information for the development of new questionnaire items and the reviewing of old ones. Research limitations/implications Implementing Focus Group (FG) in regions with different cultural traditions and levels of development and contrasting the perceptions, values and attitudes of two generations, with different formative backgrounds is not an easy task. In order to secure the adequate number and type of participants, the Focus Group were organized in close collaboration with four higher education institutions and two lifelong learning programs where the sessions took place. Participation was voluntary and consented, in accordance with the applicable legislation and standards for social research. Practical implications The article presents an accessible and adaptable roadmap to researchers working in the field of corruption studies as well as anticorruption government agencies and CSOs interested in enhancing the quality of survey questionnaires on sensitive topics target of social desirability before engaging in a high-cost fieldwork and to describe relevant information that can be extracted from the discussions held. Social implications Most cross-country surveys on corruption tend to use basic/traditional measures to assess the phenomenon, such as questions on extension, acceptability and/or experience. They take almost for granted that people have the same understanding of this complex construct, which may not hold true, as the focus group discussions illustrate. The three-stage focus group design aims to improve the quality of a survey design regarding people's attitudes, perceptions and experiences of corruption in democracy, by contributing to the development of new questions that tap into the relationship between social condemnation and the individual's socio-economic conditions. Originality/value The article provides a low-cost combination of qualitative-oriented (questionnaire development through focus groups) with a quantitative-oriented research tool (mass survey implementation) to meet mixed-method research objectives and enhance the ability to capture several “non-statistical” dimensions of complex social phenomena that are often neglected when a single-methodology approach is used.
publishDate 2021
dc.date.none.fl_str_mv 2021-01-26T16:59:57Z
2021
2021-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10451/45934
url http://hdl.handle.net/10451/45934
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv de Sousa, Luis, Pinto, Isabel, Clemente, Felippe, Maciel, Gustavo (2021). Using a three-stage focus group design to develop questionnaire items for a mass survey on corruption and austerity: a roadmap. Qualitative Research Journal, 21 (3), 304-319 (Published online 22 December 2020)
1443-9883
10.1108/QRJ-09-2020-0110
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Emerald
publisher.none.fl_str_mv Emerald
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799134527717638144