Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording

Detalhes bibliográficos
Autor(a) principal: Maroco, João
Data de Publicação: 2014
Outros Autores: Maroco, Ana Lúcia, Campos, Juliana Alvares Duarte Bonini [UNESP]
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
DOI: 10.4236/ojs.2014.46046
Texto Completo: http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHw
http://hdl.handle.net/11449/126021
Resumo: This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.
id UNSP_177e22edeb372ab1e13327130867f30e
oai_identifier_str oai:repositorio.unesp.br:11449/126021
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wordingBurnoutMaslach burnout inventory—student surveyValidityReliabilityItem inversionThis study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.Universidade Estadual Paulista Júlio de Mesquita Filho, Departamento de Odontologia Social, Faculdade de Odontologia de Araraquara, Araraquara, Rua Humaitá 1680, Centro, CEP 14801-385, SP, BrasilUnidade de Investigação em Psicologia e Saúde, Instituto Superior de Psicologia Aplicada (ISPA), Lisboa, Portugal.Universidade Estadual Paulista Júlio de Mesquita Filho, Departamento de Odontologia Social, Faculdade de Odontologia de Araraquara, Araraquara, Rua Humaitá 1680, Centro, CEP 14801-385, SP, BrasilUniversidade Estadual Paulista (Unesp)Instituto Superior de Psicologia Aplicada (ISPA)Maroco, JoãoMaroco, Ana LúciaCampos, Juliana Alvares Duarte Bonini [UNESP]2015-08-06T16:13:44Z2015-08-06T16:13:44Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article484-493http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHwOpen Journal of Statistics, v. 04, n. 06, p. 484-493, 2014.2161-718Xhttp://hdl.handle.net/11449/12602110.4236/ojs.2014.460467167211040669505Currículo Lattesreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengOpen Journal of Statisticsinfo:eu-repo/semantics/openAccess2024-09-27T18:42:54Zoai:repositorio.unesp.br:11449/126021Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestrepositoriounesp@unesp.bropendoar:29462024-09-27T18:42:54Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
title Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
spellingShingle Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
Maroco, João
Burnout
Maslach burnout inventory—student survey
Validity
Reliability
Item inversion
Maroco, João
Burnout
Maslach burnout inventory—student survey
Validity
Reliability
Item inversion
title_short Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
title_full Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
title_fullStr Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
title_full_unstemmed Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
title_sort Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
author Maroco, João
author_facet Maroco, João
Maroco, João
Maroco, Ana Lúcia
Campos, Juliana Alvares Duarte Bonini [UNESP]
Maroco, Ana Lúcia
Campos, Juliana Alvares Duarte Bonini [UNESP]
author_role author
author2 Maroco, Ana Lúcia
Campos, Juliana Alvares Duarte Bonini [UNESP]
author2_role author
author
dc.contributor.none.fl_str_mv Universidade Estadual Paulista (Unesp)
Instituto Superior de Psicologia Aplicada (ISPA)
dc.contributor.author.fl_str_mv Maroco, João
Maroco, Ana Lúcia
Campos, Juliana Alvares Duarte Bonini [UNESP]
dc.subject.por.fl_str_mv Burnout
Maslach burnout inventory—student survey
Validity
Reliability
Item inversion
topic Burnout
Maslach burnout inventory—student survey
Validity
Reliability
Item inversion
description This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.
publishDate 2014
dc.date.none.fl_str_mv 2014
2015-08-06T16:13:44Z
2015-08-06T16:13:44Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHw
Open Journal of Statistics, v. 04, n. 06, p. 484-493, 2014.
2161-718X
http://hdl.handle.net/11449/126021
10.4236/ojs.2014.46046
7167211040669505
url http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHw
http://hdl.handle.net/11449/126021
identifier_str_mv Open Journal of Statistics, v. 04, n. 06, p. 484-493, 2014.
2161-718X
10.4236/ojs.2014.46046
7167211040669505
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Open Journal of Statistics
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 484-493
dc.source.none.fl_str_mv Currículo Lattes
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv repositoriounesp@unesp.br
_version_ 1822183859370852352
dc.identifier.doi.none.fl_str_mv 10.4236/ojs.2014.46046