Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording
Autor(a) principal: | |
---|---|
Data de Publicação: | 2014 |
Outros Autores: | , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
DOI: | 10.4236/ojs.2014.46046 |
Texto Completo: | http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHw http://hdl.handle.net/11449/126021 |
Resumo: | This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded. |
id |
UNSP_177e22edeb372ab1e13327130867f30e |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/126021 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wordingBurnoutMaslach burnout inventory—student surveyValidityReliabilityItem inversionThis study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.Universidade Estadual Paulista Júlio de Mesquita Filho, Departamento de Odontologia Social, Faculdade de Odontologia de Araraquara, Araraquara, Rua Humaitá 1680, Centro, CEP 14801-385, SP, BrasilUnidade de Investigação em Psicologia e Saúde, Instituto Superior de Psicologia Aplicada (ISPA), Lisboa, Portugal.Universidade Estadual Paulista Júlio de Mesquita Filho, Departamento de Odontologia Social, Faculdade de Odontologia de Araraquara, Araraquara, Rua Humaitá 1680, Centro, CEP 14801-385, SP, BrasilUniversidade Estadual Paulista (Unesp)Instituto Superior de Psicologia Aplicada (ISPA)Maroco, JoãoMaroco, Ana LúciaCampos, Juliana Alvares Duarte Bonini [UNESP]2015-08-06T16:13:44Z2015-08-06T16:13:44Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article484-493http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHwOpen Journal of Statistics, v. 04, n. 06, p. 484-493, 2014.2161-718Xhttp://hdl.handle.net/11449/12602110.4236/ojs.2014.460467167211040669505Currículo Lattesreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengOpen Journal of Statisticsinfo:eu-repo/semantics/openAccess2024-09-27T18:42:54Zoai:repositorio.unesp.br:11449/126021Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestrepositoriounesp@unesp.bropendoar:29462024-09-27T18:42:54Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
title |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
spellingShingle |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording Maroco, João Burnout Maslach burnout inventory—student survey Validity Reliability Item inversion Maroco, João Burnout Maslach burnout inventory—student survey Validity Reliability Item inversion |
title_short |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
title_full |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
title_fullStr |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
title_full_unstemmed |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
title_sort |
Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording |
author |
Maroco, João |
author_facet |
Maroco, João Maroco, João Maroco, Ana Lúcia Campos, Juliana Alvares Duarte Bonini [UNESP] Maroco, Ana Lúcia Campos, Juliana Alvares Duarte Bonini [UNESP] |
author_role |
author |
author2 |
Maroco, Ana Lúcia Campos, Juliana Alvares Duarte Bonini [UNESP] |
author2_role |
author author |
dc.contributor.none.fl_str_mv |
Universidade Estadual Paulista (Unesp) Instituto Superior de Psicologia Aplicada (ISPA) |
dc.contributor.author.fl_str_mv |
Maroco, João Maroco, Ana Lúcia Campos, Juliana Alvares Duarte Bonini [UNESP] |
dc.subject.por.fl_str_mv |
Burnout Maslach burnout inventory—student survey Validity Reliability Item inversion |
topic |
Burnout Maslach burnout inventory—student survey Validity Reliability Item inversion |
description |
This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded. |
publishDate |
2014 |
dc.date.none.fl_str_mv |
2014 2015-08-06T16:13:44Z 2015-08-06T16:13:44Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHw Open Journal of Statistics, v. 04, n. 06, p. 484-493, 2014. 2161-718X http://hdl.handle.net/11449/126021 10.4236/ojs.2014.46046 7167211040669505 |
url |
http://www.scirp.org/Journal/PaperInformation.aspx?PaperID=49248#.Vb-sMBtVhHw http://hdl.handle.net/11449/126021 |
identifier_str_mv |
Open Journal of Statistics, v. 04, n. 06, p. 484-493, 2014. 2161-718X 10.4236/ojs.2014.46046 7167211040669505 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Open Journal of Statistics |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
484-493 |
dc.source.none.fl_str_mv |
Currículo Lattes reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
repositoriounesp@unesp.br |
_version_ |
1822183859370852352 |
dc.identifier.doi.none.fl_str_mv |
10.4236/ojs.2014.46046 |