Planning the Design and Execution of Student Performance Assessment in Serious Games

Detalhes bibliográficos
Autor(a) principal: Oliveira, Rháleff N. R.
Data de Publicação: 2021
Outros Autores: Rocha, Rafaela V., Goya, Denise H.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Journal on Interactive Systems
Texto Completo: https://sol.sbc.org.br/journals/index.php/jis/article/view/1907
Resumo: Serious Games (SGs) are used to support knowledge acquisition and skill development. For this, there is a need to measure the results achieved (both during and after students play) to ensure the game effectiveness. In this context, the aim is to develop and evaluate the AvaliaJS, a conceptual model to structure, guide and support the planning of the design and execution of the student's performance assessment in SGs. AvaliaJS has two artifacts: a canvas model, for high-level planning, and an assessment project document, for more detailed specifications of the canvas. To analyze and exemplify the use of the model, the artifacts were applied to three ready-made games as a proof of concept. In addition, the quality of AvaliaJS was evaluated by experts in SGs development and assessment using a questionnaire. The results of experts' answers confirm a good internal consistency (Cronbach's alpha α = 0.87) which indicates that AvaliaJS is correct, authentic, consistent, clear, unambiguous and flexible. However, the model will need to be validated during the process of creating a new game to ensure its usability and efficiency. In general, AvaliaJS can be used to support the team in the planning, documentation and development of artifacts and data collection in SGs, as well as in the execution of the assessment, learning measurement and constant and personalized feedback for students.
id SBC-3_3b4b06425d94dcdbd49caaf549da18b4
oai_identifier_str oai:ojs2.sol.sbc.org.br:article/1907
network_acronym_str SBC-3
network_name_str Journal on Interactive Systems
repository_id_str
spelling Planning the Design and Execution of Student Performance Assessment in Serious GamesSerious GamesConceptual ModelHuman Performance AssessmentEvaluationSerious Games (SGs) are used to support knowledge acquisition and skill development. For this, there is a need to measure the results achieved (both during and after students play) to ensure the game effectiveness. In this context, the aim is to develop and evaluate the AvaliaJS, a conceptual model to structure, guide and support the planning of the design and execution of the student's performance assessment in SGs. AvaliaJS has two artifacts: a canvas model, for high-level planning, and an assessment project document, for more detailed specifications of the canvas. To analyze and exemplify the use of the model, the artifacts were applied to three ready-made games as a proof of concept. In addition, the quality of AvaliaJS was evaluated by experts in SGs development and assessment using a questionnaire. The results of experts' answers confirm a good internal consistency (Cronbach's alpha α = 0.87) which indicates that AvaliaJS is correct, authentic, consistent, clear, unambiguous and flexible. However, the model will need to be validated during the process of creating a new game to ensure its usability and efficiency. In general, AvaliaJS can be used to support the team in the planning, documentation and development of artifacts and data collection in SGs, as well as in the execution of the assessment, learning measurement and constant and personalized feedback for students.Brazilian Computer Society2021-11-12info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://sol.sbc.org.br/journals/index.php/jis/article/view/190710.5753/jis.2021.1907Journal of Interactive Systems; v. 12 n. 1 (2021); 172-190Journal on Interactive Systems; Vol. 12 No. 1 (2021); 172-1902763-771910.5753/jis.2021reponame:Journal on Interactive Systemsinstname:Sociedade Brasileira de Computação (SBC)instacron:SBCenghttps://sol.sbc.org.br/journals/index.php/jis/article/view/1907/1861Copyright (c) 2021 Rháleff N. R. Oliveira, Rafaela V. Rocha, Denise H. Goyahttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessOliveira, Rháleff N. R.Rocha, Rafaela V.Goya, Denise H.2023-10-12T20:48:07Zoai:ojs2.sol.sbc.org.br:article/1907Revistahttps://sol.sbc.org.br/journals/index.php/jis/ONGhttps://sol.sbc.org.br/journals/index.php/jis/oaijis@sbc.org.br2763-77192763-7719opendoar:2023-10-12T20:48:07Journal on Interactive Systems - Sociedade Brasileira de Computação (SBC)false
dc.title.none.fl_str_mv Planning the Design and Execution of Student Performance Assessment in Serious Games
title Planning the Design and Execution of Student Performance Assessment in Serious Games
spellingShingle Planning the Design and Execution of Student Performance Assessment in Serious Games
Oliveira, Rháleff N. R.
Serious Games
Conceptual Model
Human Performance Assessment
Evaluation
title_short Planning the Design and Execution of Student Performance Assessment in Serious Games
title_full Planning the Design and Execution of Student Performance Assessment in Serious Games
title_fullStr Planning the Design and Execution of Student Performance Assessment in Serious Games
title_full_unstemmed Planning the Design and Execution of Student Performance Assessment in Serious Games
title_sort Planning the Design and Execution of Student Performance Assessment in Serious Games
author Oliveira, Rháleff N. R.
author_facet Oliveira, Rháleff N. R.
Rocha, Rafaela V.
Goya, Denise H.
author_role author
author2 Rocha, Rafaela V.
Goya, Denise H.
author2_role author
author
dc.contributor.author.fl_str_mv Oliveira, Rháleff N. R.
Rocha, Rafaela V.
Goya, Denise H.
dc.subject.por.fl_str_mv Serious Games
Conceptual Model
Human Performance Assessment
Evaluation
topic Serious Games
Conceptual Model
Human Performance Assessment
Evaluation
description Serious Games (SGs) are used to support knowledge acquisition and skill development. For this, there is a need to measure the results achieved (both during and after students play) to ensure the game effectiveness. In this context, the aim is to develop and evaluate the AvaliaJS, a conceptual model to structure, guide and support the planning of the design and execution of the student's performance assessment in SGs. AvaliaJS has two artifacts: a canvas model, for high-level planning, and an assessment project document, for more detailed specifications of the canvas. To analyze and exemplify the use of the model, the artifacts were applied to three ready-made games as a proof of concept. In addition, the quality of AvaliaJS was evaluated by experts in SGs development and assessment using a questionnaire. The results of experts' answers confirm a good internal consistency (Cronbach's alpha α = 0.87) which indicates that AvaliaJS is correct, authentic, consistent, clear, unambiguous and flexible. However, the model will need to be validated during the process of creating a new game to ensure its usability and efficiency. In general, AvaliaJS can be used to support the team in the planning, documentation and development of artifacts and data collection in SGs, as well as in the execution of the assessment, learning measurement and constant and personalized feedback for students.
publishDate 2021
dc.date.none.fl_str_mv 2021-11-12
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://sol.sbc.org.br/journals/index.php/jis/article/view/1907
10.5753/jis.2021.1907
url https://sol.sbc.org.br/journals/index.php/jis/article/view/1907
identifier_str_mv 10.5753/jis.2021.1907
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://sol.sbc.org.br/journals/index.php/jis/article/view/1907/1861
dc.rights.driver.fl_str_mv Copyright (c) 2021 Rháleff N. R. Oliveira, Rafaela V. Rocha, Denise H. Goya
http://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2021 Rháleff N. R. Oliveira, Rafaela V. Rocha, Denise H. Goya
http://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Brazilian Computer Society
publisher.none.fl_str_mv Brazilian Computer Society
dc.source.none.fl_str_mv Journal of Interactive Systems; v. 12 n. 1 (2021); 172-190
Journal on Interactive Systems; Vol. 12 No. 1 (2021); 172-190
2763-7719
10.5753/jis.2021
reponame:Journal on Interactive Systems
instname:Sociedade Brasileira de Computação (SBC)
instacron:SBC
instname_str Sociedade Brasileira de Computação (SBC)
instacron_str SBC
institution SBC
reponame_str Journal on Interactive Systems
collection Journal on Interactive Systems
repository.name.fl_str_mv Journal on Interactive Systems - Sociedade Brasileira de Computação (SBC)
repository.mail.fl_str_mv jis@sbc.org.br
_version_ 1796797411113304064