Planning the Design and Execution of Student Performance Assessment in Serious Games
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Journal on Interactive Systems |
Texto Completo: | https://sol.sbc.org.br/journals/index.php/jis/article/view/1907 |
Resumo: | Serious Games (SGs) are used to support knowledge acquisition and skill development. For this, there is a need to measure the results achieved (both during and after students play) to ensure the game effectiveness. In this context, the aim is to develop and evaluate the AvaliaJS, a conceptual model to structure, guide and support the planning of the design and execution of the student's performance assessment in SGs. AvaliaJS has two artifacts: a canvas model, for high-level planning, and an assessment project document, for more detailed specifications of the canvas. To analyze and exemplify the use of the model, the artifacts were applied to three ready-made games as a proof of concept. In addition, the quality of AvaliaJS was evaluated by experts in SGs development and assessment using a questionnaire. The results of experts' answers confirm a good internal consistency (Cronbach's alpha α = 0.87) which indicates that AvaliaJS is correct, authentic, consistent, clear, unambiguous and flexible. However, the model will need to be validated during the process of creating a new game to ensure its usability and efficiency. In general, AvaliaJS can be used to support the team in the planning, documentation and development of artifacts and data collection in SGs, as well as in the execution of the assessment, learning measurement and constant and personalized feedback for students. |
id |
SBC-3_3b4b06425d94dcdbd49caaf549da18b4 |
---|---|
oai_identifier_str |
oai:ojs2.sol.sbc.org.br:article/1907 |
network_acronym_str |
SBC-3 |
network_name_str |
Journal on Interactive Systems |
repository_id_str |
|
spelling |
Planning the Design and Execution of Student Performance Assessment in Serious GamesSerious GamesConceptual ModelHuman Performance AssessmentEvaluationSerious Games (SGs) are used to support knowledge acquisition and skill development. For this, there is a need to measure the results achieved (both during and after students play) to ensure the game effectiveness. In this context, the aim is to develop and evaluate the AvaliaJS, a conceptual model to structure, guide and support the planning of the design and execution of the student's performance assessment in SGs. AvaliaJS has two artifacts: a canvas model, for high-level planning, and an assessment project document, for more detailed specifications of the canvas. To analyze and exemplify the use of the model, the artifacts were applied to three ready-made games as a proof of concept. In addition, the quality of AvaliaJS was evaluated by experts in SGs development and assessment using a questionnaire. The results of experts' answers confirm a good internal consistency (Cronbach's alpha α = 0.87) which indicates that AvaliaJS is correct, authentic, consistent, clear, unambiguous and flexible. However, the model will need to be validated during the process of creating a new game to ensure its usability and efficiency. In general, AvaliaJS can be used to support the team in the planning, documentation and development of artifacts and data collection in SGs, as well as in the execution of the assessment, learning measurement and constant and personalized feedback for students.Brazilian Computer Society2021-11-12info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://sol.sbc.org.br/journals/index.php/jis/article/view/190710.5753/jis.2021.1907Journal of Interactive Systems; v. 12 n. 1 (2021); 172-190Journal on Interactive Systems; Vol. 12 No. 1 (2021); 172-1902763-771910.5753/jis.2021reponame:Journal on Interactive Systemsinstname:Sociedade Brasileira de Computação (SBC)instacron:SBCenghttps://sol.sbc.org.br/journals/index.php/jis/article/view/1907/1861Copyright (c) 2021 Rháleff N. R. Oliveira, Rafaela V. Rocha, Denise H. Goyahttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessOliveira, Rháleff N. R.Rocha, Rafaela V.Goya, Denise H.2023-10-12T20:48:07Zoai:ojs2.sol.sbc.org.br:article/1907Revistahttps://sol.sbc.org.br/journals/index.php/jis/ONGhttps://sol.sbc.org.br/journals/index.php/jis/oaijis@sbc.org.br2763-77192763-7719opendoar:2023-10-12T20:48:07Journal on Interactive Systems - Sociedade Brasileira de Computação (SBC)false |
dc.title.none.fl_str_mv |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
title |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
spellingShingle |
Planning the Design and Execution of Student Performance Assessment in Serious Games Oliveira, Rháleff N. R. Serious Games Conceptual Model Human Performance Assessment Evaluation |
title_short |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
title_full |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
title_fullStr |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
title_full_unstemmed |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
title_sort |
Planning the Design and Execution of Student Performance Assessment in Serious Games |
author |
Oliveira, Rháleff N. R. |
author_facet |
Oliveira, Rháleff N. R. Rocha, Rafaela V. Goya, Denise H. |
author_role |
author |
author2 |
Rocha, Rafaela V. Goya, Denise H. |
author2_role |
author author |
dc.contributor.author.fl_str_mv |
Oliveira, Rháleff N. R. Rocha, Rafaela V. Goya, Denise H. |
dc.subject.por.fl_str_mv |
Serious Games Conceptual Model Human Performance Assessment Evaluation |
topic |
Serious Games Conceptual Model Human Performance Assessment Evaluation |
description |
Serious Games (SGs) are used to support knowledge acquisition and skill development. For this, there is a need to measure the results achieved (both during and after students play) to ensure the game effectiveness. In this context, the aim is to develop and evaluate the AvaliaJS, a conceptual model to structure, guide and support the planning of the design and execution of the student's performance assessment in SGs. AvaliaJS has two artifacts: a canvas model, for high-level planning, and an assessment project document, for more detailed specifications of the canvas. To analyze and exemplify the use of the model, the artifacts were applied to three ready-made games as a proof of concept. In addition, the quality of AvaliaJS was evaluated by experts in SGs development and assessment using a questionnaire. The results of experts' answers confirm a good internal consistency (Cronbach's alpha α = 0.87) which indicates that AvaliaJS is correct, authentic, consistent, clear, unambiguous and flexible. However, the model will need to be validated during the process of creating a new game to ensure its usability and efficiency. In general, AvaliaJS can be used to support the team in the planning, documentation and development of artifacts and data collection in SGs, as well as in the execution of the assessment, learning measurement and constant and personalized feedback for students. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-11-12 |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://sol.sbc.org.br/journals/index.php/jis/article/view/1907 10.5753/jis.2021.1907 |
url |
https://sol.sbc.org.br/journals/index.php/jis/article/view/1907 |
identifier_str_mv |
10.5753/jis.2021.1907 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
https://sol.sbc.org.br/journals/index.php/jis/article/view/1907/1861 |
dc.rights.driver.fl_str_mv |
Copyright (c) 2021 Rháleff N. R. Oliveira, Rafaela V. Rocha, Denise H. Goya http://creativecommons.org/licenses/by/4.0 info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Copyright (c) 2021 Rháleff N. R. Oliveira, Rafaela V. Rocha, Denise H. Goya http://creativecommons.org/licenses/by/4.0 |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Brazilian Computer Society |
publisher.none.fl_str_mv |
Brazilian Computer Society |
dc.source.none.fl_str_mv |
Journal of Interactive Systems; v. 12 n. 1 (2021); 172-190 Journal on Interactive Systems; Vol. 12 No. 1 (2021); 172-190 2763-7719 10.5753/jis.2021 reponame:Journal on Interactive Systems instname:Sociedade Brasileira de Computação (SBC) instacron:SBC |
instname_str |
Sociedade Brasileira de Computação (SBC) |
instacron_str |
SBC |
institution |
SBC |
reponame_str |
Journal on Interactive Systems |
collection |
Journal on Interactive Systems |
repository.name.fl_str_mv |
Journal on Interactive Systems - Sociedade Brasileira de Computação (SBC) |
repository.mail.fl_str_mv |
jis@sbc.org.br |
_version_ |
1796797411113304064 |