Predicting completion time in high-stakes exams
Autor(a) principal: | |
---|---|
Data de Publicação: | 2019 |
Outros Autores: | , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | https://hdl.handle.net/1822/57898 |
Resumo: | For the majority of students, assessment moments are associated with significant levels of stress and anxiety. While a certain amount of stress motivates the individual and improves performance, too much stress will have the contrary effect. Stress has therefore a fundamental role on student performance. It should be the educational organizations’ mission to understand the underlying mechanisms that lead to performance anxiety and provide their students with the best coping tools and strategies. In the present study we analyze student behavior during e-assessment in terms of mouse dynamics. Two major behavioral patterns can be identified, based on ten features that quantify the performance of the student’s interaction with the computer: (1) students who are able to sustain performance during the exam and (2) students whose performance varies significantly. Data shows that the behavior of each student during the exam correlates strongly with the time it takes the student to complete it. Several classifiers were trained that predict the completion time of each exam based on the students’ interaction patterns. Two of them do it with an average error of around twelve minutes. Results show that there are still mechanisms that can be explored to better understand the complex relationship between stress, performance and human behavior, that can be used for the implementation of better stress detection, monitoring and coping strategies. |
id |
RCAP_866bfa50caf50635d12720e4d37f7123 |
---|---|
oai_identifier_str |
oai:repositorium.sdum.uminho.pt:1822/57898 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
Predicting completion time in high-stakes examsNeural NetworksOnline examsRandom decision forestsStressScience & TechnologyFor the majority of students, assessment moments are associated with significant levels of stress and anxiety. While a certain amount of stress motivates the individual and improves performance, too much stress will have the contrary effect. Stress has therefore a fundamental role on student performance. It should be the educational organizations’ mission to understand the underlying mechanisms that lead to performance anxiety and provide their students with the best coping tools and strategies. In the present study we analyze student behavior during e-assessment in terms of mouse dynamics. Two major behavioral patterns can be identified, based on ten features that quantify the performance of the student’s interaction with the computer: (1) students who are able to sustain performance during the exam and (2) students whose performance varies significantly. Data shows that the behavior of each student during the exam correlates strongly with the time it takes the student to complete it. Several classifiers were trained that predict the completion time of each exam based on the students’ interaction patterns. Two of them do it with an average error of around twelve minutes. Results show that there are still mechanisms that can be explored to better understand the complex relationship between stress, performance and human behavior, that can be used for the implementation of better stress detection, monitoring and coping strategies.This work has been supported by COMPETE, Portugal: POCI-01- 0145-FEDER-007043 and FCT – Fundação para a Ciência e Tecnologia, Portugal within the Project Scope: UID/CEC/00319/2013. This work was funded by ‘‘EUSTRESS – Sistema de Informação para a monitorização e avaliação dos níveis do stress e previsão de stress crónico, Portugal’’, No. 2015/017832 P2020 SI I&DT, (NUP, Portugal, NORTE-01-0247-FEDER-017832) in co-promotion between Optimizer-Lda and ICVS/3B’s-Uminho.Elsevier B.V.Universidade do MinhoCarneiro, Davide RuaNovais, PauloDurães, DalilaPego, José MiguelSousa, Nuno20192019-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/57898eng0167-739X10.1016/j.future.2018.01.061info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-12-30T01:24:49Zoai:repositorium.sdum.uminho.pt:1822/57898Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T19:12:51.029529Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
Predicting completion time in high-stakes exams |
title |
Predicting completion time in high-stakes exams |
spellingShingle |
Predicting completion time in high-stakes exams Carneiro, Davide Rua Neural Networks Online exams Random decision forests Stress Science & Technology |
title_short |
Predicting completion time in high-stakes exams |
title_full |
Predicting completion time in high-stakes exams |
title_fullStr |
Predicting completion time in high-stakes exams |
title_full_unstemmed |
Predicting completion time in high-stakes exams |
title_sort |
Predicting completion time in high-stakes exams |
author |
Carneiro, Davide Rua |
author_facet |
Carneiro, Davide Rua Novais, Paulo Durães, Dalila Pego, José Miguel Sousa, Nuno |
author_role |
author |
author2 |
Novais, Paulo Durães, Dalila Pego, José Miguel Sousa, Nuno |
author2_role |
author author author author |
dc.contributor.none.fl_str_mv |
Universidade do Minho |
dc.contributor.author.fl_str_mv |
Carneiro, Davide Rua Novais, Paulo Durães, Dalila Pego, José Miguel Sousa, Nuno |
dc.subject.por.fl_str_mv |
Neural Networks Online exams Random decision forests Stress Science & Technology |
topic |
Neural Networks Online exams Random decision forests Stress Science & Technology |
description |
For the majority of students, assessment moments are associated with significant levels of stress and anxiety. While a certain amount of stress motivates the individual and improves performance, too much stress will have the contrary effect. Stress has therefore a fundamental role on student performance. It should be the educational organizations’ mission to understand the underlying mechanisms that lead to performance anxiety and provide their students with the best coping tools and strategies. In the present study we analyze student behavior during e-assessment in terms of mouse dynamics. Two major behavioral patterns can be identified, based on ten features that quantify the performance of the student’s interaction with the computer: (1) students who are able to sustain performance during the exam and (2) students whose performance varies significantly. Data shows that the behavior of each student during the exam correlates strongly with the time it takes the student to complete it. Several classifiers were trained that predict the completion time of each exam based on the students’ interaction patterns. Two of them do it with an average error of around twelve minutes. Results show that there are still mechanisms that can be explored to better understand the complex relationship between stress, performance and human behavior, that can be used for the implementation of better stress detection, monitoring and coping strategies. |
publishDate |
2019 |
dc.date.none.fl_str_mv |
2019 2019-01-01T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://hdl.handle.net/1822/57898 |
url |
https://hdl.handle.net/1822/57898 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
0167-739X 10.1016/j.future.2018.01.061 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Elsevier B.V. |
publisher.none.fl_str_mv |
Elsevier B.V. |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799132564586233856 |