Predicting completion time in high-stakes exams

Detalhes bibliográficos
Autor(a) principal: Carneiro, Davide Rua
Data de Publicação: 2019
Outros Autores: Novais, Paulo, Durães, Dalila, Pego, José Miguel, Sousa, Nuno
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: https://hdl.handle.net/1822/57898
Resumo: For the majority of students, assessment moments are associated with significant levels of stress and anxiety. While a certain amount of stress motivates the individual and improves performance, too much stress will have the contrary effect. Stress has therefore a fundamental role on student performance. It should be the educational organizations’ mission to understand the underlying mechanisms that lead to performance anxiety and provide their students with the best coping tools and strategies. In the present study we analyze student behavior during e-assessment in terms of mouse dynamics. Two major behavioral patterns can be identified, based on ten features that quantify the performance of the student’s interaction with the computer: (1) students who are able to sustain performance during the exam and (2) students whose performance varies significantly. Data shows that the behavior of each student during the exam correlates strongly with the time it takes the student to complete it. Several classifiers were trained that predict the completion time of each exam based on the students’ interaction patterns. Two of them do it with an average error of around twelve minutes. Results show that there are still mechanisms that can be explored to better understand the complex relationship between stress, performance and human behavior, that can be used for the implementation of better stress detection, monitoring and coping strategies.
id RCAP_866bfa50caf50635d12720e4d37f7123
oai_identifier_str oai:repositorium.sdum.uminho.pt:1822/57898
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Predicting completion time in high-stakes examsNeural NetworksOnline examsRandom decision forestsStressScience & TechnologyFor the majority of students, assessment moments are associated with significant levels of stress and anxiety. While a certain amount of stress motivates the individual and improves performance, too much stress will have the contrary effect. Stress has therefore a fundamental role on student performance. It should be the educational organizations’ mission to understand the underlying mechanisms that lead to performance anxiety and provide their students with the best coping tools and strategies. In the present study we analyze student behavior during e-assessment in terms of mouse dynamics. Two major behavioral patterns can be identified, based on ten features that quantify the performance of the student’s interaction with the computer: (1) students who are able to sustain performance during the exam and (2) students whose performance varies significantly. Data shows that the behavior of each student during the exam correlates strongly with the time it takes the student to complete it. Several classifiers were trained that predict the completion time of each exam based on the students’ interaction patterns. Two of them do it with an average error of around twelve minutes. Results show that there are still mechanisms that can be explored to better understand the complex relationship between stress, performance and human behavior, that can be used for the implementation of better stress detection, monitoring and coping strategies.This work has been supported by COMPETE, Portugal: POCI-01- 0145-FEDER-007043 and FCT – Fundação para a Ciência e Tecnologia, Portugal within the Project Scope: UID/CEC/00319/2013. This work was funded by ‘‘EUSTRESS – Sistema de Informação para a monitorização e avaliação dos níveis do stress e previsão de stress crónico, Portugal’’, No. 2015/017832 P2020 SI I&DT, (NUP, Portugal, NORTE-01-0247-FEDER-017832) in co-promotion between Optimizer-Lda and ICVS/3B’s-Uminho.Elsevier B.V.Universidade do MinhoCarneiro, Davide RuaNovais, PauloDurães, DalilaPego, José MiguelSousa, Nuno20192019-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/57898eng0167-739X10.1016/j.future.2018.01.061info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-12-30T01:24:49Zoai:repositorium.sdum.uminho.pt:1822/57898Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T19:12:51.029529Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Predicting completion time in high-stakes exams
title Predicting completion time in high-stakes exams
spellingShingle Predicting completion time in high-stakes exams
Carneiro, Davide Rua
Neural Networks
Online exams
Random decision forests
Stress
Science & Technology
title_short Predicting completion time in high-stakes exams
title_full Predicting completion time in high-stakes exams
title_fullStr Predicting completion time in high-stakes exams
title_full_unstemmed Predicting completion time in high-stakes exams
title_sort Predicting completion time in high-stakes exams
author Carneiro, Davide Rua
author_facet Carneiro, Davide Rua
Novais, Paulo
Durães, Dalila
Pego, José Miguel
Sousa, Nuno
author_role author
author2 Novais, Paulo
Durães, Dalila
Pego, José Miguel
Sousa, Nuno
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade do Minho
dc.contributor.author.fl_str_mv Carneiro, Davide Rua
Novais, Paulo
Durães, Dalila
Pego, José Miguel
Sousa, Nuno
dc.subject.por.fl_str_mv Neural Networks
Online exams
Random decision forests
Stress
Science & Technology
topic Neural Networks
Online exams
Random decision forests
Stress
Science & Technology
description For the majority of students, assessment moments are associated with significant levels of stress and anxiety. While a certain amount of stress motivates the individual and improves performance, too much stress will have the contrary effect. Stress has therefore a fundamental role on student performance. It should be the educational organizations’ mission to understand the underlying mechanisms that lead to performance anxiety and provide their students with the best coping tools and strategies. In the present study we analyze student behavior during e-assessment in terms of mouse dynamics. Two major behavioral patterns can be identified, based on ten features that quantify the performance of the student’s interaction with the computer: (1) students who are able to sustain performance during the exam and (2) students whose performance varies significantly. Data shows that the behavior of each student during the exam correlates strongly with the time it takes the student to complete it. Several classifiers were trained that predict the completion time of each exam based on the students’ interaction patterns. Two of them do it with an average error of around twelve minutes. Results show that there are still mechanisms that can be explored to better understand the complex relationship between stress, performance and human behavior, that can be used for the implementation of better stress detection, monitoring and coping strategies.
publishDate 2019
dc.date.none.fl_str_mv 2019
2019-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/1822/57898
url https://hdl.handle.net/1822/57898
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 0167-739X
10.1016/j.future.2018.01.061
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Elsevier B.V.
publisher.none.fl_str_mv Elsevier B.V.
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799132564586233856