Web application for the analysis of assessment tests

Detalhes bibliográficos
Autor(a) principal: Prata, Paula
Data de Publicação: 2018
Outros Autores: Duarte, Luís, Ferrão, Maria Eugénia
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10400.6/8729
Resumo: Introduction: An assessment test enables the evaluation of an individual’s competence or ability. Such tests are important for both teaching and professional training institutions, as well as for the recruiting of human resources in the enterprise. Objectives: The present paper introduces the “Evaluate” web application, for the analysis of assessment tests. Methods: The design and implementation of the application is described, which allows the management of assessment items, used to constitute evaluation tests, upon which results the main descriptive statistic values used under the classical test theory in the analysis of assessment tests are calculated. The application was developed in Python, within the Django framework, and tested with real assessment tests. Results: Scores are assigned to each assessment item, and various statistics — such as difficulty and discrimination index, point-biserial correlation, test internal consistency coefficient — can be obtained upon the answers of the subjects, as well as a graphic analysis of the performance of each subject on each assessment item, as well as on the test as a whole. Conclusion: The “Evaluate” application makes a meaningful contribution to a better knowledge of assessment tools used in competence evaluation, by allowing the detection of inconsistencies and the consequent improvement in the process.
id RCAP_23874b23acb8166a54ec44b08d26190b
oai_identifier_str oai:ubibliorum.ubi.pt:10400.6/8729
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Web application for the analysis of assessment testsClassical test theoryE-assessmentData analysisIntroduction: An assessment test enables the evaluation of an individual’s competence or ability. Such tests are important for both teaching and professional training institutions, as well as for the recruiting of human resources in the enterprise. Objectives: The present paper introduces the “Evaluate” web application, for the analysis of assessment tests. Methods: The design and implementation of the application is described, which allows the management of assessment items, used to constitute evaluation tests, upon which results the main descriptive statistic values used under the classical test theory in the analysis of assessment tests are calculated. The application was developed in Python, within the Django framework, and tested with real assessment tests. Results: Scores are assigned to each assessment item, and various statistics — such as difficulty and discrimination index, point-biserial correlation, test internal consistency coefficient — can be obtained upon the answers of the subjects, as well as a graphic analysis of the performance of each subject on each assessment item, as well as on the test as a whole. Conclusion: The “Evaluate” application makes a meaningful contribution to a better knowledge of assessment tools used in competence evaluation, by allowing the detection of inconsistencies and the consequent improvement in the process.Introdução: Um teste de aferição permite a avaliação de uma dada competência ou capacidade de um individuo. Estes testes são importantes quer no âmbito de instituições de ensino, quer no âmbito empresarial para o recrutamento de recursos humanos. Objetivos: O artigo tem como principal objectivo apresentar a aplicação web designada "Evaluate" para a análise de testes de aferição. Métodos: Descreve-se o desenho e implementação da aplicação que permite fazer a gestão de questões ou itens de aferição, a partir dos quais é possível a construção de testes de avaliação. A partir dos resultados dos alunos na resolução desses testes, são calculadas as principais estatísticas descritivas usadas na análise de testes de aferição das aprendizagens ao abrigo da teoria clássica dos testes. A aplicação “Evaluate” foi desenvolvida em Python usando a framework Django e foi testada com provas de aferição reais. Resultados: Para cada teste são atribuídas cotações aos itens e, a partir das respostas dos alunos, são obtidas diversas estatísticas tais como: índice de dificuldade e de discriminação, correlação ponto-bisserial, coeficiente de consistência interna do teste. A aplicação permitir ainda a análise gráfica do desempenho dos alunos por cada item e no teste como um todo. Conclusões: A aplicação “Evaluate” é uma ferramenta que contribui para um melhor conhecimento dos instrumentos de aferição usados na avaliação de conhecimentos, permitindo identificar inconsistências e consequentemente introduzir melhorias no processo.Introducción: Una prueba de evaluación permite la evaluación de una determinada competencia de un individuo. Estas pruebas son importantes tanto en el ámbito de las instituciones de enseñanza, tanto en el ámbito empresarial para la contratación de recursos humanos. Objetivo: El artículo tiene como principal objetivo presentar la aplicación web designada “Evaluate” para análisis de pruebas de evaluación. Métodos: Se describe el diseño e implementación de la aplicación que permite hacer la gestión de cuestiones, a partir de los cuales es posible la construcción de pruebas de evaluación. A partir de los resultados de los alumnos en la resolución de estas pruebas, son calculadas las principales estadísticas descriptivas utilizadas en el análisis de pruebas de evaluación de los aprendizajes bajo la teoría clásica de las pruebas. La aplicación “Evaluate” fue desarrollada en Python usando el framework Django y fue probada con pruebas de evaluación real. Resultados: Para cada prueba se asignan cotizaciones a los ítems y, a partir de las respuestas de los alumnos, se obtienen diversas estadísticas por cada ítem e por cada prueba. La aplicación permite además el análisis gráfico del desempeño de los alumnos por cada ítem y en la prueba como un todo. Conclusiones: La aplicación “Evaluate” es una herramienta que contribuye a un mejor conocimiento de los instrumentos de medición usados en la evaluación de conocimientos, permitiendo identificar inconsistencias y consecuentemente introducir mejoras en el proceso.Millenium - Journal of Education, Technologies, and HealthuBibliorumPrata, PaulaDuarte, LuísFerrão, Maria Eugénia2020-01-27T09:27:38Z2018-09-272018-09-27T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.6/8729engPrata, P., Duarte, L. & Ferrão., M. E. (2018),Web application for the analysis of assessment tests. Millenium, 2(7), 91-101, 20180873-3015https://doi.org/10.29352/mill0207.08.00176info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-12-15T09:49:00Zoai:ubibliorum.ubi.pt:10400.6/8729Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T00:49:00.123207Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Web application for the analysis of assessment tests
title Web application for the analysis of assessment tests
spellingShingle Web application for the analysis of assessment tests
Prata, Paula
Classical test theory
E-assessment
Data analysis
title_short Web application for the analysis of assessment tests
title_full Web application for the analysis of assessment tests
title_fullStr Web application for the analysis of assessment tests
title_full_unstemmed Web application for the analysis of assessment tests
title_sort Web application for the analysis of assessment tests
author Prata, Paula
author_facet Prata, Paula
Duarte, Luís
Ferrão, Maria Eugénia
author_role author
author2 Duarte, Luís
Ferrão, Maria Eugénia
author2_role author
author
dc.contributor.none.fl_str_mv uBibliorum
dc.contributor.author.fl_str_mv Prata, Paula
Duarte, Luís
Ferrão, Maria Eugénia
dc.subject.por.fl_str_mv Classical test theory
E-assessment
Data analysis
topic Classical test theory
E-assessment
Data analysis
description Introduction: An assessment test enables the evaluation of an individual’s competence or ability. Such tests are important for both teaching and professional training institutions, as well as for the recruiting of human resources in the enterprise. Objectives: The present paper introduces the “Evaluate” web application, for the analysis of assessment tests. Methods: The design and implementation of the application is described, which allows the management of assessment items, used to constitute evaluation tests, upon which results the main descriptive statistic values used under the classical test theory in the analysis of assessment tests are calculated. The application was developed in Python, within the Django framework, and tested with real assessment tests. Results: Scores are assigned to each assessment item, and various statistics — such as difficulty and discrimination index, point-biserial correlation, test internal consistency coefficient — can be obtained upon the answers of the subjects, as well as a graphic analysis of the performance of each subject on each assessment item, as well as on the test as a whole. Conclusion: The “Evaluate” application makes a meaningful contribution to a better knowledge of assessment tools used in competence evaluation, by allowing the detection of inconsistencies and the consequent improvement in the process.
publishDate 2018
dc.date.none.fl_str_mv 2018-09-27
2018-09-27T00:00:00Z
2020-01-27T09:27:38Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10400.6/8729
url http://hdl.handle.net/10400.6/8729
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Prata, P., Duarte, L. & Ferrão., M. E. (2018),Web application for the analysis of assessment tests. Millenium, 2(7), 91-101, 2018
0873-3015
https://doi.org/10.29352/mill0207.08.00176
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Millenium - Journal of Education, Technologies, and Health
publisher.none.fl_str_mv Millenium - Journal of Education, Technologies, and Health
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799136383287164928

Registros relacionados