Next-generation Enem assessment with fewer items and high reliability using CAT

Detalhes bibliográficos
Autor(a) principal: Jaloto, Alexandre
Data de Publicação: 2023
Outros Autores: Primi, Ricardo
Tipo de documento: preprint
Idioma: eng
Título da fonte: SciELO Preprints
Texto Completo: https://preprints.scielo.org/index.php/scielo/preprint/view/5339
Resumo: The Brazilian High School Exam (Enem) results are used to enter higher education and obtain scholarships and study financing. The Enem comprises an essay and four 45-item tests that measure educational skills in different areas of knowledge. Therefore, this work aims to verify the possibility of reducing the number of items in Enem through a Computerized Adaptive Testing (CAT). We used tests from the 2009 to 2019 editions of Enem. The items have been calibrated and positioned on four scales (one for each area). we simulated a CAT, which ended when the error was less than or equal to 0.30, or 45 items were applied. On average, the application ranged from 12.0 (Languages ​​and Codes; LC) to 29.2 (Mathematics; MT) items. Results point to the potential of reducing the size of Enem to 20 items for a proportion that varies from 39.8% (MT) to 94.8% (LC).
id SCI-1_f62e9fa94d02a4beebb79debe65d0944
oai_identifier_str oai:ops.preprints.scielo.org:preprint/5339
network_acronym_str SCI-1
network_name_str SciELO Preprints
repository_id_str
spelling Next-generation Enem assessment with fewer items and high reliability using CATEvaluación Enem de próxima generación con menos ítems y alta confiabilidad usando CATPróxima geração do Enem com menos itens e alta confiabilidade usando CATavaliação dos estudantespsicometriateoria da resposta ao itemadmissão no ensino superiorstudent assessmentpsychometricsitem response theoryadmission to higher educationevaluación de estudiantespsicometríateoría de la respuesta al ítemadmisión a la educación superiorThe Brazilian High School Exam (Enem) results are used to enter higher education and obtain scholarships and study financing. The Enem comprises an essay and four 45-item tests that measure educational skills in different areas of knowledge. Therefore, this work aims to verify the possibility of reducing the number of items in Enem through a Computerized Adaptive Testing (CAT). We used tests from the 2009 to 2019 editions of Enem. The items have been calibrated and positioned on four scales (one for each area). we simulated a CAT, which ended when the error was less than or equal to 0.30, or 45 items were applied. On average, the application ranged from 12.0 (Languages ​​and Codes; LC) to 29.2 (Mathematics; MT) items. Results point to the potential of reducing the size of Enem to 20 items for a proportion that varies from 39.8% (MT) to 94.8% (LC).Los resultados del Examen Brasileño de Enseñanza Media (Enem) se utilizan para acceder a la enseñanza superior y obtener becas y financiación de estudios. El Enem se compone de un ensayo y cuatro pruebas de 45 ítems que miden competencias educativas en diferentes áreas del conocimiento. Por lo tanto, este trabajo tiene como objetivo verificar la posibilidad de reducir la cantidad de ítems en Enem a través de una prueba adaptativa computarizada (CAT). Utilizamos pruebas de las ediciones 2009 a 2019 de Enem. Los ítems han sido calibrados y posicionados en cuatro escalas (una para cada área). Simulamos una CAT, que terminaba cuando el error era menor o igual a 0,30, o se aplicaban 45 ítems. En promedio, la aplicación osciló entre 12,0 (Linguajes y códigos; LC) y 29,2 (Matemáticas; MT) ítems. Los resultados apuntan al potencial de reducir el tamaño de Enem a 20 ítems para una proporción que varía de 39,8% (MT) a 94,8% (LC).Os resultados do Enem são usados para ingressar no ensino superior e obter bolsas e financiamento de estudos. O Enem é composto por uma redação e quatro provas de 45 itens que medem habilidades educacionais em diferentes áreas do conhecimento. Portanto, este trabalho tem como objetivo verificar a possibilidade de redução do número de itens no Enem por meio de uma Testagem Adaptativa Computadorizada (CAT). Utilizamos provas das edições de 2009 a 2019 do Enem. Os itens foram calibrados e posicionados em quatro escalas (uma para cada área). Simulamos uma CAT, que terminava quando o erro era menor ou igual a 0,30 ou eram aplicados 45 itens. Em média, a aplicação variou de 12,0 (Idiomas e Códigos; LC) a 29,2 (Matemática; MT) itens. Os resultados apontam para o potencial de redução do tamanho do Enem para 20 itens para uma proporção que varia de 39,8% (MT) a 94,8% (LC).SciELO PreprintsSciELO PreprintsSciELO Preprints2023-01-03info:eu-repo/semantics/preprintinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://preprints.scielo.org/index.php/scielo/preprint/view/533910.1590/SciELOPreprints.5339enghttps://preprints.scielo.org/index.php/scielo/article/view/5339/10324Copyright (c) 2023 Alexandre Jaloto, Ricardo Primihttps://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessJaloto, AlexandrePrimi, Ricardoreponame:SciELO Preprintsinstname:SciELOinstacron:SCI2022-12-27T23:23:26Zoai:ops.preprints.scielo.org:preprint/5339Servidor de preprintshttps://preprints.scielo.org/index.php/scieloONGhttps://preprints.scielo.org/index.php/scielo/oaiscielo.submission@scielo.orgopendoar:2022-12-27T23:23:26SciELO Preprints - SciELOfalse
dc.title.none.fl_str_mv Next-generation Enem assessment with fewer items and high reliability using CAT
Evaluación Enem de próxima generación con menos ítems y alta confiabilidad usando CAT
Próxima geração do Enem com menos itens e alta confiabilidade usando CAT
title Next-generation Enem assessment with fewer items and high reliability using CAT
spellingShingle Next-generation Enem assessment with fewer items and high reliability using CAT
Jaloto, Alexandre
avaliação dos estudantes
psicometria
teoria da resposta ao item
admissão no ensino superior
student assessment
psychometrics
item response theory
admission to higher education
evaluación de estudiantes
psicometría
teoría de la respuesta al ítem
admisión a la educación superior
title_short Next-generation Enem assessment with fewer items and high reliability using CAT
title_full Next-generation Enem assessment with fewer items and high reliability using CAT
title_fullStr Next-generation Enem assessment with fewer items and high reliability using CAT
title_full_unstemmed Next-generation Enem assessment with fewer items and high reliability using CAT
title_sort Next-generation Enem assessment with fewer items and high reliability using CAT
author Jaloto, Alexandre
author_facet Jaloto, Alexandre
Primi, Ricardo
author_role author
author2 Primi, Ricardo
author2_role author
dc.contributor.author.fl_str_mv Jaloto, Alexandre
Primi, Ricardo
dc.subject.por.fl_str_mv avaliação dos estudantes
psicometria
teoria da resposta ao item
admissão no ensino superior
student assessment
psychometrics
item response theory
admission to higher education
evaluación de estudiantes
psicometría
teoría de la respuesta al ítem
admisión a la educación superior
topic avaliação dos estudantes
psicometria
teoria da resposta ao item
admissão no ensino superior
student assessment
psychometrics
item response theory
admission to higher education
evaluación de estudiantes
psicometría
teoría de la respuesta al ítem
admisión a la educación superior
description The Brazilian High School Exam (Enem) results are used to enter higher education and obtain scholarships and study financing. The Enem comprises an essay and four 45-item tests that measure educational skills in different areas of knowledge. Therefore, this work aims to verify the possibility of reducing the number of items in Enem through a Computerized Adaptive Testing (CAT). We used tests from the 2009 to 2019 editions of Enem. The items have been calibrated and positioned on four scales (one for each area). we simulated a CAT, which ended when the error was less than or equal to 0.30, or 45 items were applied. On average, the application ranged from 12.0 (Languages ​​and Codes; LC) to 29.2 (Mathematics; MT) items. Results point to the potential of reducing the size of Enem to 20 items for a proportion that varies from 39.8% (MT) to 94.8% (LC).
publishDate 2023
dc.date.none.fl_str_mv 2023-01-03
dc.type.driver.fl_str_mv info:eu-repo/semantics/preprint
info:eu-repo/semantics/publishedVersion
format preprint
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://preprints.scielo.org/index.php/scielo/preprint/view/5339
10.1590/SciELOPreprints.5339
url https://preprints.scielo.org/index.php/scielo/preprint/view/5339
identifier_str_mv 10.1590/SciELOPreprints.5339
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://preprints.scielo.org/index.php/scielo/article/view/5339/10324
dc.rights.driver.fl_str_mv Copyright (c) 2023 Alexandre Jaloto, Ricardo Primi
https://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2023 Alexandre Jaloto, Ricardo Primi
https://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv SciELO Preprints
SciELO Preprints
SciELO Preprints
publisher.none.fl_str_mv SciELO Preprints
SciELO Preprints
SciELO Preprints
dc.source.none.fl_str_mv reponame:SciELO Preprints
instname:SciELO
instacron:SCI
instname_str SciELO
instacron_str SCI
institution SCI
reponame_str SciELO Preprints
collection SciELO Preprints
repository.name.fl_str_mv SciELO Preprints - SciELO
repository.mail.fl_str_mv scielo.submission@scielo.org
_version_ 1797047831021748224

Registros relacionados