Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis

Detalhes bibliográficos
Autor(a) principal: Chenoll, Antonio
Data de Publicação: 2021
Outros Autores: Junguito, Mónica, Navas, Grauben
Tipo de documento: Artigo
Idioma: spa
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: https://doi.org/10.34624/id.v13i5.27163
Resumo: Written production tests are one of the most common means to assess the skills’ level of foreign language students. They are also one of the resources that most lends itself to a detailed language skill’s analysis by studying the corpora provided by the students. However, due to the COVID-19 health emergency, many teachers have been forced to carry out this type of tests online. While teachers have been able to retain some control over the testing, they have also been aware that students can use digital tools to improve their texts, even though it is explicitly prohibited in the test instructions. This article presents a quantitative and qualitative analysis on the students’ written productions focusing on two main aspects: on the one hand, a formal perspective of the texts; on the other hand, a qualitative exploration of the role that stress can exert during this type of evaluation over time. Thus, these written texts are analyzed by comparing the results obtained with two different testing methods: a group of texts produced in a digital context but in a face to face monitored situation, against another group of tests produced online and under online and remote monitoring. The results obtained with both methods were contrasted to infer the level in which these students might have accessed to digitally available linguistic tools. It was observed that the stress level was significantly reduced during the semester. The results also show that students did access translation tools sporadically, though they avoided to use linguistic correcting tools.
id RCAP_266a5418f4d1e42a9dd7a9c9c8e89072
oai_identifier_str oai:proa.ua.pt:article/27163
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysisAnálisis contrastivo de pruebas de producción escrita en contexto presencial y en contexto online: nivel de estrés, fiabilidad de la prueba y análisis de erroresWritten production tests are one of the most common means to assess the skills’ level of foreign language students. They are also one of the resources that most lends itself to a detailed language skill’s analysis by studying the corpora provided by the students. However, due to the COVID-19 health emergency, many teachers have been forced to carry out this type of tests online. While teachers have been able to retain some control over the testing, they have also been aware that students can use digital tools to improve their texts, even though it is explicitly prohibited in the test instructions. This article presents a quantitative and qualitative analysis on the students’ written productions focusing on two main aspects: on the one hand, a formal perspective of the texts; on the other hand, a qualitative exploration of the role that stress can exert during this type of evaluation over time. Thus, these written texts are analyzed by comparing the results obtained with two different testing methods: a group of texts produced in a digital context but in a face to face monitored situation, against another group of tests produced online and under online and remote monitoring. The results obtained with both methods were contrasted to infer the level in which these students might have accessed to digitally available linguistic tools. It was observed that the stress level was significantly reduced during the semester. The results also show that students did access translation tools sporadically, though they avoided to use linguistic correcting tools.La evaluación de la expresión escrita es uno de los componentes más habituales para medir las competencias de los alumnos de una lengua extranjera. Así mismo, es uno de los recursos que más se prestan a un análisis con detalle a través del estudio del corpus. No obstante, debido a la emergencia sanitaria muchos docentes se han visto obligados a realizar este tipo de prueba de manera online a sabiendas de que, incluso con un cierto control, los estudiantes pueden recurrir a herramientas digitales que le están explícitamente prohibidas explícitamente para mejorar su producción. En este trabajo analizamos de manera cuanticualitativa las producciones de los alumnos desde perspectivas formales del texto, así como desde la perspectiva del estrés que este tipo de pruebas puedan provocar a lo largo del tiempo. Es decir, se realiza un análisis de los resultados desde diferentes perspectivas comparando la producción vigilada en formato tradicional (presencial) con la producción online para poder inferir en qué medida los alumnos han usado otras herramientas disponibles digitalmente. De los resultados obtenidos se concluye que el nivel de estrés se redujo significativamente a lo largo del semestre y que los alumnos accedieron a herramientas de traducción de manera esporádica, pero no a herramientas de corrección de textos.A avaliação da expressão escrita é um dos componentes mais comuns para as habilidades dos alunos de uma língua estrangeira. Da mesma forma, é um dos recursos mais úteis e simples para uma análise detalhada através do estudo do corpus. Todavia, devido à emergência sanitária, muitos professores foram obrigados a realizar este tipo de prova online, sabendo que, mesmo com um certo controlo, os estudantes poderiam fazer uso de ferramentas digitais (expressamente proibidas) para melhorar a sua produção. Neste trabalho, analisamos qualitativa e quantitativamente as produções dos alunos sob a ótica formal do texto, bem como sob a ótica do estresse que esse tipo de teste pode causar ao longo do tempo. Ou seja, é feita uma análise dos resultados desde diferentes perspetivas, comparando a produção controlada no formato tradicional (presencial) com a produção online para inferir em que medida os estudantes utilizaram ferramentas disponíveis digitalmente. Dos resultados obtidos depreende-se que o nível de estresse foi reduzido significativamente ao longo do semestre e que os alunos usaram esporadicamente as ferramentas de tradução, mas não as ferramentas de revisão de textos.Centro de Investigação Didática e Tecnologia na Formação de Formadores (CIDTFF) / Universidade de Aveiro2021-12-20info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://doi.org/10.34624/id.v13i5.27163https://doi.org/10.34624/id.v13i5.27163Indagatio Didactica; Vol 13 No 5 (2021); 73-90Indagatio Didactica; Vol. 13 Núm. 5 (2021); 73-90Indagatio Didactica; Vol. 13 No 5 (2021); 73-90Indagatio Didactica; vol. 13 n.º 5 (2021); 73-901647-3582reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAPspahttps://proa.ua.pt/index.php/id/article/view/27163https://proa.ua.pt/index.php/id/article/view/27163/19747http://creativecommons.org/licenses/by-nc/4.0info:eu-repo/semantics/openAccessChenoll, AntonioJunguito, MónicaNavas, Grauben2023-09-22T10:19:22Zoai:proa.ua.pt:article/27163Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T20:30:32.025073Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
Análisis contrastivo de pruebas de producción escrita en contexto presencial y en contexto online: nivel de estrés, fiabilidad de la prueba y análisis de errores
title Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
spellingShingle Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
Chenoll, Antonio
title_short Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
title_full Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
title_fullStr Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
title_full_unstemmed Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
title_sort Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
author Chenoll, Antonio
author_facet Chenoll, Antonio
Junguito, Mónica
Navas, Grauben
author_role author
author2 Junguito, Mónica
Navas, Grauben
author2_role author
author
dc.contributor.author.fl_str_mv Chenoll, Antonio
Junguito, Mónica
Navas, Grauben
description Written production tests are one of the most common means to assess the skills’ level of foreign language students. They are also one of the resources that most lends itself to a detailed language skill’s analysis by studying the corpora provided by the students. However, due to the COVID-19 health emergency, many teachers have been forced to carry out this type of tests online. While teachers have been able to retain some control over the testing, they have also been aware that students can use digital tools to improve their texts, even though it is explicitly prohibited in the test instructions. This article presents a quantitative and qualitative analysis on the students’ written productions focusing on two main aspects: on the one hand, a formal perspective of the texts; on the other hand, a qualitative exploration of the role that stress can exert during this type of evaluation over time. Thus, these written texts are analyzed by comparing the results obtained with two different testing methods: a group of texts produced in a digital context but in a face to face monitored situation, against another group of tests produced online and under online and remote monitoring. The results obtained with both methods were contrasted to infer the level in which these students might have accessed to digitally available linguistic tools. It was observed that the stress level was significantly reduced during the semester. The results also show that students did access translation tools sporadically, though they avoided to use linguistic correcting tools.
publishDate 2021
dc.date.none.fl_str_mv 2021-12-20
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://doi.org/10.34624/id.v13i5.27163
https://doi.org/10.34624/id.v13i5.27163
url https://doi.org/10.34624/id.v13i5.27163
dc.language.iso.fl_str_mv spa
language spa
dc.relation.none.fl_str_mv https://proa.ua.pt/index.php/id/article/view/27163
https://proa.ua.pt/index.php/id/article/view/27163/19747
dc.rights.driver.fl_str_mv http://creativecommons.org/licenses/by-nc/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by-nc/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Centro de Investigação Didática e Tecnologia na Formação de Formadores (CIDTFF) / Universidade de Aveiro
publisher.none.fl_str_mv Centro de Investigação Didática e Tecnologia na Formação de Formadores (CIDTFF) / Universidade de Aveiro
dc.source.none.fl_str_mv Indagatio Didactica; Vol 13 No 5 (2021); 73-90
Indagatio Didactica; Vol. 13 Núm. 5 (2021); 73-90
Indagatio Didactica; Vol. 13 No 5 (2021); 73-90
Indagatio Didactica; vol. 13 n.º 5 (2021); 73-90
1647-3582
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799133574151012352