Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , |
Tipo de documento: | Artigo |
Idioma: | spa |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | https://doi.org/10.34624/id.v13i5.27163 |
Resumo: | Written production tests are one of the most common means to assess the skills’ level of foreign language students. They are also one of the resources that most lends itself to a detailed language skill’s analysis by studying the corpora provided by the students. However, due to the COVID-19 health emergency, many teachers have been forced to carry out this type of tests online. While teachers have been able to retain some control over the testing, they have also been aware that students can use digital tools to improve their texts, even though it is explicitly prohibited in the test instructions. This article presents a quantitative and qualitative analysis on the students’ written productions focusing on two main aspects: on the one hand, a formal perspective of the texts; on the other hand, a qualitative exploration of the role that stress can exert during this type of evaluation over time. Thus, these written texts are analyzed by comparing the results obtained with two different testing methods: a group of texts produced in a digital context but in a face to face monitored situation, against another group of tests produced online and under online and remote monitoring. The results obtained with both methods were contrasted to infer the level in which these students might have accessed to digitally available linguistic tools. It was observed that the stress level was significantly reduced during the semester. The results also show that students did access translation tools sporadically, though they avoided to use linguistic correcting tools. |
id |
RCAP_266a5418f4d1e42a9dd7a9c9c8e89072 |
---|---|
oai_identifier_str |
oai:proa.ua.pt:article/27163 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysisAnálisis contrastivo de pruebas de producción escrita en contexto presencial y en contexto online: nivel de estrés, fiabilidad de la prueba y análisis de erroresWritten production tests are one of the most common means to assess the skills’ level of foreign language students. They are also one of the resources that most lends itself to a detailed language skill’s analysis by studying the corpora provided by the students. However, due to the COVID-19 health emergency, many teachers have been forced to carry out this type of tests online. While teachers have been able to retain some control over the testing, they have also been aware that students can use digital tools to improve their texts, even though it is explicitly prohibited in the test instructions. This article presents a quantitative and qualitative analysis on the students’ written productions focusing on two main aspects: on the one hand, a formal perspective of the texts; on the other hand, a qualitative exploration of the role that stress can exert during this type of evaluation over time. Thus, these written texts are analyzed by comparing the results obtained with two different testing methods: a group of texts produced in a digital context but in a face to face monitored situation, against another group of tests produced online and under online and remote monitoring. The results obtained with both methods were contrasted to infer the level in which these students might have accessed to digitally available linguistic tools. It was observed that the stress level was significantly reduced during the semester. The results also show that students did access translation tools sporadically, though they avoided to use linguistic correcting tools.La evaluación de la expresión escrita es uno de los componentes más habituales para medir las competencias de los alumnos de una lengua extranjera. Así mismo, es uno de los recursos que más se prestan a un análisis con detalle a través del estudio del corpus. No obstante, debido a la emergencia sanitaria muchos docentes se han visto obligados a realizar este tipo de prueba de manera online a sabiendas de que, incluso con un cierto control, los estudiantes pueden recurrir a herramientas digitales que le están explícitamente prohibidas explícitamente para mejorar su producción. En este trabajo analizamos de manera cuanticualitativa las producciones de los alumnos desde perspectivas formales del texto, así como desde la perspectiva del estrés que este tipo de pruebas puedan provocar a lo largo del tiempo. Es decir, se realiza un análisis de los resultados desde diferentes perspectivas comparando la producción vigilada en formato tradicional (presencial) con la producción online para poder inferir en qué medida los alumnos han usado otras herramientas disponibles digitalmente. De los resultados obtenidos se concluye que el nivel de estrés se redujo significativamente a lo largo del semestre y que los alumnos accedieron a herramientas de traducción de manera esporádica, pero no a herramientas de corrección de textos.A avaliação da expressão escrita é um dos componentes mais comuns para as habilidades dos alunos de uma língua estrangeira. Da mesma forma, é um dos recursos mais úteis e simples para uma análise detalhada através do estudo do corpus. Todavia, devido à emergência sanitária, muitos professores foram obrigados a realizar este tipo de prova online, sabendo que, mesmo com um certo controlo, os estudantes poderiam fazer uso de ferramentas digitais (expressamente proibidas) para melhorar a sua produção. Neste trabalho, analisamos qualitativa e quantitativamente as produções dos alunos sob a ótica formal do texto, bem como sob a ótica do estresse que esse tipo de teste pode causar ao longo do tempo. Ou seja, é feita uma análise dos resultados desde diferentes perspetivas, comparando a produção controlada no formato tradicional (presencial) com a produção online para inferir em que medida os estudantes utilizaram ferramentas disponíveis digitalmente. Dos resultados obtidos depreende-se que o nível de estresse foi reduzido significativamente ao longo do semestre e que os alunos usaram esporadicamente as ferramentas de tradução, mas não as ferramentas de revisão de textos.Centro de Investigação Didática e Tecnologia na Formação de Formadores (CIDTFF) / Universidade de Aveiro2021-12-20info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://doi.org/10.34624/id.v13i5.27163https://doi.org/10.34624/id.v13i5.27163Indagatio Didactica; Vol 13 No 5 (2021); 73-90Indagatio Didactica; Vol. 13 Núm. 5 (2021); 73-90Indagatio Didactica; Vol. 13 No 5 (2021); 73-90Indagatio Didactica; vol. 13 n.º 5 (2021); 73-901647-3582reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAPspahttps://proa.ua.pt/index.php/id/article/view/27163https://proa.ua.pt/index.php/id/article/view/27163/19747http://creativecommons.org/licenses/by-nc/4.0info:eu-repo/semantics/openAccessChenoll, AntonioJunguito, MónicaNavas, Grauben2023-09-22T10:19:22Zoai:proa.ua.pt:article/27163Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T20:30:32.025073Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis Análisis contrastivo de pruebas de producción escrita en contexto presencial y en contexto online: nivel de estrés, fiabilidad de la prueba y análisis de errores |
title |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis |
spellingShingle |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis Chenoll, Antonio |
title_short |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis |
title_full |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis |
title_fullStr |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis |
title_full_unstemmed |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis |
title_sort |
Contrastive analysis of written production tests in a face-toface learning context and in an online context: stress level, test reliability and error analysis |
author |
Chenoll, Antonio |
author_facet |
Chenoll, Antonio Junguito, Mónica Navas, Grauben |
author_role |
author |
author2 |
Junguito, Mónica Navas, Grauben |
author2_role |
author author |
dc.contributor.author.fl_str_mv |
Chenoll, Antonio Junguito, Mónica Navas, Grauben |
description |
Written production tests are one of the most common means to assess the skills’ level of foreign language students. They are also one of the resources that most lends itself to a detailed language skill’s analysis by studying the corpora provided by the students. However, due to the COVID-19 health emergency, many teachers have been forced to carry out this type of tests online. While teachers have been able to retain some control over the testing, they have also been aware that students can use digital tools to improve their texts, even though it is explicitly prohibited in the test instructions. This article presents a quantitative and qualitative analysis on the students’ written productions focusing on two main aspects: on the one hand, a formal perspective of the texts; on the other hand, a qualitative exploration of the role that stress can exert during this type of evaluation over time. Thus, these written texts are analyzed by comparing the results obtained with two different testing methods: a group of texts produced in a digital context but in a face to face monitored situation, against another group of tests produced online and under online and remote monitoring. The results obtained with both methods were contrasted to infer the level in which these students might have accessed to digitally available linguistic tools. It was observed that the stress level was significantly reduced during the semester. The results also show that students did access translation tools sporadically, though they avoided to use linguistic correcting tools. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-12-20 |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://doi.org/10.34624/id.v13i5.27163 https://doi.org/10.34624/id.v13i5.27163 |
url |
https://doi.org/10.34624/id.v13i5.27163 |
dc.language.iso.fl_str_mv |
spa |
language |
spa |
dc.relation.none.fl_str_mv |
https://proa.ua.pt/index.php/id/article/view/27163 https://proa.ua.pt/index.php/id/article/view/27163/19747 |
dc.rights.driver.fl_str_mv |
http://creativecommons.org/licenses/by-nc/4.0 info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
http://creativecommons.org/licenses/by-nc/4.0 |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Centro de Investigação Didática e Tecnologia na Formação de Formadores (CIDTFF) / Universidade de Aveiro |
publisher.none.fl_str_mv |
Centro de Investigação Didática e Tecnologia na Formação de Formadores (CIDTFF) / Universidade de Aveiro |
dc.source.none.fl_str_mv |
Indagatio Didactica; Vol 13 No 5 (2021); 73-90 Indagatio Didactica; Vol. 13 Núm. 5 (2021); 73-90 Indagatio Didactica; Vol. 13 No 5 (2021); 73-90 Indagatio Didactica; vol. 13 n.º 5 (2021); 73-90 1647-3582 reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799133574151012352 |