Assessing second language oral proficiency development with holistic and analytic scales
Autor(a) principal: | |
---|---|
Data de Publicação: | 2020 |
Outros Autores: | |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Ilha do Desterro |
Texto Completo: | https://periodicos.ufsc.br/index.php/desterro/article/view/72059 |
Resumo: | The present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development. |
id |
UFSC-9_36b027087f436b79b66a590ab1804c81 |
---|---|
oai_identifier_str |
oai:periodicos.ufsc.br:article/72059 |
network_acronym_str |
UFSC-9 |
network_name_str |
Ilha do Desterro |
repository_id_str |
|
spelling |
Assessing second language oral proficiency development with holistic and analytic scalesAvaliação do desenvolvimento da proficiência oral no segundo idioma com escalas holísticas e analíticasThe present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development.O presente estudo discute como um grupo de avaliadores experientes usa diferentes tipos de escalas para avaliar o desenvolvimento da proficiência oral em inglês como segunda língua (L2). Os avaliadores atribuíram taxas a amostras de fala primeiro usando uma escala holística (CEFR, 2018) e depois atribuindo taxas de pronúncia, vocabulário, gramática e desempenho de fluência usando escalas individuais. As amostras de fala foram gravadas por cinco brasileiros. Houve duas sessões de coleta de dados, com a segunda ocorrendo 7-8 meses após a primeira. Os resultados indicam altos níveis de concordância entre avaliadores para todas as escalas. Além disso, os avaliadores detectaram mudanças no desempenho dos falantes em quatro das cinco escalas: proficiência oral L2, vocabulário, gramática e fluência, e essas diferenças nas taxas ao longo do tempo foram significativas para proficiência oral, vocabulário e fluência. Assim, os diferentes tipos de escala permitem detectar o desenvolvimento da proficiência oral de L2.UFSC2020-10-22info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionQuantitative researchapplication/pdfhttps://periodicos.ufsc.br/index.php/desterro/article/view/7205910.5007/2175-8026.2020v73n3p227Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; Vol. 73 No. 3 (2020): English grammar: theoretical and experimental investigations; 227-250Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; v. 73 n. 3 (2020): English grammar: theoretical and experimental investigations; 227-2502175-80260101-4846reponame:Ilha do Desterroinstname:Universidade Federal de Santa Catarina (UFSC)instacron:UFSCenghttps://periodicos.ufsc.br/index.php/desterro/article/view/72059/44515Copyright (c) 2020 Rosane Silveirahttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessSilveira, RosaneMartins, Thaisy da Silva2020-10-22T17:34:03Zoai:periodicos.ufsc.br:article/72059Revistahttp://www.periodicos.ufsc.br/index.php/desterroPUBhttps://periodicos.ufsc.br/index.php/desterro/oaiilha@cce.ufsc.br||corseuil@cce.ufsc.br||ilhadodesterro@gmail.com2175-80260101-4846opendoar:2020-10-22T17:34:03Ilha do Desterro - Universidade Federal de Santa Catarina (UFSC)false |
dc.title.none.fl_str_mv |
Assessing second language oral proficiency development with holistic and analytic scales Avaliação do desenvolvimento da proficiência oral no segundo idioma com escalas holísticas e analíticas |
title |
Assessing second language oral proficiency development with holistic and analytic scales |
spellingShingle |
Assessing second language oral proficiency development with holistic and analytic scales Silveira, Rosane |
title_short |
Assessing second language oral proficiency development with holistic and analytic scales |
title_full |
Assessing second language oral proficiency development with holistic and analytic scales |
title_fullStr |
Assessing second language oral proficiency development with holistic and analytic scales |
title_full_unstemmed |
Assessing second language oral proficiency development with holistic and analytic scales |
title_sort |
Assessing second language oral proficiency development with holistic and analytic scales |
author |
Silveira, Rosane |
author_facet |
Silveira, Rosane Martins, Thaisy da Silva |
author_role |
author |
author2 |
Martins, Thaisy da Silva |
author2_role |
author |
dc.contributor.author.fl_str_mv |
Silveira, Rosane Martins, Thaisy da Silva |
description |
The present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development. |
publishDate |
2020 |
dc.date.none.fl_str_mv |
2020-10-22 |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion Quantitative research |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://periodicos.ufsc.br/index.php/desterro/article/view/72059 10.5007/2175-8026.2020v73n3p227 |
url |
https://periodicos.ufsc.br/index.php/desterro/article/view/72059 |
identifier_str_mv |
10.5007/2175-8026.2020v73n3p227 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
https://periodicos.ufsc.br/index.php/desterro/article/view/72059/44515 |
dc.rights.driver.fl_str_mv |
Copyright (c) 2020 Rosane Silveira http://creativecommons.org/licenses/by/4.0 info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Copyright (c) 2020 Rosane Silveira http://creativecommons.org/licenses/by/4.0 |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
UFSC |
publisher.none.fl_str_mv |
UFSC |
dc.source.none.fl_str_mv |
Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; Vol. 73 No. 3 (2020): English grammar: theoretical and experimental investigations; 227-250 Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; v. 73 n. 3 (2020): English grammar: theoretical and experimental investigations; 227-250 2175-8026 0101-4846 reponame:Ilha do Desterro instname:Universidade Federal de Santa Catarina (UFSC) instacron:UFSC |
instname_str |
Universidade Federal de Santa Catarina (UFSC) |
instacron_str |
UFSC |
institution |
UFSC |
reponame_str |
Ilha do Desterro |
collection |
Ilha do Desterro |
repository.name.fl_str_mv |
Ilha do Desterro - Universidade Federal de Santa Catarina (UFSC) |
repository.mail.fl_str_mv |
ilha@cce.ufsc.br||corseuil@cce.ufsc.br||ilhadodesterro@gmail.com |
_version_ |
1789434831835234304 |