Assessing second language oral proficiency development with holistic and analytic scales

Detalhes bibliográficos
Autor(a) principal: Silveira, Rosane
Data de Publicação: 2020
Outros Autores: Martins, Thaisy da Silva
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Ilha do Desterro
Texto Completo: https://periodicos.ufsc.br/index.php/desterro/article/view/72059
Resumo: The present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development.
id UFSC-9_36b027087f436b79b66a590ab1804c81
oai_identifier_str oai:periodicos.ufsc.br:article/72059
network_acronym_str UFSC-9
network_name_str Ilha do Desterro
repository_id_str
spelling Assessing second language oral proficiency development with holistic and analytic scalesAvaliação do desenvolvimento da proficiência oral no segundo idioma com escalas holísticas e analíticasThe present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development.O presente estudo discute como um grupo de avaliadores experientes usa diferentes tipos de escalas para avaliar o desenvolvimento da proficiência oral em inglês como segunda língua (L2). Os avaliadores atribuíram taxas a amostras de fala primeiro usando uma escala holística (CEFR, 2018) e depois atribuindo taxas de pronúncia, vocabulário, gramática e desempenho de fluência usando escalas individuais. As amostras de fala foram gravadas por cinco brasileiros. Houve duas sessões de coleta de dados, com a segunda ocorrendo 7-8 meses após a primeira. Os resultados indicam altos níveis de concordância entre avaliadores para todas as escalas. Além disso, os avaliadores detectaram mudanças no desempenho dos falantes em quatro das cinco escalas: proficiência oral L2, vocabulário, gramática e fluência, e essas diferenças nas taxas ao longo do tempo foram significativas para proficiência oral, vocabulário e fluência. Assim, os diferentes tipos de escala permitem detectar o desenvolvimento da proficiência oral de L2.UFSC2020-10-22info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionQuantitative researchapplication/pdfhttps://periodicos.ufsc.br/index.php/desterro/article/view/7205910.5007/2175-8026.2020v73n3p227Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; Vol. 73 No. 3 (2020): English grammar: theoretical and experimental investigations; 227-250Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; v. 73 n. 3 (2020): English grammar: theoretical and experimental investigations; 227-2502175-80260101-4846reponame:Ilha do Desterroinstname:Universidade Federal de Santa Catarina (UFSC)instacron:UFSCenghttps://periodicos.ufsc.br/index.php/desterro/article/view/72059/44515Copyright (c) 2020 Rosane Silveirahttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessSilveira, RosaneMartins, Thaisy da Silva2020-10-22T17:34:03Zoai:periodicos.ufsc.br:article/72059Revistahttp://www.periodicos.ufsc.br/index.php/desterroPUBhttps://periodicos.ufsc.br/index.php/desterro/oaiilha@cce.ufsc.br||corseuil@cce.ufsc.br||ilhadodesterro@gmail.com2175-80260101-4846opendoar:2020-10-22T17:34:03Ilha do Desterro - Universidade Federal de Santa Catarina (UFSC)false
dc.title.none.fl_str_mv Assessing second language oral proficiency development with holistic and analytic scales
Avaliação do desenvolvimento da proficiência oral no segundo idioma com escalas holísticas e analíticas
title Assessing second language oral proficiency development with holistic and analytic scales
spellingShingle Assessing second language oral proficiency development with holistic and analytic scales
Silveira, Rosane
title_short Assessing second language oral proficiency development with holistic and analytic scales
title_full Assessing second language oral proficiency development with holistic and analytic scales
title_fullStr Assessing second language oral proficiency development with holistic and analytic scales
title_full_unstemmed Assessing second language oral proficiency development with holistic and analytic scales
title_sort Assessing second language oral proficiency development with holistic and analytic scales
author Silveira, Rosane
author_facet Silveira, Rosane
Martins, Thaisy da Silva
author_role author
author2 Martins, Thaisy da Silva
author2_role author
dc.contributor.author.fl_str_mv Silveira, Rosane
Martins, Thaisy da Silva
description The present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development.
publishDate 2020
dc.date.none.fl_str_mv 2020-10-22
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
Quantitative research
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://periodicos.ufsc.br/index.php/desterro/article/view/72059
10.5007/2175-8026.2020v73n3p227
url https://periodicos.ufsc.br/index.php/desterro/article/view/72059
identifier_str_mv 10.5007/2175-8026.2020v73n3p227
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://periodicos.ufsc.br/index.php/desterro/article/view/72059/44515
dc.rights.driver.fl_str_mv Copyright (c) 2020 Rosane Silveira
http://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2020 Rosane Silveira
http://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv UFSC
publisher.none.fl_str_mv UFSC
dc.source.none.fl_str_mv Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; Vol. 73 No. 3 (2020): English grammar: theoretical and experimental investigations; 227-250
Ilha do Desterro A Journal of English Language, Literatures in English and Cultural Studies; v. 73 n. 3 (2020): English grammar: theoretical and experimental investigations; 227-250
2175-8026
0101-4846
reponame:Ilha do Desterro
instname:Universidade Federal de Santa Catarina (UFSC)
instacron:UFSC
instname_str Universidade Federal de Santa Catarina (UFSC)
instacron_str UFSC
institution UFSC
reponame_str Ilha do Desterro
collection Ilha do Desterro
repository.name.fl_str_mv Ilha do Desterro - Universidade Federal de Santa Catarina (UFSC)
repository.mail.fl_str_mv ilha@cce.ufsc.br||corseuil@cce.ufsc.br||ilhadodesterro@gmail.com
_version_ 1789434831835234304