Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers

Detalhes bibliográficos
Autor(a) principal: Oliveira, Diego Fernando de
Data de Publicação: 2022
Tipo de documento: Artigo
Idioma: por
Título da fonte: Domínios de Lingu@gem
Texto Completo: https://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444
Resumo: The EPPLE (Proficiency Exam for Foreign Language Teachers) is an assessment instrument in constant improvement (CONSOLO and TEIXEIRA DA SILVA, 2014; COLOMBO, 2019) which aims at assessing the proficiency of the FL teacher in the Brazilian context. Currently, the EPPLE has only a holistic scale to assess the oral performance of candidates, developed intuitively. Thus, it is necessary to build an analytical and empirically based proficiency scale to produce an argument for the validity of the assessment criteria that classify the oral performances in the exam. The vocabulary accuracy, among other constructs of the linguistic competence, is extremely important for the FL language teacher oral proficiency, since the teacher teaches LE using the target language in communicative contexts (FREEMAN et al., 2015). The present study presents results of the application of EBBs (Empirically derived, Binary choice, Boundary definition scales), an empirical methodology for the development of assessment criteria and rating scales developed by Upshur and Turner (1999), for the construction of a framework of empirically verifiable criteria to assess the vocabulary accuracy used by EPPLE candidates. From data analysis, it was possible to develop an analytical proficiency scale to assess vocabulary accuracy that integrates the coherence of the vocabulary, the accurate use of metalanguage and the knowledge of keywords related to linguistic topics.
id UFU-12_d5663e432acf288a4c9c1cb16c6796d4
oai_identifier_str oai:ojs.www.seer.ufu.br:article/59444
network_acronym_str UFU-12
network_name_str Domínios de Lingu@gem
repository_id_str
spelling Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachersCritérios empiricamente verificáveis para a avaliação do vocabulário na produção oral do professor de língua estrangeiravaliação docente. Proficiência oral. Língua Estrangeira. Vocabulário.Teacher assessment. Oral proficiency. Foreign language. Vocabulary.The EPPLE (Proficiency Exam for Foreign Language Teachers) is an assessment instrument in constant improvement (CONSOLO and TEIXEIRA DA SILVA, 2014; COLOMBO, 2019) which aims at assessing the proficiency of the FL teacher in the Brazilian context. Currently, the EPPLE has only a holistic scale to assess the oral performance of candidates, developed intuitively. Thus, it is necessary to build an analytical and empirically based proficiency scale to produce an argument for the validity of the assessment criteria that classify the oral performances in the exam. The vocabulary accuracy, among other constructs of the linguistic competence, is extremely important for the FL language teacher oral proficiency, since the teacher teaches LE using the target language in communicative contexts (FREEMAN et al., 2015). The present study presents results of the application of EBBs (Empirically derived, Binary choice, Boundary definition scales), an empirical methodology for the development of assessment criteria and rating scales developed by Upshur and Turner (1999), for the construction of a framework of empirically verifiable criteria to assess the vocabulary accuracy used by EPPLE candidates. From data analysis, it was possible to develop an analytical proficiency scale to assess vocabulary accuracy that integrates the coherence of the vocabulary, the accurate use of metalanguage and the knowledge of keywords related to linguistic topics.O EPPLE (Exame de Proficiência para Professores de Línguas Estrangeiras) é um instrumento avaliativo em constante aprimoramento (CONSOLO e TEIXEIRA DA SILVA, 2014; COLOMBO, 2019) que se volta para a avaliação da proficiência do professor de LE no contexto brasileiro. Atualmente, o EPPLE possui apenas uma escala holística para a avaliação do desempenho oral de candidatos, desenvolvida intuitivamente. Dessa forma, é necessário que se construa uma escala de proficiência analítica empiricamente embasada para a produção de um argumento para a validade dos critérios avaliativos que classificam os desempenhos orais no exame. A precisão do vocabulário empregado, entre outros construtos da competência linguística, é de extrema importância para a proficiência oral do professor de LE, uma vez que o professor ensina a LE utilizando a língua-alvo em contextos comunicativos (FREEMAN et al., 2015). O presente estudo apresenta resultados da aplicação dos EBBs (Empirically derived, Binary choice, Boundary definition scales), metodologia empírica para o desenvolvimento de critérios avaliativos e escalas de proficiência linguística desenvolvida por Upshur e Turner (1999), em amostras do banco de dados do EPPLE. A partir da análise, construiu-se de um quadro de critérios empiricamente verificáveis para a avaliação da precisão do vocabulário empregado pelos candidatos do exame, assim como desenvolveu-se uma escala de proficiência analítica que contempla a coerência do vocabulário empregado, o uso preciso de terminologia técnica e o (re)conhecimento de palavras-chave relacionadas à tarefa metalinguística. PP/UFU2022-01-06info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdftext/xmlhttps://seer.ufu.br/index.php/dominiosdelinguagem/article/view/5944410.14393/DL49-v16n1a2022-3Domínios de Lingu@gem; Vol. 16 No. 1 (2022): Número Atemático; 70-92Domínios de Lingu@gem; Vol. 16 Núm. 1 (2022): Número Atemático; 70-92Domínios de Lingu@gem; v. 16 n. 1 (2022): Número Atemático; 70-921980-5799reponame:Domínios de Lingu@geminstname:Universidade Federal de Uberlândia (UFU)instacron:UFUporhttps://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444/31174https://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444/35114Copyright (c) 2022 Diego Fernando de Oliveirahttp://creativecommons.org/licenses/by-nc-nd/4.0info:eu-repo/semantics/openAccessOliveira, Diego Fernando de2022-11-30T19:23:42Zoai:ojs.www.seer.ufu.br:article/59444Revistahttps://seer.ufu.br/index.php/dominiosdelinguagemPUBhttps://seer.ufu.br/index.php/dominiosdelinguagem/oairevistadominios@ileel.ufu.br||1980-57991980-5799opendoar:2022-11-30T19:23:42Domínios de Lingu@gem - Universidade Federal de Uberlândia (UFU)false
dc.title.none.fl_str_mv Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
Critérios empiricamente verificáveis para a avaliação do vocabulário na produção oral do professor de língua estrangeira
title Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
spellingShingle Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
Oliveira, Diego Fernando de
valiação docente. Proficiência oral. Língua Estrangeira. Vocabulário.
Teacher assessment. Oral proficiency. Foreign language. Vocabulary.
title_short Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
title_full Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
title_fullStr Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
title_full_unstemmed Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
title_sort Empirically verifiable criteria to assess vocabulary accuracy in the oral production of foreign language teachers
author Oliveira, Diego Fernando de
author_facet Oliveira, Diego Fernando de
author_role author
dc.contributor.author.fl_str_mv Oliveira, Diego Fernando de
dc.subject.por.fl_str_mv valiação docente. Proficiência oral. Língua Estrangeira. Vocabulário.
Teacher assessment. Oral proficiency. Foreign language. Vocabulary.
topic valiação docente. Proficiência oral. Língua Estrangeira. Vocabulário.
Teacher assessment. Oral proficiency. Foreign language. Vocabulary.
description The EPPLE (Proficiency Exam for Foreign Language Teachers) is an assessment instrument in constant improvement (CONSOLO and TEIXEIRA DA SILVA, 2014; COLOMBO, 2019) which aims at assessing the proficiency of the FL teacher in the Brazilian context. Currently, the EPPLE has only a holistic scale to assess the oral performance of candidates, developed intuitively. Thus, it is necessary to build an analytical and empirically based proficiency scale to produce an argument for the validity of the assessment criteria that classify the oral performances in the exam. The vocabulary accuracy, among other constructs of the linguistic competence, is extremely important for the FL language teacher oral proficiency, since the teacher teaches LE using the target language in communicative contexts (FREEMAN et al., 2015). The present study presents results of the application of EBBs (Empirically derived, Binary choice, Boundary definition scales), an empirical methodology for the development of assessment criteria and rating scales developed by Upshur and Turner (1999), for the construction of a framework of empirically verifiable criteria to assess the vocabulary accuracy used by EPPLE candidates. From data analysis, it was possible to develop an analytical proficiency scale to assess vocabulary accuracy that integrates the coherence of the vocabulary, the accurate use of metalanguage and the knowledge of keywords related to linguistic topics.
publishDate 2022
dc.date.none.fl_str_mv 2022-01-06
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444
10.14393/DL49-v16n1a2022-3
url https://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444
identifier_str_mv 10.14393/DL49-v16n1a2022-3
dc.language.iso.fl_str_mv por
language por
dc.relation.none.fl_str_mv https://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444/31174
https://seer.ufu.br/index.php/dominiosdelinguagem/article/view/59444/35114
dc.rights.driver.fl_str_mv Copyright (c) 2022 Diego Fernando de Oliveira
http://creativecommons.org/licenses/by-nc-nd/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2022 Diego Fernando de Oliveira
http://creativecommons.org/licenses/by-nc-nd/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
text/xml
dc.publisher.none.fl_str_mv PP/UFU
publisher.none.fl_str_mv PP/UFU
dc.source.none.fl_str_mv Domínios de Lingu@gem; Vol. 16 No. 1 (2022): Número Atemático; 70-92
Domínios de Lingu@gem; Vol. 16 Núm. 1 (2022): Número Atemático; 70-92
Domínios de Lingu@gem; v. 16 n. 1 (2022): Número Atemático; 70-92
1980-5799
reponame:Domínios de Lingu@gem
instname:Universidade Federal de Uberlândia (UFU)
instacron:UFU
instname_str Universidade Federal de Uberlândia (UFU)
instacron_str UFU
institution UFU
reponame_str Domínios de Lingu@gem
collection Domínios de Lingu@gem
repository.name.fl_str_mv Domínios de Lingu@gem - Universidade Federal de Uberlândia (UFU)
repository.mail.fl_str_mv revistadominios@ileel.ufu.br||
_version_ 1797067717612666880