Assessment of reading in english as foreign language: investigating the defensibility of test items

Detalhes bibliográficos
Autor(a) principal: Tumolo, Celso Henrique Soufen
Data de Publicação: 2005
Tipo de documento: Tese
Idioma: eng
Título da fonte: Repositório Institucional da UFSC
Texto Completo: http://repositorio.ufsc.br/handle/123456789/101915
Resumo: Tese (doutorado) - Universidade Federal de Santa Catarina, Centro de Comunicação e Expressão. Programa de Pós-Graduação em Letras/Inglês e Literatura Correspondente.
id UFSC_2ef685d8533de014afe70084a866f42d
oai_identifier_str oai:repositorio.ufsc.br:123456789/101915
network_acronym_str UFSC
network_name_str Repositório Institucional da UFSC
repository_id_str 2373
spelling Assessment of reading in english as foreign language: investigating the defensibility of test itemsLiteraturaLingua inglesaLinguistica aplicadaTese (doutorado) - Universidade Federal de Santa Catarina, Centro de Comunicação e Expressão. Programa de Pós-Graduação em Letras/Inglês e Literatura Correspondente.In the present study, the defensibility of test items is investigated in three different testing situations: proficiency tests, classroom tests, and university entrance examinations. The defensibility is judged using the concept of validity as put forth by Messick (1989) for educational testing and by Bachman (1990) for language testing, i.e., in terms of validity of the interpretations and actions based on test item responses, considering the justifications coming from evidential basis and consequential basis. For the investigation, in terms of evidential basis, for construct-related evidence, constructs of language ability and reading ability are used, and for criterion-related evidence, the criterion defined for university studies by Weir, Huizhong, and Yan (2000) and the framework proposed by Bachman (1990) for the assessment of authenticity of test tasks in relation to the criterion tasks are used. In terms of consequential basis, an appraisal of the consequences is based on Bachman's (1990) notion of fairness and Shohamy's (2001) critical perspective of the use of tests. The method used for the investigation is based on recent notion of validity as argument-based proposed by many scholars in the area of testing. It is also based on the validity table proposed by Chapelle (1994) for considerations of the forces of the arguments, both in favor, or against the validity of the interpretation of ability based on the items, with the additional feature of a third column, with the refutation of the argument against, as suggested by Davidson (personal communication, 2004). Considering the arguments provided for each item, it is possible to conclude that some items are defensible and some are not. Some defensible items focus on skills such as identification of syntax and cohesion, in particular lexical cohesion, inference of word meaning, elementary and propositional inferences, and identification of functional value. Some non-defensible items have the construct-irrelevant aspects of assessing constructs other than reading ability, such as vocabulary knowledge, background knowledge, writing ability, illustration comprehension, and the criterion-irrelevant aspect of assessing tasks not present in the criterion, such as the tasks specific for reading non-academic texts as poems, narratives, advertisements, and technical problems impeding test takers to perform at their level of ability. Other non-defensible items have the consequence of being biased once specific background knowledge is presupposed for their answers. The political and pedagogical implications of the conclusions claim for the choice or development of items incorporating features of validity, in all the facets, considering both evidential basis and consequential basis, so as to make them more defensible.Florianópolis, SCTomitch, Leda Maria BragaUniversidade Federal de Santa CatarinaTumolo, Celso Henrique Soufen2013-07-15T23:32:10Z2013-07-15T23:32:10Z20052005info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdf213306http://repositorio.ufsc.br/handle/123456789/101915engreponame:Repositório Institucional da UFSCinstname:Universidade Federal de Santa Catarina (UFSC)instacron:UFSCinfo:eu-repo/semantics/openAccess2014-01-12T02:47:08Zoai:repositorio.ufsc.br:123456789/101915Repositório InstitucionalPUBhttp://150.162.242.35/oai/requestopendoar:23732014-01-12T02:47:08Repositório Institucional da UFSC - Universidade Federal de Santa Catarina (UFSC)false
dc.title.none.fl_str_mv Assessment of reading in english as foreign language: investigating the defensibility of test items
title Assessment of reading in english as foreign language: investigating the defensibility of test items
spellingShingle Assessment of reading in english as foreign language: investigating the defensibility of test items
Tumolo, Celso Henrique Soufen
Literatura
Lingua inglesa
Linguistica aplicada
title_short Assessment of reading in english as foreign language: investigating the defensibility of test items
title_full Assessment of reading in english as foreign language: investigating the defensibility of test items
title_fullStr Assessment of reading in english as foreign language: investigating the defensibility of test items
title_full_unstemmed Assessment of reading in english as foreign language: investigating the defensibility of test items
title_sort Assessment of reading in english as foreign language: investigating the defensibility of test items
author Tumolo, Celso Henrique Soufen
author_facet Tumolo, Celso Henrique Soufen
author_role author
dc.contributor.none.fl_str_mv Tomitch, Leda Maria Braga
Universidade Federal de Santa Catarina
dc.contributor.author.fl_str_mv Tumolo, Celso Henrique Soufen
dc.subject.por.fl_str_mv Literatura
Lingua inglesa
Linguistica aplicada
topic Literatura
Lingua inglesa
Linguistica aplicada
description Tese (doutorado) - Universidade Federal de Santa Catarina, Centro de Comunicação e Expressão. Programa de Pós-Graduação em Letras/Inglês e Literatura Correspondente.
publishDate 2005
dc.date.none.fl_str_mv 2005
2005
2013-07-15T23:32:10Z
2013-07-15T23:32:10Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv 213306
http://repositorio.ufsc.br/handle/123456789/101915
identifier_str_mv 213306
url http://repositorio.ufsc.br/handle/123456789/101915
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Florianópolis, SC
publisher.none.fl_str_mv Florianópolis, SC
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFSC
instname:Universidade Federal de Santa Catarina (UFSC)
instacron:UFSC
instname_str Universidade Federal de Santa Catarina (UFSC)
instacron_str UFSC
institution UFSC
reponame_str Repositório Institucional da UFSC
collection Repositório Institucional da UFSC
repository.name.fl_str_mv Repositório Institucional da UFSC - Universidade Federal de Santa Catarina (UFSC)
repository.mail.fl_str_mv
_version_ 1808652127519637504

Registros relacionados