Proposta alternativa para análise do desempenho em provas cognitivas assistidas

Detalhes bibliográficos
Autor(a) principal: Queiroz, Odoisa Antunes de
Data de Publicação: 2010
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)
Texto Completo: http://repositorio.ufes.br/handle/10/3003
Resumo: Since 1991, Brazilian researchers study the children’s learning potential, especially of children with special educational needs (SEN), based on supervised evaluation, in which the structured format (pretest -intervention –posttest) includes an intermediate step of a systematic help of the examiner, calculating the rate of gain between the initial step and the final, both without help. This analysis, however, has been criticized methodologically. This dissertation, then, analyzed alternative proposal for data analysis of assisted evidence, applied to data that were already collected of 248 children with (157) and without SEN (91) (average 8 years and six months old). In order for this to be done, data of 8 performed researches were integrated between 1999 and 2008, which utilized 4 assisted cognitive tests (270 handouts) and 3 psychometric tests (355 handouts). These data were organized in 3 studies, among them a theoretical one (Study 1), and they were analyzed regarding the: (a) relations between statusvariables (age, gender, levelof education, type of development problem –visual, communication or learning difficulties) and the cognitive performance in the assisted tests (b) performance in the two modalities of tests (psychometric and assisted) (Study 2); (c) performance in the steps without help (pretest) and of maintenance (posttest) of the assisted tests, by the Item Response Theory (IRT); (d) comparison of the traditional rate of gain and the obtained results by the IRT (Study 3). In the Study 2, the 6 researches already done were put together, providing an overview about the projects, with contributions, in an effort to verify some distinctions between the two evaluative modalities. In this study, the collected information showed that, in fact, the two methodologies have their peculiarities: the traditional ones evaluate questions regarding the examiner’s accumulated knowledge, while the assisted measure the learning potential. In what regards the comparisons of performance in the tests, it was verified that an inferior result in the psychometric test doesn’t lead the examined to a low cognitive gain in the assisted test. And still, the fact that an individual is suffering from a development problem doesn’t imply in his/her total failure in the tests. In the Study 3, the construction procedures of the data’s equalization of the assisted test showed that the pre and posttest’s steps have items with similar difficulty levels. In what is referred to the comparison between the traditional metrics and those obtained by the IRT, it was verified that the gain values and theta are similar. Finally, it is noteworthy that the two evaluation modalities, assisted and psychometric, have their particularities, being important for the development of adequate measures, which will offer improvementto the psychological, educational, affective and social conditions of the population.
id UFES_fd16c0c1aaffcd4e4fe946d723cd9588
oai_identifier_str oai:repositorio.ufes.br:10/3003
network_acronym_str UFES
network_name_str Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)
repository_id_str 2108
spelling Primi, RicardoEnumo, Sônia Regina FiorimQueiroz, Odoisa Antunes deFerrão, Erika da SilvaTokumaru, Rosana Suemi2016-08-29T14:10:08Z2016-07-112016-08-29T14:10:08Z2010-08-26Since 1991, Brazilian researchers study the children’s learning potential, especially of children with special educational needs (SEN), based on supervised evaluation, in which the structured format (pretest -intervention –posttest) includes an intermediate step of a systematic help of the examiner, calculating the rate of gain between the initial step and the final, both without help. This analysis, however, has been criticized methodologically. This dissertation, then, analyzed alternative proposal for data analysis of assisted evidence, applied to data that were already collected of 248 children with (157) and without SEN (91) (average 8 years and six months old). In order for this to be done, data of 8 performed researches were integrated between 1999 and 2008, which utilized 4 assisted cognitive tests (270 handouts) and 3 psychometric tests (355 handouts). These data were organized in 3 studies, among them a theoretical one (Study 1), and they were analyzed regarding the: (a) relations between statusvariables (age, gender, levelof education, type of development problem –visual, communication or learning difficulties) and the cognitive performance in the assisted tests (b) performance in the two modalities of tests (psychometric and assisted) (Study 2); (c) performance in the steps without help (pretest) and of maintenance (posttest) of the assisted tests, by the Item Response Theory (IRT); (d) comparison of the traditional rate of gain and the obtained results by the IRT (Study 3). In the Study 2, the 6 researches already done were put together, providing an overview about the projects, with contributions, in an effort to verify some distinctions between the two evaluative modalities. In this study, the collected information showed that, in fact, the two methodologies have their peculiarities: the traditional ones evaluate questions regarding the examiner’s accumulated knowledge, while the assisted measure the learning potential. In what regards the comparisons of performance in the tests, it was verified that an inferior result in the psychometric test doesn’t lead the examined to a low cognitive gain in the assisted test. And still, the fact that an individual is suffering from a development problem doesn’t imply in his/her total failure in the tests. In the Study 3, the construction procedures of the data’s equalization of the assisted test showed that the pre and posttest’s steps have items with similar difficulty levels. In what is referred to the comparison between the traditional metrics and those obtained by the IRT, it was verified that the gain values and theta are similar. Finally, it is noteworthy that the two evaluation modalities, assisted and psychometric, have their particularities, being important for the development of adequate measures, which will offer improvementto the psychological, educational, affective and social conditions of the population.Desde 1991, pesquisadores brasileiros estudam o potencial de aprendizagem infantil, especialmente de crianças com necessidades educativas especiais (NEE), com base na avaliação assistida, cujo formato estruturado (pré-teste intervenção - pós-teste) inclui uma fase intermediária de ajuda sistematizada do examinador, calculando-se a taxa de ganho entre a fase inicial e a final, ambas sem ajuda. Essa análise, entretanto, tem sido criticada metodologicamente. Esta dissertação, então, analisou propostas alternativas de análise de dados de provas assistidas, aplicada a dados já coletados de 248 crianças com (157) e sem NEE (91) (idade média: 8 anos e 6 meses). Para isso, foram integrados dados de 8 pesquisas realizadas entre 1999 e 2008, que utilizaram 4 provas cognitivas assistidas (270 aplicações) e 3 psicométricas (355 aplicações). Esses dados foram organizados em 3 estudos, sendo um teórico (Estudo 1), e analisados quanto a: (a) relações entre variáveis de status (idade, sexo, escolaridade, tipo de problema de desenvolvimento ou deficiência visual, problemas de comunicação ou dificuldades de aprendizagem) e o desempenho cognitivo nas provas assistidas (b) desempenho nas duas modalidades de provas (psicométricas e assistidas) (Estudo 2); (c) desempenho nas fases sem ajuda (pré-teste) e de manutenção (pós-teste) das provas assistidas, pela Teoria de Resposta ao Item (TRI); (d) comparação da taxa de ganho tradicional e os resultados obtidos pela TRI (Estudo 3). No Estudo 2, foram agrupadas as 6 pesquisas já realizadas, proporcionando um panorama geral sobre os trabalhos, com contribuições, no sentido de verificar algumas distinções entre as duas modalidades avaliativas. Nesse estudo, as informações coletadas mostraram que, de fato, as duas metodologias possuem suas peculiaridades: as tradicionais avaliam questões relativas ao conhecimento acumulado do examinando, enquanto que as assistidas medem o potencial de aprendizagem. Em relação às comparações de desempenho nas provas, verificou-se que um resultado inferior na prova psicométrica não sentencia o examinado a um ganho cognitivo baixo na prova assistida. E ainda, ser portador de algum problema de desenvolvimento não implica em insucesso total nas provas. Quanto ao Estudo 3, os procedimentos de construção da equalização dos dados da prova assistida mostraram que as fases de pré e pós-teste possuem itens com níveis de dificuldade semelhantes. No que se refere à comparação entre as métricas tradicionais e aquelas obtidas pela TRI, verificou-se que os valores de ganho e theta são semelhantes. Finalmente, cabe destacar que as duas modalidades de avaliação, assistida e psicométrica, tem suas particularidade, sendo importantes para o desenvolvimento de medidas adequadas, que melhorem as condições psicológicas, educacionais, afetivas e sociais da população.TextQUEIROZ, Odoisa Antunes de. Proposta alternativa para análise do desempenho em provas cognitivas assistidas. 2010. Dissertação (Mestrado em Psicologia) - Universidade Federal do Espírito Santo, Centro de Ciências Humanas e Naturais, Vitória, 2010.http://repositorio.ufes.br/handle/10/3003porUniversidade Federal do Espírito SantoMestrado em PsicologiaPrograma de Pós-Graduação em PsicologiaUFESBRDynamic AssessmentItem Response Theory (IRT)Disabled ChildrenAvaliação assistidaTeoria de resposta ao item (TRI)DeficientesAvaliação educacionalTestes e medidas educacionaisAvaliação educacionalDeficientesTestes psicológicosPsicometriaPsicologia159.9Proposta alternativa para análise do desempenho em provas cognitivas assistidasAlternative proposal for analysis of performance on dynamic testsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)instname:Universidade Federal do Espírito Santo (UFES)instacron:UFESORIGINALOdoisa-Antunes-de-Queiroz-2010-trabalho.pdfapplication/pdf1835465http://repositorio.ufes.br/bitstreams/48652cce-d678-42a7-addc-2666e0121fc3/download51e3c08734b9266d576b9dbb900ac01aMD5110/30032024-07-02 15:22:30.043oai:repositorio.ufes.br:10/3003http://repositorio.ufes.brRepositório InstitucionalPUBhttp://repositorio.ufes.br/oai/requestopendoar:21082024-07-11T14:36:31.744076Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) - Universidade Federal do Espírito Santo (UFES)false
dc.title.none.fl_str_mv Proposta alternativa para análise do desempenho em provas cognitivas assistidas
dc.title.alternative.none.fl_str_mv Alternative proposal for analysis of performance on dynamic tests
title Proposta alternativa para análise do desempenho em provas cognitivas assistidas
spellingShingle Proposta alternativa para análise do desempenho em provas cognitivas assistidas
Queiroz, Odoisa Antunes de
Dynamic Assessment
Item Response Theory (IRT)
Disabled Children
Avaliação assistida
Teoria de resposta ao item (TRI)
Deficientes
Avaliação educacional
Psicologia
Testes e medidas educacionais
Avaliação educacional
Deficientes
Testes psicológicos
Psicometria
159.9
title_short Proposta alternativa para análise do desempenho em provas cognitivas assistidas
title_full Proposta alternativa para análise do desempenho em provas cognitivas assistidas
title_fullStr Proposta alternativa para análise do desempenho em provas cognitivas assistidas
title_full_unstemmed Proposta alternativa para análise do desempenho em provas cognitivas assistidas
title_sort Proposta alternativa para análise do desempenho em provas cognitivas assistidas
author Queiroz, Odoisa Antunes de
author_facet Queiroz, Odoisa Antunes de
author_role author
dc.contributor.advisor-co1.fl_str_mv Primi, Ricardo
dc.contributor.advisor1.fl_str_mv Enumo, Sônia Regina Fiorim
dc.contributor.author.fl_str_mv Queiroz, Odoisa Antunes de
dc.contributor.referee1.fl_str_mv Ferrão, Erika da Silva
dc.contributor.referee2.fl_str_mv Tokumaru, Rosana Suemi
contributor_str_mv Primi, Ricardo
Enumo, Sônia Regina Fiorim
Ferrão, Erika da Silva
Tokumaru, Rosana Suemi
dc.subject.eng.fl_str_mv Dynamic Assessment
Item Response Theory (IRT)
Disabled Children
topic Dynamic Assessment
Item Response Theory (IRT)
Disabled Children
Avaliação assistida
Teoria de resposta ao item (TRI)
Deficientes
Avaliação educacional
Psicologia
Testes e medidas educacionais
Avaliação educacional
Deficientes
Testes psicológicos
Psicometria
159.9
dc.subject.por.fl_str_mv Avaliação assistida
Teoria de resposta ao item (TRI)
Deficientes
Avaliação educacional
dc.subject.cnpq.fl_str_mv Psicologia
dc.subject.br-rjbn.none.fl_str_mv Testes e medidas educacionais
Avaliação educacional
Deficientes
Testes psicológicos
Psicometria
dc.subject.udc.none.fl_str_mv 159.9
description Since 1991, Brazilian researchers study the children’s learning potential, especially of children with special educational needs (SEN), based on supervised evaluation, in which the structured format (pretest -intervention –posttest) includes an intermediate step of a systematic help of the examiner, calculating the rate of gain between the initial step and the final, both without help. This analysis, however, has been criticized methodologically. This dissertation, then, analyzed alternative proposal for data analysis of assisted evidence, applied to data that were already collected of 248 children with (157) and without SEN (91) (average 8 years and six months old). In order for this to be done, data of 8 performed researches were integrated between 1999 and 2008, which utilized 4 assisted cognitive tests (270 handouts) and 3 psychometric tests (355 handouts). These data were organized in 3 studies, among them a theoretical one (Study 1), and they were analyzed regarding the: (a) relations between statusvariables (age, gender, levelof education, type of development problem –visual, communication or learning difficulties) and the cognitive performance in the assisted tests (b) performance in the two modalities of tests (psychometric and assisted) (Study 2); (c) performance in the steps without help (pretest) and of maintenance (posttest) of the assisted tests, by the Item Response Theory (IRT); (d) comparison of the traditional rate of gain and the obtained results by the IRT (Study 3). In the Study 2, the 6 researches already done were put together, providing an overview about the projects, with contributions, in an effort to verify some distinctions between the two evaluative modalities. In this study, the collected information showed that, in fact, the two methodologies have their peculiarities: the traditional ones evaluate questions regarding the examiner’s accumulated knowledge, while the assisted measure the learning potential. In what regards the comparisons of performance in the tests, it was verified that an inferior result in the psychometric test doesn’t lead the examined to a low cognitive gain in the assisted test. And still, the fact that an individual is suffering from a development problem doesn’t imply in his/her total failure in the tests. In the Study 3, the construction procedures of the data’s equalization of the assisted test showed that the pre and posttest’s steps have items with similar difficulty levels. In what is referred to the comparison between the traditional metrics and those obtained by the IRT, it was verified that the gain values and theta are similar. Finally, it is noteworthy that the two evaluation modalities, assisted and psychometric, have their particularities, being important for the development of adequate measures, which will offer improvementto the psychological, educational, affective and social conditions of the population.
publishDate 2010
dc.date.issued.fl_str_mv 2010-08-26
dc.date.accessioned.fl_str_mv 2016-08-29T14:10:08Z
dc.date.available.fl_str_mv 2016-07-11
2016-08-29T14:10:08Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv QUEIROZ, Odoisa Antunes de. Proposta alternativa para análise do desempenho em provas cognitivas assistidas. 2010. Dissertação (Mestrado em Psicologia) - Universidade Federal do Espírito Santo, Centro de Ciências Humanas e Naturais, Vitória, 2010.
dc.identifier.uri.fl_str_mv http://repositorio.ufes.br/handle/10/3003
identifier_str_mv QUEIROZ, Odoisa Antunes de. Proposta alternativa para análise do desempenho em provas cognitivas assistidas. 2010. Dissertação (Mestrado em Psicologia) - Universidade Federal do Espírito Santo, Centro de Ciências Humanas e Naturais, Vitória, 2010.
url http://repositorio.ufes.br/handle/10/3003
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv Text
dc.publisher.none.fl_str_mv Universidade Federal do Espírito Santo
Mestrado em Psicologia
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Psicologia
dc.publisher.initials.fl_str_mv UFES
dc.publisher.country.fl_str_mv BR
publisher.none.fl_str_mv Universidade Federal do Espírito Santo
Mestrado em Psicologia
dc.source.none.fl_str_mv reponame:Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)
instname:Universidade Federal do Espírito Santo (UFES)
instacron:UFES
instname_str Universidade Federal do Espírito Santo (UFES)
instacron_str UFES
institution UFES
reponame_str Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)
collection Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)
bitstream.url.fl_str_mv http://repositorio.ufes.br/bitstreams/48652cce-d678-42a7-addc-2666e0121fc3/download
bitstream.checksum.fl_str_mv 51e3c08734b9266d576b9dbb900ac01a
bitstream.checksumAlgorithm.fl_str_mv MD5
repository.name.fl_str_mv Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) - Universidade Federal do Espírito Santo (UFES)
repository.mail.fl_str_mv
_version_ 1813022618625769472