Proposta alternativa para análise do desempenho em provas cognitivas assistidas
Autor(a) principal: | |
---|---|
Data de Publicação: | 2010 |
Tipo de documento: | Dissertação |
Idioma: | por |
Título da fonte: | Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) |
Texto Completo: | http://repositorio.ufes.br/handle/10/3003 |
Resumo: | Since 1991, Brazilian researchers study the children’s learning potential, especially of children with special educational needs (SEN), based on supervised evaluation, in which the structured format (pretest -intervention –posttest) includes an intermediate step of a systematic help of the examiner, calculating the rate of gain between the initial step and the final, both without help. This analysis, however, has been criticized methodologically. This dissertation, then, analyzed alternative proposal for data analysis of assisted evidence, applied to data that were already collected of 248 children with (157) and without SEN (91) (average 8 years and six months old). In order for this to be done, data of 8 performed researches were integrated between 1999 and 2008, which utilized 4 assisted cognitive tests (270 handouts) and 3 psychometric tests (355 handouts). These data were organized in 3 studies, among them a theoretical one (Study 1), and they were analyzed regarding the: (a) relations between statusvariables (age, gender, levelof education, type of development problem –visual, communication or learning difficulties) and the cognitive performance in the assisted tests (b) performance in the two modalities of tests (psychometric and assisted) (Study 2); (c) performance in the steps without help (pretest) and of maintenance (posttest) of the assisted tests, by the Item Response Theory (IRT); (d) comparison of the traditional rate of gain and the obtained results by the IRT (Study 3). In the Study 2, the 6 researches already done were put together, providing an overview about the projects, with contributions, in an effort to verify some distinctions between the two evaluative modalities. In this study, the collected information showed that, in fact, the two methodologies have their peculiarities: the traditional ones evaluate questions regarding the examiner’s accumulated knowledge, while the assisted measure the learning potential. In what regards the comparisons of performance in the tests, it was verified that an inferior result in the psychometric test doesn’t lead the examined to a low cognitive gain in the assisted test. And still, the fact that an individual is suffering from a development problem doesn’t imply in his/her total failure in the tests. In the Study 3, the construction procedures of the data’s equalization of the assisted test showed that the pre and posttest’s steps have items with similar difficulty levels. In what is referred to the comparison between the traditional metrics and those obtained by the IRT, it was verified that the gain values and theta are similar. Finally, it is noteworthy that the two evaluation modalities, assisted and psychometric, have their particularities, being important for the development of adequate measures, which will offer improvementto the psychological, educational, affective and social conditions of the population. |
id |
UFES_fd16c0c1aaffcd4e4fe946d723cd9588 |
---|---|
oai_identifier_str |
oai:repositorio.ufes.br:10/3003 |
network_acronym_str |
UFES |
network_name_str |
Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) |
repository_id_str |
2108 |
spelling |
Primi, RicardoEnumo, Sônia Regina FiorimQueiroz, Odoisa Antunes deFerrão, Erika da SilvaTokumaru, Rosana Suemi2016-08-29T14:10:08Z2016-07-112016-08-29T14:10:08Z2010-08-26Since 1991, Brazilian researchers study the children’s learning potential, especially of children with special educational needs (SEN), based on supervised evaluation, in which the structured format (pretest -intervention –posttest) includes an intermediate step of a systematic help of the examiner, calculating the rate of gain between the initial step and the final, both without help. This analysis, however, has been criticized methodologically. This dissertation, then, analyzed alternative proposal for data analysis of assisted evidence, applied to data that were already collected of 248 children with (157) and without SEN (91) (average 8 years and six months old). In order for this to be done, data of 8 performed researches were integrated between 1999 and 2008, which utilized 4 assisted cognitive tests (270 handouts) and 3 psychometric tests (355 handouts). These data were organized in 3 studies, among them a theoretical one (Study 1), and they were analyzed regarding the: (a) relations between statusvariables (age, gender, levelof education, type of development problem –visual, communication or learning difficulties) and the cognitive performance in the assisted tests (b) performance in the two modalities of tests (psychometric and assisted) (Study 2); (c) performance in the steps without help (pretest) and of maintenance (posttest) of the assisted tests, by the Item Response Theory (IRT); (d) comparison of the traditional rate of gain and the obtained results by the IRT (Study 3). In the Study 2, the 6 researches already done were put together, providing an overview about the projects, with contributions, in an effort to verify some distinctions between the two evaluative modalities. In this study, the collected information showed that, in fact, the two methodologies have their peculiarities: the traditional ones evaluate questions regarding the examiner’s accumulated knowledge, while the assisted measure the learning potential. In what regards the comparisons of performance in the tests, it was verified that an inferior result in the psychometric test doesn’t lead the examined to a low cognitive gain in the assisted test. And still, the fact that an individual is suffering from a development problem doesn’t imply in his/her total failure in the tests. In the Study 3, the construction procedures of the data’s equalization of the assisted test showed that the pre and posttest’s steps have items with similar difficulty levels. In what is referred to the comparison between the traditional metrics and those obtained by the IRT, it was verified that the gain values and theta are similar. Finally, it is noteworthy that the two evaluation modalities, assisted and psychometric, have their particularities, being important for the development of adequate measures, which will offer improvementto the psychological, educational, affective and social conditions of the population.Desde 1991, pesquisadores brasileiros estudam o potencial de aprendizagem infantil, especialmente de crianças com necessidades educativas especiais (NEE), com base na avaliação assistida, cujo formato estruturado (pré-teste intervenção - pós-teste) inclui uma fase intermediária de ajuda sistematizada do examinador, calculando-se a taxa de ganho entre a fase inicial e a final, ambas sem ajuda. Essa análise, entretanto, tem sido criticada metodologicamente. Esta dissertação, então, analisou propostas alternativas de análise de dados de provas assistidas, aplicada a dados já coletados de 248 crianças com (157) e sem NEE (91) (idade média: 8 anos e 6 meses). Para isso, foram integrados dados de 8 pesquisas realizadas entre 1999 e 2008, que utilizaram 4 provas cognitivas assistidas (270 aplicações) e 3 psicométricas (355 aplicações). Esses dados foram organizados em 3 estudos, sendo um teórico (Estudo 1), e analisados quanto a: (a) relações entre variáveis de status (idade, sexo, escolaridade, tipo de problema de desenvolvimento ou deficiência visual, problemas de comunicação ou dificuldades de aprendizagem) e o desempenho cognitivo nas provas assistidas (b) desempenho nas duas modalidades de provas (psicométricas e assistidas) (Estudo 2); (c) desempenho nas fases sem ajuda (pré-teste) e de manutenção (pós-teste) das provas assistidas, pela Teoria de Resposta ao Item (TRI); (d) comparação da taxa de ganho tradicional e os resultados obtidos pela TRI (Estudo 3). No Estudo 2, foram agrupadas as 6 pesquisas já realizadas, proporcionando um panorama geral sobre os trabalhos, com contribuições, no sentido de verificar algumas distinções entre as duas modalidades avaliativas. Nesse estudo, as informações coletadas mostraram que, de fato, as duas metodologias possuem suas peculiaridades: as tradicionais avaliam questões relativas ao conhecimento acumulado do examinando, enquanto que as assistidas medem o potencial de aprendizagem. Em relação às comparações de desempenho nas provas, verificou-se que um resultado inferior na prova psicométrica não sentencia o examinado a um ganho cognitivo baixo na prova assistida. E ainda, ser portador de algum problema de desenvolvimento não implica em insucesso total nas provas. Quanto ao Estudo 3, os procedimentos de construção da equalização dos dados da prova assistida mostraram que as fases de pré e pós-teste possuem itens com níveis de dificuldade semelhantes. No que se refere à comparação entre as métricas tradicionais e aquelas obtidas pela TRI, verificou-se que os valores de ganho e theta são semelhantes. Finalmente, cabe destacar que as duas modalidades de avaliação, assistida e psicométrica, tem suas particularidade, sendo importantes para o desenvolvimento de medidas adequadas, que melhorem as condições psicológicas, educacionais, afetivas e sociais da população.TextQUEIROZ, Odoisa Antunes de. Proposta alternativa para análise do desempenho em provas cognitivas assistidas. 2010. Dissertação (Mestrado em Psicologia) - Universidade Federal do Espírito Santo, Centro de Ciências Humanas e Naturais, Vitória, 2010.http://repositorio.ufes.br/handle/10/3003porUniversidade Federal do Espírito SantoMestrado em PsicologiaPrograma de Pós-Graduação em PsicologiaUFESBRDynamic AssessmentItem Response Theory (IRT)Disabled ChildrenAvaliação assistidaTeoria de resposta ao item (TRI)DeficientesAvaliação educacionalTestes e medidas educacionaisAvaliação educacionalDeficientesTestes psicológicosPsicometriaPsicologia159.9Proposta alternativa para análise do desempenho em provas cognitivas assistidasAlternative proposal for analysis of performance on dynamic testsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da Universidade Federal do Espírito Santo (riUfes)instname:Universidade Federal do Espírito Santo (UFES)instacron:UFESORIGINALOdoisa-Antunes-de-Queiroz-2010-trabalho.pdfapplication/pdf1835465http://repositorio.ufes.br/bitstreams/48652cce-d678-42a7-addc-2666e0121fc3/download51e3c08734b9266d576b9dbb900ac01aMD5110/30032024-07-02 15:22:30.043oai:repositorio.ufes.br:10/3003http://repositorio.ufes.brRepositório InstitucionalPUBhttp://repositorio.ufes.br/oai/requestopendoar:21082024-07-11T14:36:31.744076Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) - Universidade Federal do Espírito Santo (UFES)false |
dc.title.none.fl_str_mv |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
dc.title.alternative.none.fl_str_mv |
Alternative proposal for analysis of performance on dynamic tests |
title |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
spellingShingle |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas Queiroz, Odoisa Antunes de Dynamic Assessment Item Response Theory (IRT) Disabled Children Avaliação assistida Teoria de resposta ao item (TRI) Deficientes Avaliação educacional Psicologia Testes e medidas educacionais Avaliação educacional Deficientes Testes psicológicos Psicometria 159.9 |
title_short |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
title_full |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
title_fullStr |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
title_full_unstemmed |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
title_sort |
Proposta alternativa para análise do desempenho em provas cognitivas assistidas |
author |
Queiroz, Odoisa Antunes de |
author_facet |
Queiroz, Odoisa Antunes de |
author_role |
author |
dc.contributor.advisor-co1.fl_str_mv |
Primi, Ricardo |
dc.contributor.advisor1.fl_str_mv |
Enumo, Sônia Regina Fiorim |
dc.contributor.author.fl_str_mv |
Queiroz, Odoisa Antunes de |
dc.contributor.referee1.fl_str_mv |
Ferrão, Erika da Silva |
dc.contributor.referee2.fl_str_mv |
Tokumaru, Rosana Suemi |
contributor_str_mv |
Primi, Ricardo Enumo, Sônia Regina Fiorim Ferrão, Erika da Silva Tokumaru, Rosana Suemi |
dc.subject.eng.fl_str_mv |
Dynamic Assessment Item Response Theory (IRT) Disabled Children |
topic |
Dynamic Assessment Item Response Theory (IRT) Disabled Children Avaliação assistida Teoria de resposta ao item (TRI) Deficientes Avaliação educacional Psicologia Testes e medidas educacionais Avaliação educacional Deficientes Testes psicológicos Psicometria 159.9 |
dc.subject.por.fl_str_mv |
Avaliação assistida Teoria de resposta ao item (TRI) Deficientes Avaliação educacional |
dc.subject.cnpq.fl_str_mv |
Psicologia |
dc.subject.br-rjbn.none.fl_str_mv |
Testes e medidas educacionais Avaliação educacional Deficientes Testes psicológicos Psicometria |
dc.subject.udc.none.fl_str_mv |
159.9 |
description |
Since 1991, Brazilian researchers study the children’s learning potential, especially of children with special educational needs (SEN), based on supervised evaluation, in which the structured format (pretest -intervention –posttest) includes an intermediate step of a systematic help of the examiner, calculating the rate of gain between the initial step and the final, both without help. This analysis, however, has been criticized methodologically. This dissertation, then, analyzed alternative proposal for data analysis of assisted evidence, applied to data that were already collected of 248 children with (157) and without SEN (91) (average 8 years and six months old). In order for this to be done, data of 8 performed researches were integrated between 1999 and 2008, which utilized 4 assisted cognitive tests (270 handouts) and 3 psychometric tests (355 handouts). These data were organized in 3 studies, among them a theoretical one (Study 1), and they were analyzed regarding the: (a) relations between statusvariables (age, gender, levelof education, type of development problem –visual, communication or learning difficulties) and the cognitive performance in the assisted tests (b) performance in the two modalities of tests (psychometric and assisted) (Study 2); (c) performance in the steps without help (pretest) and of maintenance (posttest) of the assisted tests, by the Item Response Theory (IRT); (d) comparison of the traditional rate of gain and the obtained results by the IRT (Study 3). In the Study 2, the 6 researches already done were put together, providing an overview about the projects, with contributions, in an effort to verify some distinctions between the two evaluative modalities. In this study, the collected information showed that, in fact, the two methodologies have their peculiarities: the traditional ones evaluate questions regarding the examiner’s accumulated knowledge, while the assisted measure the learning potential. In what regards the comparisons of performance in the tests, it was verified that an inferior result in the psychometric test doesn’t lead the examined to a low cognitive gain in the assisted test. And still, the fact that an individual is suffering from a development problem doesn’t imply in his/her total failure in the tests. In the Study 3, the construction procedures of the data’s equalization of the assisted test showed that the pre and posttest’s steps have items with similar difficulty levels. In what is referred to the comparison between the traditional metrics and those obtained by the IRT, it was verified that the gain values and theta are similar. Finally, it is noteworthy that the two evaluation modalities, assisted and psychometric, have their particularities, being important for the development of adequate measures, which will offer improvementto the psychological, educational, affective and social conditions of the population. |
publishDate |
2010 |
dc.date.issued.fl_str_mv |
2010-08-26 |
dc.date.accessioned.fl_str_mv |
2016-08-29T14:10:08Z |
dc.date.available.fl_str_mv |
2016-07-11 2016-08-29T14:10:08Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
QUEIROZ, Odoisa Antunes de. Proposta alternativa para análise do desempenho em provas cognitivas assistidas. 2010. Dissertação (Mestrado em Psicologia) - Universidade Federal do Espírito Santo, Centro de Ciências Humanas e Naturais, Vitória, 2010. |
dc.identifier.uri.fl_str_mv |
http://repositorio.ufes.br/handle/10/3003 |
identifier_str_mv |
QUEIROZ, Odoisa Antunes de. Proposta alternativa para análise do desempenho em provas cognitivas assistidas. 2010. Dissertação (Mestrado em Psicologia) - Universidade Federal do Espírito Santo, Centro de Ciências Humanas e Naturais, Vitória, 2010. |
url |
http://repositorio.ufes.br/handle/10/3003 |
dc.language.iso.fl_str_mv |
por |
language |
por |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
Text |
dc.publisher.none.fl_str_mv |
Universidade Federal do Espírito Santo Mestrado em Psicologia |
dc.publisher.program.fl_str_mv |
Programa de Pós-Graduação em Psicologia |
dc.publisher.initials.fl_str_mv |
UFES |
dc.publisher.country.fl_str_mv |
BR |
publisher.none.fl_str_mv |
Universidade Federal do Espírito Santo Mestrado em Psicologia |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) instname:Universidade Federal do Espírito Santo (UFES) instacron:UFES |
instname_str |
Universidade Federal do Espírito Santo (UFES) |
instacron_str |
UFES |
institution |
UFES |
reponame_str |
Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) |
collection |
Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) |
bitstream.url.fl_str_mv |
http://repositorio.ufes.br/bitstreams/48652cce-d678-42a7-addc-2666e0121fc3/download |
bitstream.checksum.fl_str_mv |
51e3c08734b9266d576b9dbb900ac01a |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 |
repository.name.fl_str_mv |
Repositório Institucional da Universidade Federal do Espírito Santo (riUfes) - Universidade Federal do Espírito Santo (UFES) |
repository.mail.fl_str_mv |
|
_version_ |
1813022618625769472 |