Value-added Modeling and the Power of Magical Thinking

Detalhes bibliográficos
Autor(a) principal: Braun, Henry
Data de Publicação: 2012
Tipo de documento: Artigo
Título da fonte: Ensaio (Rio de Janeiro. Online)
Texto Completo: https://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346
Resumo: This article explains the impetus in the United States behind the drive to extend test-based accountability to teachers and the growing interest in employing value-added models to generate the indicators to be used in teacher evaluation. The empirical literature finds that teaching quality is the most important school-related determinant of student. Yet, in the main, teacher evaluations are done poorly – if at all – and compensation has been largely determined by seniority and credentials. Policy makers see strengthening teacher accountability as a priority. In particular, they are looking to increase the role of outputs in comparison to inputs. However, given the technical problems associated with status-based indicators of teacher and school effectiveness, the focus has turned to indicators based on some measure of the progress students have made during the academic year. Value-added analysis relies on sophisticated statistical models to generate estimates of the relative effectiveness of teachers, based on a measure related to student progress. This article provides a brief introduction to value-added models and summarizes key research findings. Although value-added estimates have some desirable properties, they do not represent a simple, neat solution to a complex evaluation problem. In this spirit, the article concludes by describing some of the many concerns regarding the use of value-added scores for high-stakes decisions and suggests some ways to enhance the likelihood that teacher accountability will contribute constructively to the improvement of teaching.
id CESGRANRIO_2eb048aaf31a3b29e330efd8d89f8ca5
oai_identifier_str oai:ojs.localhost:article/346
network_acronym_str CESGRANRIO
network_name_str Ensaio (Rio de Janeiro. Online)
repository_id_str
spelling Value-added Modeling and the Power of Magical ThinkingEl modelado de valor agregado y el poder del pensamiento magicoModelagem de valor agregado e o poder do pensamento magicoAccountability; Teacher evaluation; Value-addedAccountability; Teacher evaluation; Value-addedResponsabilizacion; Evaluacion de profesores; Valor agregadoThis article explains the impetus in the United States behind the drive to extend test-based accountability to teachers and the growing interest in employing value-added models to generate the indicators to be used in teacher evaluation. The empirical literature finds that teaching quality is the most important school-related determinant of student. Yet, in the main, teacher evaluations are done poorly – if at all – and compensation has been largely determined by seniority and credentials. Policy makers see strengthening teacher accountability as a priority. In particular, they are looking to increase the role of outputs in comparison to inputs. However, given the technical problems associated with status-based indicators of teacher and school effectiveness, the focus has turned to indicators based on some measure of the progress students have made during the academic year. Value-added analysis relies on sophisticated statistical models to generate estimates of the relative effectiveness of teachers, based on a measure related to student progress. This article provides a brief introduction to value-added models and summarizes key research findings. Although value-added estimates have some desirable properties, they do not represent a simple, neat solution to a complex evaluation problem. In this spirit, the article concludes by describing some of the many concerns regarding the use of value-added scores for high-stakes decisions and suggests some ways to enhance the likelihood that teacher accountability will contribute constructively to the improvement of teaching.Este artículo analiza el entusiasmo existente en Estados Unidos con el proceso de extender la responsabilizacion (accountability) basada en tests a profesores y el creciente interes en emplear modelos de valor agregado para originar indicadores que se utilizaran en la evaluacion de profesores. La literatura empirica muestra que la calidad de enseñanza del profesor es el factor escolar mas importante para el exito del alumno. Pero, en general, las evaluaciones de profesores se realizan de modo precario, cuando son hechas, y los beneficios se determinan prioritariamente por tiempo de servicio y por titulos. Los formuladores de politicas consideran el fortalecimiento de la responsabilizacion del profesor como una prioridad. En particular, buscan aumentar el papel de los resultados (outputs) comparados con los datos de entrada (inputs). Pero, debido a los problemas tecnicos asociados con indicadores derivados del estatus (status-based) de profesores y de la eficácia de la escuela, el foco se oriento hacia indicadores basados en el progreso de los estudiantes durante el año lectivo. Se sabe que analisis de valor agregado dependen de modelos estadisticos sofisticados para originar estimadores de la eficácia de los profesores, basados en una medida relacionada con el progreso de los alumnos. Este artículo ofrece una breve introduccion a los modelos de valor agregado y resume los principales resultados de investigaciónes. Aunque estimadores de valor agregado tengan algunas propiedades deseables, no representan una solucion sencilla y elegante para un problema complejo de evaluacion. Finalmente, el artículo describe algunas preocupaciones que surgen con el uso de scores de valor agregado para decisiones de gran consecuencia y sugiere algunas formas que ayuden a que la responsabilizacion de profesores pueda contribuir constructivamente para la mejora de la enseñanza.Esse artigo trata do impeto nos Estados Unidos da America no processo de estender a responsabilização/prestação de contas (accountability) baseada em testes a professores e no crescente interesse em empregar modelos de valor acrescentado para gerar indicadores a serem utilizados na avaliação de professores. A literatura empirica mostra que a qualidade de ensino pelo professor e o fator escolar mais importante para o sucesso do aluno. Porem, em geral, as avaliações de professores sao feitas de modo precario – quando feitas – e beneficios sao prioritariamente determinados por tempo de servico e titulos. Os formuladores de politicas veem o fortalecimento da responsabilização do professor como uma prioridade. Em particular, eles estao procurando aumentar o papel de resultados (outputs) em comparação com dados de entrada (inputs). Mas, devido aos problemas tecnicos associados com indicadores derivados do status (status-based) de professores e da eficácia da escola, o foco foi orientado para indicadores baseados em alguma medida do progresso realizado pelos estudantes durante o ano letivo. Analises de valor acrescentado dependem de modelos estatisticos sofisticados para gerar estimadores da eficácia relativa dos professores, baseados em uma medida relacionada ao progresso dos alunos. Esse artigo fornece uma breve introdução aos modelos de valor acrescentado e faz um resumo dos principais resultados de pesquisas. Embora estimadores de valor acrescentado tenham algumas propriedades desejaveis, eles nao representam uma solução simples e elegante para um problema complexo de avaliação. Nesse espirito, o artigo finaliza descrevendo algumas das muitas preocupacoes relativas ao uso de escores de valor acrescentado para decisoes de grande consequencia (high stakes) e sugere algumas maneiras para aumentar a possibilidade de que a responsabilização de professores ira contribuir construtivamente para a melhoria do ensino.Fundação CesgranrioBraun, Henry2012-01-19info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttps://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346Ensaio: Avaliação e Políticas Públicas em Educação; v. 21, n. 78 (2013): Revista Ensaio - Jan./Mar.; 115-1301809-44650104-4036reponame:Ensaio (Rio de Janeiro. Online)instname:Fundação Cesgranrioinstacron:CESGRANRIO-2pt; es; enDireitos autorais 2016 Revista Ensaio: Avaliação e Politicas Públicas em Educaçãohttp://creativecommons.org/licenses/by-nc/4.0info:eu-repo/semantics/openAccess2015-08-14T21:24:15Zoai:ojs.localhost:article/346Revistahttps://revistas.cesgranrio.org.br/index.php/ensaioONGhttps://revistas.cesgranrio.org.br/index.php/ensaio/oaiensaio@cesgranrio.org.br||fatimacunha@cesgranrio.org.br||alan@cesgranrio.org.br1809-44650104-4036opendoar:2015-08-14T21:24:15Ensaio (Rio de Janeiro. Online) - Fundação Cesgranriofalse
dc.title.none.fl_str_mv Value-added Modeling and the Power of Magical Thinking
El modelado de valor agregado y el poder del pensamiento magico
Modelagem de valor agregado e o poder do pensamento magico
title Value-added Modeling and the Power of Magical Thinking
spellingShingle Value-added Modeling and the Power of Magical Thinking
Braun, Henry
Accountability; Teacher evaluation; Value-added
Accountability; Teacher evaluation; Value-added
Responsabilizacion; Evaluacion de profesores; Valor agregado
title_short Value-added Modeling and the Power of Magical Thinking
title_full Value-added Modeling and the Power of Magical Thinking
title_fullStr Value-added Modeling and the Power of Magical Thinking
title_full_unstemmed Value-added Modeling and the Power of Magical Thinking
title_sort Value-added Modeling and the Power of Magical Thinking
author Braun, Henry
author_facet Braun, Henry
author_role author
dc.contributor.none.fl_str_mv


dc.contributor.author.fl_str_mv Braun, Henry
dc.subject.none.fl_str_mv
dc.subject.por.fl_str_mv Accountability; Teacher evaluation; Value-added
Accountability; Teacher evaluation; Value-added
Responsabilizacion; Evaluacion de profesores; Valor agregado
topic Accountability; Teacher evaluation; Value-added
Accountability; Teacher evaluation; Value-added
Responsabilizacion; Evaluacion de profesores; Valor agregado
description This article explains the impetus in the United States behind the drive to extend test-based accountability to teachers and the growing interest in employing value-added models to generate the indicators to be used in teacher evaluation. The empirical literature finds that teaching quality is the most important school-related determinant of student. Yet, in the main, teacher evaluations are done poorly – if at all – and compensation has been largely determined by seniority and credentials. Policy makers see strengthening teacher accountability as a priority. In particular, they are looking to increase the role of outputs in comparison to inputs. However, given the technical problems associated with status-based indicators of teacher and school effectiveness, the focus has turned to indicators based on some measure of the progress students have made during the academic year. Value-added analysis relies on sophisticated statistical models to generate estimates of the relative effectiveness of teachers, based on a measure related to student progress. This article provides a brief introduction to value-added models and summarizes key research findings. Although value-added estimates have some desirable properties, they do not represent a simple, neat solution to a complex evaluation problem. In this spirit, the article concludes by describing some of the many concerns regarding the use of value-added scores for high-stakes decisions and suggests some ways to enhance the likelihood that teacher accountability will contribute constructively to the improvement of teaching.
publishDate 2012
dc.date.none.fl_str_mv 2012-01-19
dc.type.none.fl_str_mv
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346
url https://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346
dc.language.iso.fl_str_mv pt; es; en
language_invalid_str_mv pt; es; en
dc.rights.driver.fl_str_mv Direitos autorais 2016 Revista Ensaio: Avaliação e Politicas Públicas em Educação
http://creativecommons.org/licenses/by-nc/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Direitos autorais 2016 Revista Ensaio: Avaliação e Politicas Públicas em Educação
http://creativecommons.org/licenses/by-nc/4.0
eu_rights_str_mv openAccess
dc.coverage.none.fl_str_mv








dc.publisher.none.fl_str_mv Fundação Cesgranrio
publisher.none.fl_str_mv Fundação Cesgranrio
dc.source.none.fl_str_mv Ensaio: Avaliação e Políticas Públicas em Educação; v. 21, n. 78 (2013): Revista Ensaio - Jan./Mar.; 115-130
1809-4465
0104-4036
reponame:Ensaio (Rio de Janeiro. Online)
instname:Fundação Cesgranrio
instacron:CESGRANRIO-2
instname_str Fundação Cesgranrio
instacron_str CESGRANRIO-2
institution CESGRANRIO-2
reponame_str Ensaio (Rio de Janeiro. Online)
collection Ensaio (Rio de Janeiro. Online)
repository.name.fl_str_mv Ensaio (Rio de Janeiro. Online) - Fundação Cesgranrio
repository.mail.fl_str_mv ensaio@cesgranrio.org.br||fatimacunha@cesgranrio.org.br||alan@cesgranrio.org.br
_version_ 1754832030705647616