Value-added Modeling and the Power of Magical Thinking
Autor(a) principal: | |
---|---|
Data de Publicação: | 2012 |
Tipo de documento: | Artigo |
Título da fonte: | Ensaio (Rio de Janeiro. Online) |
Texto Completo: | https://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346 |
Resumo: | This article explains the impetus in the United States behind the drive to extend test-based accountability to teachers and the growing interest in employing value-added models to generate the indicators to be used in teacher evaluation. The empirical literature finds that teaching quality is the most important school-related determinant of student. Yet, in the main, teacher evaluations are done poorly – if at all – and compensation has been largely determined by seniority and credentials. Policy makers see strengthening teacher accountability as a priority. In particular, they are looking to increase the role of outputs in comparison to inputs. However, given the technical problems associated with status-based indicators of teacher and school effectiveness, the focus has turned to indicators based on some measure of the progress students have made during the academic year. Value-added analysis relies on sophisticated statistical models to generate estimates of the relative effectiveness of teachers, based on a measure related to student progress. This article provides a brief introduction to value-added models and summarizes key research findings. Although value-added estimates have some desirable properties, they do not represent a simple, neat solution to a complex evaluation problem. In this spirit, the article concludes by describing some of the many concerns regarding the use of value-added scores for high-stakes decisions and suggests some ways to enhance the likelihood that teacher accountability will contribute constructively to the improvement of teaching. |
id |
CESGRANRIO_2eb048aaf31a3b29e330efd8d89f8ca5 |
---|---|
oai_identifier_str |
oai:ojs.localhost:article/346 |
network_acronym_str |
CESGRANRIO |
network_name_str |
Ensaio (Rio de Janeiro. Online) |
repository_id_str |
|
spelling |
Value-added Modeling and the Power of Magical ThinkingEl modelado de valor agregado y el poder del pensamiento magicoModelagem de valor agregado e o poder do pensamento magicoAccountability; Teacher evaluation; Value-addedAccountability; Teacher evaluation; Value-addedResponsabilizacion; Evaluacion de profesores; Valor agregadoThis article explains the impetus in the United States behind the drive to extend test-based accountability to teachers and the growing interest in employing value-added models to generate the indicators to be used in teacher evaluation. The empirical literature finds that teaching quality is the most important school-related determinant of student. Yet, in the main, teacher evaluations are done poorly – if at all – and compensation has been largely determined by seniority and credentials. Policy makers see strengthening teacher accountability as a priority. In particular, they are looking to increase the role of outputs in comparison to inputs. However, given the technical problems associated with status-based indicators of teacher and school effectiveness, the focus has turned to indicators based on some measure of the progress students have made during the academic year. Value-added analysis relies on sophisticated statistical models to generate estimates of the relative effectiveness of teachers, based on a measure related to student progress. This article provides a brief introduction to value-added models and summarizes key research findings. Although value-added estimates have some desirable properties, they do not represent a simple, neat solution to a complex evaluation problem. In this spirit, the article concludes by describing some of the many concerns regarding the use of value-added scores for high-stakes decisions and suggests some ways to enhance the likelihood that teacher accountability will contribute constructively to the improvement of teaching.Este artículo analiza el entusiasmo existente en Estados Unidos con el proceso de extender la responsabilizacion (accountability) basada en tests a profesores y el creciente interes en emplear modelos de valor agregado para originar indicadores que se utilizaran en la evaluacion de profesores. La literatura empirica muestra que la calidad de enseñanza del profesor es el factor escolar mas importante para el exito del alumno. Pero, en general, las evaluaciones de profesores se realizan de modo precario, cuando son hechas, y los beneficios se determinan prioritariamente por tiempo de servicio y por titulos. Los formuladores de politicas consideran el fortalecimiento de la responsabilizacion del profesor como una prioridad. En particular, buscan aumentar el papel de los resultados (outputs) comparados con los datos de entrada (inputs). Pero, debido a los problemas tecnicos asociados con indicadores derivados del estatus (status-based) de profesores y de la eficácia de la escuela, el foco se oriento hacia indicadores basados en el progreso de los estudiantes durante el año lectivo. Se sabe que analisis de valor agregado dependen de modelos estadisticos sofisticados para originar estimadores de la eficácia de los profesores, basados en una medida relacionada con el progreso de los alumnos. Este artículo ofrece una breve introduccion a los modelos de valor agregado y resume los principales resultados de investigaciónes. Aunque estimadores de valor agregado tengan algunas propiedades deseables, no representan una solucion sencilla y elegante para un problema complejo de evaluacion. Finalmente, el artículo describe algunas preocupaciones que surgen con el uso de scores de valor agregado para decisiones de gran consecuencia y sugiere algunas formas que ayuden a que la responsabilizacion de profesores pueda contribuir constructivamente para la mejora de la enseñanza.Esse artigo trata do impeto nos Estados Unidos da America no processo de estender a responsabilização/prestação de contas (accountability) baseada em testes a professores e no crescente interesse em empregar modelos de valor acrescentado para gerar indicadores a serem utilizados na avaliação de professores. A literatura empirica mostra que a qualidade de ensino pelo professor e o fator escolar mais importante para o sucesso do aluno. Porem, em geral, as avaliações de professores sao feitas de modo precario – quando feitas – e beneficios sao prioritariamente determinados por tempo de servico e titulos. Os formuladores de politicas veem o fortalecimento da responsabilização do professor como uma prioridade. Em particular, eles estao procurando aumentar o papel de resultados (outputs) em comparação com dados de entrada (inputs). Mas, devido aos problemas tecnicos associados com indicadores derivados do status (status-based) de professores e da eficácia da escola, o foco foi orientado para indicadores baseados em alguma medida do progresso realizado pelos estudantes durante o ano letivo. Analises de valor acrescentado dependem de modelos estatisticos sofisticados para gerar estimadores da eficácia relativa dos professores, baseados em uma medida relacionada ao progresso dos alunos. Esse artigo fornece uma breve introdução aos modelos de valor acrescentado e faz um resumo dos principais resultados de pesquisas. Embora estimadores de valor acrescentado tenham algumas propriedades desejaveis, eles nao representam uma solução simples e elegante para um problema complexo de avaliação. Nesse espirito, o artigo finaliza descrevendo algumas das muitas preocupacoes relativas ao uso de escores de valor acrescentado para decisoes de grande consequencia (high stakes) e sugere algumas maneiras para aumentar a possibilidade de que a responsabilização de professores ira contribuir construtivamente para a melhoria do ensino.Fundação CesgranrioBraun, Henry2012-01-19info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttps://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346Ensaio: Avaliação e Políticas Públicas em Educação; v. 21, n. 78 (2013): Revista Ensaio - Jan./Mar.; 115-1301809-44650104-4036reponame:Ensaio (Rio de Janeiro. Online)instname:Fundação Cesgranrioinstacron:CESGRANRIO-2pt; es; enDireitos autorais 2016 Revista Ensaio: Avaliação e Politicas Públicas em Educaçãohttp://creativecommons.org/licenses/by-nc/4.0info:eu-repo/semantics/openAccess2015-08-14T21:24:15Zoai:ojs.localhost:article/346Revistahttps://revistas.cesgranrio.org.br/index.php/ensaioONGhttps://revistas.cesgranrio.org.br/index.php/ensaio/oaiensaio@cesgranrio.org.br||fatimacunha@cesgranrio.org.br||alan@cesgranrio.org.br1809-44650104-4036opendoar:2015-08-14T21:24:15Ensaio (Rio de Janeiro. Online) - Fundação Cesgranriofalse |
dc.title.none.fl_str_mv |
Value-added Modeling and the Power of Magical Thinking El modelado de valor agregado y el poder del pensamiento magico Modelagem de valor agregado e o poder do pensamento magico |
title |
Value-added Modeling and the Power of Magical Thinking |
spellingShingle |
Value-added Modeling and the Power of Magical Thinking Braun, Henry Accountability; Teacher evaluation; Value-added Accountability; Teacher evaluation; Value-added Responsabilizacion; Evaluacion de profesores; Valor agregado |
title_short |
Value-added Modeling and the Power of Magical Thinking |
title_full |
Value-added Modeling and the Power of Magical Thinking |
title_fullStr |
Value-added Modeling and the Power of Magical Thinking |
title_full_unstemmed |
Value-added Modeling and the Power of Magical Thinking |
title_sort |
Value-added Modeling and the Power of Magical Thinking |
author |
Braun, Henry |
author_facet |
Braun, Henry |
author_role |
author |
dc.contributor.none.fl_str_mv |
|
dc.contributor.author.fl_str_mv |
Braun, Henry |
dc.subject.none.fl_str_mv |
|
dc.subject.por.fl_str_mv |
Accountability; Teacher evaluation; Value-added Accountability; Teacher evaluation; Value-added Responsabilizacion; Evaluacion de profesores; Valor agregado |
topic |
Accountability; Teacher evaluation; Value-added Accountability; Teacher evaluation; Value-added Responsabilizacion; Evaluacion de profesores; Valor agregado |
description |
This article explains the impetus in the United States behind the drive to extend test-based accountability to teachers and the growing interest in employing value-added models to generate the indicators to be used in teacher evaluation. The empirical literature finds that teaching quality is the most important school-related determinant of student. Yet, in the main, teacher evaluations are done poorly – if at all – and compensation has been largely determined by seniority and credentials. Policy makers see strengthening teacher accountability as a priority. In particular, they are looking to increase the role of outputs in comparison to inputs. However, given the technical problems associated with status-based indicators of teacher and school effectiveness, the focus has turned to indicators based on some measure of the progress students have made during the academic year. Value-added analysis relies on sophisticated statistical models to generate estimates of the relative effectiveness of teachers, based on a measure related to student progress. This article provides a brief introduction to value-added models and summarizes key research findings. Although value-added estimates have some desirable properties, they do not represent a simple, neat solution to a complex evaluation problem. In this spirit, the article concludes by describing some of the many concerns regarding the use of value-added scores for high-stakes decisions and suggests some ways to enhance the likelihood that teacher accountability will contribute constructively to the improvement of teaching. |
publishDate |
2012 |
dc.date.none.fl_str_mv |
2012-01-19 |
dc.type.none.fl_str_mv |
|
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346 |
url |
https://revistas.cesgranrio.org.br/index.php/ensaio/article/view/346 |
dc.language.iso.fl_str_mv |
pt; es; en |
language_invalid_str_mv |
pt; es; en |
dc.rights.driver.fl_str_mv |
Direitos autorais 2016 Revista Ensaio: Avaliação e Politicas Públicas em Educação http://creativecommons.org/licenses/by-nc/4.0 info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Direitos autorais 2016 Revista Ensaio: Avaliação e Politicas Públicas em Educação http://creativecommons.org/licenses/by-nc/4.0 |
eu_rights_str_mv |
openAccess |
dc.coverage.none.fl_str_mv |
|
dc.publisher.none.fl_str_mv |
Fundação Cesgranrio |
publisher.none.fl_str_mv |
Fundação Cesgranrio |
dc.source.none.fl_str_mv |
Ensaio: Avaliação e Políticas Públicas em Educação; v. 21, n. 78 (2013): Revista Ensaio - Jan./Mar.; 115-130 1809-4465 0104-4036 reponame:Ensaio (Rio de Janeiro. Online) instname:Fundação Cesgranrio instacron:CESGRANRIO-2 |
instname_str |
Fundação Cesgranrio |
instacron_str |
CESGRANRIO-2 |
institution |
CESGRANRIO-2 |
reponame_str |
Ensaio (Rio de Janeiro. Online) |
collection |
Ensaio (Rio de Janeiro. Online) |
repository.name.fl_str_mv |
Ensaio (Rio de Janeiro. Online) - Fundação Cesgranrio |
repository.mail.fl_str_mv |
ensaio@cesgranrio.org.br||fatimacunha@cesgranrio.org.br||alan@cesgranrio.org.br |
_version_ |
1754832030705647616 |