[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/16877.html
   My bibliography  Save this paper

The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-career Teachers

Author

Listed:
  • Eric S. Taylor
  • John H. Tyler
Abstract
The effect of evaluation on employee performance is traditionally studied in the context of the principal-agent problem. Evaluation can, however, also be characterized as an investment in the evaluated employee's human capital. We study a sample of mid-career public school teachers where we can consider these two types of evaluation effect separately. Employee evaluation is a particularly salient topic in public schools where teacher effectiveness varies substantially and where teacher evaluation itself is increasingly a focus of public policy proposals. We find evidence that a quality classroom-observation-based evaluation and performance measures can improve mid-career teacher performance both during the period of evaluation, consistent with the traditional predictions; and in subsequent years, consistent with human capital investment. However the estimated improvements during evaluation are less precise. Additionally, the effects sizes represent a substantial gain in welfare given the program's costs.

Suggested Citation

  • Eric S. Taylor & John H. Tyler, 2011. "The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-career Teachers," NBER Working Papers 16877, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:16877
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w16877.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Steven Glazerman & Susanna Loeb & Dan Goldhaber & Douglas Staiger & Stephen Raudenbush & Grover Whitehurst, "undated". "Evaluating Teachers: The Important Role of Value-Added," Mathematica Policy Research Reports 503e125ed5244bb39586aafe1, Mathematica Policy Research.
    3. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    4. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    5. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    6. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    7. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    8. Judith Chevalier & Glenn Ellison, 1999. "Career Concerns of Mutual Fund Managers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 389-432.
    9. Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
    10. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    11. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    12. Brian A. Jacob, 2010. "Do Principals Fire the Worst Teachers?," NBER Working Papers 15715, National Bureau of Economic Research, Inc.
    13. Fama, Eugene F, 1980. "Agency Problems and the Theory of the Firm," Journal of Political Economy, University of Chicago Press, vol. 88(2), pages 288-307, April.
    14. Bengt Holmstrom, 1979. "Moral Hazard and Observability," Bell Journal of Economics, The RAND Corporation, vol. 10(1), pages 74-91, Spring.
    15. Dan Goldhaber & Michael Hansen, 2010. "Using Performance on the Job to Inform Teacher Tenure Decisions," American Economic Review, American Economic Association, vol. 100(2), pages 250-255, May.
    16. Bengt Holmström, 1999. "Managerial Incentive Problems: A Dynamic Perspective," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 169-182.
    17. Gary S. Becker, 1962. "Investment in Human Capital: A Theoretical Analysis," NBER Chapters, in: Investment in Human Beings, pages 9-49, National Bureau of Economic Research, Inc.
    18. Don Boyd & Hamp Lankford & Susanna Loeb & Matthew Ronfeldt & Jim Wyckoff, 2011. "The role of teacher quality in retention and hiring: Using applications to transfer to uncover preferences of teachers and schools," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(1), pages 88-110, December.
    19. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    20. Robert Gibbons, 2005. "Incentives Between Firms (and Within)," Management Science, INFORMS, vol. 51(1), pages 2-17, January.
    21. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    22. Richard J. Murnane & Barbara R. Phillips, 1981. "What Do Effective Teachers of Inner-City Children have in Common?," Mathematica Policy Research Reports b0614b2fa4ae4eae82cec19fb, Mathematica Policy Research.
    23. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    24. Hanushek, Eric, 1971. "Teacher Characteristics and Gains in Student Achievement: Estimation Using Micro Data," American Economic Review, American Economic Association, vol. 61(2), pages 280-288, May.
    25. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    26. Neal, Derek, 2011. "The Design of Performance Pay in Education," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 4, chapter 0, pages 495-550, Elsevier.
    27. Avinash Dixit, 2002. "# Incentives and Organizations in the Public Sector: An Interpretative Review," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 696-727.
    28. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    29. repec:mpr:mprres:6829 is not listed on IDEAS
    30. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    2. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    3. Cory Koedel & Eric Parsons & Michael Podgursky & Mark Ehlert, 2015. "Teacher Preparation Programs and Teacher Quality: Are There Real Differences Across Programs?," Education Finance and Policy, MIT Press, vol. 10(4), pages 508-534, October.
    4. Marc van der Steeg & Sander Gerritsen, 2013. "Teacher evaluations and pupil achievement: Evidence from classroom observations," CPB Discussion Paper 230, CPB Netherlands Bureau for Economic Policy Analysis.
    5. Goldhaber, Dan & Walch, Joe, 2012. "Strategic pay reform: A student outcomes-based evaluation of Denver's ProComp teacher pay initiative," Economics of Education Review, Elsevier, vol. 31(6), pages 1067-1083.
    6. Vegas, E & Ganimian, A. J., 2013. "Theory and Evidence on Teacher Policies in Developed and Developing Countries," Working Paper 104291, Harvard University OpenScholar.
    7. Marc van der Steeg & Sander Gerritsen, 2013. "Teacher evaluations and pupil achievement: Evidence from classroom observations," CPB Discussion Paper 230.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    8. Sayyed Rashid Shah & Roohul Amin & Hussain Ahmad, 2018. "Classroom Observation: Linking Teacher Evaluation and Professional Development in TESOL," Global Social Sciences Review, Humanity Only, vol. 3(2), pages 170-197, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    2. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    3. Jonah E. Rockoff & Douglas O. Staiger & Thomas J. Kane & Eric S. Taylor, 2012. "Information and Employee Evaluation: Evidence from a Randomized Intervention in Public Schools," American Economic Review, American Economic Association, vol. 102(7), pages 3184-3213, December.
    4. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    5. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    6. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    7. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    8. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    9. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    10. Mariesa A. Herrmann & Jonah E. Rockoff, 2012. "Worker Absence and Productivity: Evidence from Teaching," Journal of Labor Economics, University of Chicago Press, vol. 30(4), pages 749-782.
    11. Michael Bates & Michael Dinerstein & Andrew C. Johnston & Isaac Sorkin, 2022. "Teacher Labor Market Equilibrium and Student Achievement," CESifo Working Paper Series 9551, CESifo.
    12. Rockoff, Jonah E. & Speroni, Cecilia, 2011. "Subjective and objective evaluations of teacher effectiveness: Evidence from New York City," Labour Economics, Elsevier, vol. 18(5), pages 687-696, October.
    13. Jian Zhang & Songqing Jin & Wei Si, 2020. "Incentivising teachers? Evaluating the incentive effect of China’s teacher performance‐based compensation reform in rural China," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 64(1), pages 171-188, January.
    14. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    15. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    16. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    17. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    18. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    19. Zheng, Lei & Qi, Xiang & Zhang, Chongjiu, 2023. "Can improvements in teacher quality reduce the cognitive gap between urban and rural students in China?," International Journal of Educational Development, Elsevier, vol. 100(C).
    20. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.

    More about this item

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M59 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:16877. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.