Evaluate Teaching Performance by Residuals of Student Achievement

Lei Wanpeng; Ma Hongmei; Huang Huaming

doi:10.16382/j.cnki.1000-5560.2021.07.008

Volume 39 Issue 7

Jul. 2021

Turn off MathJax

Article Contents

Article Navigation > Journal of East China Normal University (Educational Sciences) > 2021 > 39(7): 84-91

Lei Wanpeng, Ma Hongmei, Huang Huaming. Evaluate Teaching Performance by Residuals of Student Achievement[J]. Journal of East China Normal University (Educational Sciences), 2021, 39(7): 84-91. doi: 10.16382/j.cnki.1000-5560.2021.07.008

Citation:

Lei Wanpeng, Ma Hongmei, Huang Huaming. Evaluate Teaching Performance by Residuals of Student Achievement[J]. Journal of East China Normal University (Educational Sciences), 2021, 39(7): 84-91. doi: 10.16382/j.cnki.1000-5560.2021.07.008

Citation:

PDF( 753 KB)

Evaluate Teaching Performance by Residuals of Student Achievement

doi: 10.16382/j.cnki.1000-5560.2021.07.008

1.
Faculty of Education, Central China Normal University/Hubei Institute for Basic Education Research Wuhan, 430079
2.
Faculty of Education, Shaoguan University Shaoguan, 512005

Publish Date: 2021-07-01

Abstract

Abstract

Error-component analysists argue that after netting out the effects of student background, teacher credentials and school characteristics, the residuals of test scores generated by subtracting predicted values from the class-level mean can be regarded as teachers’ effect on pupils’ achievement. The paper tests this idea by using self-collected teacher-student matched data from Hubei and Guangdong province. Residual analyses show that, (1) Marginal effects of teaching performance of teachers instructing Chinese Language Art, Math and English are among 0.3−0.5 standard deviations, among which the magnitude of Math teachers’ effect is the largest. (2) There are huge individual differences among teachers in terms of teaching performance. If a teacher of average quality were replaced by the most effective one, the whole class would witness a net gain of 0.3−1.0 standard deviations. On the contrary, if he or she were replaced by the worst colleague, mean performance of the class he or she taught would go down by 0.5−0.7 standard deviations. Policy implications of this article are obvious with regard to evaluating teachers’ performance.
- teacher assessment,
- teaching performance,
- students’ academic achievement,
- residual analysis

FullText(HTML)

References(27)

References

[1]	常芳, 党伊玮, 史耀疆, 刘承芳. (2018). “优绩优酬”: 关于西北农村教师绩效工资的实验研究. 华东师范大学学报(教育科学版),36(4),131—141.
[2]	梁文艳, 杜育红. (2011). 基于学生学业成绩的教师质量评价: 来自中国西部农村小学的证据. 北京大学教育评论,9(3),105—120. doi: 10.3969/j.issn.1671-9468.2011.03.009
[3]	雷万鹏, 马红梅. (2019). 学生成绩对教师工资的影响. 北京大学教育评论,17(4),160—172.
[4]	薛海平, 王蓉. (2016). 义务教育教师绩效奖金、教师激励与学生成绩. 教育研究,37(5),21—33.
[5]	Borman, G. D. and Kimball, S. M. (2005). Teacher Quality and Educational Equality: Do Teachers with Higher Standards-Based Evaluation Ratings Close Student Achievement Gaps?. Elementary School Journal, 106(1), 3—20. doi: 10.1086/496904
[6]	Chang, F., Wang, H., Qu, Y., Zheng, Q., Loyalka, P., Sylvia, S., Shi, Y., Dill, S.-E. and Rozelle, S. (2020). The Impact of Pay-for-Percentile Incentive on Low-Achieving Students in Rural China. Economics of Education Review, 75(3), 1—10.
[7]	Chetty, R., Friedman, J. N. and Rockoff, J. E. (2014). Measuring the Impacts of Teachers Ii: Teacher Value-Added and Student Outcomes in Adulthood. American Economic Review, 104(9), 2633—2679. doi: 10.1257/aer.104.9.2633
[8]	Cowan, J. and Goldhaber, D. D. (2018). Do Bonuses Affect Teacher Staffing and Student Achievement in High Poverty Schools? Evidence from an Incentive for National Board Certified Teachers in Washington State. Economics of Education Review, 65(4), 138—152.
[9]	Duflo, E., Dupas, P. and Kremer, M. (2011). Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya. American Economic Review, 101(5), 1739—1774. doi: 10.1257/aer.101.5.1739
[10]	Duflo, E., Dupas, P. and Kremer, M. (2015). School Governance, Teacher Incentives, and Pupil-Teacher Ratios: Experimental Evidence from Kenyan Primary Schools. Journal of Public Economics, 123(3), 92—110.
[11]	Goldhaber, D. D., Brewer, D. J. and Anderson, D. (1999). A Three-Way Error Components Analysis of Educational Productivity. Education Economics, 7(3), 199—208. doi: 10.1080/09645299900000018
[12]	Goldstein, H. (2014). Using League Table Rankings in Public Policy Formation: Statistical Issues. Annual Review of Statistics and Its Application, 1(1), 385—399. doi: 10.1146/annurev-statistics-022513-115615
[13]	Goldstein, H. and Spiegelhalter, D. J. (1996). League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance. Journal of the Royal Statistical Society: Series A (Statistics in Society), 159(3), 385—409. doi: 10.2307/2983325
[14]	Hanushek, E. A. (2011). The Economic Value of Higher Teacher Quality. Economics of Education Review, 30(3), 466—479. doi: 10.1016/j.econedurev.2010.12.006
[15]	Hanushek, E. A., Piopiunik, M. and Wiederhold, S. (2019). The Value of Smarter Teachers: International Evidence on Teacher Cognitive Skills and Student Performance. Journal of Human Resources, 54(4), 857—899. doi: 10.3368/jhr.54.4.0317.8619R1
[16]	Hanushek, E. A. and Rivkin, S. G. (2006). Teacher Quality. In E. A. Hanushek and F. Welch (Eds.), Handbook of the Economics of Education (Vol. 2, pp. 1051-1075). Amsterdam, North-Holland: Elsevier.
[17]	Hanushek, E. A. and Rivkin, S. G. (2012). The Distribution of Teacher Quality and Implications for Policy. Annual Review of Economics, 4(1), 131—157. doi: 10.1146/annurev-economics-080511-111001
[18]	Leckie, G. and Goldstein, H. (2015). A Multilevel Modelling Approach to Measuring Changing Patterns of Ethnic Composition and Segregation among London Secondary Schools, 2001-2010. Journal of the Royal Statistical Society. Series A (Statistics in Society), 178(2), 405—424. doi: 10.1111/rssa.12066
[19]	Loyalka, P., Sylvia, S., Liu, C., Chu, J. and Shi, Y. (2019). Pay by Design: Teacher Performance Pay Design and the Distribution of Student Achievement. Journal of Labor Economics, 37(3), 621—662. doi: 10.1086/702625
[20]	Milanowski, A. (2004). The Relationship between Teacher Performance Evaluation Scores and Student Achievement: Evidence from Cincinnati. Peabody Journal of Education, 79(4), 33—53. doi: 10.1207/s15327930pje7904_3
[21]	Muñoz, M. A., Prather, J. R. and Stronge, J. H. (2011). Exploring Teacher Effectiveness Using Hierarchical Linear Models: Student-and Classroom-Level Predictors and Cross-Year Stability in Elementary School Reading. Planning and Changing, 42(3-4), 241—273.
[22]	Nagler, M., Piopiunik, M. and West, M. R. (2020). Weak Markets, Strong Teachers: Recession at Career Start and Teacher Effectiveness. Journal of Labor Economics, 38(2), 453—500. doi: 10.1086/705883
[23]	Pham, L. D., Nguyen, T. D. and Springer, M. G. (2020). Teacher Merit Pay: A Meta-Analysis. American Educational Research Journal, 57(6), 1—40.
[24]	Rothstein, J. M. (2010). Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement. Quarterly Journal of Economics, 125(1), 175—214. doi: 10.1162/qjec.2010.125.1.175
[25]	Shifrer, D., Turley, R. L. and Heard, H. (2017). Do Teacher Financial Awards Improve Teacher Retention and Student Achievement in an Urban Disadvantaged School District?. American Educational Research Journal, 54(6), 1117—1153. doi: 10.3102/0002831217716540
[26]	Stronge, J. H., Ward, T. J., Tucker, P. D. and Hindman, J. L. (2007). What Is the Relationship between Teacher Quality and Student Achievement? An Exploratory Study. Journal of Personnel Evaluation in Education, 20(3-4), 165—184. doi: 10.1007/s11092-008-9053-z
[27]	Subedi, B. R., Reese, N. and Powell, R. (2015). Measuring Teacher Effectiveness through Hierarchical Linear Models: Exploring Predictors of Student Achievement and Truancy. Journal of Education and Training Studies, 3(2), 34—43.