Causal Inference in Education Research: Principles and Applications of Related Methods

HUANG Bin; FANG Chao; WANG Dong

doi:10.16382/j.cnki.1000-5560.2017.04.001

Volume 35 Issue 4

Jul. 2017

Turn off MathJax

Article Contents

Article Navigation > Journal of East China Normal University (Educational Sciences) > 2017 > 35(4): 1-14, 134

HUANG Bin, FANG Chao, WANG Dong. Causal Inference in Education Research: Principles and Applications of Related Methods[J]. Journal of East China Normal University (Educational Sciences), 2017, 35(4): 1-14, 134. doi: 10.16382/j.cnki.1000-5560.2017.04.001

Citation:

HUANG Bin, FANG Chao, WANG Dong. Causal Inference in Education Research: Principles and Applications of Related Methods[J]. Journal of East China Normal University (Educational Sciences), 2017, 35(4): 1-14, 134. doi: 10.16382/j.cnki.1000-5560.2017.04.001

Citation:

PDF( 0 KB)

Causal Inference in Education Research: Principles and Applications of Related Methods

doi: 10.16382/j.cnki.1000-5560.2017.04.001

Faculty of Public Administration/Center for Public Finance Research, Nanjing University of Finance and Economics, Nanjing 210023, China

Publish Date: 2017-04-01

Abstract

Abstract

In the past twenty years, causal inference has developed rapidly and gradually dominated the field of micrometrics. The paper first introduces the context of the emerging causal inference methods. Next, we discuss three preconditions to reach a causal conclusion, point out the major problems with making causal inference in the experimental and non experimental studies, and analyze the main causes and components of heterogeneous residual that commonly exist in the observation studies. Then, using cases of impact evaluation of small class teaching and new mechanism reform, the paper illustrates the basic principles and analyzes procedures of some quasi experimental methods, including regression discontinuity, instrumental variable, propensity score method and double difference. Finally, in response to the doubts about the internal validity of quasi experimental studies, we emphasize the importance of robustness and sensitivity test of the implicit hypothesis that hide behind quasi experimental methods.
- causal inference,
- educational research,
- quasi experiment,
- heterogeneous residual,
- internal validity

FullText(HTML)

References(27)

References

[1]	Angrist, J., Bettinger, E., & Kremer, M. (2006). Long-term educational consequences of secondary school vouchers:Evidence from administrative records in Colombia. The American Economic Review, 96(3), 847-862. doi: 10.1257/aer.96.3.847
[2]	Angrist, J. D., & Lavy, V. (1999). Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement.The Quarterly Journal of Economics, 114(2), 533-575. doi: 10.1162/003355399556061
[3]	Angrist, J. D., & Steffen, P. J. (2015).Mastering metrics:the path from cause to effect. NJ:Princeton University Press.
[4]	Borman, G. D. (2009). The use of randomized trials to inform education policy. In Sykes, G., Schneider, B. & Plank, D. N. (Eds.).Handbook of education policy research (pp. 129-138). New York:Routledge.
[5]	Cappelleri, J. C., Darlington, R. B., & Trochim, W. M. K. (1994). Power analysis of cutoff-based randomized clinical trials. Evaluation Review, 18(2), 141-152. doi: 10.1177/0193841X9401800202
[6]	Card, D. (1999).The Causal Effect of Education on Earnings.In Ashenfelter, O. & Card, D. (Eds.).Handbook of Labor Economics, 3A (pp. 1801-1864). New YorK:Elsevier.
[7]	Guo, S., & Fraser, M. W. (2010).Propensity score analysis. Thousand Oaks:Sage.
[8]	Heckman, J. J. (1979). Sample selection bias as a specification error.Econometrica, 47(1), 153-161. doi: 10.2307/1912352
[9]	Heckman, J. J. (2005). The scientific model of causality.Sociological methodology, 35(1), 1-97. doi: 10.1111/j.0081-1750.2006.00164.x
[10]	Hoxby, C. M. (2000). The Effects of Class Size on Student Achievement:New Evidence from Population Variation. The Quarterly Journal of Economics, 115(4), 1239-1285. doi: 10.1162/003355300555060
[11]	Imbens, G. W., & Angrist, J. D. (1994).Identification and estimation of local average treatment effects.Econometrica, 62(2), 467-475. doi: 10.2307/2951620
[12]	Imbens, G. W., & Rubin, D. B. (2015).Causal inference in statistics, social, and biomedical sciences:An introduction.New York:Cambridge University Press.
[13]	Jacob, B. A., & Lefgren, L. (2004). Remedial education and student achievement:A regression-discontinuity analysis. Review of Economics and Statistics, 86(1), 226-244. doi: 10.1162/003465304323023778
[14]	Kaplan, D. (2009). Causal inference in non-experimental educational policy research.In Sykes, G., Schneider, B. & Plank, D. N. (Eds.).Handbook of education policy research (pp. 139-153). New York:Routledge.
[15]	Khandker, S. R., Koolwal, G. B., & Samad, H. A. (2010).Handbook on impact evaluation:quantitative methods and practices. Washington, D. C.:World Bank Publications.
[16]	Lee, D. S., & Lemieuxa, T. Regression discontinuity designs in economics.Journal of Economic Literature, 48(2), 281-355. doi: 10.1257/jel.48.2.281
[17]	Li, H., & Luo, Y. (2004). Reporting errors, ability heterogeneity, and returns to schooling in China. Pacific Economic Review, 9(3), 191-207. doi: 10.1111/per.2004.9.issue-3
[18]	Murnane, R. J., & Willett, J. B. (2011).Methods matter:Improving causal inference in educational and social science research. Oxford:Oxford University Press.
[19]	Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39(1), 33-38. doi: 10.1080/00031305.1985.10479383
[20]	Rubin, D. B. (1986).Which ifs have causal inference. Journal of the American Statistical Association, 81, 961-962. http://bacbuc.hd.free.fr/WebDAV/data/DOM/StatMeths/Rubin-JASA1986.pdf
[21]	Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002).Experimental and quasi-experimental designs for generalized causal inference. Boston:Houghton, Mifflin and Company.
[22]	Smith, W. C. (2014). Estimating unbiased treatment effects in education using a regression discontinuity design. Practical Assessment, Research & Evaluation, 19(9), 2. http://www.academia.edu/7855396/Estimating_unbiased_treatment_effects_in_education_using_a_regression_discontinuity_design
[23]	Thistlethwaite, D. L., & Campbell, D. T. (1960). Regression-discontinuity analysis:An alternative to the ex post facto experiment. Journal of educational Psychology, 51(6), 309. doi: 10.1037/h0044319
[24]	Trochim, W. M. K. (1984). Research design for program evaluation:the regression-discontinuity approach. CA:Sage. http://www.worldcat.org/title/research-design-for-program-evaluation-the-regression-discontinuity-approach/oclc/10349137
[25]	黄斌, 钟晓琳. (2012).中国农村地区教育与个人收入——基于三省六县入户调查数据的实证研究.教育研究, (3), 18-26. http://www.cnki.com.cn/Article/CJFDTOTAL-JYYJ201203004.htm
[26]	黄斌, 汪栋.(2016).中国义务教育财政投入的回顾与展望.华中师范大学学报:人文社会科学版, 55(4), 154-161. http://www.cnki.com.cn/Article/CJFDTOTAL-HZSD201604019.htm
[27]	黄斌, 苗晶晶, 金俊. (2016). "新机制"改革对农村中小学公用经费的因果效应分析——基于准实验研究设计(工作论文). 南京: 南京财经大学公共财政研究中心.