References

Keywords

A/B Testing, Causal Inference, Causal Time Series Analysis, Data Science, Difference-in-Differences, Directed Acyclic Graphs, Econometrics, Impact Evaluation, Instrumental Variables, Heterogeneous Treatment Effects, Potential Outcomes, Power Analysis, Sample Size Calculation, Python and R Programming, Randomized Experiments, Regression Discontinuity, Treatment Effects

Get the new chapters straight to your inbox. Leave your address here.
Found an error or have a suggestion? Submit feedback here.
Follow the book’s page for new content and corrections, or follow the author.

Abadie, Alberto. 2005. “Semiparametric Difference-in-Differences Estimators.” Review of Economic Studies 72: 1–19.

Ahrens, Achim, Victor Chernozhukov, Christian Hansen, Damian Kozbur, Mark Schaffer, and Thomas Wiemann. 2025. “An Introduction to Double/Debiased Machine Learning.” https://arxiv.org/abs/2504.08324.

Angrist, Joshua D., Carol Gao, Peter Hull, and Robert W. Yeh. 2025. “Instrumental Variables in Randomized Trials.” NEJM Evidence 4 (4): EVIDctw2400204. https://doi.org/10.1056/EVIDctw2400204.

Angrist, Joshua D., and Peter Hull. 2023. “Instrumental Variables Methods Reconcile Intention-to-Screen Effects Across Pragmatic Cancer Screening Trials.” Proceedings of the National Academy of Sciences 120 (51): e2311556120. https://doi.org/10.1073/pnas.2311556120.

Angrist, Joshua D., and Alan B. Krueger. 2001. “Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments.” Journal of Economic Perspectives 15 (4): 69–85. https://doi.org/10.1257/jep.15.4.69.

Angrist, Joshua D., and Jörn-Steffen Pischke. 2008. Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton, NJ: Princeton University Press.

———. 2015. Mastering ’Metrics: The Path from Cause to Effect. Princeton, NJ: Princeton University Press.

Angrist, Joshua D., and Miikka Rokkanen. 2015. “Wanna Get Away? Regression Discontinuity Estimation of Exam School Effects Away from the Cutoff.” Journal of the American Statistical Association 110 (512): 1331–44. https://doi.org/10.1080/01621459.2015.1012259.

Arkhangelsky, Dmitry, Susan Athey, David A. Hirshberg, Guido W. Imbens, and Stefan Wager. 2021. “Synthetic Difference-in-Differences.” American Economic Review 111 (12): 4088–118. https://doi.org/10.1257/aer.20190159.

Aronow, Peter M., and Cyrus Samii. 2017. “Estimating Average Causal Effects Under General Interference, with Application to a Social Network Experiment.” Annals of Applied Statistics 11 (4): 1912–47. https://doi.org/10.1214/16-AOAS1005.

Ashenfelter, Orley. 1978. “Estimating the Effect of Training Programs on Earnings.” Review of Economics and Statistics 60 (1): 47–57. https://doi.org/10.2307/1924332.

Barreca, Alan I., Jason M. Lindo, and Glen R. Waddell. 2011. “Heaping-Induced Bias in Regression-Discontinuity Designs.” NBER Working Paper 17408. National Bureau of Economic Research. https://doi.org/10.3386/w17408.

Bertrand, Marianne, Esther Duflo, and Sendhil Mullainathan. 2004. “How Much Should We Trust Differences-in-Differences Estimates?” Quarterly Journal of Economics 119 (1): 249–75. https://doi.org/10.1162/003355304772839588.

Boegershausen, Johannes, Yann Cornil, Shangwen Yi, and David J. Hardisty. 2025. “On the Persistent Mischaracterization of Google and Facebook a/b Tests: How to Conduct and Report Online Platform Studies.” International Journal of Research in Marketing 42 (3, Part B): 886–903. https://doi.org/https://doi.org/10.1016/j.ijresmar.2024.12.004.

Callaway, Brantly, and Pedro H. C. Sant’Anna. 2021. “Difference-in-Differences with Multiple Time Periods.” Journal of Econometrics 225 (2): 200–230. https://doi.org/https://doi.org/10.1016/j.jeconom.2020.12.001.

Calonico, Sebastian, Matias D. Cattaneo, and Rocio Titiunik. 2014. “Robust Nonparametric Confidence Intervals for Regression-Discontinuity Designs.” Econometrica 82 (6): 2295–2326. https://doi.org/https://doi.org/10.3982/ECTA11757.

Cameron, A. Colin, and Douglas L. Miller. 2015. “A Practitioner’s Guide to Cluster-Robust Inference.” Journal of Human Resources 50 (2): 317–72. https://doi.org/10.3368/jhr.50.2.317.

Card, David, David S. Lee, Zhuan Pei, and Andrea Weber. 2015. “Inference on Causal Effects in a Generalized Regression Kink Design.” Econometrica 83 (6): 2453–83. https://doi.org/10.3982/ECTA11224.

Cattaneo, Matias D., Nicolás Idrobo, and Rocío Titiunik. 2020. A Practical Introduction to Regression Discontinuity Designs: Foundations. Cambridge: Cambridge University Press.

———. 2024. A Practical Introduction to Regression Discontinuity Designs: Extensions. Elements in Quantitative and Computational Methods for the Social Sciences. Cambridge: Cambridge University Press.

Cattaneo, Matias D., Michael Jansson, and Xinwei Ma. 2020. “Simple Local Polynomial Density Estimators.” Journal of the American Statistical Association 115 (531): 1449–55. https://doi.org/10.1080/01621459.2019.1635480.

Cattaneo, Matias D., Luke Keele, Rocío Titiunik, and Gonzalo Vazquez-Bare. 2016. “Interpreting Regression Discontinuity Designs with Multiple Cutoffs.” Journal of Politics 78 (4): 1229–48. https://doi.org/10.1086/686802.

Cattaneo, Matias D., and Rocío Titiunik. 2022. “Regression Discontinuity Designs.” Journal Article. Annual Review of Economics 14 (Volume 14, 2022): 821–51. https://doi.org/https://doi.org/10.1146/annurev-economics-051520-021409.

Cattaneo, Matias D., Rocío Titiunik, and Ruiqi Yu. 2025. “Estimation and Inference in Boundary Discontinuity Designs.” Working Paper.

Chang, Neng-Chieh. 2020. “Double/Debiased Machine Learning for Difference-in-Differences Models.” Econometrics Journal 23 (2): 177–91. https://doi.org/10.1093/ectj/utaa001.

Cinelli, Carlos, Andrew Forney, and Judea Pearl. 2024. “A Crash Course in Good and Bad Controls.” Sociological Methods & Research 53 (3): 1071–1104. https://doi.org/10.1177/00491241221099552.

Cunningham, Scott. 2021. “Causal Inference: The Mixtape.” 2021. https://mixtape.scunning.com/.

Dong, Yingying, and Arthur Lewbel. 2015. “Identifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models.” Review of Economics and Statistics 97 (5): 1081–92. https://doi.org/10.1162/REST_a_00510.

Duflo, Esther, Rachel Glennerster, and Michael Kremer. 2006. “Using Randomization in Development Economics Research: A Toolkit.” NBER Technical Working Paper 333. National Bureau of Economic Research. https://doi.org/10.3386/t0333.

Facure, Matheus. 2020. “Causal Inference for the Brave and True.” 2020. https://matheusfacure.github.io/python-causality-handbook/landing-page.html.

———. 2023. Causal Inference in Python. O’Reilly.

Ganong, Peter, and Simon Jäger. 2018. “A Permutation Test for the Regression Kink Design.” Journal of the American Statistical Association 113 (522): 494–504. https://doi.org/10.1080/01621459.2017.1328356.

Georgiev, Georgi Z. 2019. Statistical Methods in Online a/b Testing: Statistics for Data-Driven Business Decisions and Risk Management in e-Commerce. Independently published.

Gordon, Brett R., Robert Moakler, and Florian Zettelmeyer. 2023. “Close Enough? A Large-Scale Exploration of Non-Experimental Approaches to Advertising Measurement.” Marketing Science 42 (4): 768–93. https://doi.org/10.1287/mksc.2022.1413.

Hudgens, Michael G., and M. Elizabeth Halloran. 2008. “Toward Causal Inference with Interference.” Journal of the American Statistical Association 103 (482): 832–42. https://doi.org/10.1198/016214508000000292.

Huntington-Klein, Nick. 2023. “The Effect: An Introduction to Research Design and Causality.” 2023. https://theeffectbook.net/.

Ibragimov, Rustam, and Ulrich K. Müller. 2016. “Inference with Few Heterogeneous Clusters.” Review of Economics and Statistics 98 (1): 83–96. https://doi.org/10.1162/REST_a_00545.

Imbens, Guido W, and Donald B Rubin. 2015. Causal Inference in Statistics, Social, and Biomedical Sciences. Cambridge university press.

Imbens, Guido, and Andrew Gelman. 2019. “Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs.” Journal of Business & Economic Statistics 37 (3): 447–56. https://doi.org/10.1080/07350015.2017.1366909.

James, Gareth, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2013. An Introduction to Statistical Learning: With Applications in r. Springer Texts in Statistics. Springer.

James, Gareth, Daniela Witten, Trevor Hastie, Robert Tibshirani, and Jonathan Taylor. 2023. An Introduction to Statistical Learning with Applications in Python. Springer Texts in Statistics. Springer. https://doi.org/10.1007/978-3-031-38747-0.

Jung, Yonghan, Jin Tian, and Elias Bareinboim. 2021. “Double Machine Learning Density Estimation for Local Treatment Effects with Instruments.” In Advances in Neural Information Processing Systems, edited by M. Ranzato, A. Beygelzimer, Y. Dauphin, P. S. Liang, and J. Wortman Vaughan, 34:21821–33. Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2021/file/b61a560ed1b918340a0ddd00e08c990e-Paper.pdf.

Kahneman, Daniel. 2011. Thinking, Fast and Slow. New York: Farrar, Straus; Giroux.

Keele, Luke, and Rocío Titiunik. 2015. “Geographic Boundaries as Regression Discontinuities.” Political Analysis 23 (1): 127–55. https://doi.org/10.1093/pan/mpu014.

———. 2018. “Geographic Natural Experiments with Interference: The Effect of All-Mail Voting on Turnout in Colorado.” CESifo Economic Studies 64 (2): 127–49. https://doi.org/10.1093/cesifo/ify006.

Kohavi, Ron, and Roger Longbotham. 2011. “Unexpected Results in Online Controlled Experiments.” ACM SIGKDD Explorations Newsletter 12 (2): 31–35. https://doi.org/10.1145/1964897.1964905.

Kohavi, Ron, Diane Tang, and Ya Xu. 2020. Trustworthy Online Controlled Experiments: A Practical Guide to a/b Testing. Cambridge University Press.

Lee, David S, Justin McCrary, Marcelo J Moreira, and Jack Porter. 2022. “Valid t-Ratio Inference for IV.” American Economic Review 112 (10): 3260–90. https://doi.org/10.1257/aer.20211063.

List, John A., Ian Muir, and Gregory Sun. 2025. “Using Machine Learning for Efficient Flexible Regression Adjustment in Economic Experiments.” Econometric Reviews 44 (1): 2–40. https://doi.org/10.1080/07474938.2024.2373446.

List, John A., Azeem M. Shaikh, and Yang Xu. 2019. “Multiple Hypothesis Testing in Experimental Economics.” Experimental Economics 22 (4): 773–93. https://doi.org/10.1007/s10683-018-09597-5.

MacKinnon, James G., and Matthew D. Webb. 2018. “The Wild Bootstrap for Few (Treated) Clusters.” Econometrics Journal 21 (2): 114–35. https://doi.org/10.1111/ectj.12107.

———. 2020. “Randomization Inference for Difference-in-Differences with Few Treated Clusters.” Journal of Econometrics 218 (2): 435–50. https://doi.org/10.1016/j.jeconom.2020.04.024.

MailerLite. 2025. “Email Marketing Benchmarks 2025: Is Your Open Rate on Track?” MailerLite. 2025. https://www.mailerlite.com/blog/email-marketing-benchmarks.

Noack, Claudia, and Christoph Rothe. 2023. “Donut Regression Discontinuity Designs.” Working Paper. https://arxiv.org/abs/2308.14464.

Orellana, Sebastián, Leandro Magga, Paolo Gorgi, Hyeokmoon Kweon, and Felipe Bahamonde. 2024. “Estimating Causal Effects of Customer Satisfaction on Downstream Metrics in a Multi-Queue Contact Center.” arXiv Preprint arXiv:2412.04860. https://doi.org/10.48550/arXiv.2412.04860.

Pearl, Judea, and Dana Mackenzie. 2018. The Book of Why: The New Science of Cause and Effect. New York: Basic Books (US), Penguin (UK).

Rachitsky, Lenny. 2023. “What Is a Good Free-to-Paid Conversion Rate?” Lenny’s Newsletter. 2023. https://www.lennysnewsletter.com/p/what-is-a-good-free-to-paid-conversion.

Stock, James H., and Motohiro Yogo. 2005. “Testing for Weak Instruments in Linear IV Regression.” In Identification and Inference for Econometric Models: Essays in Honor of Thomas Rothenberg, edited by Donald W. K. Andrews and James H. Stock, 80–108. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511614491.006.

Sun, Liyang, and Sarah Abraham. 2021. “Estimating Dynamic Treatment Effects in Event Studies with Heterogeneous Treatment Effects.” Journal of Econometrics 225 (2): 175–99. https://doi.org/https://doi.org/10.1016/j.jeconom.2020.09.006.

Taleb, Nassim Nicholas. 2007. The Black Swan: The Impact of the Highly Improbable. New York: Random House.

Thomke, Stefan H. 2020. Experimentation Works: The Surprising Power of Business Experiments. Harvard Business Press.

Wong, Vivian C., Peter M. Steiner, and Thomas D. Cook. 2013. “Analyzing Regression-Discontinuity Designs with Multiple Assignment Variables: A Comparative Study of Four Estimation Methods.” Journal of Educational and Behavioral Statistics 38 (2): 107–41. https://doi.org/10.3102/1076998611432172.

Wooldridge, Jeffrey M. 2015. Introductory Econometrics: A Modern Approach. 6th ed. Cengage Learning.