with Jörg Ankel-Peters, Abel Brodeur, Anna Dreber, and Magnus Johannesson
Funded by the German Research Foundation (DFG) within the priority program "META-REP" (Program's website) and Open Philanthropy
Project duration: 2022-2025
This project assesses the robustness and replicability of 66 studies in development economics, published in the American Economic Review, American Economic Journal: Applied Economics, and the Journal of Development Economics. To conduct the robustness reproductions, we hired external researchers, who follow a standardized reproduction protocol developed as part of the project.
Besides the core study, the project includes several subprojects, such as the development of standardized protocol for conducting robustness reproductions, a visualization tool to illustrate results across robustness reproductions, and a pilot for an expert survey to resolve a replication debate.
Reproduction and Replication at the Science-Policy Interface
with Jörg Ankel-Peters and Abel Brodeur
Funded by Open Philanthropy
Project duration: 2025-2026
This project aims to advance the role of meta-scientific replication in shaping evidence-based policy by pursuing three key objectives:
Bridging the gap between ongoing meta-scientific replication endeavors and evidence-based policy.
Despite an increasing number of large-scale reproductions, their insights often fail to influence real-world policy decisions, as they are thematically very diverse. We aim to close this gap by systematically integrating reprodcution findings into policy discussions, ensuring that empirical research informs decision-making more effectively.
Start mass reproducing studies in three policy-relevant fields: air pollution, carbon pricing, and deforestation.
Levergaing I4R's replication games and hiring external researchers with expert knowledge, we will conduct robustness reproductions to assess the reliability of existing empirical findings. Our meta-studies will provide the scientific community and policymakers with insights into strengths, limitations, and reproducibility of these research fields.
Fostering a sustainable replication culture in public health and environmental research.
We will explore both demand- and supply-side factors of replications in environmental and health economics. Using targeted surveys among active researchers (supply side) and journal editors (demand side), we will analyze perceptions, barriers, and incentives surrounding replication efforts. Additionally, we will collaborate with journals to develop transparent replication policies, ensuring that replication-based comments are systematically reviewed and published when warranted.