
It also models procedures designed to simplify and improve reproducibility" (). Replication teams followed a research protocol and received logistical assistance as they collected materials, identified the key finding for replication, ran their experiment, conducted analyses, and reported their findings.Īs stated in an initial report from 2012, "The Reproducibility Project uses an open methodology to test the reproducibility of psychological science. The Reproducibility Project: Psychology began in November 2011, finished primary data collection in December 2014, and published a summary of the results in August 2015. : The Transparency and Openness Promotion Guidelines are a collective effort to improve transparency and reproducibility across disciplines. : Learn more and get started using the free, open-source Open Science Framework for your own project management, archiving, manuscript sharing, and research registration. : Learn more about the organization that facilitated the project and its initiatives to increase the transparency and reproducibility of research. : Read additional comments on the publication and responses made by members of the Open Science Collaboration. : Explore the final reports and data for individual replications mentioned in Gilbert et al.'s technical comment. : Read the response to Gilbert et al.'s technical comment, written by members of the Open Science Collaboration. : Read the technical comment written by Gilbert, King, Pettigrew, and Wilson on the Reproducibility Project: Psychology. : Find articles, slides, notes, and videos of presentations of the Reproducibility Project: Psychology and related efforts. : Learn more about the design, management, and operation of this large-scale crowdsourced project. : Reproduce the analyses of the individual projects and the aggregate results. : Explore the preregistrations, materials, data, and result reports of the individual replication projects. Supplementary materials to "Estimating the Reproducibility of Psychological Science." Includes additional graphs and details on analyses. : Read the and supplementary material summarizing the results of the Reproducibility Project: Psychology. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Thirty-six percent of replications had significant results 47% of original effect sizes were in the 95% confidence interval of the replication effect size 39% of effects were subjectively rated to have replicated the original result and, if no bias in original results is assumed, combining original and replication results left 68% with significant effects. Ninety-seven percent of original studies had significant results (p <. 188), representing a substantial decline. 257) were half the magnitude of original effects (Mr =. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. # Estimating the Reproducibility of Psychological Science
