--- title: "Reproducibility Project: Cancer Biology" description: Improving rigor, transparency, and sharing in preclinical research may accelerate discovery of knowledge, solutions, and treatments. image: https://www.cos.io/hubfs/rpcb-social.jpg --- - Our sites: - [OSF](https://osf.io) - [TOP Guidelines](https://www.cos.io/initiatives/top-guidelines?hsLang=en) - [* *Bluesky](https://bsky.app/profile/cos.io)[* *Mastodon](https://fosstodon.org/@CenterforOpenScience)[* *Linkedin](https://www.linkedin.com/company/center-for-open-science/)[* *YouTube](https://www.youtube.com/@CenterforOpenScience) - [**  Shop](https://www.redbubble.com/people/OpenScience/shop) - [**  Donate](https://www.cos.io/support-cos?hsLang=en) [![Center for Open Science](https://www.cos.io/hs-fs/hubfs/Logos/COS%202024/cos-full-tag-h.png?width=2000&height=293&name=cos-full-tag-h.png "Center for Open Science")](https://www.cos.io?hsLang=en) ** ** ![Reproducibility Project: Cancer Biology](https://www.cos.io/hubfs/Logos/logo-rpcb-horizontal-white.png) ![Reproducibility Project: Cancer Biology](https://www.cos.io/hubfs/Logos/RPCB/logo-rpcb-bigicon-white.png) - [Overview](https://www.cos.io/rpcb?hsLang=en) - [Contributors & Supporters](https://www.cos.io/rpcb-contributors?hsLang=en) - [Press & News](https://www.cos.io/rpcb-press-news?hsLang=en) - [Get Involved](https://www.cos.io/rpcb-get-involved?hsLang=en) - [**Papers on eLife](https://elifesciences.org/collections/9b1e83d1/reproducibility-project-cancer-biology) - [**Data & Code on OSF](https://osf.io/collections/rpcb/) ## Project Overview The *Reproducibility Project: Cancer Biology* was an 8-year effort to replicate experiments from high-impact cancer biology papers published between 2010 and 2012. The project was a collaboration between the [Center of Open Science](https://www.cos.io/?hsLang=en) and [Science Exchange](https://ww2.scienceexchange.com/s/) with all papers published as part of this project available in a [collection at *eLife*](https://elifesciences.org/collections/9b1e83d1/reproducibility-project-cancer-biology) and all replication data, code, and digital materials for the project available in a [collection on OSF](https://osf.io/collections/rpcb/). When preparing replications of **193 experiments** from **53 papers** there were a number of challenges. 2% experiments with open data 70% of experiments required asking for key reagents 69% of experiments needing a key reagent original authors were willing to share 0% of protocols completely described 32% of experiments the original authors were not helpful (or unresponsive) 41% of experiments the original authors were very helpful Fully designed protocols were submitted to eLife for peer review before conducting the replications - a publishing format called [Registered Reports](https://www.cos.io/initiatives/registered-reports?hsLang=en) - to ensure that the proposed experiments were of the appropriate rigor and quality. Accepted replication protocols received a commitment in advance to publish the findings regardless of outcome. Additional challenges were encountered for the experiments that were conducted. 67% required modifications to complete 41% of modifications completely implemented Ultimately, 50 replication experiments from 23 of the original papers were completed, generating data about the replicability of a total of 158 effects. There are many ways to evaluate and characterize replication outcomes, some simplified summaries of the findings include: - Replication effect sizes were 85% smaller on average than the original findings - 46% of effects replicated successfully on more criteria than they failed - Original positive results were half as likely to replicate successfully (40%) than original null results (80%) Collectively, this evidence suggests opportunities to improve the transparency, sharing, and rigor of preclinical research to advance the pace of discovery. [![Discover more about the project](https://no-cache.hubspot.com/cta/default/6723653/fbee0bf0-338e-443f-a690-24bfb5ed8171.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/fbee0bf0-338e-443f-a690-24bfb5ed8171)[![Read more about replicability](https://no-cache.hubspot.com/cta/default/6723653/ed192f18-c6e3-4b9e-b112-baef19236254.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/ed192f18-c6e3-4b9e-b112-baef19236254)[![View data & code on OSF](https://no-cache.hubspot.com/cta/default/6723653/2e09cc33-3c98-41d9-8b12-9eed2c05edcd.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/2e09cc33-3c98-41d9-8b12-9eed2c05edcd) ## Get Involved #### Supporters Consider supporting more projects like RP:CB and other efforts to increase openness, integrity, and reproducibility of science. [![Learn more](https://no-cache.hubspot.com/cta/default/6723653/01cbe8ee-4c90-4982-9ed0-425330431c5f.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/01cbe8ee-4c90-4982-9ed0-425330431c5f) #### Researchers Improve workflow efficiency with integrated tools, keep track of your research in one place, learn new tools, preregister your work, and more. [![Learn more](https://no-cache.hubspot.com/cta/default/6723653/b39751a0-f2b0-436d-8ffd-d6634c4c8226.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/b39751a0-f2b0-436d-8ffd-d6634c4c8226) #### Institutions Learn about tools and services for your communities to increase transparency and visibility of research outputs, accelerating discovery and reuse. [![Learn more](https://no-cache.hubspot.com/cta/default/6723653/2a5907b6-40a1-4139-92de-ace394cb4395.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/2a5907b6-40a1-4139-92de-ace394cb4395) #### Journals & Societies Increase the transparency and openness of research, learn how to signal open practices, increase your conference’s reach, and more. [![Learn more](https://no-cache.hubspot.com/cta/default/6723653/1a1bd94d-fe5b-4af3-a72e-3d1593445724.png)](https://cta-redirect.hubspot.com/cta/redirect/6723653/1a1bd94d-fe5b-4af3-a72e-3d1593445724) Questions about the project can be directed to [contact+rpcb@cos.io](mailto:contact+rpcb@cos.io). Share: [![Facebook](https://www.cos.io/hubfs/RPCB/icon-fb.svg)](https://www.facebook.com/sharer/sharer.php?u=https%3A//cos.io/rpcb)[![Twitter](https://www.cos.io/hubfs/RPCB/icon-tw.svg)](https://twitter.com/intent/tweet?text=Access%20the%20Reproducibility%20Project%3A%20Cancer%20Biology,%20a%20collaboration%20of%0Athe%20Center%20for%20Open%20Science%20%40OSFramework,%20%40ScienceExchange%20%26%20%40eLife%20w/%0Asupport%20from%20%40Arnold_Ventures,%20replicating%20experiments%20from%20past%0A%23cancerbiology%20papers.%20https%3A//cos.io/rpcb%20%23openscience%20%23replication)[![LinkedIn](https://www.cos.io/hubfs/RPCB/icon-li.svg)](https://www.linkedin.com/shareArticle?mini=true&url=https%3A//cos.io/rpcb&title=Reproducibility%20Project%3A%20Cancer%20Biology&summary=Access%20the%20Reproducibility%20Project%3A%20Cancer%20Biology,%20a%20collaboration%0Abetween%20the%20Center%20for%20Open%20Science,%20Science%20Exchange%20%26%20eLife%20with%0Asupport%20from%20Arnold%20Ventures,%20replicating%20experiments%20from%20past%0A%23cancerbiology%20papers.%20%23openscience%20%23replication%0A%23science%20%23research&source=) Hero image: Photo by [National Cancer Institute](https://unsplash.com/@nci?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText) on [Unsplash](https://unsplash.com/s/photos/cancer-cell?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText) ![Center for Open Science](https://www.cos.io/hubfs/Logos/COS%202024/cos-full-tag-h-w.png) 6218 Georgia Avenue NW, Suite #1, Unit 3189 Washington, DC 20011 Email: [contact@cos.io](mailto:contact@cos.io) - [* *Bluesky](https://bsky.app/profile/cos.io) - [* *Mastodon](https://fosstodon.org/@CenterforOpenScience) - [* *Linkedin](https://www.linkedin.com/company/center-for-open-science/) - [* *YouTube](https://www.youtube.com/@CenterforOpenScience) **Join our mailing list** [![Creative Commons License](https://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/) Unless otherwise noted, this site is licensed under a [Creative Commons Attribution 4.0 International (CC BY 4.0) License](https://creativecommons.org/licenses/by/4.0/). [Translation Help](https://www.cos.io/how-to-translate?hsLang=en) | [Terms of Use](https://github.com/CenterForOpenScience/centerforopenscience.org/blob/master/TERMS_OF_USE.md) | [Privacy Policy](https://github.com/CenterForOpenScience/centerforopenscience.org/blob/master/PRIVACY_POLICY.md) - [**About**](https://www.cos.io/about?hsLang=en) - [Team](https://www.cos.io/about/team?hsLang=en) - [Board](https://www.cos.io/about/board?hsLang=en) - [Partners](https://www.cos.io/about/partnership-framework?hsLang=en) - [News](https://www.cos.io/about/news?hsLang=en) - [Impact](https://www.cos.io/impact?hsLang=en) - [History](https://www.cos.io/timeline?hsLang=en) - [Finances](https://www.cos.io/about/finances?hsLang=en) - [Compliance and Standards](https://www.cos.io/compliance-and-standards?hsLang=en) - [Diversity, Equity & Inclusion](https://www.cos.io/about/diversity-equity-and-inclusion-at-cos?hsLang=en) - [Careers](https://www.cos.io/careers?hsLang=en) - [**Engage**](https://www.cos.io/engage?hsLang=en) - [Tools](https://www.cos.io/tools?hsLang=en) - [Training](https://www.cos.io/services/training?hsLang=en) - [Community Building](https://www.cos.io/community-building?hsLang=en) - [Policy Reform](https://www.cos.io/policy-reform?hsLang=en) - **  [Donate](https://www.cos.io/support-cos?hsLang=en) - [**Open Science**](https://www.cos.io/open-science?hsLang=en) - [Preregistration](https://www.cos.io/initiatives/prereg?hsLang=en) - [Registered Reports](https://www.cos.io/initiatives/registered-reports?hsLang=en) - [**Research**](https://www.cos.io/services/research?hsLang=en) - [SCORE](https://www.cos.io/score?hsLang=en) - [RP: Cancer Biology](https://www.cos.io/rpcb) - [RP: Psychology](https://osf.io/ezcuj/wiki/home/) - [Events](https://www.cos.io/events?hsLang=en) - [Blog](https://www.cos.io/blog?hsLang=en) - [Contact](https://www.cos.io/contact-us?hsLang=en) - [Shop](https://www.redbubble.com/people/OpenScience/shop) - [OSF](https://osf.io) - [TOP Guidelines](https://www.cos.io/initiatives/top-guidelines?hsLang=en) **Responsible stewards of your support** [![Charity Navigator](https://www.cos.io/hs-fs/hubfs/Logos/charity-navigator.png?width=100&name=charity-navigator.png)](https://www.charitynavigator.org/ein/461496217)[![Platinum Transparency 2023](https://widgets.guidestar.org/TransparencySeal/9294495)](https://www.guidestar.org/profile/46-1496217)[![SOC 2](https://www.cos.io/hs-fs/hubfs/Logos/badge-soc2.png?width=100&name=badge-soc2.png)](https://www.aicpa-cima.com/resources/landing/system-and-organization-controls-soc-suite-of-services) COS has earned top recognition from **[Charity Navigator](https://www.charitynavigator.org/ein/461496217)** and **[Candid](https://www.guidestar.org/profile/46-1496217)** (formerly GuideStar) for our financial transparency and accountability to our mission. COS and the OSF were also awarded SOC2 accreditation in 2023 after an independent assessment of our security and procedures by the **[American Institute of CPAs (AICPA)](https://www.aicpa-cima.com/resources/landing/system-and-organization-controls-soc-suite-of-services)**. We invite all of our sponsors, partners, and members of the community to learn more about how our organization operates, our impact, our financial performance, and our nonprofit status. **Photo Stream** - - - - - - - - - - - -