The Center for Open Science (COS) is committed to increasing the openness, integrity, and reproducibility of research. Supported by the Robert Wood Johnson Foundation (RWJF), the Scaling Machine Assessments of Research Trustworthiness (SMART) competition exemplifies this mission by exploring innovative methods to predict the replicability of scientific findings using algorithms. This work expands the work from the Systematizing Confidence in Open Research and Evidence (SCORE) program. Central to this effort is a partnership with the Framework for Open and Reproducible Research Training (FORRT) and its resource, the FORRT Replication Database (FReD).
The SMART Competition and the Role of FReD
The SMART competition is an initiative designed to advance automated methods for evaluating research replicability. By utilizing data from COS’s SCORE program, the competition will invite diverse teams to develop new algorithmic approaches, fostering innovation and collaboration across disciplines.
FReD, a crowdsourced database documenting replication studies, plays a key role in the competition. Through the partnership between COS and FORRT, FReD is being enhanced to serve as a vital resource of replication outcomes that can be used by researchers to train algorithms. This collaboration not only strengthens the competition but also establishes FReD as a more robust tool for the broader research community.
By aligning efforts and leveraging support from RWJF, COS and FORRT are advancing open science, demonstrating the impact of strategic partnerships, and ensuring that resources like FReD contribute directly to the success of the SMART competition and broader open science initiatives.
Become a Key Contributor to Open Science
FORRT is recruiting paid Data Curators to help grow and validate the FReD database. This opportunity is ideal for researchers and students passionate about open science who are interested in making a meaningful impact while working remotely and flexibly.
Role of a Data Curator
- Enter and validate entries in the replication database.
- Conduct systematic searches to expand the collection.
- Document work to ensure transparency and quality.
Benefits of Participation
- Gain skills in data extraction, validation, and literature review.
- Contribute to advancing research transparency and applicability.
Interested? Check out the full job description and fill in the application form to apply!
A Partnership Built on Shared Goals
This collaboration between COS and FORRT is fueled by shared values of transparency and innovation. Engage with these efforts and keep an eye out for the launch of the SMART competition in 2025 to join in advancing research transparency and reproducibility. Together, initiatives like SMART and partnerships with organizations like FORRT aim to progress a more robust and trustworthy future in research.
