Give

Assessments of Reproducibility

Replicating predictive models in scale for research on MOOC

A program of reproducibility research in the domain of learning analytics with a specific focus on predictive models of student success. It includes an open-source software infrastructure, the MOOC Replication Framework (MORF), which can be used to reproduce results on larger scale datasets.  It also includes a report on reproductions of work from other scholars ...

Large-Scale, Reproducible Implementation and Evaluation of Heuristics for Optimization Problems

Research developing new heuristics for optimization problems is often not reproducible; for instance, only 4% of papers for two famous optimization problems published their source code. This limits the impact of the research both within the heuristics community and more broadly among practitioners. In this work, the authors built a large-scale open-source code-base of heuristics. ...

Assessing the reproducibility of high-throughput experiments with a Bayesian hierarchical model

A Bayesian hierarchical model framework and a set of computational toolkits to evaluate the overall reproducibility of high-throughput biological experiments, and identify irreproducible and reproducible signals via rigorous false discovery rate control procedures.