The Reproducibility Showcase features a series of online presentations and tutorials from May to August, 2020. Presenters are selected from the MIDAS Reproducibility Challenge 2020.
A significant challenge across scientific fields is the reproducibility of research results, and third-party assessment of such reproducibility. The goal of the MIDAS Reproducibility Challenge is to highlight high-quality, reproducible work at the University of Michigan by collecting examples of best practices across diverse fields. We received a large number of entries that illustrate wonderful work in the following areas:
- Theory – A definition of reproducibility and what aspects of reproducibility are critical in a particular domain or in general.
- Reproducing a Particular Study – Comprehensive record of parameters and code that allows for others to reproduce the results in a particular project.
- Generalizable Tools – A general platform for coding or running analyses that standardizes the methods for reproducible results across studies.
- Robustness – Metadata, tools and processes to improve the robustness of results to variations in data, computational hardware and software, and human decisions.
- Assessments of Reproducibility – Methods to test the consistency of results from multiple projects, such as meta-analysis or the provision of parameters that can be compared across studies.
- Reproducibility under Constraints – Sharing code and/or data to reproduce results without violating privacy or other restrictions.
This showcase will lead up to our Reproducibility Day on Sept. 14, 2020.
Presentation #1: Everyday Reproducibility: A multi-pronged approach to ensure analyses are fully reproducible, easy to access, and easy to use, Johann Gagnon-Bartsch, Assistant Professor, Statistics, May 15, 1 – 2pm.
Presentation #2: Jared Lyle, Archivist, ICPSR & Jacob Fisher, Research Investigator, Survey Research Center June 9, 1 – 2pm.
Presentation #3: Oliver He, Associate Professor, Microbiology & Immunology & Jie Song, Graduate Student Research Assistant, ICPSR June 23, 2 – 3pm.
Presentation #4: Xioquan (William) Wen, Associate Professor, Biostatistics July 7, 1 – 2pm.
Presentation #5: John Silberholz, Associate Professor, Technology and Operation & Nigel Michki, Doctoral Student, Biophysics July 21, 1 – 2pm.
Presentation #6: Sharon Glotzer, Professor, Chemical Engineering and Materials Science & Engineering July 28, 1 – 2pm.
Presentation #7: Chris Brooks, Assistant Professor of Information, School of Information August 4, 1 – 2pm.
Presentation #8: Thomas Valley, Assistant Professor, Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine August 25, 1 – 2pm.