Deprecated: Return type of Requests_Cookie_Jar::offsetExists($key) should either be compatible with ArrayAccess::offsetExists(mixed $offset): bool, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Cookie/Jar.php on line 63

Deprecated: Return type of Requests_Cookie_Jar::offsetGet($key) should either be compatible with ArrayAccess::offsetGet(mixed $offset): mixed, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Cookie/Jar.php on line 73

Deprecated: Return type of Requests_Cookie_Jar::offsetSet($key, $value) should either be compatible with ArrayAccess::offsetSet(mixed $offset, mixed $value): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Cookie/Jar.php on line 89

Deprecated: Return type of Requests_Cookie_Jar::offsetUnset($key) should either be compatible with ArrayAccess::offsetUnset(mixed $offset): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Cookie/Jar.php on line 102

Deprecated: Return type of Requests_Cookie_Jar::getIterator() should either be compatible with IteratorAggregate::getIterator(): Traversable, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Cookie/Jar.php on line 111

Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetExists($key) should either be compatible with ArrayAccess::offsetExists(mixed $offset): bool, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 40

Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetGet($key) should either be compatible with ArrayAccess::offsetGet(mixed $offset): mixed, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 51

Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetSet($key, $value) should either be compatible with ArrayAccess::offsetSet(mixed $offset, mixed $value): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 68

Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::offsetUnset($key) should either be compatible with ArrayAccess::offsetUnset(mixed $offset): void, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 82

Deprecated: Return type of Requests_Utility_CaseInsensitiveDictionary::getIterator() should either be compatible with IteratorAggregate::getIterator(): Traversable, or the #[\ReturnTypeWillChange] attribute should be used to temporarily suppress the notice in /home/lj3i62g6dk4q/public_html/wp-includes/Requests/Utility/CaseInsensitiveDictionary.php on line 91
Next in Reproducibility: standards, policies, infrastructure, and human factors :: Lorena A. Barba Group

Lorena A. Barba group

Next in Reproducibility: standards, policies, infrastructure, and human factors


Warning: Undefined variable $post in /home/lj3i62g6dk4q/public_html/wp-content/themes/spruce-theme/api/figshare.php on line 57

Warning: Attempt to read property "ID" on null in /home/lj3i62g6dk4q/public_html/wp-content/themes/spruce-theme/api/figshare.php on line 57

Description

Annual Tutte Lecture, May 27, 2019
Tutte Institute for Mathematics and Computing

Abstract
The National Academies of Science, Engineering and Medicine released a consensus study report on “Reproducibility and Replicability in Science” on 7 May 2019. The report provides definitions of reproducibility and replicability accounting for the diversity of fields in science and engineering. It assesses the state of reproducibility and replicability across science, and it offers recommendations for researchers, agencies, policy makers, journals, professional societies, and more. In its definitions, the committee emphasized the ubiquity and importance of computing and the data-intensive processes in modern science. Reproducibility was defined as obtaining consistent computational results using the same input data, computational steps, methods, code, and conditions of analysis as an original study. Although this may sound straightforward, the report describes how a number of systematic efforts to reproduce computational results have failed in more than half of the attempts made, mainly due to insufficient detail on digital artifacts, such as data, code and computational workflow. In the wake of this comprehensive report, what is next for reproducibility? Research communities will need to develop standards of practice, institutions will adopt formal policies, and funding agencies may look to support more infrastructure and tools to enable reproducibility. At the same time, the training of researchers and data scientists should be strengthened and in some ways also standardized—imitating perhaps the training of pilots and aviation professionals. In this analogy, complex processes are managed with checklists and guides, and full accountability and auditability are ensured through automatic capture of records and mandated provenance. Last but not least, the aviation industry recognizes the importance of human factors, and places them at the center of design and policy. As data and computation dominate in all fields of human enquiry, pivoting our attention to the “human in the loop” is now critical.

Files

Links