Datatractor: Metadata, automation, and registries for extractor interoperability in the chemical and materials sciences

Abstract

Two key issues hindering the transition towards FAIR data science are the poor discoverability and inconsistent instructions for the use of data extractor tools, i.e., how we go from raw data files created by instruments, to accessible metadata and scientific insight. If the existing format conversion tools are hard to find, install, and use, their reimplementation will lead to a duplication of effort, and an increase in the associated maintenance burden is inevitable. The Datatractor framework presented in this work addresses these issues. First, by providing a curated registry of such extractor tools their discoverability will increase. Second, by describing them using a standardised but lightweight schema, their installation and use is machine-actionable. Finally, we provide a reference implementation for such data extraction. The Datatractor framework can be used to provide a public-facing data extraction service, or be incorporated into other research data management tools providing added value.

(accepted version)

References in corpus (6)

• Materials Cloud, a platform for open computational science
• OPTIMADE, an API for exchanging materials data
• Developments and applications of the OPTIMADE API for materials discovery, design, and data exchange
• funcX: Federated Function as a Service for Science
• A call to arms: making the case for more reusable libraries
• Astronomical Data Formats: What we have and how we got here