ADR-24-02: OpenRefine

Status

Accepted

Impact

Low

Demand Owner

Jan Küntzer

ADR Contributors

Orlando Pereira, Alex Weigel

Reviewers

Architecture Council

Informed

Solution Architecture CC, pRED Architecture CC

Publication Date

June 6th, 2024

📗 Background

Openrefine is connected to Arvados and Roche Terminology Service (RTS). It loads comma-separated values (CSV) tables from Arvados, allows the user to curate the data by using RTS terminologies, and writes the curated CSV tables back to Arvados as a new version of the file, or to the user’s computer.

The open-refine data curation tool allows data curators to improve data quality by leveraging RTS reference terminologies with the goal of Findable, Accessible, Interoperable, and Reusable (FAIR) data.

ℹ️ Context

Felix Schwagereit, from D&A, presented Clinical Data Access - OpenRefine a Data Curation tool to the Architecture Review Forum and sought guidance on the technical and architectural design of the solution. Discussions surrounding the business architecture, information architecture, information flow, solution architecture, and infrastructure were conducted.

==🤝 Outcome / Decision Following the pRED Architecture Review Forum on April 24th, 2024, the Openrefine project architecture proposal has been endorsed.

Recommendations

Curating data is a task that needs to be executed in various places in the organization. We recommend verifying whether it is possible to offer the Openrefine data curation tool as a generic product which could also be integrated and reused by other systems in the pRED landscape.

#== 📚 Resources