DOE OSTI · 2439189
Towards FAIR Workflows for Federated Experimental Sciences
Also available from
Abstract
A de-centralized, peer-to-peer AI metadata framework is demonstrated which can enable end-to-end metadata & lineage tracking for distributed Machine Learning pipelines spanning edge, High Performance Computing, and cloud environments. With a specific example of end-to-end microscopy algorithm and datasets, the proposed method shows how to enable reproducibility, audit trail, provenance of metadata artifacts. The emerging needs of automation in experimental sciences, ML-centric workflows, and FAIR metadata management across federated compute environments is addressed.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Saranathan, Gayathri, Foltin, Martin, Tripathy, Aalap, Justine, Annmary, Ziatdinov, Maxim A., Ghosh, Ayana, Roccapriore, Kevin, Bhattacharya, Supama, Faraboschi, Paolo. 2024-07-30. Towards FAIR Workflows for Federated Experimental Sciences. https://doi.org/10.1109/cai59869.2024.00256
Cite the original work for its findings. Save a collection to share your selection of sources.