Search NASA⌕ Search

SEARCH · Search NASA

Results for “provenance tracking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Tracking Provenance of Earth Science Data

Tremendous volumes of data have been captured, archived and analyzed. Sensors, algorithms and processing systems for transforming and analyzing the data are evolving over time. Web Portals and Services can create transient data sets on-demand. Data are transferred from organization to organization with additional transformations at every stage. Provenance in this context refers to the source of data and a record of the process that led to its current state. It encompasses the documentation of a variety of artifacts related to particular data. Provenance is important for understanding and using scientific datasets, and critical for independent confirmation of scientific results. Managing provenance throughout scientific data processing has gained interest lately and there are a variety of approaches. Large scale scientific datasets consisting of thousands to millions of individual data files and processes offer particular challenges. This paper uses the analogy of art history provenance to explore some of the concerns of applying provenance tracking to earth science data. It also illustrates some of the provenance issues with examples drawn from the Ozone Monitoring Instrument (OMI) Data Processing System (OMIDAPS) run at NASA's Goddard Space Flight Center by the first author.

Tilmes, Curt↗

yProv4ML: Effortless provenance tracking for machine learning systems

The rapid growth in interest in deep learning and foundation models (FMs) in particular, has attracted the attention of a diverse range of researchers thanks to their generalization ability. However, the advent of these techniques has also brought to light the lack of transparency and rigor in the way development is pursued. In particular, the inability to determine the number of epochs and other hyperparameters in advance presents challenges in identifying the best model. To address this challenge, machine learning frameworks such as MLFlow can automate the collection of this type of information. However, these tools capture data using proprietary formats and pose little attention to lineage. This paper proposes yProv4ML, a framework that captures provenance information generated during machine learning processes in PROV-JSON format, with minimal code modification.

Machine learning↗

Opening doors to physical sample tracking and attribution in Earth and environmental sciences

Physical samples and their associated data and metadata underpin scientific discoveries across disciplines and can enable new science when appropriately archived. However, there are significant gaps in current practices and infrastructure that prevent accurate provenance tracking, reproducibility, and attribution. For most samples, descriptive metadata are often sparse, inaccessible, or absent. Samples and associated data and metadata may also be scattered across numerous physical collections, data repositories, laboratories, data files, and papers with no clear linkage or provenance tracking as new information is generated over time. The Earth Science Information Partners (ESIP) Physical Samples Curation Cluster has therefore developed guidance for scientific authors on ‘Publishing Open Research Using Physical Samples.’ This involved synthesizing existing practices, gathering community feedback, and assessing real-world examples. We identified improvements needed to enable authors to efficiently cite and link Earth science samples and related data, and track their use. Our goal is to help improve discoverability, interoperability, and reuse of physical samples, and associated data and metadata. Though primarily focused on the needs of Earth and environmental sciences, these guidelines are broadly applicable.

58 GEOSCIENCES↗

A Vision for Coupling Operation of US Fusion Facilities with HPC Systems and the Implications for Workflows and Data Management

The operation of large US Department of Energy (DOE) research facilities, like the DIII-D National Fusion Facility, results in the collection of complex multi-dimensional scientific datasets, both experimental and model-generated. In the future, it is envisioned that integrated data analysis coupled with large-scale high performance computing (HPC) simulations will be used to improve experimental planning and operation. Practically, massive data sets from these simulations provide the physics basis for generation of both reduced semi-analytic and machine-learning-based models. Storage of both HPC simulation datasets (generated from US DOE leadership computing facilities) and experimental datasets presents significant challenges. In this paper, we present a vision for a DOE-wide data management workflow that integrates US DOE fusion facilities with leadership computing facilities. Data persistence and long-term availability beyond the length of allocated projects is essential, particularly for verification and recalibration of artificial intelligence and machine learning (AI/ML) models. Because these data sets are often generated and shared among hundreds of users across multiple leadership computing facility centers, they would benefit from cross-platform accessibility, persistent identifiers (e.g. DOI, or digital object identifier), and provenance tracking. Here, the ability to handle different data access patterns suggests that a combination of low cost, high latency (e.g. for storing ML training sets) and high cost, low latency systems (e.g. for real-time, integrated machine control feedback) may be needed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Early results from the TOPEX/POSEIDON GPS precise orbit determination demonstration

TOPEX/POSEIDON, a US/French oceanographic mission launched in August 1992, is the first earth satellite to carry a multi-channel, dual frequency Global Positioning System (GPS) receiver capable of making high precision P-code pseudorange and carrier phase measurements. The receiver was placed on TOPEX/POSEIDON as an experiment to demonstrate the potential of differential GPS tracking for subdecimeter orbit determination. In addition to the receiver, TOPEX/POSEIDON carries two flight-proven tracking systems to provide the operational precise orbit determination needed to meet the mission scientific requirements. These include a French-built one-way Doppler system known as DORIS (Doppler Orbitography and Radiopositioning Integrated by Satellite) and a circular ring of laser retroreflectors. Here we evaluate the quality of the GPS-determined orbits by examining post-fit residuals, orbit comparisons with DORIS, and orbit repeatability on overlapping data arcs. Overlapping data arcs with 6 hrs of common data out of a 30-hr arc have an average root-mean-square (RMS) altitude difference of 3.0 cm for 9 arcs. The average RMS altitude difference about the mean with a DORIS orbit was 5.7 cm.

Bertiger, Willy↗

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗

Refreshing Waste Tracking Software for the 2020's - 20059

The Waste Compliance and Tracking System (WCATS) is a software application designed to manage waste operations from cradle to grave. The system provides the support needed for characterization, generation, processing, and shipment of all waste generated or stored at Los Alamos National Laboratory (LANL). Waste is tracked with task records for containers in real-time via both desktop and mobile device applications. The software allows application administrators to configure sites with appropriate limits for Pu-239 equivalent Curies (PE-Ci), fissile gram equivalents (FGEs), volume limits, as well as custom limits for site-specific technical safety requirements (TSRs). WCATS was developed based on a need at Los Alamos National Laboratory for a modern, customizable waste tracking system that could support many different waste types. The application is built using Oracle{sup R} database and Oracle{sup R} ADF Swing application framework. The technologies and software frameworks selected for the system were finalized in 2006. Although Oracle{sup R} Database has proven to be robust, the user interface and application framework interface with the database have been deprecated and need to be replaced. The technologies selected for modernization follow the open-source model, which allows the WCATS team to more easily recruit developers, improve the speed of development, and ease the deployment and adoption of the system. The tools that support the re-engineering effort are Vue.js{sup R}, a JavaScript{sup R} framework, and Spring Boot{sup R}, an API (application programming interface) development tool written in Java{sup R}. An API allows for simplified communication from the database to the user interface of the application. In addition, legacy Crystal Reports{sup R} will be replaced with reports developed with the open source Pentaho{sup TM}f Report Designer community edition. Because the application uses HTML and JavaScript{sup R}, it builds upon tools that have been used for many years in web development. These tools have large community support and their proven track record will ensure that enhancements to WCATS can continue for years to come. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Enabling Modular Autonomous Feedback‐Loops in Materials Science through Hierarchical Experimental Laboratory Automation and Orchestration

Abstract Materials acceleration platforms (MAPs) operate on the paradigm of integrating combinatorial synthesis, high‐throughput characterization, automatic analysis, and machine learning. Within a MAP, one or multiple autonomous feedback loops may aim to optimize materials for certain functional properties or to generate new insights. The scope of a given experiment campaign is defined by the range of experiment and analysis actions that are integrated into the experiment framework. Herein, the authors present a method for integrating many actions within a hierarchical experimental laboratory automation and orchestration (HELAO) framework. They demonstrate the capability of orchestrating distributed research instruments that can incorporate data from experiments, simulations, and databases. HELAO interfaces laboratory hardware and software distributed across several computers and operating systems for executing experiments, data analysis, provenance tracking, and autonomous planning. Parallelization is an effective approach for accelerating knowledge generation provided that multiple instruments can be effectively coordinated, which the authors demonstrate with parallel electrochemistry experiments orchestrated by HELAO. Efficient implementation of autonomous research strategies requires device sharing, asynchronous multithreading, and full integration of data management in experimental orchestration, which to the best of the authors’ knowledge, is demonstrated for the first time herein.

36 MATERIALS SCIENCE↗

Rapid Solidification Effects in Additively Manufactured Si and SiGe Compositions

SiGe alloys have a proven track record as robust high-temperature thermoelectric materials, powering NASA missions like SNAP-10A, LES-9, and Voyager 1 and 2. Enhancing thermoelectric efficiency hinges on minimizing thermal conductivity while preserving electrical conductivity. Rapid solidification via LPBF can generate microstructural features such as subgrain cellular boundaries and twinning, which may help reduce thermal conductivity while preserving semiconducting behavior. Here, this study investigates the potential of laser powder bed fusion (LPBF) additive manufacturing to fabricate nanostructured Si and SiGe thermoelectric materials. High cooling rates (10 5 to 10 7 K/s) rates inherent to the LPBF process are conducive to forming such nanostructures. Moreover, this fabrication technique could also be suitable for fabricating complex geometries needed to achieve improved device level performance. Process mapping of commercial Si powder with irregular morphology was first performed to understand the LPBF processing behavior of this semiconductor material. Subsequent studies included in-house synthesized B-doped (p-type) Si7 8 Ge 22 spherical powder that was produced via ultrasonic atomization. Scan strategies involved multiple laser exposures to mitigate solidification cracking: a high density of >98% was achieved, but solidification cracking could not be fully eliminated. Subsequently, a high electrical resistivity (i.e., low conductivity) was observed, but the measured Seebeck coefficient, ∼230 μV/K @ 500 °C, proved that good semiconductor material was being fabricated. A subgrain cellular structure (5–10 μm) was observed as defined by Ge segregation to the intercellular boundaries. The remelting strategies helped lower the cooling rates in processing SiGe, but this still resulted in high residual stresses, which induced a remarkably high density of twins (78–95%) to accommodate the deformation. This unique grain structure offers an avenue for phonon scattering and potential improvements in thermoelectric performance.

figure of merit↗

MEMOTE for standardized genome-scale metabolic model testing

Reconstructing metabolic reaction networks enables the development of testable hypotheses of an organism’s metabolism under different conditions. State-of-the-art genome-scale metabolic models (GEMs) can include thousands of metabolites and reactions that are assigned to subcellular locations. Gene–protein–reaction (GPR) rules and annotations using database information can add meta-information to GEMs. GEMs with metadata can be built using standard reconstruction protocols, and guidelines have been put in place for tracking provenance and enabling interoperability, but a standardized means of quality control for GEMs is lacking. Here we report a community effort to develop a test suite named MEMOTE (for metabolic model tests) to assess GEM quality.

59 BASIC BIOLOGICAL SCIENCES↗

Announcing the Biomedical Data Translator: Initial Public Release

ABSTRACT The growing availability of biomedical data offers vast potential to improve human health, but the complexity and lack of integration of these datasets often limit their utility. To address this, the Biomedical Data Translator Consortium has developed an open‐source knowledge graph–based system—Translator—designed to integrate, harmonize, and make inferences over diverse biomedical data sources. We announce here Translator's initial public release and provide an overview of its architecture, standards, user interface, and core features. Translator employs a scalable, federated, knowledge graph framework for the integration of clinical, genomic, pharmacological, and other biomedical knowledge sources, enabling query retrieval, inference, and hypothesis generation. Translator's user interface is designed to support the exploration of knowledge relationships and the generation of insights, without requiring deep technical expertise and gradually revealing more detailed evidence, provenance, and confidence information, as needed by a given user. To demonstrate Translator's application and impact, we highlight features of the user interface in the context of three real‐world use cases: suggesting potential therapeutics for patients with rare disease; explaining the mechanism of action of a pipeline drug; and screening and validating drug candidates in a model organism. We discuss strengths and limitations of reasoning within a largely federated system and the need for rich concept modeling and deep provenance tracking. Finally, we outline future directions for enhancing Translator's functionality and expanding its data sources. Translator represents a significant step forward in making complex biomedical knowledge more accessible and actionable, aiming to accelerate translational research and improve patient care.

Research & Experimental Medicine↗

AiiDA-INQ plugin

The AiiDA-INQ plugin will allow the INQ code developed at the lab to utilize the AiiDA workflow manager which enables high-throughput workflows. This includes provenance tracking, restart capabilities, job calculators, and other capabilities

Keilbart, NathanD↗

Consist v0.1.0

A Python library for provenance tracking, intelligent caching, and data virtualization in scientific simulation workflows. It automatically records code, configuration, and input data to skip redundant computations and enables querying results across many runs without manual bookkeeping. Designed to support multi-model simulation workflows like the BEAM CORE toolset at LBL, but designed to be extensible to a wide range of research workflows. Combines lineage tracking features as provided by OpenLineage with deterministic hashing like SnakeMake, and adds powerful analysis tools on model outputs.

Needell, Zachary [Lawrence Berkeley National Labor↗

Autonomous Tools for Attack Surface Reduction

The electric power grid is a complex critical infrastructure that forms the lifeline of modern society, and its secure and reliable operation is of paramount importance to national security and economic well being. However, recent findings documented in authoritative sources indicate the threat of cyber-based attacks growing in numbers and sophistication. However, securing the grid against stealthy cyber attacks is a challenging task due to legacy nature of the infrastructure coupled with dynamic nature of threat landscape and ever growing sophistication of the adversaries. Additionally, the grid’s attack surface continues to grow with the increased dependence on digital communications and control that now extends to each consumer through smart meters and distributed energy resources. Unfortunately, this expansive surface increases the grid’s vulnerability and further exposes critical control systems in both substations and control centers. To respond to this emerging need, we had successfully assembled an interdisciplinary team with academic- industry partnership to successfully conduct research, development, evaluation, demonstration, and commercialization of attack surface reduction tools, whose goal is to significantly reduce the cyber attack surface in the North American power grid. Our proposed project was a synergistic collaborative effort leveraging the synergistic expertise of the team members across power systems, cyber security and CPS security, testbeds, field deployments and demonstration, and successful commercialization. The team consisted of leading experts from two major universities – Iowa State University, Washington State University – complemented by reputed researchers from two DOE national laboratories – Pacific Northwest National Lab, and Argonne National Lab, one major utility vendor GE Global Research, and one utility partner – Cedar Falls Utilities (CFU). The team members have proven track record of successful academic-industry collaboration in interdisciplinary R&D projects, and bring onboard some of the best state-of-the-art testbed resources, industry-grade SCADA/EMS/DMS environment for experimentation and field demonstration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

GaAsP/Si Tandem Solar Cells: Pathway to Low-Cost, High-Efficiency Photovoltaics

Si is the dominant PV technology, now and for the foreseeable future, due to its extensive manufacturing infrastructure, supply chain, feedstock availability, and highly optimized degree of fabrication processes, which altogether has produced an economic scenario where PV electricity generation is often cheaper than conventional fossil based generation. In many places, the overarching goal of grid parity has been achieved, but further improvement in performance-cost metrics are still needed to sustain the continued LCOE reductions needed to not only compete with conventional generation, but displace it on a global scale; a matter of critical importance if we stand any hope of slowing climate change. Nevertheless, single-junction Si PV is already nearing its physical limit, both in performance and cost, and is thus cannot meet these long-term goals alone. To this end, we are working on the development of monolithic III-V/Si tandem solar cells, which improve upon the performance of pure Si by providing enhanced utilization (reduced thermalization) of high-energy photons. This architecture nominally combines the substantial existing knowledge base, manufacturing infrastructure, and low cost of Si PV with the high efficiencies afforded by the well-established multijunction approach — the only proven way to break the single-junction limit. Although the metal-halide perovskite/Si tandem architecture has garnered substantial attention in recent years, serious questions regarding reliability and service lifetime remain, whereas III-V PV has a proven track record, including in the harsh concentrator and space environments. Additionally, there are multiple fabrication approaches to producing III-V/Si tandem cells, but we are focused on monolithic epitaxial integration as it is the most likely to yield the lowest ultimate LCOE in a fully mature, scaled technology. In this work we have produced multiple generations of GaAsP/Si tandem solar cells, demonstrating a more than 10% absolute AM1.5G efficiency improvement within the time frame of the project, including two verified world records. We have done this using industry-standard fabrication methods, showing that this platform can ultimately be manufactured at scale using existing or only slightly upgraded Si and III-V tooling. Our scientific and engineering advances across a range of fundamental and applied areas – III-V/Si heteroepitaxial integration, defect control in metamorphic III-V epitaxy, fundamental materials-oriented solar cell design and modeling methodology, and more – have created clear pathways for continued advances toward the goal of >30% AM1.5G cell efficiency (and >25% module) and will serve to inform the broader research community for well beyond this immediate application. Techno-economic modeling indicates that our approach can indeed meet SunShot/SETO LCOE targets, but as with any “post-Si” technology there are difficult, but not insurmountable barriers, requiring continued focused research and development efforts.

14 SOLAR ENERGY↗

Climate Change and the Environmental Imperative

To mitigate the consequences of climate change, global economies need to rapidly decarbonize by upgrading their energy infrastructure to carbon-free technologies. Nuclear energy has a proven track record on the electric grid and large potential to contribute to sectors beyond just power.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Hydrogen Generation and Industrial Heat Opportunities for Nuclear Plants in the Gulf Coast

The United States (U.S.) nuclear-generation fleet stands as a critical national strategic asset, playing a pivotal role in achieving climate goals. Operating on light-water reactor (LWR) technologies, this fleet provides the largest share of U.S. carbon-free electrical generation, ensuring 24/7 clean-energy stability. With a proven track record of reliability while operating at high-capacity factors, consistently above 90%, the existing nuclear fleet serves as a cornerstone for sustainable energy. The Department of Energy’s (DOE’s) Light Water Reactor Sustainability (LWRS), Flexible Plant Operations and Generation pathway addresses U.S. nuclear power plant (NPP) grid integration challenges in the face of evolving energy landscapes. Research at Idaho National Laboratory (INL) highlights the potential synergy between high-temperature steam-electrolysis (HTSE) technology and nuclear steam and electricity during periods of high renewable grid penetration. Large-scale nuclear-integrated hydrogen production through HTSE presents significant potential for decarbonizing such energy-intensive sectors as oil refining, petrochemicals, ammonia, and fertilizers. The strategic advantage lies in the nuclear sector’s capability to deliver clean electrical and/or steam output during periods of low demand. Nuclear-produced hydrogen—with its ability to provide high-purity clean H 2 well below the national standard of 1 kg of CO 2 per kg of H 2 —represents a breakthrough methodology. This emphasizes the crucial role NPPs can fill in addressing the increasing need for clean hydrogen, establishing them as essential contributors to decarbonization. This report specifically delves into hydrogen-generation opportunities from the U.S. Gulf Coast region. This study aims to assess NPP capabilities for hydrogen production and to identify practical nearby industrial and pipeline-operator off-takers for nuclear-integrated hydrogen production as well as to present some specific case-study analysis showing the conditions under which nuclear hydrogen production and sale can be profitable. Also considered in this report is preliminary analysis of nuclear-heat opportunities accessible near Waterford NPP via transportation of hypothetical steam pipelines and heat-exchange equipment.

08 HYDROGEN↗

Creep Degradation of Austenitic Steels in CO2 Environments

Steels have a proven track record of safe operation in steam power plants for decades. Interest in developing supercritical CO2 power cycles as a more efficient and sustainable alternative to steam cycles has driven a need to understand steel performance in these new environments. In particular, the potential of the high temperature CO2 environment to influence the creep behavior of the steel must be determined. Prior research on this topic between the 1960s and 1980s found conflicting conclusions, but nevertheless raised the possibility that carburization during CO2 exposure may strongly affect the creep behavior. This raises concerns particularly for thin-sectioned components such as compact heat exchangers, where even small rates of carburization can become problematic over long operating lifetimes. To shed light on this issue, this research investigates the creep behavior of austenitic stainless steel 347H and 309H (a higher Cr alternative) at 650°C. Specimens of 0.5, 1.0, and 2.0 mm thickness were tested to further assess the effect of steel thickness. Both steels show a reduction in creep life in CO2 relative to air, with 309H showing slightly better performance than 374H. Analysis is ongoing to determine the reason for degraded creep properties.

Rozman, Kyle A.↗