Search NASA⌕ Search

SEARCH · Search NASA

Results for “Workflow Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Enforcing End-to-end I/O Policies for Scientific Workflows using Software-Defined Storage Resource Enclaves

Data-intensive knowledge discovery requires scientific applications to run concurrently with analytics and visualization codes executing in situ for timely output inspection and knowledge extraction. Consequently, I/O pipelines of scientific workflows can be long and complex because they comprise many stages of analytics across different layers of the I/O stack of high-performance computing systems. Performance limitations at any I/O layer or stage can cause an I/O bottleneck resulting in greater than expected end-to-end I/O latency. In this paper, we present the design and implementation of a novel data management infrastructure called Software-Defined Storage Resource Enclaves (SIREN) at system level to enforce end-to-end policies that dictate an I/O pipeline's performance. SIREN provides an I/O performance interface for users to specify the desired storage resources in the context of in-situ analytics. If suboptimal performance of analytics is caused by an I/O bottleneck when data are transferred between simulations and analytics, schedulers in different layers of the I/O stack automatically provide the guaranteed lower bounds on I/O throughput. Lastly, our experimental results demonstrate that SIREN provides performance isolation among scientific workflows sharing multiple storage servers across two I/O layers (burst buffer and parallel file systems) while maintaining high system scalability and resource utilization.

97 MATHEMATICS AND COMPUTING↗

MURMoT: Design and Application of Microbial Uranium Reduction Monitoring Tools

The overarching project goal of the MURMoT project was the design of tools to elucidate the presence, abundance, dynamics, spatial distribution, and activity of metal- and radionuclide-transforming bacteria. To accomplish these objectives, an integrated approach that combined nucleic acid-based tools, proteomic workflows, uranium isotope measurements, and U(IV) speciation and structure analyses using the Advanced Photon Source (APS) at Argonne National Laboratory was developed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data Intensive Scientific Workflows on a Federated Cloud: CRADA Final Report

The Fermilab Scientific Computing Division and the KISTI Global Science Experimental Data Hub Center have built a prototypical large-scale infrastructure to handle scientific workflows of stakeholders to run on multiple cloud resources. The demonstrations have been in the areas of (a) Data-Intensive Scientific Workflows on Federated Clouds, (b) Interoperability and Federation of Cloud Resources, and (c) Virtual Infrastructure Automation to enable On-Demand Services.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

HPC-FAIR: A Framework Managing Data and AI Models for Analyzing and Optimizing Scientific Applications

The increasing reliance on machine learning (ML) to analyze and optimize large-scale scientific applications on supercomputers faces a significant bottleneck: the lack of readily available, high-quality training datasets and the difficulty in reusing existing AI models. This project was motivated by the urgent need to address the “FAIR” principles (Findability, Accessibility, Interoperability, Reusability) for both training datasets and AI models in the high-performance computing (HPC) domain. The project developed HPC-FAIR, a high-performance computing data management framework designed to centralize HPC-related datasets and AI models within a unified hub. To ensure interoperability, the framework established a standardized representation and vocabulary (ontology) for both data and models. HPC-FAIR also implemented automated workflows to streamline data processing, model access, and benchmarking. Additionally, the project focused on optimizing data harnessing efficiency through advanced techniques like deep reuse and compression-based analytics.

97 MATHEMATICS AND COMPUTING↗

PARETO UI 1.1.0 Release

PARETO is an open-source Python-based software package for oilfield produced water management and beneficiary reuse optimization. PARETO supports produced water industry by providing cost-effective water management solutions. This version introduced an updated User Interface (UI) which makes it easier to navigate and understand the solution for industry users. New Features: - Map files are added for visualization - Added output export function button - Water residual view added - Workflow was streamlined - File extension was expanded - Minor bugfix

AS↗

Sensor Webs with a Service-Oriented Architecture for On-demand Science Products

This paper describes the work being managed by the NASA Goddard Space Flight Center (GSFC) Information System Division (ISD) under a NASA Earth Science Technology Ofice (ESTO) Advanced Information System Technology (AIST) grant to develop a modular sensor web architecture which enables discovery of sensors and workflows that can create customized science via a high-level service-oriented architecture based on Open Geospatial Consortium (OGC) Sensor Web Enablement (SWE) web service standards. These capabilities serve as a prototype to a user-centric architecture for Global Earth Observing System of Systems (GEOSS). This work builds and extends previous sensor web efforts conducted at NASA/GSFC using the Earth Observing 1 (EO-1) satellite and other low-earth orbiting satellites.

Mandl, Daniel↗

Quantifying Water Storage Change and Land Subsidence Induced by Reservoir Impoundment Using GRACE, Landsat, and GPS Data

The construction of hydropower dams is a common strategy to support a country's increasing need for electricityand river water management for industry and agriculture. Although the hydrological and geophysical impacts ofwater relocation are usually assessed prior to impoundment, their accuracy is generally limited due to the lack ofin situ observations, especially in a remote area. This study presents a workflow to quantify the terrestrial waterstorage change (TWS) and land subsidence induced by a reservoir's water impoundment using multiple satelliteobservations (GRACE, Landsat), land surface models (CABLE, GLDAS, NCEP, ECMWF), and GPS data. The studysite is the Bakun Dam, located in Sarawak, Malaysia, which is the largest hydropower dam in Southeast Asia.Commencing operation in late 2010, the dam induced a change of water mass and lake surface area that wasclearly observed by GRACE and Landsat observations, respectively. During the 17-month impounding period(from August 2010 to December 2011), GRACE observed a dramatic increase of approximately 200mmequivalent water height, while Landsat detected an increased lake extent of around 600 km2. In this paper, aforward model is developed to determine the increased water surface level corresponding to GRACE observations,estimated to be about 120 m. In contrast to GRACE, the TWS derived from land surface models cannotcapture the increased TWS, due to the lack of reservoir routing algorithms in the models. In addition, the landsubsidence was calculated using the disk load model constructed based on the GRACE-derived lake level andLandsat-derived lake extent; the result is validated with the GPS data from BIN1 station, located at the westerncoast of Borneo. The commencement stage of the Bakun Dam induces the large-scale land subsidence, whichcauses the GPS-BIN1 station to subside by ~9 mm, and move toward the Bakun Lake by ~4 mm. Computation ofthe surface displacements directly from GRACE spherical harmonic coefficient data fails to capture the subsidencefeature, mainly due to the truncation error. Overall, this study demonstrates that evaluating GRACE inconjunction with Landsat, LSMs, and GPS data allows the exploitation of the gravity signal at a much smallerspatial scale than its intrinsic resolution. Benefiting from global coverage, the newly developed satellite-basedalgorithm is a valuable tool for assessing the impacts of reservoir operation on hydrological and geophysicalchanges from local to regional scales.

Tangdamrongsub, Natthachet↗

FAIR for AI: An interdisciplinary and international community building perspective

A foundational set of findable, accessible, interoperable, and reusable (FAIR) principles were proposed in 2016 as prerequisites for proper data management and stewardship, with the goal of enabling the reusability of scholarly data. The principles were also meant to apply to other digital assets, at a high level, and over time, the FAIR guiding principles have been re-interpreted or extended to include the software, tools, algorithms, and workflows that produce data. FAIR principles are now being adapted in the context of AI models and datasets. Here, we present the perspectives, vision, and experiences of researchers from different countries, disciplines, and backgrounds who are leading the definition and adoption of FAIR principles in their communities of practice, and discuss outcomes that may result from pursuing and incentivizing FAIR AI research. The material for this report builds on the FAIR for AI Workshop held at Argonne National Laboratory on June 7, 2022.

97 MATHEMATICS AND COMPUTING↗

Sighten Final Technical Report DEEE0006690 Deploying an integrated and comprehensive solar financing software platform

Over the project, Sighten built a comprehensive software-as-a-service (Saas) platform to automate and streamline the residential solar financing workflow. Before the project period, significant time and money was spent by companies on front-end tools related to system design and proposal creation, but comparatively few resources were available to support the many back-end calculations and data management processes that underpin third party financing. Without a tool like Sighten, the solar financing processes involved passing information from the homeowner prospect into separate tools for system design, financing, and then later to reporting tools including Microsoft Excel, CRM software, in-house software, outside software, and offline, manual processes. Passing data between tools and attempting to connect disparate systems results in inefficiency and inaccuracy for the industry. Sighten was built to consolidate all financial and solar-related calculations in a single software platform. It significantly improves upon the accuracy of these calculations and exposes sophisticated new analysis tools resulting in a rigorous, efficient and cost-effective toolset for scaling residential solar. Widely deploying a platform like Sighten’s significantly and immediately impacts the residential solar space in several important ways: 1) standardizing and improving the quality of all quantitative calculations involved in the residential financing process, most notably project finance, system production and reporting calculations; 2) representing a true step change in terms of reporting and analysis capabilities by maintaining more accurate data and exposing sophisticated tools around simulation, tranching, and financial reporting, among others, to all stakeholders in the space; 3) allowing a broader group of developers/installers/finance companies to access the capital markets by providing an out-of-the-box toolset that handles the execution of running investor capital through a rooftop solar financing program. Standardizing and improving all calculations, improving data quality, and exposing new analysis tools previously unavailable affects investment in the residential space in several important ways: 1) lowering the cost of capital for existing capital providers by mitigating uncertainty and de-risking the solar asset class; 2) attracting new, lower cost investors to the solar asset class as reporting and data quality resemble standards of more mature asset classes; 3) increasing the prevalence of liquidity options for investors through back leverage, securitization, or secondary sale by providing the tools necessary for lenders, ratings agencies, etc. to properly understand a portfolio of residential solar assets. During the project period, Sighten successfully built and scaled a commercially ready tool for the residential solar market. The software solution built by Sighten has been deployed with key target customer segments identified in the award deliverables: solar installers, solar developers/channel managers, and solar financiers, including lenders. Each of these segments greatly benefits from the availability of the Sighten toolset.

14 SOLAR ENERGY↗

White Paper: Scalable Digital Twin Capabilities for Aging and Surveillance of Engineered Systems

This white paper presents a multi-year initiative to develop practical, secure, and scalable digital twin capabilities for engineered systems in aging and surveillance contexts—an approach pioneered at the National Nuclear Security Administration (NNSA) Lawrence Livermore National Laboratory (LLNL) that maps directly onto the needs and ambitions of the Navy for ship- and fleet-level digital twins. LLNL’s work in building part- and process-level digital twins for advanced manufacturing, with a vision to scale up to entire factory floors and, ultimately, enterprise-wide digital twins, offers an adaptable pathway for the Navy as it seeks to modernize lifecycle management, readiness, and predictive maintenance across ships and fleets. For our application, we integrate physics-based modeling with automated data ingestion, processing, and AI-driven calibration, creating hybrid models that are both interpretable and data responsive. We modernized legacy workflows, established centralized data infrastructure, automated experimental pipelines, and demonstrated end-to-end coupling of accelerated aging data with finite element simulations via optimization and surrogate modeling. The result is a generalizable framework that supports part-level digital twins today and lays the groundwork for future system-level twins suitable for Navy applications.

36 MATERIALS SCIENCE↗

Carbon Utilization and Storage Partnership of the Western United States

This technical report documents research conducted under DOE Award No. DE-FE0031837 focused on evaluating the feasibility of carbon capture, utilization, and storage (CCUS) systems in the central and western United States. The project integrated geologic characterization, reservoir simulation, infrastructure modeling, and economic analysis to assess CO₂ storage potential near industrial sources and develop strategies for transport and sequestration. The work included subsurface modeling, risk assessment, monitoring and verification (MRV) planning, and evaluation of regulatory pathways such as EPA Underground Injection Control (UIC) Class VI permitting and IRS 45Q tax credit eligibility. Results demonstrate the viability of multiple storage approaches, including saline formations, enhanced coalbed methane recovery, and basalt mineralization, supported by data-driven workflows and regional analyses. The project also produced permitting templates, technology transfer activities, and stakeholder engagement efforts to support deployment readiness. These findings contribute to the development of scalable, economically viable CCUS systems and provide a repeatable framework for future carbon management projects.

20 FOSSIL-FUELED POWER PLANTS↗

A portable application framework for energy management and information systems (EMIS) solutions using Brick semantic schema

This paper introduces a portable framework for developing, scaling and maintaining energy management and information systems (EMIS) applications using an ontology-based approach. Key contributions include an interoperable layer based on Brick schema, the formalization of application constraints pertaining metadata and data requirements, and a field demonstration. The framework allows for querying metadata models, fetching data, preprocessing, and analyzing data, thereby offering a modular and flexible workflow for application development. Its effectiveness is demonstrated through a case study involving the development and implementation of a data-driven anomaly detection tool for the photovoltaic systems installed at the Politecnico di Torino, Italy. During eight months of testing, the framework was used to tackle practical challenges including: (i) developing a machine learning-based anomaly detection pipeline, (ii) replacing data-driven models during operation, (iii) optimizing model deployment and retraining, (iv) handling critical changes in variable naming conventions and sensor availability (v) extending the pipeline from one system to additional ones.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

PyHydroGeophysX: An extensible open-source platform for integrating hydrological models with geophysical measurements

Hydrological models and geophysical measurements are widely used tools for understanding subsurface hydrological processes relevant to water resource management, yet they typically remain disconnected due to technical barriers. We present PyHydroGeophysX, an open-source Python platform bridging this gap by providing standardized interfaces between hydrological modeling software (MODFLOW, ParFlow) and geophysical simulation tools (PyGIMLi, SimPEG). The platform implements bidirectional workflows: translating hydrological outputs into simulated geophysical responses through petrophysical models, and extracting hydrological information from geophysical inversions. Key features include bidirectional workflow modules, configurable petrophysical models, time-lapse inversion with temporal regularization, parallel computing, and mesh utilities for property transfer between geophysical and hydrological grids. The modular architecture of PyHydroGeophysX enables researchers to incorporate additional models and methods, fostering broader adoption of integrated hydrogeophysical approaches. The software is freely available on GitHub and is intended for researchers and practitioners working at the intersection of hydrology and geophysics.

Hydrogeophysics↗

Comprehensive MRI simulation methodology using a dedicated MRI scanner in radiation oncology for external beam radiation treatment planning

Purpose: The use of magnetic resonance imaging (MRI) in radiation oncology is expanding rapidly, and more clinics are integrating MRI into their radiation therapy workflows. However, radiation therapy presents a new set of challenges and places additional constraints on MRI compared to diagnostic radiology that, if not properly addressed, can undermine the advantages MRI offers for radiation treatment planning (RTP). The authors introduce here strategies to manage several challenges of using MRI for virtual simulation in external beam RTP. Methods: A total of 810 clinical MRI simulation exams were performed using a dedicated MRI scanner for external beam RTP of brain, breast, cervix, head and neck, liver, pancreas, prostate, and sarcoma cancers. Patients were imaged in treatment position using MRI-optimal immobilization devices. Radiofrequency (RF) coil configurations and scan protocols were optimized based on RTP constraints. Off-resonance and gradient nonlinearity-induced geometric distortions were minimized or corrected prior to using images for RTP. A multidisciplinary MRI simulation guide, along with window width and level presets, was created to standardize use of MR images during RTP. A quality assurance program was implemented to maintain accuracy and repeatability of MRI simulation exams. Results: The combination of a large bore scanner, high field strength, and circumferentially wrapped, flexible phased array RF receive coils permitted acquisition of thin slice images with high contrast-to-noise ratio (CNR) and image intensity uniformity, while simultaneously accommodating patient setup and immobilization devices. Postprocessing corrections and alternative acquisition methods were required to reduce or correct off-resonance and gradient nonlinearity induced geometric distortions. Conclusions: The methodology described herein contains practical strategies the authors have implemented through lessons learned performing clinical MRI simulation exams. In their experience, these strategies provide robust, high fidelity, high contrast MR images suitable for external beam RTP.

60 APPLIED LIFE SCIENCES↗

Preliminary Assessment of Tecplot Chorus for Analyzing Ensemble of CTH Simulations

The exploration of large parameter spaces in search of problem solution and uncertainty quantifcation produces very large ensembles of data. Processing ensemble data will continue to require more resources as simulation complexity and HPC platform throughput increase. More tools are needed to help provide rapid insight into these data sets to decrease manual processing time by the analyst and to increase knowledge the data can provide. One such tool is Tecplot Chorus, whose strengths are visualizing ensemble metadata and linked images. This report contains the analysis and conclusions from evaluating Tecplot Chorus with an example problem that is relevant to Sandia National Laboratories. This report documents a preliminary evaluation of Tecplot Chorus for analyzing ensemble data from CTH simulations. The project that funded this report and evaluation is also evaluating and guiding development with SNL’s Slycat. Slycat and Tecplot Chorus each have their strengths, weaknesses, and overlapping capabilities. It is quite likely that, as the scale of ensemble data increases, both of these tools (and possibly others) will be needed for different processing goals. This report will focus on Tecplot Chorus and its application to an example ensemble of data supplied by David J. Peterson and John P. Korbin; this example is of a flyer plate impact and weld study henceforth referred to as CTH Impact Example. This evaluation also defines a workflow for analysts that can help reduce the time and resources for processing ensemble data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Quantifying Water Storage Change and Land Subsidence Induced by Reservoir Impoundment Using GRACE, Landsat, and GPS Data

The construction of hydropower dams is a common strategy to support a country's increasing need for electricity and river water management for industry and agriculture. Although the hydrological and geophysical impacts of water relocation are usually assessed prior to impoundment, their accuracy is generally limited due to the lack of in situ observations, especially in a remote area. This study presents a workflow to quantify the terrestrial water storage change (TWS) and land subsidence induced by a reservoir's water impoundment using multiple satellite observations (GRACE, Landsat), land surface models (CABLE, GLDAS, NCEP, ECMWF), and GPS data. The study site is the Bakun Dam, located in Sarawak, Malaysia, which is the largest hydropower dam in Southeast Asia. Commencing operation in late 2010, the dam induced a change of water mass and lake surface area that was clearly observed by GRACE and Landsat observations, respectively. During the 17-month impounding period (from August 2010 to December 2011), GRACE observed a dramatic increase of approximately 200 mm equivalent water height, while Landsat detected an increased lake extent of around 600 km2. In this paper, a forward model is developed to determine the increased water surface level corresponding to GRACE observations, estimated to be about 120 m. In contrast to GRACE, the TWS derived from land surface models cannot capture the increased TWS, due to the lack of reservoir routing algorithms in the models. In addition, the land subsidence was calculated using the disk load model constructed based on the GRACE-derived lake level and Landsat-derived lake extent; the result is validated with the GPS data from BIN1 station, located at the western coast of Borneo. The commencement stage of the Bakun Dam induces the large-scale land subsidence, which causes the GPS-BIN1 station to subside by ~9 mm, and move toward the Bakun Lake by ~4 mm. Computation of the surface displacements directly from GRACE spherical harmonic coefficient data fails to capture the subsidence feature, mainly due to the truncation error. Overall, this study demonstrates that evaluating GRACE in conjunction with Landsat, LSMs, and GPS data allows the exploitation of the gravity signal at a much smaller spatial scale than its intrinsic resolution. Benefiting from global coverage, the newly developed satellite-based algorithm is a valuable tool for assessing the impacts of reservoir operation on hydrological and geophysical changes from local to regional scales.

Natthachet Tangdamrongsub↗

Illinois Storage Corridor CarbonSAFE Phase III: Stakeholder Engagement and Outreach Plan

The Stakeholder Engagement and Outreach Plan provides a comprehensive framework for engaging stakeholders of the Illinois Storage Corridor (ISC) project. The ISC project is a CarbonSAFE Phase III project designed to facilitate commercial deployment of carbon capture, utilization, and storage (CCUS) in Illinois. The project aims to establish a multi-industry carbon storage corridor through development of storage sites near the One Earth Energy (OEE) ethanol production facility in north-central Illinois and the Prairie State Generating Company (PSGC) coal-fired power plant in south-central Illinois, with combined annual CO 2 capture ultimately exceeding 8.6 million tons per year. Stakeholder engagement is recognized as a critical component for successful CCUS deployment, alongside technical and economic considerations. As an emerging technology, CCUS may not be well understood by the general population, and lack of public awareness can lead to opposition that poses significant barriers to project development. This plan addresses this challenge through systematic stakeholder identification, analysis, planning, and implementation of engagement actions. The plan is structured around four main sections: Communication, Stakeholder Analysis, Stakeholder Engagement, and Environmental Justice. Activities will be conducted under Tasks 1 and 4 of the project's Statement of Project Objectives, with two key subtasks: (1) developing a stakeholder analysis and engagement plan through face-to-face meetings, facilitated discussions, and surveys; and (2) implementing stakeholder engagement and public outreach activities including meetings, open houses, and permit hearings. The Illinois State Geological Survey (ISGS) will manage engagement activities following DOE-NETL best practices, focusing on providing objective, fact-based information about CCUS and the ISC project. A comprehensive Communication Plan establishes protocols for media contacts, site visits, and crisis communications. The stakeholder analysis follows a structured workflow process divided into Pre-feasibility and Feasibility phases, incorporating contextual understanding, assessment, data collection, and analysis. Key stakeholder groups include government bodies, educational organizations, conservation and environmental groups, agricultural communities, and religious organizations. The plan addresses common stakeholder questions regarding project risks, benefits, safety, property values, liability, and environmental impacts. Recommendations emphasize developing clear messaging, creating informational materials, and preparing to address both project-specific and broader environmental concerns to ensure transparent communication and build stakeholder support throughout project implementation.

25 ENERGY STORAGE↗