Search NASA⌕ Search

SEARCH · Search NASA

Results for “Workflow Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Modeling-Driven Damage Tolerant Design of Graphene Nanoplatelet/Carbon Fiber/Epoxy Hybrid Composite Panels for Full-Scale Aerospace Structures

The objective of this study is to design a new nano graphenecarbon fiberpolymer hybrid composite that can be used for the NASA SLS Composite Exploration Upper Stage (CEUS) forward skirt structure. The new material will improve the resistance to open-hole compression failure of the structure relative to traditional polymer fiber composites. The material is designed rapidly and with little cost using the Integrated Computational Materials Engineering (ICME) approach. Multiscale modeling and experiments are used to synergistically optimize the material design to yield improved properties and performance by controlling key processing parameters for manufacturing nano-enhanced materials. Specifically, the nanocomposite panel showed a 22 reduction in mass relative to the traditional composite panel, while both designs are equal in terms of ease of manufacture. This potential mass savings corresponds to an estimated 45 savings in materials and manufacturing costs. The multiscale ICME workflow developed for this project can be readily applied to the development of nano-enhanced composite materials and large aerospace structures. In addition, all key aspects of ICME were employed to complete this project including multiscale modeling, experimental characterization and visualization, data management, visualization, error and uncertainty quantification, and education. The results presented herein indicate a dramatic level of success, as well as the power and potential of ICME approach and multiscale modeling for composite materials.

computational mechanics↗

DataSpaces: An Interaction and Coordination Framework for Coupled Simulation Workflows

Emerging high-performance distributed computing environments are enabling new end-to-end formulations in science and engineering that involve multiple interacting processes and data-intensive application workflows. For example, current fusion simulation efforts are exploring coupled models and codes that simultaneously simulate separate application processes, such as the core and the edge turbulence, and run on different high performance computing resources. These components need to interact, at runtime, with each other and with services for data monitoring, data analysis and visualization, and data archiving. As a result, they require efficient support for dynamic and flexible couplings and interactions, which remains a challenge. This paper presents Data-Spaces, a flexible interaction and coordination substrate that addresses this challenge. DataSpaces essentially implements a semantically specialized virtual shared space abstraction that can be associatively accessed by all components and services in the application workflow. It enables live data to be extracted from running simulation components, indexes this data online, and then allows it to be monitored, queried and accessed by other components and services via the space using semantically meaningful operators. The underlying data transport is asynchronous, low-overhead and largely memory-to-memory. The design, implementation, and experimental evaluation of DataSpaces using a coupled fusion simulation workflow is presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Netload Range Cost Curves for Coordinated Transmission-Distribution Planning Under DER Growth Uncertainty

The increasing penetration of distributed energy resources (DERs) requires better coordination between transmission and distribution (T&D) planning to ensure system security and cost efficiency. However, misaligned planning horizons, computational burdens, and privacy concerns hinder effective coordination, leading to either underutilized resources caused by overinvestments or reliability risks due to underinvestment. To address this challenge, we introduce netload range cost curves (NRCCs), a novel approach for managing long-term DER growth uncertainty through T&D coordination, while preserving existing data-sharing and regulatory structures. NRCCs provide pairs of (i) peak substation netload guarantees and (ii) corresponding distribution upgrade options and costs, enabling their seamless integration into transmission planning workflows. To compute NRCCs efficiently, we develop a transmission-aware distribution network planning (TADNP), which is subsequently integrated to an iterative computation procedure. These NRCCs are then embedded into an NRCC-informed transmission planning model to enable resource-efficient coordination. We illustrate our proposed approach with a case study based on realistic distribution and transmission systems in the San Francisco Bay Area, California. Our results indicate the possibility of dramatic savings in transmission investments by incorporating the proposed NRCC-integrated T&D coordination framework.

Li, Yujia↗

Spatialyze: A Geospatial Video Analytics System with Spatial-Aware Optimizations

Videos that are shot using commodity hardware such as phones and surveillance cameras record various metadata such as time and location. We encounter suchgeospatial videoson a daily basis and such videos have been growing in volume significantly. Yet, we do not have data management systems that allow users to interact with such data effectively. In this paper, we describe Spatialyze, a new framework for end-to-end querying of geospatial videos. Spatialyze comes with a domain-specific language where users can construct geospatial video analytic workflows using a 3-step, declarative,build-filter-observeparadigm. Internally, Spatialyze leverages the declarative nature of such workflows, the temporal-spatial metadata stored with videos, and physical behavior of real-world objects to optimize the execution of workflows. Our results using real-world videos and workflows show that Spatialyze can reduce execution time by up to 5.3×, while maintaining up to 97.1% accuracy compared to unoptimized execution.

Computer Science↗

Model data for infrastructure-aware simulation of compound flooding at Alligator Bayou Watershed, southeast Texas

This dataset supports infrastructure-aware hydrologic modeling and flood scenario analysis for the Alligator Bayou Watershed, a highly managed urban watershed in Southeast Texas. It includes Jupyter notebooks for figure reproduction, model configuration files, simulation outputs, and derived products used to quantify the influence of engineered stormwater infrastructure on flood behavior across multiple spatial scales. The dataset was generated using the Watershed Workflow Python package and the Advanced Terrestrial Simulator (ATS), enabling integrated surface–subsurface hydrologic simulations on a channel-aligned mesh with explicit representations of pump stations, gate structures, detention basins, and impervious surfaces. Outputs include time series of gate and pump flows, stage observations, and water balance components, as well as spatially explicit fields of peak ponded depth and flood duration across multiple infrastructure scenarios spanning a single-location detention basin expansion, distributed drainage limitations, and compound coastal flooding. These data facilitate full reproducibility of the manuscript figures and support further research on urban flood dynamics and the role of stormwater infrastructure in shaping watershed-scale flood response.

EARTH SCIENCE > OCEANS > COASTAL PROCESSES↗

Risk-Significant Adverse Condition Awareness Strengthens Assurance of Fault Management Systems

As spaceflight systems increase in complexity, Fault Management (FM) systems are ranked high in risk-based assessment of software criticality, emphasizing the importance of establishing highly competent domain expertise to provide assurance. Adverse conditions (ACs) and specific vulnerabilities encountered by safety- and mission-critical software systems have been identified through efforts to reduce the risk posture of software-intensive NASA missions. Acknowledgement of potential off-nominal conditions and analysis to determine software system resiliency are important aspects of hazard analysis and FM. A key component of assuring FM is an assessment of how well software addresses susceptibility to failure through consideration of ACs. Focus on significant risk predicted through experienced analysis conducted at the NASA Independent Verification Validation (IVV) Program enables the scoping of effective assurance strategies with regard to overall asset protection of complex spaceflight as well as ground systems. Research efforts sponsored by NASA's Office of Safety and Mission Assurance defined terminology, categorized data fields, and designed a baseline repository that centralizes and compiles a comprehensive listing of ACs and correlated data relevant across many NASA missions. This prototype tool helps projects improve analysis by tracking ACs and allowing queries based on project, mission type, domaincomponent, causal fault, and other key characteristics. Vulnerability in off-nominal situations, architectural design weaknesses, and unexpected or undesirable system behaviors in reaction to faults are curtailed with the awareness of ACs and risk-significant scenarios modeled for analysts through this database. Integration within the Enterprise Architecture at NASA IVV enables interfacing with other tools and datasets, technical support, and accessibility across the Agency. This paper discusses the development of an improved workflow process utilizing this database for adaptive, risk-informed FM assurance that critical software systems will safely and securely protect against faults and respond to ACs in order to achieve successful missions.

Fault management↗

Transportation Hub Infrastructure Expansion: Decision Support Under Uncertainty

The Athena project (www.athena-mobility.org) has worked to investigate the relationship between the Dallas-Fort Worth Airport (DFW) and the greater Dallas area in order to better understand and therefore better inform future decision-making regarding the critical infrastructure that influence mobility between the airport and the city. Through this work, infrastructure related to curbside pickup and drop-off, parking, public transit, and the road network congestion were identified as critical to the operation of the DFW transportation hub. The infrastructure analysis and expansion aspect of the Athena project is focused on the restructuring of the CTA curb as a hierarchical curb and the building or repurposing of parking infrastructure as the interplay between these two areas. Many sources of uncertainty exist that may impact future airport and transportation hub operations, such as passenger volume growth, population demographic changes over time, electric vehicle (EV) adoption rates, and autonomous vehicle (AV) adoption rates. Due to these sources of uncertainty, we have selected for our research a modeling framework that can capture various types of uncertainty and hedge against those uncertainties in the optimization process. We analyze road network and curb congestion, the rise of transportation networking companies, trends in parking usage, existing policies around this infrastructure, airport revenue streams, and other contributing factors to enable infrastructure decision making with less uncertainty. To accomplish this wholistic analysis, we have developed a novel multi-stage, multi-period stochastic optimization model which considers the airport's decisions from 2025-2045 under different possible future macro trajectories and day-to-day variations in operational conditions captured as "annual representation of operations" scenarios with respective probabilities. This model has also been designed to leverage the outputs of various efforts under the Athena project to create a combined decision framework for infrastructure decisions. These various efforts include the route optimization model, the ASPIRES simulation, the mode choice model, and the SUMO traffic simulation. Our computational experiments of this system at scale have resulted in a working version of our infrastructure model which enables the explicit representation and consideration of various sources of uncertainty in the decision process to enable robust, flexible decision-making. This model has been effectively run on NREL's HPC system, Eagle, with large numbers of stochastic scenarios and shows promise as a scalable tool for robust consideration of uncertainties in airport planning. We have tested our model using 30,240 operational circumstances in total, resulting in a problem with more 200 million variables. This model was solved in several different configurations, and a workflow to simulate the performance of the infrastructure model results was developed and deployed. In general, our results indicate that a combination of remote parking, remote curb infrastructure, and dynamic pricing can generate revenue, reduce emissions, accommodate emerging technologies such as AVs and EVs, and manage airport passenger growth over time. We note the success of the proposed strategy depends on the data collection and forecasting abilities of DFW. We have also seen that the AV adoption by TNCs might necessitate larger amounts of remote curb. The results of this work inform strategies for airport infrastructure decision making, as well as demonstrate the value of an adaptable model, but also indicate that there are avenues remaining where further research would be of value.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Integrated Life Cycle and Techno-Economic Assessments of Central Appalachian Legacy Mine Sites for Biomass Development and Waste Coal Utilization

This project, funded by the U.S. Department of Energy – National Energy Technology Laboratory (DOE-NETL) under award DE-FE0032212, evaluated how legacy coal mine lands and coal refuse piles in Central Appalachia (West Virginia and Pennsylvania) can be reclaimed and repurposed to support biomass development and beneficial utilization of waste coal, with the long-term goal of supporting net-zero or net-negative greenhouse gas (GHG) pathways. The project had two primary objectives: 1. Characterize legacy mine sites (including site conditions, waste coal/refuse resources, and soil/ecosystem indicators) and develop reclamation and best management practices (BMPs) for biomass cultivation; and 2. Conduct integrated machine learning (ML)-assisted life cycle assessment (LCA) and techno-economic analysis (TEA) to quantify environmental and economic outcomes for multiple biomass and waste-coal utilization pathways. Across West Virginia, the team identified ~625 coal refuse sites covering ~19,705 acres, and developed methods to estimate refuse pile volume using digital elevation models (DEMs) and geospatial workflows. A large subset of sites received volume estimates totaling ~1.6 billion m³.

01 COAL, LIGNITE, AND PEAT↗

Systems Innovation: Modernization & Efficiencies for ESH&Q Reviews

Environmental compliance reviews at INL have traditionally been managed through fragmented systems, relying on multiple spreadsheets and manual processes. This inefficiency led to time-consuming status updates and redundant tasks, such as manually sending reminder emails and transferring data from Excel to the Environmental Review Process (ERP). Initial attempts to streamline these processes using Power Automate and Excel revealed significant limitations, necessitating a more comprehensive solution. To address these immediate inefficiencies, automated workflows were developed using Power Automate. These workflows were designed to send scheduled status update reminders and capture responses through standardized forms, with submitted data flowing directly into centralized Excel trackers. This automation reduced the administrative burden, improved data accuracy, and enabled faster, more consistent reporting. Specifically, email automation achieved a 65% efficiency gain, while data integration saw a 48% improvement, resulting in 91% of project statuses being updated within two months. Despite the improvements brought by Power Automate, the fragmented nature of the review processes persisted. To further enhance efficiency and accuracy, the Integrated Review Tool (IRT) was developed. The IRT aims to centralize review initiation and connect team systems, creating an interconnected data infrastructure that preserves team autonomy while enhancing overall efficiency. This tool automates email reminders, centralizes reviews, and streamlines data integration, significantly improving the accuracy and efficiency of environmental compliance reviews. The design and development of the IRT involved advanced systems methodology, process mapping, project management, and collaboration with subject matter experts. The minimum viable product design is 100% complete, and system development is currently underway, with expected outcomes including a centralized entry point for all ESH&Q reviews, automated routing, real-time tracking and analytics, AI integration, and a user-friendly interface. This project demonstrates the potential of leveraging automation and integrated systems to enhance efficiency, accuracy, and decision-making in environmental reporting and compliance processes at INL.

99 - GENERAL AND MISCELLANEOUS↗

JGI Archive and Metadata Organizer (JAMO) v2.0.0

JAMO (JGI Archive and Metadata Organizer) helps researchers keep large collections of scientific files organized, findable, and safe. It lets you submit files with consistent, template-driven metadata, bundle related files into sets, and track them as a group instead of one by one. As data ages, JAMO automatically moves it from fast disk to cost-saving tape and can bring it back when needed, keeping storage lean without losing access. A simple web/CLI workflow supports submitting, checking status, retrying, and updating metadata. Compared with generic storage, JAMO's strengths are: clear, searchable metadata tuned for science; set-level organization that mirrors real projects; and built-in lifecycle care (archive, purge, restore) so you don't have to manage those steps yourself.

Cassol, Daniela [Lawrence Berkeley National Labora↗

AToM (Advanced Tokamak Modeling)

This final report for the AToM project documents the contributions from General Atomics over the period 1 September 2014 to 31 August 2017. This includes significant progress on the development of tokamak integrated modeling frameworks (OMFIT and IPS), and development of new workflows for computing plasma profile (temperature, density, etc) evolution. Significant effort was also carried out in the high-performance computing arena, by adding the COGENT edge-simulation code to the AToM portfolio, and performing optimization of the CGYRO plasma turbulence code. Issues of data management and user outreach are also documented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Development of Intelligent Monitoring System (IMS) Modules for the Aquistore CO 2 Storage Project

The monitoring data generated at a CO 2 storage site can quickly result in large amounts of data, often requiring significant labor- and time-intensive efforts to process and analyze before being able to make operational decisions. Implementing an intelligent monitoring system (IMS) can reduce the associated data-processing and analysis costs, which can thereby improve the efficiency of the monitoring process and enable real-time operational decision-making. The Energy & Environmental Research Center (EERC) has completed a 3-year project focused on developing an IMS comprising new workflows, algorithms, and a user interface for the automation and integration of geologic carbon dioxide (CO 2 ) storage site-monitoring and simulation data. The design for the IMS was based on using injection and monitoring data acquired from Aquistore, an operating CO 2 storage project. Managed by the Petroleum Technology Research Centre, the Aquistore Project is injecting CO 2 captured from SaskPower’s coal-fired Boundary Dam Power Station into a deep saline formation for geologic storage. Using data from the Aquistore Project provided a real-world basis to develop an IMS.

47 OTHER INSTRUMENTATION↗

High Energy Physics Network Requirements Review: Final Report, July 2024–December 2024

The world-class research infrastructure at the US Department of Energy (DOE) Office of Science (SC) provides the research community with premier observational, experimental, computational, and network capabilities. Each user facility is designed to provide unique capabilities to advance the core DOE mission in science and technology for its SC program to stimulate rich scientific discoveries and enhance its innovation ecosystem. Research communities gather and flourish around each user facility, bringing together new and enhanced perspectives. The continual reinvention of the practice of science — as users and staff forge novel approaches expressed in research workflows — unlocks new discoveries and propels scientific progress. Within this research ecosystem, the high-performance computing (HPC) and networking user facilities stewarded by the SC’s Advanced Scientific Computing Research (ASCR) program play a dynamic cross-cutting role, enabling complex workflows demanding high-performance data, networking, and computing solutions. The ASCR facilities enterprise seeks to understand and meet the needs and requirements across SC and DOE domain science programs and priority efforts, highlighted by the formal requirements review methodology. Between July and December 2024, the Energy Sciences Network (ESnet) and the Office of High Energy Physics (HEP) of the DOE-SC organized an ESnet requirements review of HEP-supported program activities. Preparation for these events included identification of key stakeholders: program and facility management, research groups, and technology providers. Each stakeholder group was asked to prepare formal case study documents about its relationship to the HEP program to build a complete understanding of the current, near-term, and long-term status, expectations, and processes that will support the science going forward.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A high-performance workflow system for subsurface simulation

Subsurface modeling applications typically neglect uncertainty in the conceptual models, past or future scenarios, and attribute most or all uncertainty to errors in model parameters. In this contribution, uncertainty in technetium-99 transport in a heterogeneous, deep vadose zone is explored with respect to the conceptual model using a next generation user environment called Akuna. Akuna provides a range of tools to manage environmental modeling projects, from managing simulation data to visualizing results from high-performance computational simulators. Core toolsets accessible through the user interface include model setup, grid generation, parameter estimation, and uncertainty quantification. The BC Cribs site at Hanford in southeastern Washington State is used to demonstrate Akuna capabilities. At the BC Cribs site, conceptualization of the system is highly uncertain because only sparse information is available for the geologic conceptual model, the physical and chemical properties of the sediments, and the history of waste disposal operations. Using the Akuna toolset to perform an analysis of conservative solute transport, significant prediction uncertainty in simulated concentrations is demonstrated by conceptual model variation. This demonstrates that conceptual model uncertainty is an important consideration in sparse data environments such as BC Cribs. It is also demonstrated that Akuna and the underlying toolset provides an integrated modeling environment that streamlines model setup, parameter optimization, and uncertainty analyses for high-performance computing applications.

Akuna↗

Modelling the Effects of Wetland Restoration on Coastal Hydrology: A Case Study of Elkhorn Slough Watershed, California

ABSTRACT Coastal wetlands, some of the most productive ecosystems on Earth, provide critical ecosystem services, including support of biodiversity, carbon sequestration and flood protection. In recent decades, these ecosystems have experienced extensive coastal wetland loss. Coastal wetland restoration provides a beacon of hope, offering a chance to reclaim these important habitats. However, even with billions of dollars invested worldwide in restoring coastal wetlands, we still lack comprehensive knowledge about the effectiveness of these restoration efforts in recovering wetland ecosystem functions and how future climate change may affect these efforts. The ability to evaluate how these ecosystems will function in the future is vital for examining current investments and developing future protection and management plans. We selected Elkhorn Slough, a tidal estuary, in California, to investigate the impact of wetland restoration and sea level rise (SLR) on coastal hydrology using the process‐based coastal hydrologic model, Advanced Terrestrial Simulator (ATS), informed by site‐specific data. We designed a novel modelling workflow for incorporating wetland restoration features into land cover and soil properties for the model parameterization. The validation results demonstrate a strong agreement between modelled and observed data. We studied the characteristics of coastal watershed hydrology, then focused on the surface water dynamics at two wetland sites within Elkhorn Slough, a reference site and a restored site. Our simulation results indicate that the restored site successfully maintains surface elevation, resulting in reduced surface inundation. We also examined the impact of wetland restoration under expected SLR over the next few decades. The low‐lying Yampah Marsh, the reference site, is likely to be inundated due to future SLR when highest tides arrive, while a higher percentage of Hester Marsh, the restored site, would retain marsh vegetation in coming decades, regardless of tidal conditions. Our study provides important information for examining the outcome of restoration practices that include surface elevation in tidal wetlands under climate changes.

advanced terrestrial simulator↗

Curifactory

Curifactory is a library and CLI tool designed to help organize and manage research experiments in Python. Experiment management requires several aspects, including experiment orchestration, parameterization, caching, reproducibility, reporting, and parallelization. Existing projects such as MLFlow, MetaFlow, Luigi, and Pachyderm support these aspects in several different ways and to various degrees. Curifactory provides a different opinion to these, with a heavier focus on supporting general research experiment workflows for individuals or small teams working primarily in Python.

Martindale, Nathan [Oak Ridge National Lab. (ORNL)↗

Report for Task 15: Developed Tool Verification/Validation Report (Deliverable D11): AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency

This report summarizes the verification report for the developed modules. The team conducted verification in two phases. In phase 1, the modules were validated using offline validation methods and in phase 2 the modules were subjected to real-time validation. This report outlines the approach and the results for the modules under offline and real-time settings. The rest of the report details the functional workflow of AGGREGATE modules, we then transition to offline validation followed by real-time validation of modules. We conclude the report by discussing some of the key points of this report.

14 SOLAR ENERGY↗

Hybrid learning techniques for scientific data reduction with performance guarantees

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING↗