SEARCH · Search NASA

Results for “computational workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Integrating and Characterizing HPC Task Runtime Systems for hybrid AI-HPC workloads

Scientific workflows increasingly involve both HPC and machine-learning tasks, combining MPI-based simulations, training, and inference in a single execution. Launchers such as Slurm’s srun constrain concurrency and throughput, making them unsuitable for dynamic and heterogeneous workloads. We present a performance study of RADICAL-Pilot (RP) integrated with Flux and Dragon, two complementary runtime systems that enable hierarchical resource management and high-throughput function execution. Using synthetic and production-scale workloads on Frontier, we characterize the task execution properties of RP across runtime configurations. RP+Flux sustains up to 930 tasks/s, and RP+Flux+Dragon exceeds 1,500 tasks/s with over 99.6% utilization. In contrast, srun peaks at 152 tasks/s and degrades with scale, with utilization below 50%. For IMPECCABLE.v2 drug discovery campaign, RP+Flux reduces makespan by 30–60% relative to srun/Slurm and increases throughput more than four times on up to 1,024. These results demonstrate hybrid runtime integration in RP as a scalable approach for hybrid AI-HPC workloads.

HPC-AI↗

DOE OSTI2021

Insights into scale translation of methane transport in nanopores

Accurate prediction of flow behavior in shale matrix is critical for efficient development of shale gas reservoirs. In these systems, the majority of pores are in the nano-size range. As a result, continuum-based approaches may not be appropriate to simulate flow in such systems. Molecular dynamics (MD) simulations are capable of capturing the relevant microscale physics. Their relatively high computational expense, however, restricts MD simulations to rather small systems and domains. This limitation creates a gap between computational need of macroscale systems and capabilities of MD simulations. The lattice Boltzmann method (LBM) is a suitable candidate to bridge this gap. In this work, the multiple-relaxation-time (MRT)-LBM is used to study methane transport in nano-size pores. Adsorption effects near solid boundaries, as well as non-ideal behavior of fluids, are accounted for via incorporating appropriate force terms in LBM. In this work, parameters associated with the force terms in the equation of state are studied in detail, and a workflow is proposed to determine optimal values of these parameters for gas flow in slit pores. Specifically, we establish these parameters such that the range of density values that the model is able to simulate is maximized. We demonstrate this workflow by simulating gas flow where velocity and density profiles from MD simulations are used as reference data. Results from LBM simulations are in good agreement with MD reference data for pores that are 4 nm in width or larger. Moreover, we propose a preconditioning scheme to improve the stability of LBM in dealing with complex geometries. The robustness of this scheme is demonstrated by simulating several roughness geometries. This work motivates the use of LBM in scale translation of the physics of mass transport in more complex permeable media.

03 NATURAL GAS↗

DOE OSTI2023

pyGWBSE: a high throughput workflow package for GW-BSE calculations

Abstract We develop an open-source python workflow package, py GWBSE to perform automated first-principles calculations within the GW-BSE (Bethe-Salpeter) framework. GW-BSE is a many body perturbation theory based approach to explore the quasiparticle (QP) and excitonic properties of materials. GW approximation accurately predicts bandgaps of materials by overcoming the bandgap underestimation issue of the more widely used density functional theory (DFT). BSE formalism produces absorption spectra directly comparable with experimental observations. py GWBSE package achieves complete automation of the entire multi-step GW-BSE computation, including the convergence tests of several parameters that are crucial for the accuracy of these calculations. py GWBSE is integrated with Wannier90 , to generate QP bandstructures, interpolated using the maximally-localized wannier functions. py GWBSE also enables the automated creation of databases of metadata and data, including QP and excitonic properties, which can be extremely useful for future material discovery studies in the field of ultra-wide bandgap semiconductors, electronics, photovoltaics, and photocatalysis.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Market optimization and technoeconomic analysis of hydrogen-electricity coproduction systems

Decarbonization efforts across North America, Europe, and beyond rely on variable renewable energy sources such as wind and solar, as well as alternative fuels, such as hydrogen, to support the sustainable energy transition. These advancements have prompted a need for more flexibility in the electric grid to complement non-dispatchable energy sources and increased demand from electrification. Integrated energy systems are well suited to provide this flexibility, but conventional technoeconomic modeling paradigms neglect the time-varying dynamic nature of the grid and thus undervalue resource flexibility. In this work, we develop a computational optimization framework for dynamic market-based technoeconomic comparison of integrated energy systems that coproduce low-carbon electricity and hydrogen (e.g., solid oxide fuel cells, solid oxide electrolysis) against technologies that only produce electricity (e.g., natural gas combined cycle with carbon capture) or only produce hydrogen. Our framework starts with rigorous physics-based process models, built in the open-source Institute for the Design of Advanced Energy Systems (IDAES) modeling and optimization platform, for six energy process concepts. Using these rigorous models and a workflow to optimally design each technology, the framework is shown to be capable of evaluating new and emerging technologies in varying energy markets under a plethora of future scenarios (i.e., renewables penetration, carbon tax, etc.). Ultimately, our framework finds that solid oxide fuel cell-based coproduction systems achieve positive profits for 85% of the analyzed market scenarios. From these market optimization results, we use multivariate linear regression (R 2 values up to 0.99) to determine which electricity price statistics are most significant to predict the optimized annual profit of each system. The proposed framework provides a powerful tool for directly comparing flexible, multi-product energy process concepts to help discern optimal technology and integration options.

08 HYDROGEN↗

DOE OSTI2023

Not just for programmers: How GitHub can accelerate collaborative and reproducible research in ecology and evolution

Abstract Researchers in ecology and evolutionary biology are increasingly dependent on computational code to conduct research. Hence, the use of efficient methods to share, reproduce, and collaborate on code as well as document research is fundamental. GitHub is an online, cloud‐based service that can help researchers track, organize, discuss, share, and collaborate on software and other materials related to research production, including data, code for analyses, and protocols. Despite these benefits, the use of GitHub in ecology and evolution is not widespread. To help researchers in ecology and evolution adopt useful features from GitHub to improve their research workflows, we review 12 practical ways to use the platform. We outline features ranging from low to high technical difficulty, including storing code, managing projects, coding collaboratively, conducting peer review, writing a manuscript, and using automated and continuous integration to streamline analyses. Given that members of a research team may have different technical skills and responsibilities, we describe how the optimal use of GitHub features may vary among members of a research collaboration. As more ecologists and evolutionary biologists establish their workflows using GitHub, the field can continue to push the boundaries of collaborative, transparent, and open research.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2023

Status of Multiphysics Modeling of Critical DPCs in a Geological Repository

A summary of previous work focused on the first two scenarios is presented as an established workflow. These canisters could reach an equilibrium at a low quasi–steady-state power level that could be sustained for thousands of years. The majority of this report describes an effort to expand the initial methodology to include the scenario in which a DPC has enough excess reactivity to boil the water inside the canister. This scenario involves a variety of tools and modeling approaches to capture the two-phase behavior, including RELAP5-3D, STAR-CCM+, and TRACE. Efforts using the high-fidelity computational fluid dynamics results to verify the accuracy of RELAP5-3D and TRACE for boiling DPCs are also presented. A new modeling strategy using TRACE appears to be the most promising approach for expanding the analysis of critical DPCs beyond the subcooled scenarios. Finally, this report describes ongoing work investigating the fourth scenario, in which a critical DPC is sealed in saturated bentonite. The primary goal in this research is to understand the power output and associated pressure increase to inform geomechanics simulations that could predict the impact on a geological repository.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2016

WavePropaGator : interactive framework for X-ray free-electron laser optics design and simulations

This article describes the WavePropaGator (WPG) package, a new interactive software framework for coherent and partially coherent X-ray wavefront propagation simulations. The package has been developed at European XFEL for users at the existing and emerging free-electron laser (FEL) facilities, as well as at the third-generation synchrotron sources and future diffraction-limited storage rings. The WPG addresses the needs of beamline scientists and user groups to facilitate the design, optimization and improvement of X-ray optics to meet their experimental requirements. The package uses the Synchrotron Radiation Workshop (SRW) C/C++ library and its Python binding for numerical wavefront propagation simulations. The framework runs reliably under Linux, Microsoft Windows 7 and Apple Mac OS X and is distributed under an open-source license. The available tools allow for varying source parameters and optics layouts and visualizing the results interactively. The wavefront history structure can be used for tracking changes in every particular wavefront during propagation. The batch propagation mode enables processing of multiple wavefronts in workflow mode. The paper presents a general description of the package and gives some recent application examples, including modeling of full X-ray FEL beamlines and start-to-end simulation of experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Frequent Fulcrum Functions: The Basics of SCALE’s Graphical User Interface [Slides]

This tutorial introduces the Fulcrum graphical user interface and the basic functions that enhance the common activities of creating, editing, navigating, executing, and visualizing SCALE input files. This tutorial will help you become familiar with the Fulcrum input file text editor and the integrated input development environment features of autocompletion, automatic checking, cursor context, and input navigation. In addition, the Fulcrum and SCALE runtime environment will be reviewed to improve the understanding of job execution workflow. This tutorial does not cover data and geometry plotting. Please see the Advanced User Interface Capabilities tutorial for details regarding plotting data and geometry. No prior experience with SCALE is required. You can follow along using SCALE 6.2 or 6.3-beta.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2015

Validation of an in-vivo proton beam range check method in an anthropomorphic pelvic phantom using dose measurements

Purpose: In-vivo dosimetry and beam range verification in proton therapy could play significant role in proton treatment validation and improvements. In-vivo beam range verification, in particular, could enable new treatment techniques one of which could be the use of anterior fields for prostate treatment instead of opposed lateral fields as in current practice. This paper reports validation study of an in-vivo range verification method which can reduce the range uncertainty to submillimeter levels and potentially allow for in-vivo dosimetry. Methods: An anthropomorphic pelvic phantom is used to validate the clinical potential of the time-resolved dose method for range verification in the case of prostrate treatment using range modulated anterior proton beams. The method uses a 3 × 4 matrix of 1 mm diodes mounted in water balloon which are read by an ADC system at 100 kHz. The method is first validated against beam range measurements by dose extinction measurements. The validation is first completed in water phantom and then in pelvic phantom for both open field and treatment field configurations. Later, the beam range results are compared with the water equivalent path length (WEPL) values computed from the treatment planning system XIO. Results: Beam range measurements from both time-resolved dose method and the dose extinction method agree with submillimeter precision in water phantom. For the pelvic phantom, when discarding two of the diodes that show sign of significant range mixing, the two methods agree with ±1 mm. Only a dose of 7 mGy is sufficient to achieve this result. The comparison to the computed WEPL by the treatment planning system (XIO) shows that XIO underestimates the protons beam range. Quantifying the exact XIO range underestimation depends on the strategy used to evaluate the WEPL results. To our best evaluation, XIO underestimates the treatment beam range between a minimum of 1.7% and maximum of 4.1%. Conclusions: Time-resolved dose measurement method satisfies the two basic requirements, WEPL accuracy and minimum dose, necessary for clinical use, thus, its potential for in-vivo protons range verification. Further development is needed, namely, devising a workflow that takes into account the limits imposed by proton range mixing and the susceptibility of the comparison of measured and expected WEPLs to errors on the detector positions. The methods may also be used for in-vivo dosimetry and could benefit various proton therapy treatments.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Assessment of Process Modeling Tools for Determining Variability in Additively Manufactured Parts

The Advanced Materials and Manufacturing Technologies (AMMT) program aims to accelerate the development, qualification, demonstration, and deployment of advanced materials and manufacturing technologies to enable reliable and economical nuclear energy However, the unique aspects of additive manufacturing (AM) materials in terms of their processing history, microstructure, and properties, are a major barrier for qualification and certification of nuclear components. Much of this challenge may be attributed to component scale variations in microstructure and properties that are driven by local influences of process conditions and geometry on thermal history, melt pool dynamics, and corresponding microstructure evolution. Computational modeling tools may be helpful in this regard to aid in predicting and controlling this level of variability. The purpose of this report is to review the current state-of-the-art for process modeling with regards to metal AM. For this purpose, we consider specifically the case study of laser powder bed fusion (LPBF) processing of SS316, a family of alloys that are both commonly used in nuclear energy applications and suitable for AM processing. The report first introduces the necessary components of a process modeling workflow, followed by a review of the current status of each. At the end, application of these modeling tools to understanding variability in AM process given their current state are considered, and recommendations for future development are proposed

36 MATERIALS SCIENCE↗

DOE OSTI2019

Automating Anharmonic Lattice Thermal Conductivity Calculations using Compressed Sensing Lattice Dynamics [Poster]

Engineering heat transfer is critical for applications in heat exchangers, semiconductor devices, thermoelectrics and more. This demand motivates a high-throughput computational methodology for systematically designing materials with improved thermal properties. One emerging method which can rapidly and explicitly consider phonon-phonon interactions even for highly anharmonic materials is Compressive Sensing Lattice Dynamics (CSLD). In fact, CSLD accurately predicts 2nd (harmonic) and 3rd+ order (anharmonic) interatomic force constants (IFCs) with orders of magnitude fewer Density Functional Theory (DFT) calculations than conventional methods. However, doing CSLD can be an exhaustive, many-step process requiring an intimate knowledge of its sensitivity to parameters. Consequently, this work implements an automatic CSLD workflow capable of obtaining the thermal conductivity of potentially thousands of materials, benchmarks the stability of the workflow against materials with a range of anharmonicity, and begins constructing a dataset of thermal conductivity values and phonon dispersion curves to be stored in the Materials Project for public use.

Chang, Rees↗

DOE OSTI2015

Cloud services for the Fermilab scientific stakeholders

As part of the Fermilab/KISTI cooperative research project, Fermilab has successfully run an experimental simulation workflow at scale on a federation of Amazon Web Services (AWS), FermiCloud, and local FermiGrid resources. We used the CernVM-FS (CVMFS) file system to deliver the application software. We established Squid caching servers in AWS as well, using the Shoal system to let each individual virtual machine find the closest squid server. We also developed an automatic virtual machine conversion system so that we could transition virtual machines made on FermiCloud to Amazon Web Services. We used this system to successfully run a cosmic ray simulation of the NOvA detector at Fermilab, making use of both AWS spot pricing and network bandwidth discounts to minimize the cost. On FermiCloud we also were able to run the workflow at the scale of 1000 virtual machines, using a private network routable inside of Fermilab. As a result, we present in detail the technological improvements that were used to make this work a reality.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2017

MarpoDB: An open registry for Marchantia polymorpha genetic parts

Marchantia polymorpha is an extant relative of the earliest terrestrial plants and has attracted a substantial interest as a model organism for evolutionary and developmental studies. Given its relatively simple genome, compact gene families, simple morphology, ease of propagation and transformation, M. polymorpha is becoming a promising platform for plant synthetic biology. Modular genetic parts have been essential for development of synthetic biology approaches, so we sought to design an engineering oriented database for M. polymorpha genetic parts where each gene is a standalone functional unit. MarpoDB is a database of M. polymorpha genes and genetic parts, which is tailored to become an integral tool for a synthetic biology workflow. Among its features are precompiled cross-database querying to InterPro, Pfam signatures and non-redundant Viridiplantae BLAST annotations; BLAST querying to M. polymorpha genes; sequence export in GenBank format; recoding of sequences to the common syntax for type IIS assembly and exchange of DNA parts; and a minimalistic, intuitive and interactive user interface for gene models and sequence exploration. Furthermore, we have implemented user input to encourage feedback, collaboration and exchange between the MarpoDB community. MarpoDB source-code is released on GitHub to promote development of computational tools for synthetic biology.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗

DOE OSTI2016

SU-F-T-252: An Investigation of Gamma Knife Frame Definition Error When Using a Pre-Planning Workflow

Purpose: To determine causal factors related to high frame definition error when treating GK patients using a pre-planning workflow. Methods: 160 cases were retrospectively reviewed. All patients received treatment using a pre-planning workflow whereby stereotactic coordinates are determined from a CT scan acquired after framing using a fiducial box. The planning software automatically detects the fiducials and compares their location to expected values based on the rigid design of the fiducial system. Any difference is reported as mean and maximum frame definition error. The manufacturer recommends these values be less than 1.0 mm and 1.5 mm. In this study, frame definition error was analyzed in comparison with a variety of factors including which neurosurgeon/oncologist/physicist was involved with the procedure, number of post used during framing (3 or 4), type of lesion, and which CT scanner was utilized for acquisition. An analysis of variance (ANOVA) approach was used to statistically evaluate the data and determine causal factors related to instances of high frame definition error. Results: Two factors were identified as significant: number of post (p=0.0003) and CT scanner (p=0.0001). Further analysis showed that one of the four scanners was significantly different than the others. This diagnostic scanner was identified as an older model with localization lasers not tightly calibrated. The average value for maximum frame definition error using this scanner was 1.48 mm (4 posts) and 1.75 mm (3 posts). For the other scanners this value was 1.13 mm (4 posts) and 1.40 mm (3 posts). Conclusion: In utilizing a pre-planning workflow the choice of CT scanner matters. Any scanner utilized for GK should undergo routine QA at a level appropriate for radiation oncology. In terms of 3 vs 4 post, it is hypothesized that three posts provide less stability during CT acquisition. This will be tested in future work.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2026

Operational Evolution of FTS3: A DevOps Driven Approach to Elastic Operations

The File Transfer Service (FTS3) is a distributed data movement service developed at CERN and widely used to transfer data across the Worldwide LHC Computing Grid (WLCG). At Fermilab, FTS3 supports data transfers for multiple experiments, including Intensity Frontier experiments such as DUNE, enabling reliable data movement between WebDAV endpoints in Europe and the Americas. At CHEP 2021, we reported on the initial containerized deployment of FTS3 on OKD, the community Kubernetes distribution of Red Hat OpenShift. In this work, we present the subsequent evolution of this deployment, focusing on new operational capabilities introduced to improve scalability, robustness, and long-term maintainability. We describe the adoption of more secure and reproducible container build workflows, the integration of DevOps-driven operational practices, and enhancements in monitoring and automation. A key new result is the introduction of horizontal scaling and elastic resource management, allowing FTS3 components to dynamically adapt to workload variations while maintaining service reliability. We also discuss improvements in fault tolerance and operational procedures derived from production experience. Finally, we summarize lessons learned from operating FTS3 as a Kubernetes-native service and outline how these developments have improved the resilience and efficiency of data movement operations at Fermilab.

Munoz Flores, Victor Leopoldo [Fermilab]↗

DOE OSTI2024

Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

Ensemble-based simulation and learning (ESnL) has long been used in hydrology for parameter inference, but computational demands of process-based ESnL can be quite high. To address this issue, we propose a deep neural operator learning approach. Neural operators are generic machine learning algorithms that can learn functional mappings between infinite-dimensional spaces, providing a highly flexible tool for scientific machine learning. Our approach is built upon DeepONet, a specific deep neural operator, and is designed to address several common problems in hydrology, namely, model parameter estimation, prediction at ungaged locations, and uncertainty quantification. Here we demonstrate the effectiveness of our DeepONet-based workflow using an existing large model ensemble created for an eastern U.S. watershed that is instrumented with 10 streamflow gages. Results suggest DeepONet achieves high efficiency in learning an ML surrogate model from the model ensemble, with the modified Kling-Gupta Efficiency exceeding 0.9 on holdout test sets. Parameter inference, carried out using the trained DeepONet surrogate model and genetic algorithm, also yields robust results. Additionally, we formulate and train a separate DeepONet model for physics-informed, seq-to-seq streamflow forecasting, which further reduces biases in the pre-trained DeepONet surrogate model. While this study focuses primarily on a single watershed, our approach is general and may be extended to enable learning from model ensembles across multiple basins or models. Thus, this research represents a significant contribution to the application of hybrid machine learning in hydrology.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Acceleration of Power System Dynamic Simulations Using a Deep Equilibrium Layer and Neural ODE Surrogate

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based resources exacerbates the computational burden of running time domain simulations. Here, in this paper, we propose a data-driven surrogate model based on implicit machine learningspecifically deep equilibrium layers and neural ordinary differential equationsto learn a reduced order model of a portion of the full underlying system. The data-driven surrogate achieves similar accuracy and reduction in simulation time compared to a physics-based surrogate, without the constraint of requiring detailed knowledge of the underlying dynamic models. This work also establishes key requirements needed to integrate the surrogate into existing simulation workflows; the proposed surrogate is initialized to a steady state operating point that matches the power flow solution by design.

Neural ordinary differential equations↗