Search NASA⌕ Search

SEARCH · Search NASA

Results for “SPACE TOOL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Design of Novel Hot Gas Component for Gas Turbine Engines Enabled by Materials and Additive Manufacturing Process Development

This CRADA project was the result of a project award under FOA-DOE-0001980. The overarching FOA project team consisted of researchers from Carpenter Technology Corporation (CTC), Solar Turbines Incorporated (Solar), Pennsylvania State University (PSU), University of California-Santa Barbara (UCSB), and Oak Ridge National Laboratory (ORNL). Evaluations were conducted on two high-γ’ superalloys that were designed by CTC and the UCSB. One alloy named GammaPrint-700 (GP-700) is a cobalt-base superalloy. The other alloy named GammaPrint-1100 (GP-1100) is a nickel-base (Ni-base) superalloy. PSU provided expertise and experimental testing of the thermal performance of AM micro-cooling architectures. ORNL provided expertise with the AM superalloy materials characterization and AM processing science. Solar provided turbine component design expertise. The focus of this CRADA report is to document the efforts between ORNL and CTC towards the development of superalloys designed for AM. The project goal was to use an AM processable high-temperature superalloy and design for Additive Manufacturing (DfAM) techniques to design an efficient turbine component (i.e. a turbine tip shoe) with enhanced cooling features that can only be fabricated through additive manufacturing (AM). The efficiencies of existing combined heat and power (CHP) engines are capped by both component design and materials limitations. However, AM of a tip shoe component from a γ’strengthened superalloy offers the design flexibility to increase the efficiency and power of an industrial gas turbine. This project brought about advancements in the DfAM tip shoe design space and in the area of high temperature superalloys processable through laser powder bed fusion (LPBF) AM. State of art computation design tools were utilized to optimize unique cooling features into a tip shoe component design. A two-prong materials development approach was taken to support development of the AM tip shoe geometry. The first approach centered on investigating the processability and the appropriate process science for the industry standard high-γ’ nickel-base (Ni-base) superalloy Mar-M247. This superalloy is typically cast and considered non-weldable by traditional welding standards. In the course of this work, the alloy was not deemed feasible for process scale-up due to significant cracking issues during printing. The second approach focused on the development and evaluation of a novel cobalt-base superalloy, GammaPrint™-700 (GP-700 and a Ni-base superalloy, GammaPrint™-1100 (GP-1100) designed to mitigate the significant AM processing issues with Mar-M247. The processability of these two alloys were investigated through electron beam melting (EBM) binder-jet AM (BJAM), and LPBF as a risk mitigation for manufacturability. To be considered a candidate material for down-selection to proceed to full-scale AM tip shoe engine testing trials, the high temperature creep rupture strength was required to achieve at a minimum, a Larsen Miller Parameter (LMP) increase of 10.9% over the baseline material LPBF AM Hastelloy X.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Design of Novel Hot Gas Component for Gas Turbine Engines Enabled by Materials and Additive Manufacturing Process Development

This CRADA project was the result of a project award under FOA-DOE-0001980. The overarching FOA project team consisted of researchers from Carpenter Technology Corporation (CTC), Solar Turbines Incorporated (Solar), Pennsylvania State University (PSU), University of California-Santa Barbara (UCSB), and Oak Ridge National Laboratory (ORNL). Evaluations were conducted on two high-γ’ superalloys that were designed by CTC and the UCSB. One alloy named GammaPrint-700 (GP-700) is a cobalt-base superalloy. The other alloy named GammaPrint-1100 (GP-1100) is a nickel-base (Ni-base) superalloy. PSU provided expertise and experimental testing of the thermal performance of AM micro-cooling architectures. ORNL provided expertise with the AM superalloy materials characterization and AM processing science. Solar provided turbine component design expertise. The focus of this CRADA report is to document the efforts between ORNL and CTC towards the development of superalloys designed for AM. The project goal was to use an AM processable high-temperature superalloy and design for Additive Manufacturing (DfAM) techniques to design an efficient turbine component (i.e. a turbine tip shoe) with enhanced cooling features that can only be fabricated through additive manufacturing (AM). The efficiencies of existing combined heat and power (CHP) engines are capped by both component design and materials limitations. However, AM of a tip shoe component from a γ’strengthened superalloy offers the design flexibility to increase the efficiency and power of an industrial gas turbine. This project brought about advancements in the DfAM tip shoe design space and in the area of high temperature superalloys processable through laser powder bed fusion (LPBF) AM. State of art computation design tools were utilized to optimize unique cooling features into a tip shoe component design. A two-prong materials development approach was taken to support development of the AM tip shoe geometry. The first approach centered on investigating the processability and the appropriate process science for the industry standard high-γ’ nickel-base (Ni-base) superalloy Mar-M247. This superalloy is typically cast and considered non-weldable by traditional welding standards. In the course of this work, the alloy was not deemed feasible for process scale-up due to significant cracking issues during printing. The second approach focused on the development and evaluation of a novel cobalt-base superalloy, GammaPrint™-700 (GP-700 and a Ni-base superalloy, GammaPrint™-1100 (GP-1100) designed to mitigate the significant AM processing issues with Mar-M247. The processability of these two alloys were investigated through electron beam melting (EBM) binder-jet AM (BJAM), and LPBF as a risk mitigation for manufacturability. To be considered a candidate material for down-selection to proceed to fullscale AM tip shoe engine testing trials, the high temperature creep rupture strength was required to achieve at a minimum, a Larsen Miller Parameter (LMP) increase of 10.9% over the baseline material LPBF AM Hastelloy X.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Comprehensive Framework for Assessing Terrestrial Analogue Field Sites for Ocean Worlds

Field studies at terrestrial analogue sites represent an important contribution to the science of ocean worlds. The value of the science and technology investigations conducted at field analogue sites depends on the relevance of the analogue environment to the target ocean world. We accept that there are no perfect analogues for many of the unique environments represented by ocean worlds but suggest that a one‐to‐one matching of environmental characteristics and conditions is not crucial to the success or impact of the work. Instead, we must determine which processes and parameters are required to map directly to the target ocean world environment with high fidelity to address the science question. In this review paper, we discuss the outcomes of a workshop aimed at developing a new framework for evaluating the suitability of analogue field locations for ocean worlds research. Here we present a two‐step approach to (a) identify the most crucial processes and parameters associated with a given science question and (b) assess the fidelity of these processes and parameters at a proposed field site to those expected for the target ocean world. We demonstrate this approach in a test case evaluating three types of ocean world analogue environments with respect to a science question. The consensus document presented here equips veteran and new investigators with valuable tools to better assess and justify their analogue site selections.

58 GEOSCIENCES↗
DOE OSTI2024

Advance Local Mobility Through Energy Efficient Mobility Systems Technologies

Everyone deserves reliable, affordable, and safe transportation to connect people to jobs, healthcare, education, and recreation. Our transportation systems are interconnected, multimodal networks working together to move people and goods. These systems are dynamic and are being reshaped by factors such as population trends, new technologies, shifting labor models, economic forces, and changing climate. Energy efficient mobility systems (EEMS) technologies can help transportation planners ensure changes in our transportation systems are equitable and sustainable by improving energy efficiency, travel time, and affordability, as well as overall access to mobility. Transportation planners and decision makers can use the following EEMS tools and strategies to advance local mobility.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Design of Ionization Profile Monitors at the Integrable Optics Test Accelerator Facility at Fermilab

The Integrable Optics Test Accelerator (IOTA) at Fermilab is transitioning from an electron beam facility to a proton beam facility for studies in nonlinear accelerator optics and space-charge dominated proton beams. This project involves the commissioning and fabrication of Ionization Profile Monitors (IPMs) to enable beam profile measurements at IOTA. In general, IPMs work on principle of residual gas ionization by the beam to generate beam profile. This work focuses on a mechanical design that leverages a controlled injection of noble gases, primarily Argon, as the ultra-high vacuum of the IOTA ring provides insufficient residual gas for ionization. Efforts to understand vacuum integration to ensure compatibility with the storage ring environment, the integration of real-time data acquisition systems and the commissioning of the IPMs will be discussed. This project provides a versatile diagnostic tool, supporting IOTA’s role as a testbed for larger-scale accelerator facilities and contributing to the broader understanding of beam physics in high-intensity, high-space-charge regimes.

Mwaniki, M. W. [IIT, Chicago] (ORCID:0000000169057↗
DOE OSTI2024

Photometric redshifts probability density estimation from recurrent neural networks in the DECam local volume exploration survey data release 2

Photometric wide-field surveys are imaging the sky in unprecedented detail. These surveys face a significant challenge in efficiently estimating galactic photometric redshifts while accurately quantifying associated uncertainties. In this work, we address this challenge by exploring the estimation of Probability Density Functions (PDFs) for the photometric redshifts of galaxies across a vast area of 17,000 square degrees, encompassing objects with a median 5 σ point-source depth of g = 24.3, r = 23 . 9 , i = 23.5, and z = 22.8 mag. Our approach uses deep learning, specifically integrating a Recurrent Neural Network architecture with a Mixture Density Network, to leverage magnitudes and colors as input features for constructing photometric redshift PDFs across the whole DECam Local Volume Exploration (DELVE) survey sky footprint. Subsequently, we rigorously evaluate the reliability and robustness of our estimation methodology, gauging its performance against other well-established machine learning methods to ensure the quality of our redshift estimations. Our best results constrain photometric redshifts with the bias of − 0 . 0013 , a scatter of 0.0293, and an outlier fraction of 5.1%. These point estimates are accompanied by well-calibrated PDFs evaluated using diagnostic tools such as Probability Integral Transform and Odds distribution. We also address the problem of the accessibility of PDFs in terms of disk space storage and the time demand required to generate their corresponding parameters.We present a novel Autoencoder model that reduces the size of PDF parameter arrays to one-sixth of their original length, significantly decreasing the time required for PDF generation to one-eighth of the time needed when generating PDFs directly from the magnitudes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Analysis of fast-ion losses measured in MAST-U via infrared thermography and a Fast Ion Loss Detector

Fast-ion losses need to be monitored to avoid damage to plasma facing components. In existing experimental devices, the scintillator-based fast-ion loss detector (FILD) is the most advanced diagnostic for measuring fast-ion losses. However, FILDs provide only local information about the losses. Infrared (IR) thermography can be used as a complementary tool for more global monitoring of the deposition of fast-ion losses on the wall, at the expense of no velocity-space resolution. IR cameras measure the temperature of the plasma facing components. This measurement, determined by a combined effect of the thermal plasma, radiation, neutrons and fast-ion losses, can be decomposed to infer the fast-ion load on the tokamak wall. In this manuscript, a workflow to estimate fast-ion losses via IR thermography is applied to the MAST-U spherical tokamak, using a 1D approximation to extract the experimental heat flux on the FILD front face from IR data. To numerically estimate the different contributions to this total heat flux, the field-line tracing environment SMITER is used to calculate the thermal plasma contribution, the orbit-following Monte-Carlo code ASCOT to estimate the fast-ion losses, and bolometry measurements for the radiation. To validate the workflow, two discharges, L-mode plasmas with low MHD activity, were executed using on and off-axis beams, respectively. The experimentally and numerically estimated heat flux are of the same order of magnitude for the on-axis heated scenario, with a strong dependence of the estimated fast-ion losses contribution on the fit to the kinetic profiles used as input. This is also true for the off-axis heated scenario, where the total numerically estimated heat flux is 2.1 or 1.3 times higher than the maximum experimentally estimated heat flux, depending on the ASCOT input used.

FILD↗
DOE OSTI2025

A geometric framework for momentum-based optimizers for low-rank training

Low-rank pre-training and fine-tuning have recently emerged as promising techniques for reducing the computational and storage costs of large neural networks. Training low-rank parameterizations typically relies on conventional optimizers such as heavy ball momentum methods or Adam. In this work, we identify and analyze potential difficulties that these training methods encounter when used to train low-rank parameterizations of weights. In particular, we show that classical momentum methods can struggle to converge to a local optimum due to the geometry of the underlying optimization landscape. To address this, we introduce novel training strategies derived from dynamical low-rank approximation, which explicitly account for the underlying geometric structure. Our approach leverages and combines tools from dynamical low-rank approximation and momentum-based optimization to design optimizers that respect the intrinsic geometry of the parameter space. We validate our methods through numerical experiments, demonstrating faster convergence, and stronger validation metrics at given parameter budgets.

Schotthoefer, Steffen [ORNL] (ORCID:00000002156965↗
DOE OSTI2024

Scaling neural simulations in STACS

Abstract As modern neuroscience tools acquire more details about the brain, the need to move towards biological-scale neural simulations continues to grow. However, effective simulations at scale remain a challenge. Beyond just the tooling required to enable parallel execution, there is also the unique structure of the synaptic interconnectivity, which is globally sparse but has relatively high connection density and non-local interactions per neuron. There are also various practicalities to consider in high performance computing applications, such as the need for serializing neural networks to support potentially long-running simulations that require checkpoint-restart. Although acceleration on neuromorphic hardware is also a possibility, development in this space can be difficult as hardware support tends to vary between platforms and software support for larger scale models also tends to be limited. In this paper, we focus our attention on Simulation Tool for Asynchronous Cortical Streams (STACS), a spiking neural network simulator that leverages the Charm++ parallel programming framework, with the goal of supporting biological-scale simulations as well as interoperability between platforms. Central to these goals is the implementation of scalable data structures suitable for efficiently distributing a network across parallel partitions. Here, we discuss a straightforward extension of a parallel data format with a history of use in graph partitioners, which also serves as a portable intermediate representation for different neuromorphic backends. We perform scaling studies on the Summit supercomputer, examining the capabilities of STACS in terms of network build and storage, partitioning, and execution. We highlight how a suitably partitioned, spatially dependent synaptic structure introduces a communication workload well-suited to the multicast communication supported by Charm++. We evaluate the strong and weak scaling behavior for networks on the order of millions of neurons and billions of synapses, and show that STACS achieves competitive levels of parallel efficiency.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Thermocouple and RTD Drift Due to Neutron Irradiation and Temperature for Space Nuclear Applications: A Review

Temperature measurement is a key factor in the safe and reliable operation of nuclear reactors. Thermocouples and resistance temperature detectors (RTDs) are among the most common and reliable tools deployed for temperature measurement, and some are capable of operating in extreme environments such as very high temperature and neutron radiation fields anticipated in nuclear thermal propulsion (NTP) or fission surface power. These devices are known to exhibit drifting behavior in their temperature readings throughout their operational lifetimes. Here, to help select appropriate instrumentation, it is important to identify the factors that influence drift as well as typical behavior in these environments. This work is focused on identifying contributing factors in the performance of thermocouples and RTDs. An extensive literature review is included that discusses several experimental results in different environments. Although individual instrument performance may vary with construction methods, materials selection, and vendors, this review aims to assist in the selection process and identify typical expected behaviors of several devices.

Chesser, Ryan J. [Oak Ridge National Laboratory (O↗
DOE OSTI2026

CDRL: Certification-Driven Reinforcement Learning for Neutrino Flavor Model Discovery

Many scientific discovery problems require searching combinatorial hypothesis spaces under complex domain constraints. Reinforcement learning (RL) offers a promising approach, but existing methods rely on scalar rewards that provide limited information about why candidate solutions fail, leading agents to repeatedly explore invalid regions. We introduce Certification-Driven Reinforcement Learning (CDRL), a framework that leverages structured feedback from symbolic reasoning tools. When a candidate violates domain constraints, these tools produce certificates identifying the actions responsible for failure. CDRL converts these certificates into reusable constraints that eliminate classes of invalid solutions and guide exploration toward valid regions. We evaluate CDRL on neutrino flavor model discovery in theoretical particle physics, where the hypothesis space exceeds $10^{26}$ possible models, and compare it with the state-of-the-art RL approach previously used for this task. Across three theory spaces, CDRL achieves up to 1.95$\times$ higher valid model rates and up to 6.33$\times$ higher neutrino model rates while evaluating up to 4$\times$ fewer candidates. We further extract 40 interpretable rules from search trajectories using a post-hoc decision-tree framework and show that reusing them as soft constraints yields gains of up to 2$\times$ in valid model rates and 3$\times$ in neutrino model discovery across all three theory spaces. These results suggest that CDRL uncovers reusable structure in combinatorial search spaces and provides a general framework for scientific model discovery.

Jha, Piyush [Georgia Tech., Atlanta; Georgia Tech]↗
DOE OSTI2025

Web-Based Tools for Data-Informed Remedy Optimization: Software Theory and User Guide

This report documents the development and application of two web-based decision-support tools for pump-and-treat (P&T) groundwater remediation systems: PTOLEMY (Pump-and-Treat Optimized Location Evaluation to Maximize Yields) and OPTIMA (Optimization for Pump-and-Treat Implementation, Management, & Assessment). These tools enhance remedy design and management by leveraging advanced computational methods – specifically deep learning and multi-objective optimization – within a user-friendly platform. By integrating data-driven models with established hydrogeological knowledge, PTOLEMY and OPTIMA enable more efficient evaluation of well placement and operational strategies, helping site managers balance multiple remediation objectives under complex conditions. Both tools are implemented as modules within the SOCRATES (Suite Of Comprehensive Rapid Analysis Tools for Environmental Sites) web platform, which provides data access, visualization, and analytics to support remedy optimization across sites in the U.S. Department of Energy Office of Environmental Management complex. PTOLEMY is a rapid screening module designed to identify promising locations for new extraction wells. It employs a multi-channel three-dimensional convolutional neural network (MC3D-CNN) trained on high-fidelity simulation data to predict the relative performance (in terms of contaminant mass recovery) of potential well sites. Through an interactive web interface, PTOLEMY visualizes the probability of high performance across a site, highlighting areas where an extraction well is likely to yield above-threshold contaminant removal over a multi-year period. PTOLEMY’s map-based displays and exportable results support transparent communication of screening analyses. By focusing attention on the most favorable candidate locations, the tool augments traditional engineering judgment and physics-based modeling, providing a data informed basis for subsequent detailed evaluations. OPTIMA is a multi objective optimization module designed to find wellfield layouts and operating schedules that meet various cleanup goals. It quickly evaluates thousands of candidate setups – combinations of well locations, timing, and rates – and returns a small set of best trade-off options for comparison. At its core, OPTIMA uses a U-Net-based surrogate model – a deep-learning emulator of a groundwater flow and transport simulator – to dramatically accelerate scenario evaluations. Coupling this fast surrogate with the NSGA-II (Non-dominated Sorting Genetic Algorithm II) evolutionary algorithm, OPTIMA explores a wide decision space of well locations and schedules to identify Pareto-optimal solutions that trade off key objectives (e.g., minimizing cleanup time, maximizing contaminant mass removal, and minimizing plume extent). The tool outputs a family of optimal configurations and visualizes their trade-offs (Pareto frontiers of cleanup metrics and maps of optimized well placements). Site managers can use these results to understand the range of viable strategies and to select candidate designs for more detailed verification. OPTIMA is currently under active development and not yet fully released; this guide provides early documentation to support planning and gather user feedback.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Merging the computational design of chimeric type I polyketide synthases with enzymatic pathways for chemical biosynthesis

Synthetic biology offers the promise of manufacturing chemicals more sustainably than petrochemistry. Yet, both the rate at which biomanufacturing can synthesize these molecules and the net chemical accessible space are limited by existing pathway discovery methods, which can often rely on arduous literature searches. Here, we introduce BioPKS pipeline, an automated retrobiosynthesis tool combining multifunctional type I polyketide synthases (PKSs) and monofunctional enzymes via two complementary tools: RetroTide and DORAnet. Monofunctional enzymes are valuable for carefully decorating a substrate’s carbon backbone while PKSs are unique in their ability to iteratively catalyze carbon-carbon bond formation reactions, thereby expanding carbon backbones in a predictable fashion. We evaluate the performance of BioPKS pipeline using a previously reported set of 155 biomanufacturing candidates, achieving exact synthetic designs for 93 compounds and generating chemically similar pathways for most remaining targets. Furthermore, BioPKS pipeline can propose pathways for the complex therapeutic natural products cryptofolione and basidalin.

Chainani, Yash↗
DOE OSTI2025

Neural refinement of sample weights

Monte Carlo simulations are an essential tool in particle physics data analysis. Events are typically generated alongside weights that redistribute the cross section of the simulated process across the phase space. These weights can be negative, and several post hoc methods have been developed to eliminate or mitigate the negative values. All of these methods share the common strategy of approximating the average weight as a function of phase space. We introduce an alternative approach, which, instead of reweighting to the average, refines the initial weights with a scaling transformation, utilizing a phase space-dependent factor. Since this new refinement method does not need to model the full weight distribution, it can be more accurate. High-dimensional and unbinned phase space is processed using neural networks for the refinement method. In addition to the refinement method, we introduce a new resampling protocol, which can be used in conjunction with any weight transformation to not only preserve the average weight but also the statistical uncertainties of the initial distribution. Using both realistic and synthetic examples, we show that the new neural refinement method is able to match or exceed the accuracy of similar weight transformations and that the new resampling protocol is simpler in implementation than previous methods while exhibiting equivalent statistical properties.

Artificial neural networks↗
DOE OSTI2024

MEP Metric Correlations with Socioeconomic and Built Environment Factors [Slides]

NREL's Mobility Energy Productivity tool, or MEP, quantifies the ability of an area's transportation system to connect individuals to goods, services, employment opportunities, and other activities while accounting for time, cost, and energy. However, the MEP tool itself does not examine correlations between mobility energy productivity and other sociodemographic and built environment variables relevant to the urban and transportation planning space. Examining these correlations could have two possible implications -- first, understanding what factors correlate with mobility energy productivity could help urban planners make equitable decisions in allocating transportation resources. Second, as the MEP has not been calculated for all urban areas in the US and is computationally expensive, if other publicly available variables were predictive enough of MEP then a simple model could be used to predict MEP instead of having to compute it for an area for which it has not been updated. A statistical analysis to investigate both of these questions is presented, with many significant associations found between the MEP and identified variables of interest.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Scaling Ensembles of Data-Intensive Quantum Chemical Calculations for Millions of Molecules

Deep learning models are efficient computational tools that can accelerate the inverse design of molecules with desired functional properties by generating predictions at a fraction of the time required by traditional quantum chemical approaches. To ensure that a model maintains accuracy and transferability across broad regions of the chemical space explored during the inverse design, it must be trained on massively large volumes of simulation data. This requires running large-scale ensemble quantum chemical calculations on high-performance computing (HPC) systems for data collection. However, the efficient execution of such large ensemble calculations and the management of large volumes of output data require tools that can judiciously utilize computational resources and manage metadata overhead on the file system. Therefore, we present a high-performance, scalable, ensemble management framework for performing data-intensive quantum chemical electronic structure calculations for organic molecules. This framework provides abstractions to plug different ab initio, first principles, and first principles-based semi-empirical methods and executes them efficiently at large scale on HPC systems. It dynamically distributes tasks to resources and uses tiered storage for managing large collections of files. We employed this framework to process over ten million organic molecules and generate open-source datasets that provide UV-vis absorption spectra by running time-dependent density-functional tight-binding calculations. It is the largest database containing molecular optical spectra that were simulated with quantum chemical methods in a consistent manner.

Mehta, Kshitij↗
DOE OSTI2025

Diffuse scattering from correlated electron systems

The role of inhomegeneity in determining the properties of correlated electron systems is poorly understood because of the dearth of structural probes of disorder at the nanoscale. Advances in both neutron and x-ray scattering instrumentation now allow comprehensive measurements of diffuse scattering in single crystals over large volumes of reciprocal space, enabling structural correlations to be characterized over a range of length scales from 5 to 200 angstroms or more. When combined with new analysis tools, such as three-dimensional difference pair-distribution functions, these advanced capabilities have produced fresh insights into the interplay of structural fluctuations and electronic properties in a broad range of correlated electron materials. This review describes recent investigations that have demonstrated the importance of understanding structural inhomogeneity pertaining to phenomena as diverse as superconductivity, charge density wave modulations, metal-insulator transitions, and multipolar interactions.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Distributed Machine Learning Workflow with PanDA and iDDS in LHC ATLAS

Machine Learning (ML) has become one of the important tools for High Energy Physics analysis. As the size of the dataset increases at the Large Hadron Collider (LHC), and at the same time the search spaces become bigger and bigger in order to exploit the physics potentials, more and more computing resources are required for processing these ML tasks. In addition, complex advanced ML workflows are developed in which one task may depend on the results of previous tasks. How to make use of vast distributed CPUs/GPUs in WLCG for these big complex ML tasks has become a popular research area. In this paper, we present our efforts enabling the execution of distributed ML workflows on the Production and Distributed Analysis (PanDA) system and intelligent Data Delivery Service (iDDS). First, we describe how PanDA and iDDS deal with large-scale ML workflows, including the implementation to process workloads on diverse and geographically distributed computing resources. Next, we report real-world use cases, such as HyperParameter Optimization, Monte Carlo Toy confidence limits calculation, and Active Learning. Finally, we conclude with future plans.

97 MATHEMATICS AND COMPUTING↗