Search NASA⌕ Search

SEARCH · Search NASA

Results for “planning optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Conflict Resolution Strategies for Balloon-Airship Encounters in Upper Class E Air Traffic Management (ETM)

This paper examines strategic conflict resolution strategies for pair-wise high-altitude balloon, airship encounters. By strategic is meant that the conflict is identified (detected) at the time of flight plan submission or flight plan alteration through a service, such as an ETM Service Supplier (ESS). We investigate optimal control solutions for two classes of problems: non-cooperative, where the balloon must alter its ascent trajectory in order to avoid the airship and cooperative, where both vehicles make maneuvers through a negotiation protocol.

airship balloon negotiation optimal control↗
DOE OSTI2026

Optimizing Energy Use in Pulp & Paper with DOE’s Energy Intensive Industries Resources

The U.S. pulp and paper industry is the third-largest energy consumer in manufacturing, accounting for roughly 10% of sector energy use. Improving energy efficiency reduces operating costs and strengthens competitiveness. To support this effort, the U.S. Department of Energy (DOE), through Oak Ridge National Laboratory (ORNL), launched the Energy Intensive Industries (EII) Initiative. A two-year pilot across 45 industrial sites identified more than 4 trillion Btu/year in potential energy savings. This presentation outlines plans for a follow-up technical assistance program tailored to pulp and paper mills. Available resources include a cost-savings scoping tool, implementation planning guidance, and technical support for applying advanced methods such as Pinch Analysis for integrated process-utilities optimization. The session introduces key Pinch Analysis principles and highlights case studies demonstrating measurable improvements. ORNL also seeks industry feedback on barriers to efficiency improvements, including technology gaps and resource needs. DOE’s broader objective is to accelerate productivity and economic competitiveness across U.S. energy-intensive industries.

Kamath, Dipti [ORNL] (ORCID:0000000278739994)↗
DOE OSTI2025

Advanced Fuels Campaign Execution Plan

The Advanced Fuels Campaign (AFC) Execution Plan details the strategy, mission, scope, and goals—both near-term and long-term—along with the structure and organization of nuclear fuels and materials research, development, and demonstration (RD&D) activities within the Fuel Cycle Technologies (FCT) program. The FCT program, tasked by the U.S. Department of Energy (DOE), employs a science-based approach to advance fuel technologies. This approach integrates theory, experiments, and multi-scale modeling and simulation (M&S) to develop a predictive understanding of fuel fabrication processes and fuel/cladding performance under irradiation, moving beyond traditional empirical methods. The long-term goals of the AFC are guided by the AFC Strategic Plan and align with the DOE Office of Nuclear Energy (NE) Roadmap [1], which outlines a multi-decade vision for demonstrating and qualifying advanced fuel forms to support diverse fuel cycle options. Near-term goals focus on enhancing accident tolerant fuels (ATF) for Light Water Reactors (LWR), a significant challenge that demands balancing immediate objectives with ongoing progress toward advanced reactor missions. Accelerating the traditional fuel qualification process to meet ATF objectives is another critical challenge. A detailed set of 5-year goals, summarized below, has been developed in line with the overarching science-based fuel development approach: • Advanced LWR Fuel Technologies: By 2027, support the development of advanced LWR fuel technologies with improved performance and enhanced accident tolerance. This includes high burnup (HBu), low enriched uranium (LEU)+, coated cladding, and doped fuel, aimed at complementing industry-led significant LWR uprates and plant refurbishments. • Tristructural Isotropic (TRISO) Fuel: Achieve qualification by 2028 and develop improved designs for emerging markets. • Metal Fuel: Achieve qualification by 2028 and develop improved designs for emerging markets. • Molten Salt Fuel: By 2027, deploy a robust program that enables fuel salt qualification technologies needed to support fuel salt research and development (R&D), focusing on emergent needs to derisk fuel salt production and utilization in advanced reactors. • Long-Term ATF: Develop fuel technologies that enable significant power uprates (~50%) in refurbished or new LWRs while optimizing fissile material utilization and waste disposal. The 5-year milestones in the AFC Execution Plan are contingent on an assumed budget. This Execution Plan will be updated annually to reflect actual funding profiles as budget guidance becomes available, ensuring milestones are adjusted accordingly. In summary, the AFC Execution Plan presents a comprehensive strategy to advance nuclear fuel technologies through a science-based approach, addressing both near-term and long-term goals while adapting to funding realities.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Zero-Emissions Roadmap for Oakland County

This document outlines a strategic pathway for Oakland County, Michigan to achieve zero emissions by 2050 under the Clean Energy to Communities (C2C) Program. The report encompasses analyses and high-level modeling to guide Oakland County in its emission reduction goals. Key methods include establishing an emissions inventory baseline with ongoing evaluation of future projects’ emissions impacts. Core elements include decommissioning old infrastructure, enhancing energy efficiency, deploying hybrid and ground-source heat pumps, and transitioning to electric fleets. It is proposed to structure the planning process into 5-year strategic plans to make the decarbonization process manageable. The document also emphasizes the need for reassessment of goals and periodic updates to remain adaptive to technological advancements and funding considerations. A matrixed approach for evaluating projects by cost and emissions savings is suggested to optimize decision-making given finite resources.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1994

Interactive orbital proximity operations planning system instruction and training guide

This guide instructs users in the operation of a Proximity Operations Planning System. This system uses an interactive graphical method for planning fuel-efficient rendezvous trajectories in the multi-spacecraft environment of the space station and allows the operator to compose a multi-burn transfer trajectory between orbit initial chaser and target trajectories. The available task time (window) of the mission is predetermined and the maneuver is subject to various operational constraints, such as departure, arrival, spatial, plume impingement, and en route passage constraints. The maneuvers are described in terms of the relative motion experienced in a space station centered coordinate system. Both in-orbital plane as well as out-of-orbital plane maneuvering is considered. A number of visual optimization aids are used for assisting the operator in reaching fuel-efficient solutions. These optimization aids are based on the Primer Vector theory. The visual feedback of trajectory shapes, operational constraints, and optimization functions, provided by user-transparent and continuously active background computations, allows the operator to make fast, iterative design changes that rapidly converge to fuel-efficient solutions. The planning tool is an example of operator-assisted optimization of nonlinear cost functions.

Grunwald, Arthur J.↗
DOE OSTI2025

Optimizing Power Line Undergrounding Decisions under Varying Wildfire Risk and Weather Scenarios

Abstract—The threat of wildfire ignitions from electric power equipment has led utilities to increasingly turn to preemptive power shutoffs, which, while effective in reducing grid-induced wildfire risk, can cause significant load loss. Undergrounding power lines is an alternative strategy for preventing grid-induced wildfires. However, undergrounding lines is costly, so an efficient undergrounding plan must balance reductions in wildfire risk and load loss with the cost of undergrounding lines. We propose a robust optimization model to identify which power lines to underground to maximize load served while limiting wildfire risk across a range of wildfire risk and weather scenarios. Since solving this problem may be computationally heavy for large power grids and many operating scenarios, we present a delayed constraint generation algorithm to iteratively add scenarios until an optimal solution is found. We evaluate the performance of this framework on the RTS-GMLC with scenarios representing a year of operating conditions and compare it with a stochastic programming formulation. Our results indicate that our undergrounding model is successful in reducing load shed and risk compared to baseline cases in which no mitigation action is taken and only power shutoffs are implemented (no undergrounding). The robust formulation also reduces more load shed than the stochastic formulation in the most extreme scenarios. Index Terms—grid resilience, optimization, transmission systems, underground power lines, wildfire risk.

Taylor, S. [Department of Electrical and Computer ↗
NASA NTRS2019

Solid Fuel Ignition and Extinction (SoFIE) Project on ISS

The Solid Fuel Ignition and Extinction (SoFIE) project studies ignition and flammability of solid spacecraft materials (fuels) in practical geometries and realistic atmospheric conditions. It is an experiment insert designed for use within the existing Combustion Integrated Rack (CIR). The CIR chamber provides a level of containment and permits testing at variable oxygen concentrations and pressures representative of current and planned NASA Space Exploration Atmospheres. The applications of SoFIE include: (1) Determining safer selection of cabin materials and validating NASA materials flammability selection using 1-g test protocols for low-gravity fires, (2) Improving understanding of early fire growth behavior, (3) Validating material flammability numerical models, (4) Determining optimal suppression techniques for burning materials by diluents, flow reduction, and venting, (5) Obtaining burning behavior of actual engineering materials planned for spacecraft, (6) Developing corresponding models of microgravity flame spread, flammability, and extinction, and use the results to improve normal gravity combustion models for terrestrial applications. The hardware permits a wide range of solid-material combustion and fire suppression studies. It supports multiple investigations using common infrastructure including sample holders, flow control, test sections, external radiant heaters, igniters, and diagnostics. SoFIE has been developed to meet the requirements of five unique investigations. It is currently being built and slated to begin operations on the ISS in July 2021. Given the general capabilities of the hardware insert, it is intended to be used as a facility for future researchers who can propose to NASA for related solid combustion studies.

Ferkul, Paul↗
NASA NTRS2022

Exploring Applications of Machine Learning for Wildfire Monitoring and Detection using Unmanned Aerial Vehicles

Wildfires are increasing in frequency and severity around the world, including the United States. The losses caused by wildfires could be mitigated if high-risk areas, hotspots, and flare-ups could be monitored continuously, such as through the use of Unmanned Aerial Vehicles (UAVs). This paper documents exploratory efforts using machine learning to determine efficient flight paths for UAVs and to detect wildfires using image classification. On path planning, three machine learning techniques—Genetic Algorithm, Simulated Annealing, and Dynamic Programming—were explored. Genetic Algorithm was found to be an effective approach for path planning for wildfire monitoring and surveillance by UAVs. For a scenario of 25 locations in a circular arrangement, the algorithm was able to return the optimal path. The accuracy and execution time was found to be sensitive to the algorithm hyperparameters selected, which was especially evident in scenarios with hundreds or thousands of locations. Simulated Annealing was also found to be an effective approach for UAV path planning, with a major benefit of avoiding getting trapped in local minima and being straightforward to implement. Like Genetic Algorithm, the performance of Simulated Annealing was also found to be sensitive to the algorithm hyperparameters selected. By comparison, Dynamic Programming guarantees optimality for any number of locations, but it was found to be less practical in terms of execution time for scenarios with more than about a couple dozen locations. On wildfire detection, image classification using deep learning with a convolutional neural network was explored. Transfer learning was found to be a useful technique to efficiently train deep learning models. Also, it was determined that GPU processing can increase training speed by an order of magnitude, which enables significantly faster development. For a validation test set of 500 images, there were only two false negatives and zero false positives. These results demonstrate that detecting wildfires in static cameras using machine learning is feasible and establish a baseline for using images captured by UAVs in flight for wildfire detection.

Wildfire management↗
NASA NTRSDate not supplied

Avoiding Selection Bias in Generating Examples of Plans in the Presence of Heuristic Error

It is generally understood that heuristic error hurts the performance of search algorithms, measured in terms of search effort. Hence there is an interest in understanding how to reduce heuristic error. One way to do this is to learn a heuristic from a set of examples of plans generated offline, e.g. bootstrapping methods. In this paper, we consider how some methods for generating examples of plans may skew the training set in the presence of heuristic errors. Initial theoretical results show that duplicate detection is one source of selection bias in the canonical A* algorithm. We introduce a duplicate selection scheme for A* that avoids selection bias in generating cost-optimal examples, without compromising memory efficiency, and develop ideas in the satisficing setting. We evaluate our approach on n x m grids with multiple cost-optimal solutions and synthetic heuristic error. Finally, we attempt to extend these ideas to the problem of generating extreme examples of plans.

Alison S Paredes↗
NASA NTRS2014

Affordable Development and Optimization of CERMET Fuels for NTP Ground Testing

CERMET fuel materials for Nuclear Thermal Propulsion (NTP) are currently being developed at NASA's Marshall Space Flight Center. The work is part of NASA's Advanced Space Exploration Systems Nuclear Cryogenic Propulsion Stage (NCPS) Project. The goal of the FY12-14 project is to address critical NTP technology challenges and programmatic issues to establish confidence in the affordability and viability of an NTP system. A key enabling technology for an NCPS system is the fabrication of a stable high temperature nuclear fuel form. Although much of the technology was demonstrated during previous programs, there are currently no qualified fuel materials or processes. The work at MSFC is focused on developing critical materials and process technologies for manufacturing robust, full-scale CERMET fuels. Prototypical samples are being fabricated and tested in flowing hot hydrogen to understand processing and performance relationships. As part of this initial demonstration task, a final full scale element test will be performed to validate robust designs. The next phase of the project will focus on continued development and optimization of the fuel materials to enable future ground testing. The purpose of this paper is to provide a detailed overview of the CERMET fuel materials development plan. The overall CERMET fuel development path is shown in Figure 2. The activities begin prior to ATP for a ground reactor or engine system test and include materials and process optimization, hot hydrogen screening, material property testing, and irradiation testing. The goal of the development is to increase the maturity of the fuel form and reduce risk. One of the main accomplishmens of the current AES FY12-14 project was to develop dedicated laboratories at MSFC for the fabrication and testing of full length fuel elements. This capability will enable affordable, near term development and optimization of the CERMET fuels for future ground testing. Figure 2 provides a timeline of the development and optimization tasks for the AES FY15-17 follow on program.

Hickman, Robert R.↗
NASA NTRS2016

An Integrated Gate Turnaround Management Concept Leveraging Big Data Analytics for NAS Performance Improvements

"Gate Turnaround" plays a key role in the National Air Space (NAS) gate-to-gate performance by receiving aircraft when they reach their destination airport, and delivering aircraft into the NAS upon departing from the gate and subsequent takeoff. The time spent at the gate in meeting the planned departure time is influenced by many factors and often with considerable uncertainties. Uncertainties such as weather, early or late arrivals, disembarking and boarding passengers, unloading/reloading cargo, aircraft logistics/maintenance services and ground handling, traffic in ramp and movement areas for taxi-in and taxi-out, and departure queue management for takeoff are likely encountered on the daily basis. The Integrated Gate Turnaround Management (IGTM) concept is leveraging relevant historical data to support optimization of the gate operations, which include arrival, at the gate, departure based on constraints (e.g., available gates at the arrival, ground crew and equipment for the gate turnaround, and over capacity demand upon departure), and collaborative decision-making. The IGTM concept provides effective information services and decision tools to the stakeholders, such as airline dispatchers, gate agents, airport operators, ramp controllers, and air traffic control (ATC) traffic managers and ground controllers to mitigate uncertainties arising from both nominal and off-nominal airport gate operations. IGTM will provide NAS stakeholders customized decision making tools through a User Interface (UI) by leveraging historical data (Big Data), net-enabled Air Traffic Management (ATM) live data, and analytics according to dependencies among NAS parameters for the stakeholders to manage and optimize the NAS performance in the gate turnaround domain. The application will give stakeholders predictable results based on the past and current NAS performance according to selected decision trees through the UI. The predictable results are generated based on analysis of the unique airport attributes (e.g., runway, taxiway, terminal, and gate configurations and tenants), and combined statistics from past data and live data based on a specific set of ATM concept-of-operations (ConOps) and operational parameters via systems analysis using an analytic network learning model. The IGTM tool will then bound the uncertainties that arise from nominal and off-nominal operational conditions with direct assessment of the gate turnaround status and the impact of a certain operational decision on the NAS performance, and provide a set of recommended actions to optimize the NAS performance by allowing stakeholders to take mitigation actions to reduce uncertainty and time deviation of planned operational events. An IGTM prototype was developed at NASA Ames Simulation Laboratories (SimLabs) to demonstrate the benefits and applicability of the concept. A data network, using the System Wide Information Management (SWIM)-like messaging application using the ActiveMQ message service, was connected to the simulated data warehouse, scheduled flight plans, a fast-time airport simulator, and a graphic UI. A fast-time simulation was integrated with the data warehouse or Big Data/Analytics (BAI), scheduled flight plans from Aeronautical Operational Control AOC, IGTM Controller, and a UI via a SWIM-like data messaging network using the ActiveMQ message service, illustrated in Figure 1, to demonstrate selected use-cases showing the benefits of the IGTM concept on the NAS performance.

Efficent ATM systems↗
NASA NTRS2026

Smart Process Planning for Automated Fiber Placement

Many industries, including aerospace, automotive, wind energy, maritime, and sporting goods, rely on strong, lightweight materials called composites. These materials are made by layering fibers, which can come in the form of narrow strips or wider sheets, and setting them in a polymer matrix. One of the most advanced ways to make these parts is through automated fiber placement, where a machine lays down the fibers in precise patterns. This method can create very efficient and strong designs, but it is complex, expensive, and often depends heavily on the experience of skilled engineers. Today, the design, manufacturing, and inspection stages of composite production are usually handled separately. This separation means that important information, such as how a part will be built or what defects might occur, is not always shared between stages. As a result, parts may not be as lightweight, strong, or defect-free as possible, and the process can take longer and cost more. This research develops a smart process planning system that connects design, manufacturing, and inspection into one continuous process. Built as software that works with existing tools, the system can automatically plan how the fibers are placed, predicting and reducing defects while improving both manufacturability and strength. The system optimizes not only individual layers but also how defects are distributed across all layers, preventing them from stacking up in ways that weaken the final part. It also uses inspection results from completed parts to improve future designs, creating a feedback loop where each stage informs the others. The system was tested by designing a composite panel using this new approach and comparing it to a panel made with state-of-the-art manual planning methods. The results showed that the system could intentionally control where defects appeared and increase the efficiency of the planning process. By unifying design, manufacturing, and inspection, this research shows a way to make advanced composite manufacturing more efficient, consistent, and cost-effective. This approach lowers the barrier to using automated fiber placement and opens the door for its wider adoption not only in aerospace but also in industries such as automotive, wind energy, maritime, and sporting goods, where strong and lightweight structures are essential.

Computer-Aided Process Planning↗
NASA NTRS2010

Multi-Objective Multi-User Scheduling for Space Science Missions

We have developed an architecture called MUSE (Multi-User Scheduling Environment) to enable the integration of multi-objective evolutionary algorithms with existing domain planning and scheduling tools. Our approach is intended to make it possible to re-use existing software, while obtaining the advantages of multi-objective optimization algorithms. This approach enables multiple participants to actively engage in the optimization process, each representing one or more objectives in the optimization problem. As initial applications, we apply our approach to scheduling the James Webb Space Telescope, where three objectives are modeled: minimizing wasted time, minimizing the number of observations that miss their last planning opportunity in a year, and minimizing the (vector) build up of angular momentum that would necessitate the use of mission critical propellant to dump the momentum. As a second application area, we model aspects of the Cassini science planning process, including the trade-off between collecting data (subject to onboard recorder capacity) and transmitting saved data to Earth. A third mission application is that of scheduling the Cluster 4-spacecraft constellation plasma experiment. In this paper we describe our overall architecture and our adaptations for these different application domains. We also describe our plans for applying this approach to other science mission planning and scheduling problems in the future.

science planning↗
NASA NTRS2014

Spacecraft Trajectory Analysis and Mission Planning Simulation (STAMPS) Software

STAMPS simulates either three- or six-degree-of-freedom cases for all spacecraft flight phases using translated HAL flight software or generic GN&C models. Single or multiple trajectories can be simulated for use in optimization and dispersion analysis. It includes math models for the vehicle and environment, and currently features a "C" version of shuttle onboard flight software. The STAMPS software is used for mission planning and analysis within ascent/descent, rendezvous, proximity operations, and navigation flight design areas.

Puckett, Nancy↗
NASA NTRS2025

Innovative Drug Selection, Storage, and Shelf-Life Strategies for Exploration Spaceflight

Medications have been a part of space travel dating back to the Apollo missions. A safe and effective medication formulary is essential to maintaining crew health and performance during long-duration spaceflight outside of low Earth orbit (LEO). Distance from Earth creates four key operational changes that increase medical risks, including communication, resupply, crewmember health, and evacuation. The current spaceflight pharmaceutical formulary consists of medications indicated to treat a variety of anticipated medical events and healthcare needs during spaceflight, but depends on a robust consumables resupply chain, which may be strained for a Lunar, and possibly non-existent for a Mars mission. The specific medications selections for the formulary may change to optimally align with the mission, crew compliment, and spacecraft design. Medical support at long-duration exploration missions will differ from LEO missions due to mission duration, lack of consumables resupply, prolonged exposure to space radiation, and the absence of emergency medical return capability. Loss of medication resupply limits or removes the ability to replace medications that have been exhausted or degraded, potentially exacerbating the medical risk posture. To address these anticipated risks, long-duration missions must consider use of novel medical technologies, treatment modalities, and smart medical systems that offer greater crew autonomy, such as physiologically based pharmacokinetic modeling, drug repurposing, on demand drug synthesis, or wearable drug delivery / monitoring devices. Once an ideal formulary for exploration space is determined, it is essential to establish the chemical and physical stability of each medication compound, as well as its safety by identifying its degradation profiles and products. Although few studies have been conducted to provide evidence on the physicochemical stability of pharmaceuticals during space missions, the data suggests that the spaceflight environment may promote degradation in some pharmaceuticals. Formulary drug purity and efficacy should be verified by pharmaceutical stability assessments, and can be realized non-destructively, and accessed in remote environments. Non-destructive pharmaceutical analysis and statistical modelling techniques could optimize exploration spaceflight medical care by enabling early detection of suboptimal therapeutics. Likewise, novel packaging, storage strategies, and dosage form innovations are promising countermeasures to optimize pharmaceutical shelf life, purity, and quality of exploration spaceflight medications. As we prepare for more distant exploration missions, risk management planning for astronaut healthcare should include the assembly of a medication formulary that is comprehensive enough to prevent or treat anticipated medical events, remains safe and chemically stable, and retains sufficient potency to last for the duration of the mission. Following extensive review of the literature, we will present innovative formulary optimization strategies, pharmaceutical stability assessment techniques, and storage and packaging solutions that could enhance drug safety and efficacy for future exploration spaceflight missions.

Vernie R Daniels↗
NASA NTRS2018

Numerically Optimized Coronagraph Designs for the Habitable Exoplanet Imaging Mission (HabEx) Concept

The primary science goal of the Habitable Exoplanet Imaging Mission (HabEx), one of four candidate flagship missions under investigation, is to image and spectrally characterize Earth-like exoplanets. It is well known that pupil obscurations degrade coronagraphic performance and complicate coronagraph design, so HabEx is planned to have an off-axis, unobscured primary mirror. We utilize the circular symmetry of the aperture to investigate 1D-radial coronagraph optimization methods that are prohibitively time-consuming or intractable in 2D, such as diffractive pupil remapping and concurrent, multi-plane optimization. We also directly constrain sensitivities to dynamic, low-order Zernike aberrations, which are separable in polar coordinates and can thus be propagated as 1D-radial integrals. The mask technologies in our designs claim heritage from the extensive modeling and testbed experiments performed by the Wide-Field Infrared Survey Telescope (WFIRST) Coronagraph Instrument (CGI) project. In this paper, we detail our optimization methods and outline future work to complete our design survey.

Balasubramaian, Kunjithapatham↗
DOE OSTI2026

Optimal CO 2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: A Markov game perspective

Geological carbon storage (GCS) projects could involve a diverse array of stakeholders or players from public, private, and regulatory sectors, each with different objectives and responsibilities. Given the complexity, scale, and long-term nature of GCS operations, determining whether individual stakeholders can independently optimize their interests — or whether collaborative coalition agreements are needed — remains a central question for effective GCS project planning and management. To access large, high-quality storage resources, future GCS deployment may increasingly occur in geologically connected sites, where shared geological features such as pressure space and reservoir pore capacity can lead to competitive behavior among stakeholders. In this work, we propose a paradigm based on Markov games to quantitatively investigate how different coalition structures affect the goals of stakeholders. We frame this multi-stakeholder multi-site problem as a multi-agent reinforcement learning problem with safety constraints. Our approach enables agents to learn optimal strategies while complying with safety regulations. We present an example where multiple operators are injecting CO 2 into their respective project areas in a geologically connected basin. To address the high computational cost of repeated simulations of high fidelity models, a previously developed surrogate model based on the Embed-to-Control (E2C) framework is employed. Our results demonstrate the effectiveness of the proposed framework in addressing optimal management of CO 2 storage when multiple stakeholders with different objectives and goals are involved.

58 GEOSCIENCES↗
DOE OSTI2024

Distributed Machine Learning Workflow with PanDA and iDDS in LHC ATLAS

Machine Learning (ML) has become one of the important tools for High Energy Physics analysis. As the size of the dataset increases at the Large Hadron Collider (LHC), and at the same time the search spaces become bigger and bigger in order to exploit the physics potentials, more and more computing resources are required for processing these ML tasks. In addition, complex advanced ML workflows are developed in which one task may depend on the results of previous tasks. How to make use of vast distributed CPUs/GPUs in WLCG for these big complex ML tasks has become a popular research area. In this paper, we present our efforts enabling the execution of distributed ML workflows on the Production and Distributed Analysis (PanDA) system and intelligent Data Delivery Service (iDDS). First, we describe how PanDA and iDDS deal with large-scale ML workflows, including the implementation to process workloads on diverse and geographically distributed computing resources. Next, we report real-world use cases, such as HyperParameter Optimization, Monte Carlo Toy confidence limits calculation, and Active Learning. Finally, we conclude with future plans.

97 MATHEMATICS AND COMPUTING↗