SEARCH · Search NASA

Results for “Heterogeneous Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2024

An Active Learning-Based Streaming Pipeline for Reduced Data Training of Structure Finding Models in Neutron Diffractometry

Structure determination workloads in neutron diffractometry are computationally expensive and routinely require several hours to many days to determine the structure of a material from its neutron diffraction patterns. The potential for machine learning models trained on simulated neutron scattering patterns to significantly speed up these tasks have been reported recently. However, the amount of simulated data needed to train these models grows exponentially with the number of structural parameters to be predicted and poses a significant computational challenge. To overcome this challenge, we introduce a novel batch-mode active learning (AL) policy that uses uncertainty sampling to simulate training data drawn from a probability distribution that prefers labelled examples about which the model is least certain. We confirm its efficacy in training the same models with ∼ 75% less training data while improving the accuracy. We then discuss the design of an efficient stream-based training workflow that uses this AL policy and present a performance study on two heterogeneous platforms to demonstrate that, compared with a conventional training workflow, the streaming workflow delivers ∼ 20% shorter training time without any loss of accuracy.

Wang, Tianle [Brookhaven National Laboratory (BNL)↗

DOE OSTI2025

A simplified CFD approach for modeling mass transport in catalytic open-cell foams

A simplified macroscopic CFD approach is presented to model mass transport including chemical reactions in washcoated open-cell foams. The foam is treated as a porous medium. Species conversion during chemical reactions is modeled using appropriate source terms based on reaction rate expressions and modified to account for the mass transport resistances occurring at the fluid-washcoat interfaces and within the washcoat layers. As example, the catalytic CO oxidation over platinum is studied. The simulation results show good agreement with experimental data from literature. A parametric study on washcoat parameters, such as thickness, tortuosity, porosity, and size, is carried out. Increasing the washcoat thickness from 5 to 100 µm or decreasing the tortuosity to porosity ratio from 5 to 20 decreases the CO conversion by 10 %. The proposed model is found to be reliable and has the advantage of lower computational cost, making it a suitable tool for foam-based catalytic reactor design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Modeling separation of lanthanides via heterogeneous ligand binding

Individual lanthanide elements have physical/electronic/magnetic properties that make each useful for specific applications. Several of the lanthanides cations (Ln 3+ ) naturally occur together in the same ores. They are notoriously difficult to separate from each other due to their chemical similarity. Predicting the Ln 3+ differential binding energies (ΔΔE) or free energies (ΔΔG) at different binding sites, which are key figures of merit for separation applications, will help design of materials with lanthanide selectivity. We apply ab initio molecular dynamics (AIMD) simulations and density functional theory (DFT) to calculate ΔΔG for Ln 3+ coordinated to ligands in water and embedded in metal–organic frameworks (MOFs), and ΔΔE for Ln 3+ bonded to functionalized silica surfaces, thus circumventing the need for the computational costly absolute binding (free) energies ΔG and ΔE. Perturbative AIMD simulations of water-inundated simulation cells are applied to examine the selectivity of ligands towards adjacent Ln 3+ in the periodic table. Static DFT calculations with a full Ln 3+ first coordination shell, while less rigorous, show that all ligands examined with net negative charges are more selective towards the heavier lanthanides than a charge-neutral coordination shell made up of water molecules. Amine groups are predicted to be poor ligands for lanthanide-binding. Finally, we also address cooperative ion binding, i.e., using different ligands in concert to enhance lanthanide selectivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Neural network kinetics for exploring diffusion multiplicity and chemical ordering in compositionally complex materials

Diffusion involving atom transport from one location to another governs many important processes and behaviors such as precipitation and phase nucleation. The inherent chemical complexity in compositionally complex materials poses challenges for modeling atomic diffusion and the resulting formation of chemically ordered structures. Here, we introduce a neural network kinetics (NNK) scheme that predicts and simulates diffusion-induced chemical and structural evolution in complex concentrated chemical environments. The framework is grounded on efficient on-lattice structure and chemistry representation combined with artificial neural networks, enabling precise prediction of all path-dependent migration barriers and individual atom jumps. To demonstrate the method, we study the temperature-dependent local chemical ordering in a refractory NbMoTa alloy and reveal a critical temperature at which the B2 order reaches a maximum. The atomic jump randomness map exhibits the highest diffusion heterogeneity (multiplicity) in the vicinity of this characteristic temperature, which is closely related to chemical ordering and B2 structure formation. The scalable NNK framework provides a promising new avenue to exploring diffusion-related properties in the vast compositional space within which extraordinary properties are hidden.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Multi-cycle reload analysis of a long cycle gas-cooled fast modular reactor

There is currently significant interest in deploying HALEU-fueled fast reactors, including the General Atomics (GA) Fast Modular Reactor (FMR). Such reactors can achieve very long fuel cycles, but with multi-batch loading will take decades to reach equilibrium. This motivates design and analysis of both the initial core and multi-cycle reload, which is typically performed using fast-running, deterministic fast reactor codes such as the Argonne Reactor Computation (ARC) codes. In this paper, multicycle reload of the GA FMR is analyzed using the ARC codes. The GA FMR utilizes 19.75 % enriched fuel in a 16 year cycle with a three-batch strategy, with twice-burned fuel placed on the core periphery. The GA FMR has a softened neutron spectrum due to reflecting elements in the core, so the neutronic solution is first benchmarked against the OpenMC Monte Carlo code. Discrepancy on k eff is 400–600 pcm, likely due to the softened neutron spectrum, heterogeneous fuel assembly design and central reflector. However, the rms discrepancy on the assembly power distribution is only 0.6 %, despite the presence of the central reflector. A reload strategy is devised for the first three cycles of such a reactor, ultimately spanning the first 45–48 years of its operation. The fresh core uses 19.75 %, 19.25 % and 16.75 % enriched fuel in place of fresh, once-burned and twice-burned and is then subsequently refueled with only 19.75 % enriched fuel. The cycle length is varied over 3 cycles of operation to balance fuel utilization and reactor availability, specifically with use of an extended 18-year Cycle 1, followed by a shortened 11-year Cycle 2. Cycle 3 is close to the target 16-year length. Finally, placing twice burned assemblies next to the GA FMR central reflector can reduce power peaking by 3 %, at the expense of slightly reducing the cycle length.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2026

Synergistic Solvent-Surface Interactions Enable Alkyne Semihydrogenation at Palladium

Enabling higher yield and better selectivity for fine-chemical synthesis through heterogeneous catalysis is intricately linked to the interplay of active sites, reaction conditions, and mass transfer influence provided by the catalyst. Alkyne semihydrogenation is ubiquitous in the production of bulk chemicals in the pharmaceutical, polymer, or fine-chemical industries, but product selectivity remains a major challenge. Here, in this study, we demonstrate that the design of catalysts encompassing nickel (Ni) foams as contiguous monolith supports, decorated with ultralow loading of Pd/PdO x nanoparticles on a carbonized polydopamine interface and tuned with a thin layer of Al 2 O 3 , in conjunction with an optimized reaction environment leads to highly selective alkyne semihydrogenation. The reactions demonstrate good functional group tolerance and applicability to flow reactor systems. Combined computational and experimental studies are presented to describe the synergistic effect between the solvent-surface interaction and the degree of Pd surface reduction that are necessary to promote this selectivity. The system highlights the opportunity for catalyst-solvent codesign as a benign alternative to more complex reactants featuring extrinsic poisons or less-favored dopants.

atomic layer deposition↗

DOE OSTI2024

Weak shock compaction on granular salt

This study conducted integrated experiments and computational modeling to investigate the speeds of a developing shock within granular salt and analyzed the effect of various impact velocities up to 245 m/s. Experiments were conducted on table salt utilizing a novel setup with a considerable bore length for the sample, enabling visualization of a moving shock wave. Experimental analysis using particle image velocimetry enabled the characterization of shock velocity and particle velocity histories. Mesoscale simulations further enabled advanced analysis of the shock wave’s substructure. In simulations, the shock front’s precursor was shown to have a heterogeneous nature, which is usually modeled as uniform in continuum analyses. The presence of force chains results in a spread out of the shock precursor over a greater ramp distance. With increasing impact velocity, the shock front thickness reduces, and the precursor of the shock front becomes less heterogeneous. Furthermore, mesoscale modeling suggests the formation of force chains behind the shock front, even under the conditions of weak shock. This study presents novel mesoscale simulation results on salt corroborated with data from experiments, thereby characterizing the compaction front speeds in the weak shock regime.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Models for Single–Site Heterogeneous Catalysts on Carbon: MoO 2 Epoxidation Catalyst Anchored to a Fullerene

Single-site molybdenum dioxo catalysts, fullerenol/MoO 2 , are prepared via grafting precursor (DME)MoO 2 Cl 2 onto a highly polyhydroxylated fullerene (ful) and an isomerically-pure and well-defined fullerene (ful*). These catalyst structures are characterized by ICP-OES, XPS, XANES, EXAFS, DRIFT, Raman, and NMR spectroscopy, and DFT. Mo 3d 5/2 XPS and Mo K-edge XANES assign the oxidation state as Mo(VI). Mo EXAFS data fitting reveals two Mo=O double and two Mo–O single bonds at distances of 1.7 and 1.9 Å, respectively, while an Mo=O stretchingl mode is observed at ~950 cm –1 by DRIFT and Raman spectroscopy. These data align well with DFT computational results, supporting the proposed catalyst structure as Fullerene(-μ-O-) 2 M(=O) 2 . Additionally, DFT provides insight into the energetically favorable grafting sites for an isomerically pure fullerenol. The scope of fullerenol/MoO 2 mediated alkene epoxidation includes abiotic alkenes, natural occurring terpenes, and conjugated olefins. For cyclooctene the rate law is first-order in [Mo], near first order in [olefin] and zero-order in [t-butyl hydroperoxide]. A plausible reaction mechanism involves peroxide addition first and then cyclooctene addition directly across the peroxo bond forming the epoxide product, consistent with DFT computation. Overall, fullerenol/MoO 2 shows promise as a sustainable and structurally well-defined system with versatile catalytic activity and good epoxidation recyclability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Designing resilient IoT and Edge Computing with federated tinyML

The rapid growth of the Internet of Things (IoT) and Edge Computing (EC) has brought significant conveniences to modern society but has also greatly expanded the cyber attack surfaces, particularly as these technologies are being increasingly integrated into critical systems such as power grids, healthcare, and smart homes. Here, to improve IoT/EC’s cybersecurity posture, we leveraged Artificial Intelligence (AI) and Machine Learning (ML) by employing tinyML to monitor voluminous IoT data for cyber threats while addressing devices’ resource constraints, and utilizing Federated Learning (FL) to share local detection knowledge across the system while preserving privacy. Building on our three-layer architecture combining tinyML and FL to enhance autonomous cyber attack detection, this paper demonstrated that the architecture improves detection accuracy, reduces resource consumption, and enables lightweight, secure IoT device monitoring. These results were validated using the public N-BaIoT dataset as well as real IoT network traffic data collected under multiple attack scenarios from our testbeds. Additionally, we introduced an enhanced FL methodology with a novel preprocessing stage, including federated feature selection and global preprocessor construction, to address IoT/EC data heterogeneity. We developed a physical IoT testbed for attack simulations and data collection, implemented a tinyML-powered detector for realistic model validation, and also built a virtual testbed for scalable evaluations of FL models across diverse network environments.

Cognitive cyber↗

DOE OSTI2025

Formation of Composite SiC/SiC Joints by Embedded Wire Chemical Vapor Deposition

The joining of ceramic monoliths or composites to date has primarily been limited to the formation of brittle monolithic joints using heterogeneous (dissimilar) materials, similar to brazing in metals. The development of a damage-tolerant joint layer by SiC fiber reinforcements is demonstrated here. Tube workpieces made of SiC fiber-SiC matrix composite are joined using a nonwoven SiC fiber mat densified by embedded wire chemical vapor deposition (EWCVD), creating a fiber-reinforced weld-like joint by homogeneous joining. EWCVD uses a localized heating method to target deposition and growth to the joint region specifically, while minimizing thermal damage to the surrounding composite tube material. X-ray computed tomography (XCT) is used to nondestructively characterize as-made joints for relative density, adhesion, and composition. In situ XCT analysis during mechanical testing revealed crack deflections in the bonding layer, which indicates a toughening mechanism typical of ceramic matrix composite phase. Gas permeation testing of these proof-of-concept composite joints identified relatively high leak rates in comparison to fully coated SiC/SiC composite tube workpieces. In conclusion, the novelty of the composite joining method and current technology challenges, including gas permeability, are discussed in comparison with traditional ceramic joints and materials.

SiC↗

DOE OSTI2025

Large Language Model Integration for Knowledge Retrieval and Interaction for the DUNE Experiment

The Deep Underground Neutrino Experiment (DUNE) is a next-generation neutrino experiment that will generate an unprecedented volume of heterogeneous information-from documentation and technical notes to experimental data and reconstruction pipelines. Efficient knowledge retrieval and contextual understanding are increasingly critical for collaboration-wide productivity and onboarding. In this work, we present DUNE-GPT, a prototype framework that leverages large language models (LLMs) and retrieval-augmented generation (RAG) to enable natural-language querying of DUNE's internal documentation and technical resources. The system provides an intelligent interface for DUNE collaborators to interact with experiment-specific knowledge while maintaining data privacy and infrastructure compliance within Fermilab computing resources.

Rafique, A. [Argonne (main)]↗

DOE OSTI2026

Electrolyte-Dependent, “Microscopically Irreversible” H-Atom Transfer Kinetics of Ce-Based Metal–Organic Framework, Ce-MOF-808

Redox reactions at the interface of metal oxides and protic electrolytes almost always involve protons and electrons in equal amounts. Given the stoichiometry, these proton-coupled electron transfer (PCET) reactions are thermochemically equivalent to net H-atom transfer (HAT) reactions. The correlation between the chemical nature of solid catalysts and HAT kinetics has been employed for decades as the design principle for energy-relevant reactions (e.g., reactions of 2H + /H 2 ). More recently, chemists have experimentally determined that a change in liquid electrolytes that alters the microenvironment at the redox-active sites has an equally profound impact on electrocatalysis involving PCET/HAT. Yet, precise correlations between the chemical nature of electrolytes and the PCET kinetics are, to date, rare in the literature. Herein, we report our findings using the Ce-based metal−organic framework, Ce-MOF-808, as a model system. Each Ce 6 (μ 3 −O) 4 (μ 3 − OH) 4 (OH) 6 (H 2 O) 6 node of this MOF undergoes a 1H + /1e − redox reaction. Using chronoamperometry and the Cottrell analysis, we have determined that the PCET hopping kinetics within the pores of Ce-MOF-808 can change by orders of magnitude by altering the buffer species and the proton activity of the electrolyte. Furthermore, in all buffers, reductive reactions were ∼3−10 times faster in kinetics than the reverse oxidative reaction with the same electrochemical driving force, suggesting that the system, at first glance, violates the principle of microscopic reversibility. Isothermal titration calorimetry (ITC) and computational simulations corroborated that the buffer-node binding thermodynamics are quite distinct, depending on the chemical nature of the buffer and the oxidation state of the node. Together, these results suggest that the substrate and the product during the oxidative vs reductive reaction of Ce-MOF-808 are chemically different species, which explains the apparent ‘microscopic irreversibility.’ Thus, the rational modulation of electrolytes can dramatically enhance PCET kinetics, even though the solid electrodes remain identical. Implications of these findings are contrasted with the electrochemical/electrocatalytic behavior of other redox-active MOFs, heterogeneous catalysts, and enzymatic systems at the solid−liquid interface.

Ce-based MOF↗

DOE OSTI2025

DS-TIDE: Harnessing Dynamical Systems for Efficient Time-Independent Differential Equation Solving

Time-Independent Differential Equations (TIDEs) are central to modeling equilibrium behavior across a wide range of scientific and engineering domains, from electrostatics to porous media flow. Conventional numerical solvers offer reliable solutions but incur significant computational costs due to fine-grained discretization and iterative procedures. Machine learning-based approaches address this by replacing iterative solving processes with one-time inference; however, their sophisticated models require extensive training resources that often exceed those of traditional solvers. Consequently, designing a TIDE solver that achieves high accuracy, broad applicability, and exceptional computational efficiency remains a fundamental challenge. In this paper, we propose DS-TIDE, a novel hardware solver that is inspired by, and subsequently leverages, the intrinsic connection between Dynamical Systems (DS) and Differential Equations (DEs) to efficiently and accurately solve TIDEs. DS-TIDE employs a CMOS-compatible DS-based processor, whose physical states evolve under carefully designed DE-driven dynamics and naturally converge to equilibrium -- the solution of the target TIDE -- within ~1µs on a ~1-watt DS-TIDE processor. To enhance expressivity, DS-TIDE incorporates Heterogeneous Dynamics with Temporal Layering (HDTL), which solves TIDEs through a three-stage DS evolution -- conditioning, solving, and decoding -- each governed by specialized dynamics. The entire evolution process is analogous to an infinitely deep neural network temporally unrolled, offering the system the capability of representing complex equations. Furthermore, DS-TIDE is equipped with an on-device DS-DE Auto-Alignment mechanism that dynamically adapts intrinsic hardware dynamics within milliseconds, effectively aligning the system’s dynamics to diverse target DEs. Experimental results across TIDEs from a wide range of scientific and engineering domains demonstrate that DS-TIDE achieves ~10^3× speedup, ~10^5× energy savings, and competitive or superior accuracy compared to state-of-the-art numerical and ML-based solvers.

Liu, Chuan↗

DOE OSTI2026

Application of artificial intelligence methods in the international roughness index prediction of rigid and composite pavements: a systematic review

The International Roughness Index (IRI) is a widely adopted metric for quantifying pavement roughness, directly influencing vehicle safety, ride comfort, and overall roadway performance. In recent years, the use of Machine Learning (ML) models for IRI prediction has gained momentum, with the goal of improving the allocation of maintenance and rehabilitation resources by enabling accurate assessments of pavement conditions. Most prior reviews, however, have concentrated on flexible pavements, leaving a notable gap regarding rigid and composite pavements. To address this gap, the present study conducts a systematic review of Artificial Intelligence (AI) methods applied to IRI prediction for rigid and composite pavements. Literature published between 2004 and 2025 is synthesized to highlight prevailing trends, methodological contributions, and directions for future research. Particular attention is given to the types of models employed, the datasets used for training and validation, and the role of input variables and data-processing strategies. Across the included studies, ensemble learning methods (especially gradient boosting variants such as XGBoost), artificial neural networks, and hybrid architectures frequently achieved high predictive skill, with several models reporting test-set coefficients of determination approaching 0.9–0.96, indicating strong potential for capturing the influence of traffic, pavement structure, and climatic factors. Since these results are obtained from heterogeneous datasets and evaluation protocols, they are interpreted qualitatively rather than as strict cross-study rankings. Analysis of input variables revealed that pavement age and initial IRI were included in 91% (21 of 23) and 78% (18 of 23) of studies, respectively. Climatic variables such as the freezing index appeared in 57% (13 of 23), while traffic-related factors were considered in 65% (15 of 23). The findings underscore the importance of standardized, high-quality datasets, such as those from the Long-Term Pavement Performance (LTPP) program, along with data consistency, model interpretability, computational efficiency, and replicability in enhancing IRI prediction. Future research should focus on incorporating input variable selection techniques to identify the most influential predictors, thereby improving accuracy and robustness. Integrating these approaches with advanced non-linear data-driven models, coupled with robust hyperparameter optimization, holds considerable promise for strengthening the reliability of IRI prediction and supporting resilient pavement management strategies.

42 ENGINEERING↗

DOE OSTI2026

The impact of aerosol mixing state on immersion freezing: insights from classical nucleation theory and particle-resolved simulations

Immersion freezing, initiated by ice-nucleating particles (INPs) in supercooled aqueous droplets, plays an important role in the formation of ice crystals within clouds. The efficiency of immersion freezing depends strongly on INP composition and, crucially, on the mixing state – how chemical species are distributed across the particle population. Here, we quantify the impact of aerosol mixing state on immersion freezing using a combined theoretical and particle-resolved modeling approach. We derive analytical expressions for the frozen fraction of internally and externally mixed INP populations based on classical nucleation theory, showing that the frozen fraction is sensitive to whether ice-active species are present in all particles or only in a subset of the population. We introduce a multi-species immersion freezing scheme into the particle-resolved model PartMC, using the water activity-based immersion freezing model (ABIFM) to compute freezing probabilities for mixed-composition particles. To improve computational efficiency, we implement a Binned Tau-Leaping algorithm and demonstrate an order-of-magnitude speedup with minimal accuracy loss. Simulations reproduce the analytical trends in limiting cases and extend the analysis to more general aerosol populations, where mixing state continues to exert a substantial control on frozen fraction. Sensitivity analyses across particle size, species type, and cooling condition reveal that the mixing state effect is most pronounced when small amounts of highly efficient INPs are mixed with less efficient materials. These findings underscore the need to represent aerosol mixing state explicitly in models of heterogeneous ice nucleation to reduce uncertainty in cloud-phase partitioning.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Leveraging a Neural Network-Enhanced Reproducing Kernel Particle Method for Multiphysics Degradation Modeling of Energy Storage Materials

Energy storage materials exhibit strong electro-chemo-mechanical coupling and highly anisotropic material properties, contributing to the formation and propagation of micro-cracking during charge/discharge cycling and resulting in reduced performance and service life. A coupled electro-chemo-mechanical reproducing kernel particle method (RKPM) formulation has been developed to analyze this system. With microstructural images supplied by the National Renewable Energy Laboratory (NREL), pixel-based model construction by RKPM is used to represent the complex material microstructures that dictate the coupled physics of these systems. Traditional electro-chemo-mechanical models rely on mesh-based finite element methods, which can lead to difficulties in meshing such complex geometries and capturing crack propagation due to mesh dependency. Here, a neural network-enhanced reproducing kernel particle method (NN-RKPM) [1, 2] is introduced to effectively model damage and crack propagation in the material microstructures; the location, orientation, and solution transition near a localization are automatically captured by superimposed block-level NN optimizations. This NN enrichment approach allows for effective modeling of localizations via a fixed background discretization, relieving tedious efforts for adaptive refinement in traditional mesh-based methods. Applications to the heterogeneous microstructures of Li-ion battery cathodes will be presented to demonstrate the effectiveness of the proposed methods. NN-RKPM is additionally used to inform how crack opening and closure in turn affect the coupled chemical equations and material microstructure. Reference: [1] Baek, J., Chen, J. S., Susuki, K., "Neural Network enhanced Reproducing Kernel Particle Method for Modeling Localizations," International Journal for Numerical Methods in Engineering, Vol. 123, pp 4422-4454, https://doi.org/10.1002/nme.7040, 2022. [2] Baek, J., Chen, J. S., "A Neural Network-Based Enrichment of Reproducing Kernel Approximation for Modeling Brittle Fracture", Computer Methods in Applied Mechanics and Engineering Vol. 410, 116590, 2024.

degradation↗

DOE OSTI2025

Graph-Learning-Assisted State and Event Tracking for Solar-Penetrated Power Grids with Heterogeneous Data Sources

Unlike transmission systems, distribution systems do not typically contain sufficient metering to enable real-time state estimation. The lack of sufficient real-time measurements prohibits accurate and timely monitoring of the state of distribution systems. As a result, control and optimal operation of distribution systems, especially those containing large numbers of renewable generation units are not possible without proper data and information about the current state of the system. The main motivation of this project is to address this shortcoming by developing an approach which provides “predicted” real-time measurements so that they can be used to execute a distribution system state estimator. Thus, the objective of the project is to make the distribution systems fully observable, such that the hosting capacity for solar generation can be accurately estimated, and unnecessary solar curtailments can be avoided. In order to accomplish this goal, the project investigated the use of a grid-model-informed machine learning (ML) tool which integrates heterogeneous data streams obtained from AMI meters, SCADA as well as PMU measurements and created synchronous measurement snapshots for the state estimator (SE); and developed a hybrid robust SE which provides not only accurate state estimates but also real-time feedback for the ML model refinement.

14 SOLAR ENERGY↗

DOE OSTI2026

iDDS: intelligent distributed dispatch and scheduling for workflow orchestration

The intelligent distributed dispatch and scheduling (iDDS) service is a versatile workflow orchestration system designed for large-scale, distributed scientific computing. iDDS extends traditional workload and data management by integrating data-aware execution, conditional logic, and programmable workflows, enabling automation of complex and dynamic processing pipelines. Originally developed for the ATLAS experiment at the large hadron collider, iDDS has evolved into an experiment-agnostic platform that supports both template-driven workflows and a Function-as-a-Task model for Python-based orchestration. This paper presents the architecture and core components of iDDS, highlighting its scalability, modular message-driven design, and integration with systems such as PanDA and Rucio. We demonstrate its versatility through real-world use cases: fine-grained tape resource optimization for ATLAS, orchestration of large Directed Acyclic Graph (DAG) workflows for the Rubin Observatory, distributed hyperparameter optimization for machine learning applications, active learning for physics analyses, and AI-assisted detector design at the electron–ion collider. By unifying workload scheduling, data movement, and adaptive decision-making, iDDS reduces operational overhead and enables reproducible, high-throughput workflows across heterogeneous infrastructures. We conclude with current challenges and future directions, including interactive, cloud-native, and serverless workflow support.

97 MATHEMATICS AND COMPUTING↗