Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

DiffLense: a conditional diffusion model for super-resolution of gravitational lensing data

Abstract Gravitational lensing data is frequently collected at low resolution due to instrumental limitations and observing conditions. Machine learning-based super-resolution techniques offer a method to enhance the resolution of these images, enabling more precise measurements of lensing effects and a better understanding of the matter distribution in the lensing system. This enhancement can significantly improve our knowledge of the distribution of mass within the lensing galaxy and its environment, as well as the properties of the background source being lensed. Traditional super-resolution techniques typically learn a mapping function from lower-resolution to higher-resolution samples. However, these methods are often constrained by their dependence on optimizing a fixed distance function, which can result in the loss of intricate details crucial for astrophysical analysis. In this work, we introduce DiffLense , a novel super-resolution pipeline based on a conditional diffusion model specifically designed to enhance the resolution of gravitational lensing images obtained from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). Our approach adopts a generative model, leveraging the detailed structural information present in Hubble space telescope (HST) counterparts. The diffusion model, trained to generate HST data, is conditioned on HSC data pre-processed with denoising techniques and thresholding to significantly reduce noise and background interference. This process leads to a more distinct and less overlapping conditional distribution during the model’s training phase. We demonstrate that DiffLense outperforms existing state-of-the-art single-image super-resolution techniques, particularly in retaining the fine details necessary for astrophysical analyses.

Computer Science↗
DOE OSTI2026

A Kinetic Model-Driven Techno-Economic Analysis of Plastic Pyrolysis: Linking Process Dynamics to Economic Viability

This study employs a kinetic model integrated into Aspen Plus to predict pyrolysis product distribution under various conditions. A techno-economic assessment calculated the minimum selling price (MSP) of pyrolysis oil under different operating conditions for the baseline capacity of 100 kta, and across eight processing capacities ranging from 30 to 150 kta. The lowest MSP under the baseline capacity is estimated at $\$$420/ton, which is 33% lower than the 2023 average US crude oil price ($\$$74.6/bbl, equivalent to $\$$634/ton based on the density of pyrolysis oil). Under Monte Carlo simulation, accounting for variability in key economic and technical parameters, the mean MSP is estimated at $\$$1137/ton. The economic viability depends on feedstock price remaining below $\$$320/ton, defining the break-even feedstock price threshold. Sensitivity analysis further identifies capital investment and transportation cost as key economic drivers. Capacities beyond 90 kta show limited economies of scale benefits. Reducing product storage time cuts capital costs by 7% but raises operational risk. Uncertainty analysis suggests the economic feasibility of pyrolysis oil is unlikely to compete with crude oil without policy incentives.

petrochemicals↗
DOE OSTI2025

Non-Destructive, Three-Dimensional Imaging of Processes in the Rhizosphere Utilizing High Energy Photons

Soil structure, which can be described as the aggregation and distribution of pore spaces, regulates carbon, nutrient, and water cycling across the Earth system. Yet the inability to make quantitative, dynamic, in situ measurements of soil structure and rhizosphere carbon flow has prevented meaningful incorporation of soil structural processes into Earth System Models (ESMs). The key limitations are: (i) Lack of scale integration between micron-scale soil structure and ecosystem-scale models, (ii) Poor functional linkage between soil structural properties and biogeochemical processes, and (iii) Absence of dynamic 3D measurements of rhizosphere structural changes and carbon transformations. To address these challenges, we developed a new integrated positron emission tomography (PET) - microcomputed tomography (CT) imaging platform that enables the first 4D (spatial 3D and time), non-invasive, quantitative imaging of carbon allocation and rhizosphere structural dynamics in living plants and intact soils. The system combines: • Rhizo-PET (R-PET): a high-resolution positron emission tomography scanner optimized for 11 CO 2 tracing in plant roots. • a-Se micro-CT: a high-contrast, high-spatial resolution CT system based on amorphous selenium (a-Se) direct conversion technology, enabling micron-scale visualization of soil structure and root–soil interfaces. Together, these advances allow us to quantify how carbon exudates move, transform, and stabilize within the rhizosphere, directly informing missing processes in BER-relevant carbon cycle models.

42 ENGINEERING↗
DOE OSTI2024

Distributed Machine Learning Workflow with PanDA and iDDS in LHC ATLAS

Machine Learning (ML) has become one of the important tools for High Energy Physics analysis. As the size of the dataset increases at the Large Hadron Collider (LHC), and at the same time the search spaces become bigger and bigger in order to exploit the physics potentials, more and more computing resources are required for processing these ML tasks. In addition, complex advanced ML workflows are developed in which one task may depend on the results of previous tasks. How to make use of vast distributed CPUs/GPUs in WLCG for these big complex ML tasks has become a popular research area. In this paper, we present our efforts enabling the execution of distributed ML workflows on the Production and Distributed Analysis (PanDA) system and intelligent Data Delivery Service (iDDS). First, we describe how PanDA and iDDS deal with large-scale ML workflows, including the implementation to process workloads on diverse and geographically distributed computing resources. Next, we report real-world use cases, such as HyperParameter Optimization, Monte Carlo Toy confidence limits calculation, and Active Learning. Finally, we conclude with future plans.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Robust VAR Capability Curve of DER with Uncertain Renewable Generation

Active distribution system with high penetration of inverter based distributed energy resources(DER), can be utilized for var-related ancillary services at the transmission side interface. In order to utilize the DER flexibility, transmission system operator must be presented the aggregated DER flexibility of distribution system. However, the uncertainty in renewable generation, questions the credibility of aggregated capability curve in practice. In this paper, we incorporate the uncertainty into aggregation process to develop capability curve while preserving the real physics (unbalance and lossy nature) of distribution system. The Resulting capability curve with the associated probability can be harnessed by the TSO for decision making for both planning and operation.

Kar, Aditya Shankar↗
DOE OSTI2024

Operational Analytics Studies for ATLAS Distributed Computing: Data Popularity Forecast and Utilization of the WLCG Centers

Operational analytics is the direction of research related to the analysis of the current state of computing processes and the prediction of future states in order to anticipate imbalances and take timely measures to stabilize a complex system. There are two relevant areas in ATLAS Distributed Computing that are currently the focus of studies: user physics analysis including the forecast of popularity of data samples among users, and evaluating WLCG centers for their readiness to process user analysis payloads. Studying these areas is challenging due to the complexity involved, as it requires a comprehensive understanding of numerous boundary conditions typically found in large-scale distributed computing infrastructures. Forecasts of data popularity are problematic without the categorization of user tasks by their types (data transformation or physics analysis), which do not always appear on the surface but may induce noise, which introduces significant distortions for predictive analysis. Evaluating the WLCG resources by their analysis workloads is also a challenging task as it is necessary to find a balance between the workload of the resource, its performance, the waiting time for jobs on it, as well as the volume of jobs that it processes. This is especially difficult in a heterogeneous computing environment, where legacy resources are used along with modern high-performance machines. We will look at these areas of research in detail and discuss what tools and methods are used in our work, demonstrating results already obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Real-Time FPGA Implementation For Frequency Sweep Interferometry In The LBNF Complex

The Long Baseline Neutrino Facility (LBNF) will deliver a 2.4 MW muon neutrino beam from Fermilab to the Deep Underground Neutrino Experiment (DUNE), requiring unprecedented precision in beamline alignment to achieve DUNE's neutrino oscillation measurement goals. Vertical misalignments of beamline components as small as 0.5 mm can contribute 6-7\% uncertainty in predicted neutrino flux, necessitating sub-0.1 mm alignment monitoring capabilities. The Horn Location Sensor (HLS) system employs frequency sweep interferometry (FSI) in a distributed hydrostatic leveling network to achieve the required precision under harsh radiation conditions up to 5000 kRad/year. Traditional FSI implementations suffer from laser sweep nonlinearities that degrade resolution and require computationally intensive post-processing corrections using gas reference cells. This work presents a real-time FPGA-based implementation of the HLS data acquisition and processing system using a sweep tracker interferometer for dynamic sweep linearization. The system utilizes a PYNQ-Z2 FPGA with programmable logic implementing parallel 16k-point FFT processing across four channels, synchronized by the sweep tracker signal to eliminate post-processing requirements. Spectral performance testing demonstrates significant improvements in peak sharpness compared to traditional fixed-frequency digitization. The FPGA implementation enables real-time displacement monitoring with processing speeds orders of magnitude faster than software-based approaches, essential for the operational requirements of LBNF's eventual distributed sensor network. This advancement in real-time FSI processing directly supports DUNE's precision neutrino physics program by providing the rapid feedback necessary for maintaining stringent beamline alignment tolerances during high-power beam operations.

Rossel, A. Jacob [Fermilab; Unlisted]↗
DOE OSTI2025

Scaling Arctic landscape and permafrost features improves active layer depth modeling

Tundra ecosystems in the Arctic store up to 40% of global below-ground organic carbon but are exposed to the fastest climate warming on Earth. However, accurately monitoring landscape changes in the Arctic is challenging due to the complex interactions among permafrost, micro-topography, climate, vegetation, and disturbance. This complexity results in high spatiotemporal variability in permafrost distribution and active layer depth (ALD). Moreover, these key tundra processes interact at different scales, and an observational mismatch can limit our understanding of intrinsic connections and dynamics between above and below-ground processes. Consequently, this could limit our ability to model and anticipate how ALD will respond to climate change and disturbances across tundra ecosystems. In this paper, we studied the fine-scale heterogeneity of ALD and its connections with land surface characteristics across spatial and spectral scales using a combination of ground, unoccupied aerial system, airborne, and satellite observations. We showed that airborne sensors such as AVIRIS-NG and medium-resolution satellite Earth observation systems like Sentinel-2 can capture the average ALD at the landscape scale. We found that the best observational scale for ALD modeling is heavily influenced by the vegetation and landform patterns occurring on the landscape. Landscapes characterized by small-scale permafrost features such as polygon tussock tundra require high-resolution observations to capture the intrinsic connections between permafrost and small-scale land surface and disturbance patterns. Conversely, in landscapes dominated by water tracks and shrubs, permafrost features manifest at a larger scale and our model results indicate the best performance at medium resolution (5 m), outperforming both higher (0.4 m) and lower resolution (10 m) models. This transcends our study to show that permafrost response to climate change may vary across dominant ecosystem types, driven by different above- and below-ground connections and the scales at which these connections are happening. We thus recommend tailoring observational scales based on landforms and characteristics for modeling permafrost distribution, thereby mitigating the influences of spatial-scale mismatches and improving the understanding of vegetation and permafrost changes for the Arctic region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Enhancing approximate modular Bayesian inference by emulating the conditional posterior

In modular Bayesian analyses, complex models are composed of distinct modules, each representing different aspects of the data or prior information. In this context, fully Bayesian approaches can sometimes lead to undesirable feedback between modules, compromising the integrity of the inference. The “cut-distribution” prevents unwanted influence between modules by “cutting” feedback. The direct sampling (DS) algorithm is standard practice for approximating the cut-distribution, but it can be computationally intensive, especially when the number of imputations required is large. An enhanced method is proposed, the Emulating the Conditional Posterior (ECP) algorithm, which leverages emulation to increase the number of imputations. Through numerical experiment it is demonstrated that the ECP algorithm outperforms the traditional DS approach in terms of accuracy and computational efficiency, particularly when resources are constrained. Here, it is also shown how the DS algorithm can be improved using ideas from design of experiments. Some practical recommendations are given for algorithm choice in modular Bayesian analyses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Decomposition and Algorithmic Approaches for Solving Large-Scale Process Family Design Problems

Our most recent work expands the water desalination case study from 76 variants to 10,897 variants using the equation-oriented model built in Pyomo as part of the PARETO project. Using the discretization formulation presented in Stinchfield (2024a), rather than solving for all 10,897 variants simultaneously, we decompose the formulation into subproblems containing subsets of variants from the process family. We solve the overall problem with Progressive Hedging (PH) deployed in parallel on a distributed HPC cluster using the open-source Python package mpi-sppy (Knueven et al., 2023). This approach allowed us to solve this process family design problem to ~1.5% relative optimality gap in about 5 hours; in comparison, Gurobi reached ~50% relative optimality gap in about 6 hours (Stinchfield et al., 2024b). However, this approach still requires discretization of the common unit module design ranges; additionally, PH acts as a heuristic for MILP’s with gap-closing capabilities. Ideally, we would not have to use ML surrogates or discretization to solve this problem, instead solving the process family design problem with the equation-oriented model directly to achieve the most accurate results. However, recall that we did not consider solving the MINLP directly due to complexity and size. In this work, we aim to decompose and solve this large-scale MINLP using a Structured Nonlinear Global Optimization algorithm presented by Cao and Zavala (2019).

Stinchfield, Georgia↗
DOE OSTI2025

Control of core–shell nanoparticles properties through plasma synthesis: a computational study

The improved properties of core–shell nanoparticles (CSNPs) over homogeneous nanoparticles (NPs) have expanded and diversified the applications of these nanomaterials. However, controlling the properties of CSNPs can be a challenging task. Low temperature plasmas have proven to be an effective method of producing NPs with uniform size and morphology, and high yield. That said, NP transport and growth dynamics are sensitive to LTP properties. We report on a computational investigation of the evolution of Ge–Si CSNP properties as a function of operating conditions through the modeling of a flowing, two-zone inductively coupled plasma (ICP) reactor. Ar/GeH 4 and Ar/SiH 4 gas mixtures were supplied to separate plasma zones at a pressure of 1 Torr to promote growth of Ge cores and Si shells. The negatively charged CSNPs are trapped electrostatically in the vicinity of the antennas where the plasma is generated and where the majority of particle growth occurs. Particles that grow to a critical size are then de-trapped by fluid drag due to neutral gas flow. A two-dimensional hybrid plasma model coupled with a three-dimensional kinetic NP transport model were utilized to resolve plasma chemistry and NP growth processes that take place on distinct timescales. The trends in CSNP properties and trapping mechanisms associated with flow rate, applied ICP power and inlet precursor fraction are discussed. While the spatial distribution of plasma produced radical species can have significant impact on the NP growth process, the NP transport dynamics are what ultimately dictates the growth environment that is unique to each particle and so determines their final dimension and composition. The key to optimizing reactor conditions involves controlling the spatial density of growth species and plasma profile as a means to tailor particle trapping dynamics suitable to produce CSNPs for a specific application.

36 MATERIALS SCIENCE↗
DOE OSTI2025

SymbolFit: Automatic Parametric Modeling with Symbolic Regression

We introduce SymbolFit (API: https://github.com/hftsoi/symbolfit), a framework that automates parametric modeling by using symbolic regression to perform a machine-search for functions that fit the data while simultaneously providing uncertainty estimates in a single run. Traditionally, constructing a parametric model to accurately describe binned data has been a manual and iterative process, requiring an adequate functional form to be determined before the fit can be performed. The main challenge arises when the appropriate functional forms cannot be derived from first principles, especially when there is no underlying true closed-form function for the distribution. In this work, we develop a framework that automates and streamlines the process by utilizing symbolic regression, a machine learning technique that explores a vast space of candidate functions without requiring a predefined functional form because the functional form itself is treated as a trainable parameter, making the process far more efficient and effortless than traditional regression methods. We demonstrate the framework in high-energy physics experiments at the CERN Large Hadron Collider (LHC) using five real proton-proton collision datasets from new physics searches, including background modeling in resonance searches for high-mass dijet, trijet, paired-dijet, diphoton, and dimuon events. We show that our framework can flexibly and efficiently generate a wide range of candidate functions that fit a nontrivial distribution well using a simple fit configuration that varies only by random seed, and that the same fit configuration, which defines a vast function space, can also be applied to distributions of different shapes, whereas achieving a comparable result with traditional methods would have required extensive manual effort.

Tsoi, Ho Fung [Univ. of Pennsylvania, Philadelphia↗
DOE OSTI2025

Extracting the distribution amplitude of light pseudoscalar mesons using the HOPE method

The pseudoscalar meson light-cone distribution amplitudes (LCDAs) are essential non-perturbative inputs for a range of high-energy exclusive processes in quantum chromodynamics. In this proceedings, progress towards a determination of the low Mellin moments of the pion and kaon LCDAs by the HOPE Collaboration is reported.

Chang, Alex [National Yang Ming Chiao Tung Univers↗
DOE OSTI2024

Unpolarized transverse momentum dependent parton distributions of the nucleon from lattice QCD

We present a first lattice QCD calculation of the unpolarized nucleon’s isovector transverse-momentum-dependent parton distribution functions (TMDPDFs), which are essential to predict observables of multiscale, semi-inclusive processes in the standard model. We use a N f = 2 + 1 + 1 MILC ensemble with valence clover fermions on a highly improved staggered quark (HISQ) sea to compute the quark momentum distributions in a large-momentum nucleon on the lattice. The state-of-the-art techniques in renormalization and extrapolation in the correlation distance on the lattice are adopted. The perturbative kernel up to next-to-next-to-leading order is taken into account, and the dependence on the pion mass and the hadron momentum is explored. Our results are qualitatively comparable with phenomenological TMDPDFs, which provide an opportunity to predict high energy scatterings from first principles. Published by the American Physical Society 2024

Astronomy & Astrophysics↗
DOE OSTI2026

Multi-Agent Control Planes for Quantum Networks: A Scalable Architecture for Autonomous Quantum Internet Management

Quantum networks are expected to enable distributed quantum computing, secure communication, and global entanglement distribution. However, operating such networks presents significant challenges, including stochastic quantum processes, fragile entanglement resources, dynamic topology, and cross-layer control requirements. Current quantum network control architectures largely rely on centralized or hierarchical controllers inspired by classical software-defined networking (SDN). While effective for small testbeds, these approaches face scalability, latency, and reliability limitations as quantum networks grow. This paper proposes a multi-agent control plane architecture for quantum networks. In this design, intelligent software agents operate at quantum nodes, repeaters, and orchestration layers, collectively managing entanglement generation, routing, purification, and scheduling. The distributed intelligence of the agent system allows the network to adapt dynamically to quantum hardware variability and environmental noise. We argue that multi-agent systems provide significant advantages over centralized control approaches, including scalability, resilience, local autonomy, and real-time adaptation. The paper discusses architectural design principles, agent coordination mechanisms, and research challenges in deploying multi-agent control planes for the emerging quantum Internet.

Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗
DOE OSTI2026

Plan It Together: Optimizing Across Generation, Transmission, Distribution, and Distributed Energy Resources

Integrated planning holds the promise of unlocking lower total system cost solutions by connecting previously siloed planning processes. This article summarizes the state of bulk and local grid planning today and details multiple new analytical approaches that can enable more holistic planning methods to develop comprehensive solutions to generation, transmission, distribution, and distributed energy resource needs. These include both iterative approaches as well as cooptimization techniques. In addition to the benefits of these methods, the technical and institutional challenges and associated solutions are also discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Stochastic Microgrid Scheduling With Chance‐Constrained Resilience Consideration

Traditionally, it is assumed that microgrids transition seamlessly from grid‐connected operation to islanded mode in the event of sudden main grid outages. In reality, the islanding process, especially unintentional islanding, is rarely seamless. Instead, it is subject to voltage and frequency fluctuations caused by the instantaneous disconnection of the point of common coupling (PCC) switch, variations in loads and renewable generation output and even the protection tripping of distributed energy resources (DERs). To mitigate these fluctuations and facilitate a smooth islanding process, we propose a stochastic microgrid scheduling model that incorporates chance‐constrained resilience measures. Specifically, the resilience measure is defined as the probability of successful islanding (PSI), that is, the probability that a microgrid can mitigate the generation‐demand imbalance caused by the disconnection of the PCC switch, variations in load and renewable generation and DER tripping. This measure is modelled using chance constraints. Unlike existing reliability and resilience indices, which typically neglect the possibility of microgrid/DER failure under extreme events and assume their survival while primarily focussing on reducing impact duration or magnitude, the proposed PSI‐based framework explicitly addresses microgrid and DER survival during the islanding transition. The formulated nonlinear chance constraints are approximated using a multiinterval approach and equivalently represented as a mixed‐integer linear programming (MILP) formulation. Case study results validate the proposed method, showing that the PSI estimation error is reduced to less than 8%, compared to approximately 28% with existing methods. Various sensitivity analyses on the DER tripping rate and PSI settings were performed to validate the robustness of the proposed method. In particular, the necessity of accounting for DER tripping in the PSI calculation was demonstrated.

chance constrained optimization↗
DOE OSTI2024

A Comprehensive Northern Hemisphere Particle Microphysics Data Set From the Precipitation Imaging Package

Microphysical observations of precipitating particles are critical data sources for numerical weather prediction models and remote sensing retrieval algorithms. However, obtaining coherent data sets of particle microphysics is challenging as they are often unindexed, distributed across disparate institutions, and have not undergone a uniform quality control process. This work introduces a unified, comprehensive Northern Hemisphere particle microphysical data set from the National Aeronautics and Space Administration precipitation imaging package (PIP), accessible in a standardized data format and stored in a centralized, public repository. Data is collected from 10 measurement sites spanning 34° latitude (37°N–71°N) over 10 years (2014–2023), which comprise a set of 1,070,000 precipitating minutes. The provided data set includes measurements of a suite of microphysical attributes for both rain and snow, including distributions of particle size, vertical velocity, and effective density, along with higher-order products including an approximation of volume-weighted equivalent particle densities, liquid equivalent snowfall, and rainfall rate estimates. The data underwent a rigorous standardization and quality assurance process to filter out erroneous observations to produce a self-describing, scalable, and achievable data set. Case study analyses demonstrate the capabilities of the data set in identifying physical processes like precipitation phase-changes at high temporal resolution. Bulk precipitation characteristics from a multi-site intercomparison also highlight distinct microphysical properties unique to each location. This curated PIP data set is a robust database of high-quality particle microphysical observations for constraining future precipitation retrieval algorithms, and offers new insights toward better understanding regional and seasonal differences in bulk precipitation characteristics.

54 ENVIRONMENTAL SCIENCES↗