Search NASA⌕ Search

SEARCH · Search NASA

Results for “large scale network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Width-Based Discharge Partitioning in Distributary Networks: How Right We Are

River deltas are home to large populations and can be composed of complex channel networks which convey flows of matter to the shoreline. Knowledge of flow within individual channels is needed to quantify the distribution of discharge across the delta, and thus its sustainability over time. Due to a lack of field measurements at the local channel scale, researchers leverage remote sensing data to estimate the partitioning of flow. We compare data from 15 river deltas to discharge partitioning estimates based on channel network graphs derived from remote sensing imagery. We quantify errors in the common width-based method and test alternative partitioning techniques to find that width-based discharge partitioning is universally applicable, suggesting that absent any site-specific information, discharge partitioning by average channel width is an appropriate approach. We also provide networks, streamflow measurements, and flux partitioning estimates for 28 delta networks as the Discharge In Distributary NeTworks (DIDNT) dataset.

58 GEOSCIENCES↗
DOE OSTI2025

Continuous operation of a coherent 3,000-qubit system

Neutral atoms are a promising platform for quantum science, enabling advances in areas ranging from quantum simulations and computation to metrology, atomic clocks and quantum networking. Although atom losses typically limit these systems to a pulsed mode, continuous operation could substantially enhance cycle rates, remove bottlenecks in metrology and enable deep-circuit quantum evolution through quantum error correction. Here we demonstrate an experimental architecture for high-rate reloading and continuous operation of a large-scale atom-array system while realizing coherent storage and manipulation of quantum information. Our approach utilizes a series of two optical lattice conveyor belts to transport atom reservoirs into the science region, where atoms are repeatedly extracted into optical tweezers without affecting the coherence of qubits stored nearby. Using a reloading rate of 300,000 atoms in tweezers per second, we create over 30,000 initialized qubits per second, which we leverage to assemble and maintain an array of over 3,000 atoms for more than 2 hours. Furthermore, we demonstrate persistent refilling of the array with atomic qubits in either a spin-polarized or a coherent superposition state while preserving the quantum state of stored qubits. Our results pave the way for the realization of large-scale continuously operated atomic clocks, sensors and fault-tolerant quantum computers.

atomic and molecular physics↗
DOE OSTI2022

Autonomous Aerial Power Plant Inspection in GPS-denied Environments

Inspection of coal-fired power plants is frequently dangerous, includes difficult places to reach, and can turn expensive due to the downtimes and cost of inspection crew. Robotic systems have shown capabilities to address some of these issues, but most of the current robotic inspection technology in power plants is designed for specific components. Conversely, recent advances in machine vision have empowered aerial platforms for long-range, remotely-controlled, GPS-based inspections of industrial plants. This capability has led to wide spread utilization of aerial robots (commonly termed Drones, UVS or UAS) platforms for inspection in less challenging environments where both collision avoidance, and GPS reception are not significant issues. The challenge in adapting airborne technology for power plant inspection lies in internal structures and the complex network of piping, and distribution systems, which impose significant risks for collision and can hinder the reception and transmission of GPS signals. The current state of the art in aerial inspection technology within the energy sector is controlled via radio control, and utilizes GPS-based navigation, for inspection of large-scale plants such as offshore platforms and wind turbine parks. Nevertheless, close-range and autonomous inspection in the GPS-denied environments of power plants has not yet been achieved, as it requires precise guidance and navigation with real-time situational awareness and obstacle avoidance capabilities. This endeavor introduced the use of rotary wing flying robots, due to their station keeping and vertical take-off capabilities for power plant components inspection. To enable close quarter inspection two methods were used. One method uses the 3D CAD (Three-dimensional Computer-Aided Design) model of the asset to inspect to generate the UAV’s inspection path. To acquire, analyze and process the 3D model, first, the STL file is produced to obtain surface points and vectors normal to the surface. Later, by introducing other variables such as wall offset and a controlled trajectory between each outline and each subsequent layer, the flight path is generated. The proposed framework will generate a path that will pass as close as desired from the surface and navigate in intricate environments. A second method, use advanced manufacturing techniques such as CNC (Computer Numerical Control) and additive manufacturing. Once the inspection flight path is obtained, vision-based navigation systems are employed to have the UAV autonomously tracking the provided trajectory. Finally, Artificial Intelligence-enabled developments are in charge of detecting cracks and corrosion in structural components of power plants. The proposed methods are validated in simulations, laboratory and industrial setups, where it is shown that the developed systems acting together enable close-quarter autonomous aerial inspection and mapping in power plant assets. The system can be further improved by adding more sensors to navigate in different GPS-denied environments, with non-homogeneous lighting conditions, dust and in general situations where vision-based systems may fail.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2024

Synthetic Aperture Radar Initial Development and Project Scope

Development of a proof-of-concept solution consisting of a network of radars to identify and discriminate an object based on its fixed position and reports on its movement with the resolution of a few centimeters. This includes scaling the solution, addressing other critical requirements (multi-look radar to overcome occlusions and obstructions, interference), and also the ability to scale up to large warehouses. Finally, improved higher-dimensional resolution will be developed.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Hierarchical Inference of the Lensing Convergence from Photometric Catalogs with Bayesian Graph Neural Networks

Abstract We present a Bayesian graph neural network (BGNN) that can estimate the weak lensing convergence ( κ ) from photometric measurements of galaxies along a given line of sight (LOS). The method is of particular interest in strong gravitational time-delay cosmography (TDC), where characterizing the “external convergence” ( κ ext ) from the lens environment and LOS is necessary for precise Hubble constant ( H 0 ) inference. Starting from a large-scale simulation with a κ resolution of ∼1′, we introduce fluctuations on galaxy–galaxy lensing scales of ∼1″ and extract random sight lines to train our BGNN. We then evaluate the model on test sets with varying degrees of overlap with the training distribution. For each test set of 1000 sight lines, the BGNN infers the individual κ posteriors, which we combine in a hierarchical Bayesian model to yield constraints on the hyperparameters governing the population. For a test field well sampled by the training set, the BGNN recovers the population mean of κ precisely and without bias (within the 2 σ credible interval), resulting in a contribution to the H 0 error budget well under 1%. In the tails of the training set with sparse samples, the BGNN, which can ingest all available information about each sight line, extracts a stronger κ signal compared to a simplified version of the traditional method based on matching galaxy number counts, which is limited by sample variance. Our hierarchical inference pipeline using BGNNs promises to improve the κ ext characterization for precision TDC. The code is available as a public Python package, Node to Joy ⏬ .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

R Coronae Borealis Star Evolution: Simulating 3D Merger Events to 1D Stellar Evolution Including Large-scale Nucleosynthesis

R Coronae Borealis (RCB) stars are rare hydrogen-deficient carbon-rich variable supergiants thought to be the result of dynamically unstable white dwarf mergers. In this article, we attempt to model RCB stars through all the relevant timescales by simulating a merger event in Octo-tiger, a 3D adaptive mesh refinement (AMR) hydrodynamics code, and mapping the post-merger object into MESA, a 1D stellar evolution code. We then post-process the nucleosynthesis on a much larger nuclear reaction network to study the enhancement of s-process elements. We present models that match observations or previous studies in most surface abundances, isotopic ratios, early evolution, and lifetimes. We also observe similar mixing behavior to previous modeling attempts that result in the partial He-burning products visible on the surface in observations. However, we do note that our subsolar models lack any enhancement in s-process elements, which we attribute to a lack of hydrogen in the envelope. We also find that the 16 O/ 18 O isotopic ratio is very sensitive to initial hydrogen abundance and increases outside of the acceptable range with a hydrogen mass fraction greater than 10 -4 .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Scaling the training of particle classification on simulated MicroBooNE events to multiple GPUs

Measurements in Liquid Argon Time Projection Chamber (LArTPC) neutrino detectors, such as the MicroBooNE detector at Fermilab, feature large, high fidelity event images. Deep learning techniques have been extremely successful in classification tasks of photographs, but their application to LArTPC event images is challenging, due to the large size of the events. Events in these detectors are typically two orders of magnitude larger than images found in classical challenges, like recognition of handwritten digits contained in the MNIST database or object recognition in the ImageNet database. Ideally, training would occur on many instances of the entire event data, instead of many instances of cropped regions of interest from the event data. However, such efforts lead to extremely long training cycles, which slow down the exploration of new network architectures and hyperparameter scans to improve the classification performance. We present studies of scaling a LArTPC classification problem on multiple architectures, spanning multiple nodes. The studies are carried out on simulated events in the MicroBooNE detector. We emphasize that it is beyond the scope of this study to optimize networks or extract the physics from any results here. Institutional computing at Pacific Northwest National Laboratory and the SummitDev machine at Oak Ridge National Laboratory’s Leadership Computing Facility have been used. To our knowledge, this is the first use of state-of-the-art Convolutional Neural Networks for particle physics and their attendant compute techniques onto the DOE Leadership Class Facilities. We expect benefits to accrue particularly to the Deep Underground Neutrino Experiment (DUNE) LArTPC program, the flagship US High Energy Physics (HEP) program for the coming decades.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

A graph embedding‐based approach for automatic cyber‐physical power system risk assessment to prevent and mitigate threats at scale

Abstract Power systems are facing an increasing number of cyber incidents, potentially leading to damaging consequences to both physical and cyber aspects. However, the development of analytical methods for the study of large‐scale power infrastructures as cyber‐physical systems is still in its early stages. Drawing inspiration from machine‐learning techniques, the authors introduce a method inspired by the principles of graph embedding that is tailored for quantitative risk assessment and the exploration of possible mitigation strategies of large‐scale cyber‐physical power systems. The primary advantage of the graph embedding approach lies in its ability to generate numerous random walks on a graph, simulating potential access paths. Meanwhile, it enables capturing high‐dimensional structures in low‐dimensional spaces, facilitating advanced machine‐learning applications, and ensuring scalability and adaptability for comprehensive network analysis. By employing this graph embedding‐based approach, the authors present a structured and methodical framework for risk assessment in cyber‐physical systems. The proposed graph embedding‐based risk analysis framework aims to provide a more insightful perspective on cyber‐physical risk assessment and situation awareness for power systems. To validate and demonstrate its applicability, the method has been tested on two cyber‐physical power system models: the Western System Coordinating Council (WSCC) 9‐Bus System and the Illinois 200‐Bus System , thereby showing its advantages in enhancing the accuracy of risk analysis and comprehensiveness of situational awareness.

Sun, Shining↗
DOE OSTI2022

Neural network–based pore flow field prediction in porous media using super resolution

Direct pore-scale simulations of fluid flow through porous media are computationally expensive to perform for realistic systems. Previous works have demonstrated using the geometry of the microstructure of porous media to predict the velocity fields therein based on neural networks. However, such trained neural networks do not perform well for unseen porous media with a large degree of heterogeneity. In this study we propose that incorporating a coarse velocity field in the input of neural networks is an effective way to improve the prediction performance. The coarse velocity field can be simulated with a low computational cost and provides global information to regularize the ill-posedness of the learning problem, which is usually caused by the use of local geometries due to the computational resource constraints. We show that incorporating the coarse-mesh velocity field significantly improves the prediction accuracy of the fine-mesh velocity field by comparison to the prediction that relies on geometric information alone, especially for the porous medium with a large interior vuggy pore space. We also show the flexibility of training the network in using coarse velocity fields with various resolutions. The results suggest that even using coarse velocity field with a very low resolution, the predictions are still enhanced and close to the ground truths. The feasibility of the method is further demonstrated by testing the trained network on real rocks. This study highlights the merits of incorporating a coarse-mesh velocity field into the input for neural networks, which provides global, physics-based information for the model, thereby improving the model's generalization capability.

42 ENGINEERING↗
DOE OSTI2021

Self-Healing Ceramics and Mechanical Metamaterials

We performed large scale molecular dynamics (MD) simulations and reactive & quantum molecular dynamics simulations to investigate: (1) faceting, grain growth, and crack healing in ceramics; (2) stress-release mechanism and healing in fibers; and (3) mechanical properties of two-dimensional metamaterials. We also designed highly accurate interatomic potentials and forces using artificial neural networks (ANN) and first-principles molecular dynamics simulation data for use in our MD and reactive MD simulations. We demonstrated the efficacy of modeling quantum materials atomistic simulation data using unsupervised deep learning approaches on a quantum computer. These achievements are elaborated in the following sections.

36 MATERIALS SCIENCE↗
DOE OSTI2020

The Binary–Host Connection: Astrophysics of Gravitational-Wave Binaries from Host Galaxy Properties

Gravitational waves from the merger of binary neutron stars (BNSs) are accompanied by electromagnetic counterparts, making it possible to identify the associated host galaxy. In this work, we explore how properties of the hosts relate to the astrophysical processes leading to the mergers. It is thought that the BNS merger rate within a galaxy at a given epoch depends primarily on the galaxy's star formation history, as well as the underlying merger time-delay distribution of the binary systems. The stellar history of a galaxy, meanwhile, depends on the cosmological evolution of the galaxy through time, and is tied to the growth of structure in the universe. We study the hosts of BNS mergers in the context of structure formation by populating the UniverseMachine simulations with gravitational wave (GW) events, based on a simple time-delay model. We find that different time-delay distributions predict different properties of the associated host galaxies, including the distributions of stellar mass, star formation rate, halo mass, and local and large-scale clustering of hosts. Moreover, BNSs merging today with short delay times occur preferentially in hosts with high star formation rates, while those with long delay times live in dense regions within massive halos that have low star formation. Here, we show that with ${ \mathcal O }(10)$ events from current GW detector networks, it is possible to make preliminary distinctions between formation channels which trace stellar mass, halo mass, or star formation rate. We also find that strategies to follow-up GW events with electromagnetic telescopes can be significantly optimized using the clustering properties of their hosts.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Machine Learning for Improving Surface-Layer-Flux Estimates

Abstract Flows in the atmospheric boundary layer are turbulent, characterized by a large Reynolds number, the existence of a roughness sublayer and the absence of a well-defined viscous layer. Exchanges with the surface are therefore dominated by turbulent fluxes. In numerical models for atmospheric flows, turbulent fluxes must be specified at the surface; however, surface fluxes are not known a priori and therefore must be parametrized. Atmospheric flow models, including global circulation, limited area models, and large-eddy simulation, employ Monin–Obukhov similarity theory (MOST) to parametrize surface fluxes. The MOST approach is a semi-empirical formulation that accounts for atmospheric stability effects through universal stability functions. The stability functions are determined based on limited observations using simple regression as a function of the non-dimensional stability parameter representing a ratio of distance from the surface and the Obukhov length scale (Obukhov in Trudy Inst Theor Geofiz AN SSSR 1:95–115, 1946), $$z/L$$ z / L . However, simple regression cannot capture the relationship between governing parameters and surface-layer structure under the wide range of conditions to which MOST is commonly applied. We therefore develop, train, and test two machine-learning models, an artificial neural network (ANN) and random forest (RF), to estimate surface fluxes of momentum, sensible heat, and moisture based on surface and near-surface observations. To train and test these machine-learning algorithms, we use several years of observations from the Cabauw mast in the Netherlands and from the National Oceanic and Atmospheric Administration’s Field Research Division tower in Idaho. The RF and ANN models outperform MOST. Even when we train the RF and ANN on one set of data and apply them to the second set, they provide more accurate estimates of all of the fluxes compared to MOST. Estimates of sensible heat and moisture fluxes are significantly improved, and model interpretability techniques highlight the logical physical relationships we expect in surface-layer processes.

Meteorology & Atmospheric Sciences↗
DOE OSTI2025

Real-Time event reconstruction for Nuclear Physics Experiments using Artificial Intelligence

Charged track reconstruction is a critical task in nuclear physics experiments, enabling the identification and analysis of particles produced in high-energy collisions. Machine learning (ML) has emerged as a powerful tool for this purpose, addressing the challenges posed by complex detector geometries, high event multiplicities, and noisy data. Traditional methods rely on pattern recognition algorithms like the Kalman filter, but ML techniques, such as neural networks, graph neural networks (GNNs), and recurrent neural networks (RNNs), offer improved accuracy and scalability. By learning from simulated and real detector data, ML models can identify and classify tracks, predict trajectories, and handle ambiguities caused by overlapping or missing hits. Moreover, ML-based approaches can process data in near-real-time, enhancing the efficiency of experiments at large-scale facilities like the Large Hadron Collider (LHC) and Jefferson Lab (JLAB). As detector technologies and computational resources evolve, ML-driven charged track reconstruction continues to push the boundaries of precision and discovery in nuclear physics. In these proceedings, we highlight advancements in charged track identification leveraging Artificial Intelligence within the CLAS12 detector, achieving a notable enhancement in experimental statistics compared to traditional methods. Additionally, we showcase real-time event reconstruction capabilities, including the inference of charged particle properties, such as momentum, direction, and species identification, at speeds matching data acquisition rates. These innovations enable the extraction of physics observables directly from the experiment in real-time.

Gavalian, Gagik (ORCID:0000000267385457)↗
DOE OSTI2025

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗
DOE OSTI2022

WISE-PS1-STRM: neural network source classification and photometric redshifts for WISE×PS1

ABSTRACT We cross-match between the WISE All-Sky and PS1 3π DR2 source catalogues. The resulting catalogue has 354 590 570 objects, significantly fewer than the parent PS1 catalogue, but its combination of optical and infrared colours facilitate both better source classification and photometric redshift estimation. We perform a neural network-based classification of the objects into galaxies, quasars, and stars, then run neural network-based photometric redshift estimation for the galaxies. The star sample purity and quasar sample completeness measures improve substantially, and the resulting photo-z’s are significantly more accurate in terms of statistical scatter and bias than those calculated from PS1 properties alone. The catalogue will be a basis for future large-scale structure studies, and will be made available as a high-level science product via the Mikulski Archive for Space Telescopes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗
DOE OSTI2026

Automated, reliable, and efficient continental-scale replication of 7.3 petabytes of computational simulation data: A case study

We report on our experiences replicating 7.3 petabytes (PB) of Earth System Grid Federation (ESGF) computational simulation data from Lawrence Livermore National Laboratory (LLNL) in California to Argonne National Laboratory (ANL) in Illinois and Oak Ridge National Laboratory (ORNL) in Tennessee—a task motivated by a need for increased reliability, capacity, and performance. This task presented significant challenges: the need to move 29 million files twice under time pressure from aging storage hardware; a source file system bottleneck limiting throughput to 1.5 GB/s; frequent site maintenance windows; and the need for complete reliability at scale. We addressed these challenges using a simple replication tool that invoked Globus to transfer large bundles of files while tracking progress in a database, dynamically rerouting transfers to work around maintenance periods and file system limitations. Under the covers, Globus organized transfers to make efficient use of the high-speed Energy Sciences network (ESnet) and the data transfer nodes deployed at participating sites, and also addressed security, integrity checking, and recovery from a variety of transient failures. This success demonstrates the considerable benefits that can accrue from the adoption of performant data replication infrastructure. The replication tool is available at https://github.com/esgf2-us/data-replication-tools.

Globus↗
DOE OSTI2022

Physics-informed machine learning modeling for predictive control using noisy data

Due to the occurrence of over-fitting at the learning phase, the modeling of chemical processes via artificial neural networks (ANN) by using corrupted data (i.e., noisy data) is an ongoing challenge. Therefore, this work investigates the effect of both Gaussian and non-Gaussian noise on the performance of process-structure based recurrent neural networks (RNN) models, which take the form of partially-connected RNN models in this work, that are used to approximate a class of multi-input-multi-outputs nonlinear systems. Furthermore, two different techniques, specifically Monte Carlo dropout and co-teaching, are utilized in the development of partially-connected RNN models. Here, these two techniques are employed to reduce the over-fitting in ANNs when noisy data is used in the training process and, hence, to improve the open-loop accuracy as well as the closed-loop performance under a Lyapunov-based model predictive controller (MPC). Aspen Plus Dynamics, a well-known high-fidelity process simulator, is used to simulate a large-scale chemical process application in order to demonstrate the anticipated improvements in both open-loop approximation and closed-loop controller performance in the presence of Gaussian and non-Gaussian noise in the data set using physics-informed RNNs.

97 MATHEMATICS AND COMPUTING↗