Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA NETWORKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Volumetric Segmentation via Neural Networks Improves Neutron Crystallography Data Analysis

Crystallography is the powerhouse technique for molecular structure determination, with applications in fields ranging from energy storage to drug design. Accurate structure determination, however, relies partly on determining the precise locations and integrated intensities of Bragg peaks in the resulting data. Here, we describe a method for Bragg peak integration that is accomplished using neural networks. The network is based on a U-Net and identifies peaks in three-dimensional reciprocal space through segmentation, allowing prediction of the full 3D peak shape from noisy data that is commonly difficult to process. The procedure for generating appropriate training sets is detailed. Trained networks achieve Dice coefficients of 0.82 and mean IoUs of 0.69. Carrying out integration over entire datasets, it is demonstrated that integrating neural network-predicted peaks results in improved intensity statistics. Furthermore, using a second dataset, the possibility of transfer learning between datasets is shown. Given the ubiquity and growing complexity of crystallography, we anticipate integration by machine learning to play an increasingly important role across the physical sciences. These early results demonstrate the applicability of deep learning techniques for integrating crystallography data and suggest a possible role in the next generation of crystallography experiments.

Sullivan, Brendan T.↗

Development of a Real-Time, High-Speed Distribution Level Data Acquisition System

With the development of smart grids and the deployment of their enabling technologies, improved data acquisition will be needed at the distribution level to understand the full impact of these changes. With this in mind, NREL has developed a high-speed measurement and data collection network targeted specifically at the distribution level. This network is based around adaptable, rugged measurement devices designed for deployment at a variety of low and medium voltage locations below the sub-station. Each of these devices is capable of real-time data transmission via an Internet connection. Additionally, several analysis and visualization applications have been developed around the incoming data streams.

14 SOLAR ENERGY↗

Inferring Correlation Networks from Genomic Survey Data

High-throughput sequencing based techniques, such as 16S rRNA gene profiling, have the potential to elucidate the complex inner workings of natural microbial communities - be they from the world's oceans or the human gut. A key step in exploring such data is the identification of dependencies between members of these communities, which is commonly achieved by correlation analysis. However, it has been known since the days of Karl Pearson that the analysis of the type of data generated by such techniques (referred to as compositional data) can produce unreliable results since the observed data take the form of relative fractions of genes or species, rather than their absolute abundances. Using simulated and real data from the Human Microbiome Project, we show that such compositional effects can be widespread and severe: in some real data sets many of the correlations among taxa can be artifactual, and true correlations may even appear with opposite sign. Additionally, we show that community diversity is the key factor that modulates the acuteness of such compositional effects, and develop a new approach, called SparCC (available at https://bitbucket.org/yonatanf/sparcc), which is capable of estimating correlation values from compositional data. To illustrate a potential application of SparCC, we infer a rich ecological network connecting hundreds of interacting species across 18 sites on the human body. Using the SparCC network as a reference, we estimated that the standard approach yields 3 spurious species-species interactions for each true interaction and misses 60% of the true interactions in the human microbiome data, and, as predicted, most of the erroneous links are found in the samples with the lowest diversity.

59 BASIC BIOLOGICAL SCIENCES↗

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗

Pattern Discovery in Internet Background Radiation

Internet Background Radiation (IBR) is observed in empty network address spaces. No traffic should arrive there, but it does in overwhelming quantities, gathering evidences of attacks, malwares and misconfigurations. The study of IBR helps to detect spreading network problems, common vulnerabilities and attack trends. However, network traffic data evolves quickly and is of high volume and diversity, i.e., an outstanding big data challenge. When used to assist network security, it also requires the online classification of dynamic streaming data. In this paper, we introduce an AGgregation & Mode (AGM) vector to represent network traffic. The AGM format characterizes IP hosts by extracting aggregated and mode values of IP header fields, and without inspecting payloads. We performed clustering and statistical analysis to explore six months of IBR from 2012 with the AGM mapping. The discovered patterns allow building a classification of IBR, which identifies phenomena that have been actively polluting the Internet for years. The AGM representation is light and tailored for monitoring and pattern discovery. We show that AGM vectors are suitable to analyze large volumes of network traffic: they capture permanent operations, such as long term scanning, as well as bursty events from targeted attacks and short term incidents.

Iglesias, Felix↗

Understanding the linkage between electric vehicle charging network coverage and charging opportunity using GPS travel data

Using GPS travel survey data from three metropolitan areas, this paper estimates the relationship between plug-in electric vehicle (PEV) public charging infrastructure coverage and charging opportunity. The former is defined as the percentage of public areas with charging stations installed and the latter represents the drivers probability of accessing a public charger at their trip stops (stop-based) or during at least one stop of their travel day (trip chain-based). Understanding this relationship is important to PEV manufacturers and electric vehicle supply equipment (EVSE) providers, as well as government agencies, for evaluating different levels of EVSE deployment and estimating the impact of its availability on PEV adoption. Heuristic procedures are developed to estimate stop- and trip chain-based charging opportunities. Charging opportunity reflects the visibility of EVSE as the incremental security that charging stations enable, while evaluating the potential of a driver to access EVSE at travel stops or during the day, for different levels of EVSE deployment on the transportation network. The metrics proposed do not assess the probability of completing trips with electric vehicles of a given range. The analysis results indicate that drivers’ trip destinations concentrate in a few popular places and EVSE deployment in these areas could achieve relatively high levels of charging opportunity. This finding is also robust to regional variations.

33 ADVANCED PROPULSION SYSTEMS↗

3D reconstruction of an inertial-confinement fusion implosion with neural networks using multiple heterogeneous data sources

3D asymmetries are major degradation mechanisms in inertial-confinement fusion implosions at the National Ignition Facility (NIF). These asymmetries can be diagnosed and reconstructed with the neutron imaging system (NIS) on three lines of sight around the NIF target chamber. Conventional tomographic reconstructions are used to reconstruct the 3D morphology of the implosion using NIS [Volegov et al., J. Appl. Phys. 127, 083301 (2020)], but the problem is ill-posed with only three imaging lines of sight. Asymmetries can also be diagnosed with the real-time neutron activation diagnostics (RTNAD) and the neutron time-of-flight (nToF) suite. Since the NIS, RTNAD, and nToF each sample a different part of the implosion using different physical principles, we propose that it is possible to overcome the limitations of too few imaging lines of sight by performing 3D reconstructions that combine information from all three heterogeneous data sources. This work presents a new machine learning-based reconstruction technique to do just this. By using a simple physics model and group of neural networks to map 3D morphologies to data, this technique can easily account for data of multiple different types. A simple proof-of-principle is presented, demonstrating that this technique can accurately reconstruct a hot-spot shape using synthetic primary neutron images and a hot-spot velocity vector. In particular, the hot-spot’s asymmetry, quantified as spherical harmonic coefficients, is reconstructed to within ±4% of the radius in 90% of test cases. In the future, this technique will be applied to actual NIS, RTNAD, and nToF data to better understand 3D asymmetries at the NIF.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

State and Parameter Estimation for Natural Gas Pipeline Networks Using Transient State Data

Here, we formulate two estimation problems for pipeline systems in which measurements of the compressible gas flowing through a network of pipes are affected by time-varying injections, withdrawals, and compression. We consider a state estimation problem that is then extended to a joint state and parameter estimation problem that can be used for data assimilation. In both formulations, the flow dynamics are described on each pipe by space- and time-dependent densities and mass flux which evolve according to a system of coupled partial differential equations, in which momentum dissipation is modeled using the Darcy-Wiesbach friction approximation. These dynamics are first spatially discretized to obtain a system of nonlinear ordinary differential equations on which state and parameter estimation formulations are given as nonlinear least squares problems. A rapid, scalable computational method for performing a nonlinear least squares estimation is developed. Extensive simulations and computational experiments on multiple pipeline test networks demonstrate the effectiveness of the formulations in obtaining state and parameter estimates in the presence of measurement and process noise.

03 NATURAL GAS↗

Fault Detection Utilizing Convolution Neural Network on Timeseries Synchrophasor Data From Phasor Measurement Units

An end-to-end supervised learning method is proposed for fault detection in the electric grid using Big Data from multiple Phasor Measurement Units (PMUs). The approach consists of preprocessing steps aimed at reducing data noise and dimensionality, followed by utilization of six classification models considered for detecting faults. Three of the models were variants of Convolutional Neural Network (CNN) architectures that consider a single type of measurement (voltage, current or frequency) at all PMUs or all types together also at all PMUs. CNN based models were compared to traditional methods of Logistic Regression (LR), Multi-layer Perceptron (MLP) and Support Vector Machine (SVM). Evaluation was conducted on two-year data measured by PMUs at 37 locations in a large electric grid. Here, the response variable for classification were extracted from the grid-wide outage event log. Experiments show that CNN-based models outperformed traditional methods on one year out-of-sample outage detection over the entire grid.

42 ENGINEERING↗

Deep residual networks for crystallography trained on synthetic data

The use of artificial intelligence to process diffraction images is challenged by the need to assemble large and precisely designed training data sets. To address this, a codebase called Resonet was developed for synthesizing diffraction data and training residual neural networks on these data. Here, two per-pattern capabilities of Resonet are demonstrated: (i) interpretation of crystal resolution and (ii) identification of overlapping lattices. Resonet was tested across a compilation of diffraction images from synchrotron experiments and X-ray free-electron laser experiments. Crucially, these models readily execute on graphics processing units and can thus significantly outperform conventional algorithms. While Resonet is currently utilized to provide real-time feedback for macromolecular crystallography users at the Stanford Synchrotron Radiation Lightsource, its simple Python-based interface makes it easy to embed in other processing frameworks. This work highlights the utility of physics-based simulation for training deep neural networks and lays the groundwork for the development of additional models to enhance diffraction collection and analysis.

36 MATERIALS SCIENCE↗

CROCUS Sodar Measurements of Lower Atmospheric Wind Profiles at Argonne Testbed for Multiscale Observational Science (ATMOS) Site

The Scintec MFAS Sodar (Multiple-Frequency Acoustic Sounder) is an autonomous, ground-based acoustic remote sensing system designed to measure vertical profiles of horizontal wind speed, wind direction, and vertical velocity in the lower atmosphere. The instrument transmits sequences of acoustic pulses and detects the Doppler-shifted sound waves backscattered by small-scale temperature and velocity fluctuations caused by atmospheric turbulence. From these Doppler shifts, the system derives three-dimensional wind vectors by combining radial velocities from multiple beam orientations.The MFAS Sodar operates with a first usable range gate beginning at approximately 30 m above ground level and a configurable vertical resolution of 10 m. Under favorable acoustic conditions, the system provides wind profiles extending up to 600 m above ground level. Measurements are processed into 15-minute averaged profiles containing wind speed, direction, vertical velocity, and diagnostic quantities such as signal-to-noise ratio and echo strength.This dataset was collected at the Argonne Testbed for Multiscale Observational Science (ATMOS) facility in Lemont, Illinois, as part of DOE's CROCUS Urban Integrated Field Laboratory (UIFL) initiative. The purpose of these observations is to characterize the vertical wind structure and boundary-layer evolution across the urban–suburban gradient of the greater Chicago region. In particular, these data are intended to improve understanding of how local meteorology, such as lake-breeze penetration, nocturnal jets, and daytime mixing, varies between the densely built urban core and the suburban periphery. The MFAS observations provide critical context for evaluating high-resolution model simulations and for integrating with complementary lidar, radar, and in-situ meteorological measurements within the broader CROCUS UIFL network.All data are archived in NetCDF (Network Common Data Form) format and include wind and diagnostic parameters. The files can be accessed and analyzed using standard software that supports NetCDF, such as Python (e.g., xarray, netCDF4), MATLAB, R (e.g., ncdf4, raster), or Panoply (NASA’s NetCDF visualization application).

54 ENVIRONMENTAL SCIENCES↗

Introduction to Reading and Visualizing ARM Data

Atmospheric Radiation Measurement (ARM) Program standard data format is NetCDF 3 (Network Common Data Form). The object of this tutorial is to provide a basic introduction to NetCDF with an emphasis on aspects of the ARM application of NetCDF. The goal is to provide basic instructions for reading and visualizing ARM NetCDF data with the expectation that these examples can then be applied to more complex applications.

Mather, James↗

What is the National Geothermal Data System (NGDS)? Fact Sheet

Overview of the National Geothermal Data System, a distributed, interoperable network of data repositories and state geological service providers from across the U.S. and the nation's leading academic geothermal centers.

national geothermal data system, NGDS, geothermal ↗

B-PINNs: Bayesian Physics-informal Neural Networks for Forward and Inverse PDE Problems with Noisy Data

We propose a Bayesian physics-informed neural network (B-PINN) to solve both forward and inverse nonlinear problems described by partial differential equations (PDEs) and noisy data. In this Bayesian framework, the Bayesian neural network (BNN) combined with a PINN for PDEs serves as the prior while the Hamiltonian Monte Carlo (HMC) or the variational inference (VI) could serve as an estimator of the posterior. B-PINNs make use of both physical laws and scattered noisy measurements to provide predictions and quantify the aleatoric uncertainty arising from the noisy data in the Bayesian framework. Compared with PINNs, in addition to uncertainty quantification, B-PINNs obtain more accurate predictions in scenarios with large noise due to their capability of avoiding overfitting. We conduct a systematic comparison between the two different approaches for the B-PINNs posterior estimation (i.e., HMC or VI), along with dropout used for quantifying uncertainty in deep neural networks. Our experiments show that HMC is more suitable than VI with mean field Gaussian approximation for the B-PINNs posterior estimation, while dropout employed in PINNs can hardly provide accurate predictions with reasonable uncertainty. Finally, we replace the BNN in the prior with a truncated Karhunen-Loève (KL) expansion combined with HMC or a deep normalizing flow (DNF) model as posterior estimators. The KL is as accurate as BNN and much faster but this framework cannot be easily extended to high-dimensional problems unlike the BNN based framework.

Non linear PDEs, Noisy data, Bysian physics inform↗

Why wait? Let's start computing while data is still on the wire

In this era of Big Data, computing useful information from data is becoming increasingly complicated, particularly due to the ever increasing volumes of data that need to travel over the network to data centers to be stored and processed, all highly expensive operations in the long haul. In this paper we suggest that we can do computing and analysis of data "on the wire," i.e., while data is still in transit. The nature of these computations include analysis, visualization, pattern recognition, and prediction, or forecasting, on the streaming data. We follow a service function chaining architecture to implement this, assuming that the data packets arrive within a single network administrative domain. As a demonstration of this new computing paradigm, we present three examples. Firstly, we demonstrate pattern recognition and data visualization on streaming forex data, which can be used for lucrative trading in the forex market. In our second example, we analyze and learn user buying patterns from clickstream data streaming from multiple websites. Finally, we monitor solar sensors for a zero reading while the packets are still on their way to the data center, to schedule any maintenance and requisite repairs with no time delay.

97 MATHEMATICS AND COMPUTING↗

Subsets of geostationary satellite data over international observing network sites for studying the diurnal dynamics of energy, carbon, and water cycles

The latest generation of geostationary satellites provide Earth observations similar to widely used polar-orbiting sensors but at intervals as frequently as every 5–10 min, making them ideal for studying the diurnal dynamics of land–atmosphere interactions. The NASA Earth Exchange (NEX) group created the GeoNEX datasets by collating data from several geostationary platforms, including GOES-16/17/18, Himawari-8/9, and GK-2A, and placing them on a common grid to facilitate use by the Earth science community. Here, we document the GeoNEX Coincident Ground Observations (GeCGO) dataset for terrestrial ecosystem studies and provide examples for its use. Currently, GeCGO provides GOES-16 Advanced Baseline Imager (ABI) data over a 10 km × 10 km area surrounding 1586 network sites across the Americas. GeCGO makes it easy to compare the time series of geostationary data with the diurnal ground observations, including carbon/water fluxes and aerosol optical depth, and is extensible to other regions. We also develop GeoNEXTools to facilitate analyses that require both GeoNEX data and other NASA satellite data. The objectives of this paper are to introduce GeCGO and GeoNEXTools and demonstrate their applications. First, we describe the details of GeCGO and GeoNEXTools. Second, we explain how GeCGO can be integrated with other satellite data. Finally, we showcase comparisons between GeCGO and observations from three ground-based networks. GeCGO is available at https://doi.org/10.25966/y5pe-xp41 (Hashimoto et al., 2025).

Hashimoto, Hirofumi [NASA Ames Research Center (AR↗

Data efficiency assessment of generative adversarial networks in energy applications

This study investigates the data requirements of generative artificial intelligence (AI), particularly generative adversarial networks (GANs), for reliable data augmentation in energy applications. Generative AI, though seen as a solution to data limitations, requires substantial data to learn meaningful distributions—a challenge often overlooked. This study addresses the challenge through synthetic data generation for critical heat flux (CHF) and power grid demand, focusing on renewable and nuclear energy. Two variants of GAN employed are conditional GAN (cGAN) and Wasserstein GAN (wGAN). Our findings include the strong dependency of GAN on data size, with performance declining on smaller datasets and varying performance when generalizing to unseen experiments. Mass flux and heated length significantly influence CHF predictions. wGAN is more robust to feature exclusion, making it suitable for constrained synthetic data generation. In energy demand forecasting, wGAN performed well for solar, wind, and load predictions. Longer lookback hours and larger datasets improved predictions, especially for load power. Seasonal variations posed challenges, with wGAN achieving a relatively high error of Root Mean Squared Error (RMSE) of 0.32 for load power prediction, compared to RMSE of 0.07 under same-season conditions. Feature exclusions impacted cGAN the most, while wGAN showed greater robustness. This study concludes that, while generative AI is effective for data augmentation, it requires substantial data and careful training to generate realistic synthetic data and generalize to new experiments in engineering applications.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗