Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

James Webb Space Telescope - L2 Communications for Science Data Processing

JWST is the first NASA mission at the second Lagrange point (L2) to identify the need for data rates higher than 10 megabits per second (Mbps). JWST will produce approximately 235 Gigabits of science data every day that will be downlinked to the Deep Space Network (DSN). To get the data rates desired required moving away from X-band frequencies to Ka-band frequencies. To accomplish this transition, the DSN is upgrading its infrastructure. This new range of frequencies are becoming the new standard for high data rate science missions at L2. With the new frequency range, the issues of alternatives antenna deployment, off nominal scenarios, NASA implementation of the Ka-band 26 GHz, and navigation requirements will be discussed in this paper. JWST is also using Consultative Committee for Space Data Systems (CCSDS) standard process for reliable file transfer using CCSDS File Delivery Protocol (CFDP). For JWST the use of the CFDP protocol provides level zero processing at the DSN site. This paper will address NASA implementations of Ground Stations in support of Ka-band 26 GHz and lesson learned from implementing a file base (CFDP) protocol operational system.

Johns, Alan↗
NASA NTRS2010

The Heliophysics Data Environment, Virtual Observatories, NSSDC, and SPASE

Heliophysics (the study of the Sun and its effects on the Solar System, especially the Earth) has an interesting data environment in that the data are often to be found in relatively small data sets widely scattered in archives around the world. Within the last decade there have been more concentrated efforts to organize the data access methods and create a Heliophysics Data and Model Consortium (HDMC). To provide data search and access capability a number of Virtual Observatories (VO's) have been established both via funding from the U.S. National Aeronautics and Space Administration (NASA) and through other funding agencies in the U.S. and worldwide. At least 15 systems can be labeled as Heliophysics Virtual Observatories, 9 of them funded by NASA. Other parts of this data environment include Resident Archives, and the final, or "deep" archive at the National Space Science Data Center (NSSDC). The problem is that different data search and access approaches are used by all of these elements of the HDMC and a search for data relevant to a particular research question can involve consulting with multiple VO's - needing to learn a different approach for finding and acquiring data for each. The Space Physics Archive Search and Extract (SPASE) project is intended to provide a common data model for Heliophysics data and therefore a common set of metadata for searches of the VO's and other data environment elements. The SPASE Data Model has been developed through the common efforts of the HDMC representatives over a number of years. We currently have released Version 2.1. of the Data Model. The advantages and disadvantages of the Data Model will be discussed along with the plans for the future. Recent changes requested by new members of the SPASE community indicate some of the directions for further development.

Thieman, James↗
NASA NTRSDate not supplied

On-Orbit Performance of the NOAA-21 Advanced Technology Microwave Sounder (ATMS)

The Advanced Technology Microwave Sounder (ATMS) instrument provides sounding measurements of Earth’s atmosphere to collect temperature and water vapor data for NOAA’s Joint Polar Satellite System (JPSS) program. ATMS is a total-power passive microwave radiometer with 22 channels spanning a frequency range from 22 to 183 GHz. A general description of the ATMS instrument is detailed in [1]. Three ATMS units are currently on-orbit. The Suomi National Polar-orbiting Partnership (SNPP) unit was launched in 2011 and the NOAA-20 (previously JPSS-1) unit was launch in 2017. Both SNPP and NOAA-20 ATMS units are currently operational and the data is used for numerical weather prediction (NWP) models. The NOAA-21 (formerly JPSS-2) ATMS unit was launched on November 10, 2022 from Vandenberg Space Force Base in California [2]. The ATMS instrument began generating radiance data on November 21, 2022. At the time of this abstract NOAA-21 ATMS is currently completing on-orbit commissioning and checkout activities; it is expected that the commissioning activities will be complete by the IGARSS 2023 conference. This paper will focus on the on-orbit performance of the NOAA-21 ATMS instrument based on measurements and activities from the commissioning period. Comparisons will be made to specifications and to expected performance based on pre-launch test activities. Pre-launch JPSS-2 (NOAA-21) ATMS performance is detailed in [4]. Additionally, the NOAA-21 performance will be compared to the on-orbit performance of the SNPP and NOAA-21 ATMS units. The post-launch performance of SNPP ATMS is detailed in [1][5][6][7]. The post-launch performance of NOAA-20 ATMS is detailed in [5][7][8]. On-orbit performance is evaluated through data collects from nominal mission operations as well as specific post-launch tests and spacecraft maneuvers. Nominal mission operations can be used to evaluate parameters such as instrument thermal stability, Noise Equivalent Delta Temperature (NEDT)/radiometric sensitivity, geolocation, inter-channel noise correlation, striping, and radiometric bias and stability. Shortly after instrument activation, the instrument thermal stability as measured from onboard temperature sensors is evaluated to demonstrate stable and steady-state behavior. Methods for computing NEDT are described in [9][10][11]. Passive geolocation measurements are performed using the coastline inflection point (CIP) method, described in [8][12]. The striping index, used as a metric to quantify striping, is the ratio of along-track variance to cross-track variance of the observed brightness temperature [4][8][14]. Inter-channel noise correlation has been previously reported for SNPP and NOAA-20 [1][8]. Dedicated post-launch tests and spacecraft maneuvers are utilized during the commissioning phase for further evaluation of on-orbit instrument performance. These activities provide information on the optimal space view selection, noise power spectral density (PSD), gain stability, scan bias, interference from onboard transmitters, reflector emissivity, active geolocation, and radiometric bias and stability detection methods. The optimal space view selection is used to determine which of ATMS space view sectors is preferred for minimizing contamination of the space view [1]. Point and stare testing is used to generate noise PSD and gain stability information, as described in [1][8]. Spacecraft roll and pitch maneuvers allow the ATMS to view different zones, including deep space, and the data can be used to provide information on scan biases and antenna sidelobe contamination [1][8]. The pitch maneuver can also be used to assess interference from onboard Ka-band transmitters and reflector emissivity [8]. Active geolocation is evaluated as a method for geolocation, described in [15].

Edward Kim↗
DOE OSTI2023

Hybrid Attack Graph Generation with Graph Convolutional Deep-Q Learning

Critical infrastructures such as power grids have become increasingly complex, connected, and vulnerable to adverse scenarios, including cyber and physical attacks and faults. Effective risk mitigation for such cyber-physical energy systems (CPES), requires preemptive knowledge of likely adversarial attack scenarios. Hybrid Attack Graph (HAG) is a structured way to represent an adversarial scenario as an attack sequence using a threat model. However, the scarcity of documented attack sequences hinders analysts and CPES planners’ ability to identify credible attack scenarios for a given CPES. We propose a data-driven Graph Convolutional Deep-Q Network (GCDQ) to address this data challenge through generating HAGs. By leveraging limited real-world observations from the MITRE ATT&CK knowledge base, our GCDQ model synthesizes realistic graphs with the targeted attribute of minimum detectability via reinforcement learning. This generative model is the first step in creating a tool to substantially boost the attack sequence dataset and enhance the performance of CPS defense-related tasks by providing insights into likely attack sequences with given attributes.

deep learning, artificial intelligence↗
DOE OSTI2024

TwinMe4AD: WGAN-based Digital Twins for Anomaly Detection

SAND2024-08373O TwinMe4AD is a Python-based software tool designed for anomaly detection using digital twins that closely mimic real, wearable healthcare datasets. The tool is invaluable for scenarios where collecting data is either expensive or impractical, serving as a privacy-preserving solution. Sensitive information is protected by training deep learning models on synthetic data derived from real datasets. One of TwinMe4AD's key features is its anomaly detection capability, which is based on fourth-order moments of parameters. This versatile approach can be applied across a range of datasets, from univariate to multivariate, making it compatible with various types of data. It also generates synthetic twins using Wasserstein Generative Adversarial Networks (WGANs), allowing users to create a small cohort of a population similar to that of a village population. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Poorey, Kunal↗
NASA NTRS2004

Spitzer Orbit Determination During In-orbit Checkout Phase

The Spitzer Space Telescope was injected into heliocentric orbit on August 25, 2003 to observe and study astrophysical phenomena in the infrared range of frequencies. The initial 60 days was dedicated to Spitzer's "In-Orbit Checkout (IOC)" efforts. During this time high levels of Helium venting were used to cool down the telescope. Attitude control was done using reaction wheels, which in turn were de-saturated using cold gas Nitrogen thrusting. Dense tracking data (nearly continuous) by the Deep Space network (DSN) were used to perform orbit determination and to assess any possible venting imbalance. Only Doppler data were available for navigation. This paper deals with navigation efforts during the IOC phase. It includes Dust Cover Ejection (DCE) monitoring, orbit determination strategy validation and results and assessment of non-gravitational accelerations acting on Spitzer including that due to possible imbalance in Helium venting.

helium venting↗
NASA NTRS1974

Determination of the radial gradient in the region 0.81-1.0 AU using both high- and low-energy /more than 10-GeV and more than 52-MeV/ detectors for the 1-AU monitor

A determination of the radial gradient for alpha particles (31-46 MeV/nuc) and protons with energies above 7.5 MeV and 44-77 MeV in the region 1.0-0.81 AU is presented for the solar-quiet year 1966. The determinations are based on data from the Pioneer 6 space probe. Two different detectors are used: the Deep River neutron monitor and measurements of low energy protons made on the IMP-C satellite. The average energy response of the Deep River monitor is 16 GeV, whereas the IMP-C data is for protons with energies above 50 MeV. The resulting radial gradient is found to be nearly zero for the alpha particles and slightly negative for the protons. The same qualitative results were found using the IMP-C data and the Deep River neutron monitor to measure the temporal variation in the cosmic ray intensity. The present analysis indicates that detectors over a wide range of energies are suitable for measuring the radial gradient, providing sufficient statistical precision is obtained to evaluate short-term modulation and the azimuthal separation of the detectors is not great.

Sheldon, W. R.↗
DOE OSTI2022

Real-Time Optimization Workflow Status Update

Economically optimal and safe operation of integrated energy systems (IES) requires optimization at many different time scales. A real-time optimization (RTO) workflow will attempt to maximize revenue and minimize operational costs on a time scale of minutes to hours. Such a workflow requires the use of a digital twin (DT), which is a virtual representation of a physical system. The DT is updated using real-time data from the physical system, and serves as a model in an optimization framework. The optimization results are then sent back to the physical system to complete the loop. This report details the progress made in developing building blocks for a DT/RTO framework. The Risk Analysis Virtual Environment (RAVEN) platform within the Framework for Optimization of Resources and Economics (FORCE) tool suite can perform many of the tasks required for building a DT and performing RTO. The first item of this report details RAVEN enhancements that enable RAVEN workflows to be run in various environments. Data communication between the physical system and its DT is essential for successful RTO. This includes preprocessing real-time data, loading data into a data warehouse, and querying the stored data. The second section of this report describes the progress made in implementing an adapter in Python in order for Deep Lynx to handle the data communication. Typical dispatch optimization frameworks are built on linear programming (LP). The prototype RTO workflow developed in this report uses an LP problem as a part of a receding-horizon- or economic model predictive control (EMPC) based optimization. The third section of this report details the framework of an RTO workflow in which the system consists of a simple electrical storage device. A DT can be built from a reduced-order model (ROM). Integrating a ROM into a typical LP optimization framework has been challenging because most optimization packages require the user to write algebraic expressions for the system model. The final section of this report shows how an externally built RAVEN ROM can be integrated in an RTO framework by using the Python package Pyomo. This demonstrates the RTO workflow capability from a software-only perspective and is an important step in demonstrating the capability to implement an RTO workflow for a physical system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Filament-Free Bulk Resistive Memory Enables Deterministic Analogue Switching

Digital computing is nearing its physical limits as computing needs and energy consumption rapidly increase. Analogue-memory-based neuromorphic computing can be orders of magnitude more energy efficient at data-intensive tasks like deep neural networks, but has been limited by the inaccurate and unpredictable switching of analogue resistive memory. Filamentary resistive random access memory (RRAM) suffers from stochastic switching due to the random kinetic motion of discrete defects in the nanometer-sized filament. Here, this stochasticity is overcome by incorporating a solid electrolyte interlayer, in this case, yttria-stabilized zirconia (YSZ), toward eliminating filaments. Filament-free, bulk-RRAM cells instead store analogue states using the bulk point defect concentration, yielding predictable switching because the statistical ensemble behavior of oxygen vacancy defects is deterministic even when individual defects are stochastic. Both experiments and modeling show bulk-RRAM devices using TiO2-X switching layers and YSZ electrolytes yield deterministic and linear analogue switching for efficient inference and training. Bulk-RRAM solves many outstanding issues with memristor unpredictability that have inhibited commercialization, and can, therefore, enable unprecedented new applications for energy-efficient neuromorphic computing. Beyond RRAM, this work shows how harnessing bulk point defects in ionic materials can be used to engineer deterministic nanoelectronic materials and devices.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Toward Real-Time Analysis of Synchrotron Micro-Tomography Data: Accelerating Experimental Workflows with AI and HPC

ynchrotron light sources are routinely used to perform imaging experiments. In this paper, we review the relevant computational stages, identify bottlenecks, and highlight future opportunities to streamline data acquisition for experimental microscopy workflows. We demonstrate our preliminary exploration with an end-to-end scientific workflow on Summit based on micro-computed tomography data. Computational elements include: 1) reconstruction of volumetric image data; 2) denoising with deep neural networks; and 3) non-local means based segmentation and quantitative analysis.

Mcclure, James↗
DOE OSTI2020

Hybrid geological modeling: Combining machine learning and multiple-point statistics

Accurately modeling and constructing a geologically realistic subsurface model remains an outstanding problem as the morphology controls the flow behaviors. Particularly, one of the pattern-based methods, namely cross-correlation based simulation, has been proved to be an effective way to reconstruct a realistic model, at both small and large scales. However, conditioning to point data in the large-scale problems is still a crucial issue in these algorithms, since there is always a trade-off between the quality of the realizations and the degree of point data reproduction. Specifically, it is not practical to build a training image (TI) which includes all the possibilities and variabilities. Therefore, finding a pattern that can represent the point data and, at the same time, preserving the connectivities is difficult. This leads to producing highly-connected realizations with a significant mismatch or poor models with a reasonable degree of point data reproduction. To accurately reproduce the densely distributed hard data, pixel-based methods can also produce some unrealistic artifacts around the hard data. In this paper, to overcome this challenge, however, we use pattern-based methods as they often produce more disconnected geobodies when dealing with dense hard data, and proposed a hybrid algorithm using the pattern-based methods and convolutional neural network (CNN). The trained CNN model is utilized to improve the quality of conditioning to point data for the original realizations generated by the pattern-based algorithm. As such, the mismatch locations are identified, and the same regions are used in the training of CNN to mimic the procedure through which a missing region can be filled. To evaluate the performance of the proposed hybrid algorithm, it is tested on cases with different dimensions and different numbers of facies. Then, the newly improved realizations are compared with the initial realizations generated by the pattern-based algorithm. The comparison is also conducted by the flow simulation test. And it indicates that the proposed hybrid algorithm can better reproduce the point data, while the connectivities are better preserved.

58 GEOSCIENCES↗
DOE OSTI2021

DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks

Electroconvection is a multiphysics problem involving coupling of the flow field with the electric field as well as the cation and anion concentration fields. Here, we use electroconvection as a benchmark problem to put forward a new data assimilation framework, the DeepM&Mnet, for simulating multiphysics and multiscale problems at speeds much faster than standard numerical methods using pre-trained neural networks. We first pre-train DeepONets that can predict independently each field, given general inputs from the rest of the fields of the coupled system. DeepONets can approximate nonlinear operators and are composed of two sub-networks, a branch net for the input fields and a trunk net for the locations of the output field. DeepONets, which are extremely fast, are used as building blocks in the DeepM&Mnet and form constraints for the multiphysics solution along with some sparse available measurements of any of the fields. We demonstrate the new methodology and document the accuracy of each individual DeepONet, and subsequently we present two different DeepM&Mnet architectures that infer accurately and efficiently 2D electroconvection fields for unseen electric potentials. Furthermore, the DeepM&Mnet framework is general and can be applied for building any complex multiphysics and multiscale models based on very few measurements using pre-trained DeepONets in a “plug-and-play” mode.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Improving scalability of parallel CNN training by adaptively adjusting parameter update frequency

Synchronous SGD with data parallelism, the most popular parallelization strategy for CNN training, suffers from the expensive communication cost of averaging gradients among all workers. The iterative parameter updates of SGD cause frequent communications and it becomes the performance bottleneck. In this paper, we propose a lazy parameter update algorithm that adaptively adjusts the parameter update frequency to address the expensive communication cost issue. Our algorithm accumulates the gradients if the difference of the accumulated gradients and the latest gradients is sufficiently small. Here, the less frequent parameter updates reduce the per-iteration communication cost while maintaining the model accuracy. Our experimental results demonstrate that the lazy update method remarkably improves the scalability while maintaining the model accuracy. For ResNet50 training on ImageNet, the proposed algorithm achieves a significantly higher speedup (739.6 on 2048 Cori KNL nodes) as compared to the vanilla synchronous SGD (276.6) while the model accuracy is almost not affected (<0.2% difference).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Catalyzing deep decarbonization with federated battery diagnosis and prognosis for better data management in energy storage systems

Industrial data analytics methods play a central role in improving energy storage performance and efficiency, impacting the future of electrified transportation and renewable electricity generation. However, significant challenges hinder the large-scale deployment of batteries. Conventional methods rely on centralized collection and processing of fleet-level data, leading to database size issues and privacy concerns due to potential data breaches. To enable scalable deployment of battery management systems, this article proposes a federated battery diagnosis and prognosis model, which distributes the processing of battery standard current-voltage-time-usage data in a privacy-preserving manner. Instead of transferring the raw data, this approach communicates only the locally processed parameters, thus reducing communication load and preserving data confidentiality. The federated model offers a paradigm shift in battery health management through privacy-preserving distributed methods for battery data processing and lifetime prediction, ensuring the reliable and sustainable deployment of lithium-ion batteries in a rapidly evolving world.

asset health management↗
DOE OSTI2018

Interseismic Ground Deformation and Fault Slip Rates in the Greater San Francisco Bay Area From Two Decades of Space Geodetic Data

The detailed spatial variations of strain accumulation and creep on major faults in the northern San Francisco Bay Area (North Bay), which are important for seismic potential and evaluation of natural hazards, remain poorly understood. We combine interferometric synthetic aperture radar data from the ERS-1/2 and Envisat satellites between 1992 and 2010 with continuous and campaign GPS data to obtain a high spatial and temporal coverage of ground deformation of the North Bay. The SAR data from both ascending and descending orbits are combined to separate horizontal and vertical components of the deformation. We jointly invert the horizontal component of the mean velocities derived from these data to infer the deep strike-slip rates on major locked faults. We use the estimated deep rates to simulate the long-wavelength deformation due to interseismic elastic strain accumulation along these locked faults. After removing the long-wavelength signal from the InSAR horizontal mean velocity field, we estimate fault-parallel surface creep rates of up to 2 mm/year along the central section of the Rodgers Creek fault and surface creep rates ranging between 2 and 4 mm/year along the Concord fault. No surface creep is geodetically resolved along the West Napa and Green Valley fault zones. We identified characteristically repeating earthquakes on the Rodgers Creek fault, the West Napa fault, the Green Valley fault, and the Concord fault. Finally, nontectonic deformation in the Geysers geothermal field and in Late Cenozoic basins (Rohnert Park and Sonoma basins) are also observed, likely due to hydrological and sediment-compaction processes, respectively.

58 GEOSCIENCES↗
DOE OSTI2024

Real-time tracking of structural evolution in 2D MXenes using theory-enhanced machine learning

In situ Electron Energy Loss Spectroscopy (EELS) combined with Transmission Electron Microscopy (TEM) has traditionally been pivotal for understanding how material processing choices affect local structure and composition. However, the ability to monitor and respond to ultrafast transient changes, now achievable with EELS and TEM, necessitates innovative analytical frameworks. Here, we introduce a machine learning (ML) framework tailored for the real-time assessment and characterization of in operando EELS Spectrum Images (EELS-SI). We focus on 2D MXenes as the sample material system, specifically targeting the understanding and control of their atomic-scale structural transformations that critically influence their electronic and optical properties. This approach requires fewer labeled training data points than typical deep learning classification methods. By integrating computationally generated structures of MXenes and experimental datasets into a unified latent space using Variational Autoencoders (VAE) in a unique training method, our framework accurately predicts structural evolutions at latencies pertinent to closed-loop processing within the TEM. This study presents a critical advancement in enabling automated, on-the-fly synthesis and characterization, significantly enhancing capabilities for materials discovery and the precision engineering of functional materials at the atomic scale.

47 OTHER INSTRUMENTATION↗