Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural Networks Research”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Physics-Informed Machine Learning Model for Ceramic Matrix Composite Creep

A physics-informed recurrent neural network (RNN) based surrogate model is developed to emulate the nonlinear, time-dependent constitutive behavior of ceramic matrix composites (CMCs) driven by matrix damage and constituent creep at the microscale. Physics-informed constraints are introduced into the surrogate model through regularization to ground the prediction in physics and improve its predictive capabilities. Training data is generated using the high-fidelity generalized method of cells (HFGMC) approach which calls appropriate creep and damage models for each of the constituents. This coupling permits simulating the nonlinear behavior of CMCs based on constituent response at the microscale along with microstructural features such as fiber and porosity volume fraction and fiber radius. The microscale repeating unit cell is loaded under creep fatigue conditions to replicate the material loading experienced in a turbine engine. Therefore, the RNN-based surrogate model is tasked with predicting, as a function of variable input stress sequence, temperature, and microstructural features, the resulting strain history response while satisfying physical constraints related to creep rate, isochoric inelastic deformation, and strain energy density. The trained surrogate model is shown to effectively match the strain history over quantified distributions of microstructural features and relevant loading regimes and temperatures. Neural network based surrogate models can offer efficient alternatives to running computationally intensive multiscale material models to simulate the nonlinear response of large structural models. Therefore, the presented work provides evidence towards the feasibility of developing, training, and running such models for CMCs with complex microstructures, nonlinear time-dependent material response, and under non-monotonic loading conditions.

ceramic matrix composites↗

A framework to evaluate machine learning crystal stability predictions

The rapid adoption of machine learning in various scientific domains calls for the development of best practices and community agreed-upon benchmarking tasks and metrics. We present Matbench Discovery as an example evaluation framework for machine learning energy models, here applied as pre-filters to first-principles computed data in a high-throughput search for stable inorganic crystals. We address the disconnect between (1) thermodynamic stability and formation energy and (2) retrospective and prospective benchmarking for materials discovery. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with adaptive user-defined weighting of various performance metrics allowing researchers to prioritize the metrics they value most. To answer the question of which machine learning methodology performs best at materials discovery, our initial release includes random forests, graph neural networks, one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials. We highlight a misalignment between commonly used regression metrics and more task-relevant classification metrics for materials discovery. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV per atom above the convex hull. The benchmark results demonstrate that universal interatomic potentials have advanced sufficiently to effectively and cheaply pre-screen thermodynamic stable hypothetical materials in future expansions of high-throughput materials databases.

Riebesell, Janosh↗

Numerical Investigation of Fuel Property Effects on Mixed-Mode Combustion in a Spark-Ignition Engine

In this research, lean mixed-mode combustion is numerically investigated using computational fluid dynamics (CFD) in a spark-ignition engine. A new E30 fuel surrogate is developed using a neural network model with matched octane numbers. A skeletal mechanism is also developed by automated mechanism reduction and by incorporating a NO x submechanism. A hybrid approach that couples the G-equation model and the well-stirred reactor model is employed for turbulent combustion modeling. The developed CFD model is shown to well predict pressure and apparent heat release rate (AHRR) traces compared with experiment. Two types of combustion cycles (deflagration-only and mixed-mode cycles) are observed. The mixed-mode cycles feature early flame propagation and subsequent end-gas auto-ignition, leading to two distinctive AHRR peaks. The validated CFD model is then employed to investigate the effects of NO x chemistry. The NO x chemistry is found to promote auto-ignition through the residual gas, while the deflagration phase remains largely unaffected. Sensitivity analysis is finally performed to understand effects of fuel properties, including heat of vaporization (HoV) and laminar flame speed (S L ). An increased HoV tends to suppress auto-ignition through charge cooling, while the impact of HoV on flame propagation is insignificant. In contrast, an increased S L is found to significantly promote both flame propagation and end-gas auto-ignition. The promoting effect of S L on auto-ignition is not a direct chemical effect; it is rather caused by an advancement of the combustion phasing, which increases compression heating of the end-gas.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Remote sensing of earth terrain

Abstracts from 46 refereed journal and conference papers are presented for research on remote sensing of earth terrain. The topics covered related to remote sensing include the following: mathematical models, vegetation cover, sea ice, finite difference theory, electromagnetic waves, polarimetry, neural networks, random media, synthetic aperture radar, electromagnetic bias, and others.

Kong, Jin AU↗

Strictly Enforcing Invertibility and Conservation in CNN-Based Super Resolution for Scientific Datasets

Abstract Recently, deep convolutional neural networks (CNNs) have revolutionized image “super resolution” (SR), dramatically outperforming past methods for enhancing image resolution. They could be a boon for the many scientific fields that involve imaging or any regularly gridded datasets: satellite remote sensing, radar meteorology, medical imaging, numerical modeling, and so on. Unfortunately, while SR-CNNs produce visually compelling results, they do not necessarily conserve physical quantities between their low-resolution inputs and high-resolution outputs when applied to scientific datasets. Here, a method for “downsampling enforcement” in SR-CNNs is proposed. A differentiable operator is derived that, when applied as the final transfer function of a CNN, ensures the high-resolution outputs exactly reproduce the low-resolution inputs under 2D-average downsampling while improving performance of the SR schemes. The method is demonstrated across seven modern CNN-based SR schemes on several benchmark image datasets, and applications to weather radar, satellite imager, and climate model data are shown. The approach improves training time and performance while ensuring physical consistency between the super-resolved and low-resolution data. Significance Statement Recent advancements in using deep learning to increase the resolution of images have substantial potential across the many scientific fields that use images and image-like data. Most image super-resolution research has focused on the visual quality of outputs, however, and is not necessarily well suited for use with scientific data where known physics constraints may need to be enforced. Here, we introduce a method to modify existing deep neural network architectures so that they strictly conserve physical quantities in the input field when “super resolving” scientific data and find that the method can improve performance across a wide range of datasets and neural networks. Integration of known physics and adherence to established physical constraints into deep neural networks will be a critical step before their potential can be fully realized in the physical sciences.

54 ENVIRONMENTAL SCIENCES↗

Autonomous Detection and Classification of Lunar Minerals Using a Convolutional Neural Network Based Framework for the SUCR DALI Project

NASA’s long-term goal is to deploy humans to the Moon and, from there, advance human exploration to Mars, with Artemis missions as pivotal milestones. Raman spectroscopy can uniquely identify minerals, compounds, water states, and other materials, providing distinctive fingerprints for classification. A Raman instrument has been successfully deployed and utilized on the Mars surface via the Perseverance rover, but has not yet been utilized at the lunar surface The SUCR DALI project is working towards developing a Raman spectroscopy instrument to be applied in various lunar mission concepts, including within the Artemis program. The objective of my research is to assist in the maturation of the proposed SUCR DALI lunar Raman instrument through the development of an autonomous detection and classification model capable of identifying minerals and water states on the Moon’s surface.

Convolutional Neural Networks↗

Damage Detection of a Pressure Vessel with Smart Sensing and Deep Learning

Structural Health Monitoring plays a crucial role in ensuring the safety and reliability of critical infrastructure, including pressure vessels involved in various applications. This research reports the damage detection of a pressure box employed in space habitat that operates in harsh environment where both structural failure and bolt joint loosening may occur. These failure modes are extremely hard to model based on first principles. We explore proper sensing mechanism and the associated inverse analysis algorithm that can elucidate the health condition of the pressure box. It is identified that piezoelectric impedance based active interrogation can provide necessary information for damage detection in such a system. Concurrently, deep learning technique leveraging spatial convolutional neural network is synthesized to analyze the raw data acquired and identify different types of damage. By training the deep learning model on a dataset of healthy and various damage scenarios, we can achieve high accuracy in identifying the presence of damage and its type. This research provides a data-driven methodology for structural damage detection using deep learning and has the potential to be extended to various systems with different failure modes.

Yang Zhang↗

Position Papers for the 2024 ASCR Workshop on Neuromorphic Computing for Science

Engineering novel neuromorphic computing systems with functionalities, capabilities, and energy efficiency similar to biological brains is one of the most exciting and challenging scientific endeavors of our time. This workshop aims to identify key research needs, challenges, and next steps necessary to develop biologically realistic neuromorphic circuits primitives that capture the functionality of neural systems found in nature. Moreover, simulating neuromorphic computing primitives integrated into networks will be key to under standing their behavior at scale, particularly for those computing architectures where full-scale commercial fabrication is not yet readily accessible. Appropriate neuroscience datasets and metrics will have to be established to vet proposed neuromorphic circuits.

97 MATHEMATICS AND COMPUTING↗

Connectionist model-based stereo vision for telerobotics

Autonomous stereo vision for range measurement could greatly enhance the performance of telerobotic systems. Stereo vision could be a key component for autonomous object recognition and localization, thus enabling the system to perform low-level tasks, and allowing a human operator to perform a supervisory role. The central difficulty in stereo vision is the ambiguity in matching corresponding points in the left and right images. However, if one has a priori knowledge of the characteristics of the objects in the scene, as is often the case in telerobotics, a model-based approach can be taken. Researchers describe how matching ambiguities can be resolved by ensuring that the resulting three-dimensional points are consistent with surface models of the expected objects. A four-layer neural network hierarchy is used in which surface models of increasing complexity are represented in successive layers. These models are represented using a connectionist scheme called parameter networks, in which a parametrized object (for example, a planar patch p=f(h,m sub x, m sub y) is represented by a collection of processing units, each of which corresponds to a distinct combination of parameter values. The activity level of each unit in the parameter network can be thought of as representing the confidence with which the hypothesis represented by that unit is believed. Weights in the network are set so as to implement gradient descent in an energy function.

Hoff, William↗

Hazard detection and avoidance sensor for NASA's planetary landers

An optical terrain analysis based sensor system specifically designed for landing hazard detection as required for NASA's autonomous planetary landers is introduced. This optical hazard detection and avoidance (HDA) sensor utilizes an optoelectronic wedge-and-ting (WRD) filter for Fourier transformed feature extraction and an electronic neural network processor for pattern classification. A fully implemented optical HDA sensor would assure safe landing of the planetary landers. Computer simulation results of a successful feasibility study is reported. Future research for hardware system implementation is also provided.

Lau, Brian↗

Quantifying Atomically Dispersed Catalysts Using Deep Learning Assisted Microscopy

The catalytic performance of atomically dispersed catalysts (ADCs) is greatly influenced by their atomic configurations, such as atom–atom distances, clustering of atoms into dimers and trimers, and their distributions. Scanning transmission electron microscopy (STEM) is a powerful technique for imaging ADCs at the atomic scale; however, most STEM analyses of ADCs thus far have relied on human labeling, making it difficult to analyze large data sets. Here, we introduce a convolutional neural network (CNN)-based algorithm capable of quantifying the spatial arrangement of different adatom configurations. The algorithm was tested on different ADCs with varying support crystallinity and homogeneity. Results show that our algorithm can accurately identify atom positions and effectively analyze large data sets. Here, this work provides a robust method to overcome a major bottleneck in STEM analysis for ADC catalyst research. We highlight the potential of this method to serve as an on-the-fly analysis tool for catalysts in future in situ microscopy experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Numerical Investigation of a Central Fuel Property Hypothesis under Boosted Spark-ignition Conditions

In the present work, a central fuel property hypothesis (CFPH), which states that fuel properties are sufficient to provide an indication of a fuel's performance irrespective of its chemical composition, was numerically investigated In particular, the objective of the study was to determine whether Research Octane Number (RON) and Motor Octane Number (MON), as fuel properties, are sufficient to describe a fuel's knock-limited performance under boosted spark-ignition (SI) conditions within the framework of CFPH. To this end, four TPRF-bioblendstock surrogates having different compositions but matched RON (= 98) and MON (= 90), were first generated using a non-linear regression model based on artificial neural network (ANN). Three unconventional bioblendstocks were included in the analysis: Di-isobutylene (DIB), Isobutanol and Anisole. Skeletal reaction mechanisms were generated for the TPRF-DIB, TPRF-isobutanol and TPRF-anisole blends from a detailed kinetic mechanism. Thereafter, numerical simulations were performed for the fuel surrogates using the skeletal mechanisms and a virtual cooperative fuel research (CFR) engine model, under a representative boosted operating condition. In the computational fluid dynamics (CFD) model, the G-equation approach was employed to track the turbulent flame front and the well-stirred reactor model combined with multi-zone binning strategy was used to capture auto-ignition in the end-gas. In addition, laminar flame speed was tabulated for each blend as a function of pressure, temperature and equivalence ratio a priori, and the lookup tables were used to prescribe laminar flame speed as an input to the G-equation model. Parametric spark timing sweeps were performed for each fuel blend to determine the corresponding knock-limited spark advance (KLSA) and 50% burn point (CA50) at the respective KLSA timing. It was observed that despite same RON, MON and engine operating conditions, the TPRF-Anisole blend exhibited markedly different knock-limited performance from the other three blends. This deviation from the octane index (DI) expectation was shown to be caused by differences in laminar flame speed (LFS). However; it was found that relatively large fuel-specific differences in LFS (> 20%) would have to be present to cause any appreciable deviation from the 01 framework. Otherwise, RON and MON would still be robust enough to predict a fuel's knock-limited performance.

Pal, Pinaki↗

Generalizable, fast, and accurate DeepQSPR with fastprop

Abstract Quantitative Structure–Property Relationship studies (QSPR), often referred to interchangeably as QSAR, seek to establish a mapping between molecular structure and an arbitrary target property. Historically this was done on a target-by-target basis with new descriptors being devised to specifically map to a given target. Today software packages exist that calculate thousands of these descriptors, enabling general modeling typically with classical and machine learning methods. Also present today are learned representation methods in which deep learning models generate a target-specific representation during training. The former requires less training data and offers improved speed and interpretability while the latter offers excellent generality, while the intersection of the two remains under-explored. This paper introduces , a software package and general Deep-QSPR framework that combines a cogent set of molecular descriptors with deep learning to achieve state-of-the-art performance on datasets ranging from tens to tens of thousands of molecules. provides both a user-friendly Command Line Interface and highly interoperable set of Python modules for the training and deployment of feedforward neural networks for property prediction. This approach yields improvements in speed and interpretability over existing methods while statistically equaling or exceeding their performance across most of the tested benchmarks. is designed with Research Software Engineering best practices and is free and open source, hosted at github.com/jacksonburns/fastprop.

Burns, Jackson W. (ORCID:0000000206579426)↗

Low power signal processing research at Stanford

This paper gives an overview of the research being conducted at Stanford University's Space, Telecommunications, and Radioscience Laboratory in the area of low energy computation. It discusses the work we are doing in large scale digital VLSI neural networks, interleaved processor and pipelined memory architectures, energy estimation and optimization, multichip module packaging, and low voltage digital logic.

Burr, J.↗

Implementation of Adaptive Digital Controllers on Programmable Logic Devices

Much has been made of the capabilities of Field Programmable Gate Arrays (FPGA's) in the hardware implementation of fast digital signal processing functions. Such capability also makes an FPGA a suitable platform for the digital implementation of closed loop controllers. Other researchers have implemented a variety of closed-loop digital controllers on FPGA's. Some of these controllers include the widely used Proportional-Integral-Derivative (PID) controller, state space controllers, neural network and fuzzy logic based controllers. There are myriad advantages to utilizing an FPGA for discrete-time control functions which include the capability for reconfiguration when SRAM- based FPGA's are employed, fast parallel implementation of multiple control loops and implementations that can meet space level radiation tolerance requirements in a compact form-factor. Generally, a software implementation on a Digital Signal Processor (DSP) device or microcontroller is used to implement digital controllers. At Marshall Space Flight Center, the Control Electronics Group has been studying adaptive discrete-time control of motor driven actuator systems using DSP devices. While small form factor, commercial DSP devices are now available with event capture, data conversion, Pulse Width Modulated (PWM) outputs and communication peripherals, these devices are not currently available in designs and packages which meet space level radiation requirements. In general, very few DSP devices are produced that are designed to meet any level of radiation tolerance or hardness. An alternative is required for compact implementation of such functionality to withstand the harsh environment encountered on spacemap. The goal of this effort is to create a fully digital, flight ready controller design that utilizes an FPGA for implementation of signal conditioning for control feedback signals, generation of commands to the controlled system, and hardware insertion of adaptive-control algorithm approaches. Radiation tolerant FPGA's are a feasible option for reaching this goal.

Gwaltney, David A.↗

Implementation of Adaptive Digital Controllers on Programmable Logic Devices

Much has been made of the capabilities of FPGA's (Field Programmable Gate Arrays) in the hardware implementation of fast digital signal processing. Such capability also makes an FPGA a suitable platform for the digital implementation of closed loop controllers. Other researchers have implemented a variety of closed-loop digital controllers on FPGA's. Some of these controllers include the widely used proportional-integral-derivative (PID) controller, state space controllers, neural network and fuzzy logic based controllers. There are myriad advantages to utilizing an FPGA for discrete-time control functions which include the capability for reconfiguration when SRAM-based FPGA's are employed, fast parallel implementation of multiple control loops and implementations that can meet space level radiation tolerance requirements in a compact form-factor. Generally, a software implementation on a DSP (Digital Signal Processor) or microcontroller is used to implement digital controllers. At Marshall Space Flight Center, the Control Electronics Group has been studying adaptive discrete-time control of motor driven actuator systems using digital signal processor (DSP) devices. While small form factor, commercial DSP devices are now available with event capture, data conversion, pulse width modulated (PWM) outputs and communication peripherals, these devices are not currently available in designs and packages which meet space level radiation requirements. In general, very few DSP devices are produced that are designed to meet any level of radiation tolerance or hardness. The goal of this effort is to create a fully digital, flight ready controller design that utilizes an FPGA for implementation of signal conditioning for control feedback signals, generation of commands to the controlled system, and hardware insertion of adaptive control algorithm approaches. An alternative is required for compact implementation of such functionality to withstand the harsh environment encountered on spacecraft. Radiation tolerant FPGA's are a feasible option for reaching this goal.

Gwaltney, David A.↗

Numerical Investigation of a Central Fuel Property Hypothesis Under Boosted Spark-Ignition Conditions

In the present work, a central fuel property hypothesis (CFPH), which states that fuel properties are sufficient to provide an indication of a fuel’s performance irrespective of its chemical composition, was numerically investigated. In particular, the objective of the study was to determine whether Research Octane Number (RON) and Motor Octane Number (MON), as fuel properties, are sufficient to describe a fuel’s knock-limited performance under boosted spark-ignition (SI) conditions within the framework of CFPH. To this end, four TPRF-bioblendstock surrogates having different compositions but matched RON (=98) and MON (=90), were first generated using a non-linear regression model based on artificial neural network (ANN). Additionally, three unconventional bioblendstocks were included in the analysis: di-isobutylene (DIB), isobutanol, and Anisole. Skeletal reaction mechanisms were generated for the TPRF-DIB, TPRF-isobutanol, and TPRF-anisole blends from a detailed kinetic mechanism. Thereafter, numerical simulations were performed for the fuel surrogates using the skeletal mechanisms and a virtual cooperative fuel research (CFR) engine model, under a representative boosted operating condition. In the computational fluid dynamics (CFD) model, the G-equation approach was employed to track the turbulent flame front and the well-stirred reactor model combined with the multi-zone binning strategy was used to capture auto-ignition in the end-gas. In addition, laminar flame speed (LFS) was tabulated for each blend as a function of pressure, temperature, and equivalence ratio a priori, and the lookup tables were used to prescribe laminar flame speed as an input to the G-equation model. Parametric spark timing sweeps were performed for each fuel blend to determine the corresponding knock-limited spark advance (KLSA) and 50% burn point (CA50) at the respective KLSA timing. It was observed that despite same RON, MON, and engine operating conditions, the TPRF-anisole blend exhibited markedly different knock-limited performance from the other three blends. This deviation from the octane index (OI) expectation was shown to be caused by differences in laminar flame speed. However, it was found that relatively large fuel-specific differences in LFS (>20%) would have to be present to cause any appreciable deviation from the OI framework. Otherwise, RON and MON would still be robust enough to predict a fuel’s knock-limited performance.

42 ENGINEERING↗

Deep Learning-Based Failure Prognostic Model for PV Inverter Using Field Measurements

Here, this study presents a novel approach for the precise monitoring and prognosis of photovoltaic (PV) inverter status, which is crucial for the proactive maintenance of PV systems. It addresses the gaps in traditional model-based methods, which tend to neglect the overall reliability of inverters, and the limitations of data-driven approaches that largely depend on simulated data. This research presents a robust solution applicable to real-world scenarios. The proposed data-driven model for PV inverter failure prognosis employs actual inverter measurements, integrating various operational and weather-related factors based on domain knowledge. This approach effectively represents inverter stressors and operational status. Utilizing an Enhanced Siamese Convolutional Neural Network (ESCNN), the model merges operational data with domain knowledge features, redefining the prognosis challenge as a classification task. Furthermore, the paper discusses an ESCNN-based real-time inverter failure monitoring method developed on the well-trained model. The proposed models are rigorously trained and tested with real inverter data and a novel filtering method is included to address accidental failures in practical scenarios. The results validate the model's efficacy, and the directions for future research are also outlined.

42 ENGINEERING↗