Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

INTEGRATE - Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements

The INTEGRATE (Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements) project is developing a new inverse-design capability for the aerodynamic design of wind turbine rotors using invertible neural networks. This AI-based design technology can capture complex non-linear aerodynamic effects while being 100 times faster than design approaches based on computational fluid dynamics. This project enables innovation in wind turbine design by accelerating time to market through higher-accuracy early design iterations to reduce the levelized cost of energy. INVERTIBLE NEURAL NETWORKS Researchers are leveraging a specialized invertible neural network (INN) architecture along with the novel dimension-reduction methods and airfoil/blade shape representations developed by collaborators at the National Institute of Standards and Technology (NIST) learns complex relationships between airfoil or blade shapes and their associated aerodynamic and structural properties. This INN architecture will accelerate designs by providing a cost-effective alternative to current industrial aerodynamic design processes, including: - Blade element momentum (BEM) theory models: limited effectiveness for design of offshore rotors with large, flexible blades where nonlinear aerodynamic effects dominate - Direct design using computational fluid dynamics (CFD): cost-prohibitive - Inverse-design models based on deep neural networks (DNNs): attractive alternative to CFD for 2D design problems, but quickly overwhelmed by the increased number of design variables in 3D problems AUTOMATED COMPUTATIONAL FLUID DYNAMICS FOR TRAINING DATA GENERATION - MERCURY FRAMEWORK The INN is trained on data obtained using the University of Marylands (UMD) Mercury Framework, which has with robust automated mesh generation capabilities and advanced turbulence and transition models validated for wind energy applications. Mercury is a multi-mesh paradigm, heterogeneous CPU-GPU framework. The framework incorporates three flow solvers at UMD, 1) OverTURNS, a structured solver on CPUs, 2) HAMSTR, a line based unstructured solver on CPUs, and 3) GARFIELD, a structured solver on GPUs. The framework is based on Python, that is often used to wrap C or Fortran codes for interoperability with other solvers. Communication between multiple solvers is accomplished with a Topology Independent Overset Grid Assembler (TIOGA). NOVEL AIRFOIL SHAPE REPRESENTATIONS USING GRASSMAN SPACES We developed a novel representation of shapes which decouples affine-style deformations from a rich set of data-driven deformations over a submanifold of the Grassmannian. The Grassmannian representation as an analytic generative model, informed by a database of physically relevant airfoils, offers (i) a rich set of novel 2D airfoil deformations not previously captured in the data , (ii) improved low-dimensional parameter domain for inferential statistics informing design/manufacturing, and (iii) consistent 3D blade representation and perturbation over a sequence of nominal shapes. TECHNOLOGY TRANSFER DEMONSTRATION - COUPLING WITH NREL WISDEM Researchers have integrated the inverse-design tool for 2D airfoils (INN-Airfoil) into WISDEM (Wind Plant Integrated Systems Design and Engineering Model), a multidisciplinary design and optimization framework for assessing the cost of energy, as part of tech-transfer demonstration. The integration of INN-Airfoil into WISDEM allows for the design of airfoils along with the blades that meet the dynamic design constraints on cost of energy, annual energy production, and the capital costs. Through preliminary studies, researchers have shown that the coupled INN-Airfoil + WISDEM approach reduces the cost of energy by around 1% compared to the conventional design approach. This page will serve as a place to easily access all the publications from this work and the repositories for the software developed and released through this pr...

aerodynamics↗
DOE OSTI2023

Using deep machine learning to interpret proton radiography data from a pulsed power experiment

Deep machine learning is used to analyze a proton radiograph from a tin pulsed power experiment and determine density values for each pixel in the image. Two promising convolutional neural network architectures that have proven to be effective for image analysis in other applications are applied to analyze a proton radiograph and find density values. The process of creating a suitable training dataset is described, involving the Lagrangian hydrodynamic model used for simulations of the experiment, the proton radiography forward model to make synthetic images for training, and the manner in which data augmentation is used to expand the resulting image dataset. It is shown that machine learning not only produces a reasonable density field but is also able to predict features in the density field that are suggested by the proton radiograph but not captured by simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Predicting the Cetane Number, Yield Sooting Index, Kinematic Viscosity, and Cloud Point for Catalytically Upgraded Pyrolysis Oil Using Artificial Neural Networks

Abstract The conversion of biomass using fast pyrolysis has the potential to be significantly less expensive at scale compared to alternative methods such as fermentation and gasification. Selective upgrading of the products of fast pyrolysis through chemical catalysis produces compounds with lower oxygen content and lower acidity; however, identifying the specific catalytic pathways for producing viable fuels and fuel additives often requires a trial-and-error approach. Specifically, key properties of the compounds must be experimentally tested to evaluate the viability of the resultant compounds. The present work proposes predictive models constructed with artificial neural networks (ANNs) for cetane number (CN), yield sooting index (YSI), kinematic viscosity (KV), and cloud point (CP), with blind test set median absolute errors of 5.14 cetane units, 3.36 yield sooting index units, 0.07 millimeters squared per second, and 4.89 degrees Celsius, respectively. Furthermore, the cetane number, yield sooting index, kinematic viscosity, and cloud point were predicted for over three hundred expected products from the catalytic upgrading of pyrolysis oil. It was discovered that 130 of these compounds have predicted cetane numbers greater than 40, with four of these compounds possessing predicted yield sooting index values significantly less than that of diesel fuel and predicted viscosities and cloud points comparable to that of diesel fuel.

09 BIOMASS FUELS↗
DOE OSTI2022

Modeling the Solvation and Acidity of Carboxylic Acids Using an Ab Initio Deep Neural Network Potential

Formic and acetic acid constitute the simplest of carboxylic acids, yet they exhibit fascinating chemistry in the condensed phase such as proton transfer and dimerization. The go-to method of choice for modeling these rare events have been accurate but expensive ab-initio molecular dynamics simulations. Here, we present a deep neural network potential trained using accurate ab-initio data that can be used in tandem with enhanced-sampling methods to perform an efficient exploration of the free-energy surface of aqueous solutions of weak carboxylic acids. In particular, we show that our model captures proton dissociation and provides a good estimate of the pK a , as well as the dimerization of formic and acetic acid. This provides a suitable starting point for applications in different research areas where computational efficiency coupled with the accuracy of ab-initio methods is required.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Invertible Temper Modeling using Normalizing Flows and the Effects of Structure Preserving Loss

Advanced manufacturing research and development is typically small-scale, owing to costly experiments associated with these novel processes. Deep learning techniques could help accelerate this development cycle but frequently struggle in small-data regimes like the advanced manufacturing space. While prior work has applied deep learning to modeling visually plausible advanced manufacturing microstructures, little work has been done on data-driven modeling of how microstructures are affected by heat treatment, or assessing the degree to which synthetic microstructures are able to support existing workflows. We propose to address this gap by using invertible neural networks (normalizing flows) to model the effects of heat treatment, e.g., tempering. The model is developed using scanning electron microscope imagery from samples produced using shear-assisted processing and extrusion (ShAPE) manufacturing. This approach not only produces visually and topologically plausible samples, but also captures information related to a sample’s material properties or experimental process parameters. We also demonstrate that topological data analysis, used in prior work to characterize microstructures, can also be used to stabilize model training, preserve structure, and improve downstream results. We assess directions for future work and identify our approach as an important step towards end-to-end deep learning system for accelerating advanced manufacturing research and development.

Howland, Sylvia↗
DOE OSTI2022

GFINNs: GENERIC formalism informed neural networks for deterministic and stochastic dynamical systems

Here we propose the GENERIC formalism informed neural networks (GFINNs) that obey the symmetric degeneracy conditions of the GENERIC formalism. GFINNs comprise two modules, each of which contains two components. We model each component using a neural network whose architecture is designed to satisfy the required conditions. The component-wise architecture design provides flexible ways of leveraging available physics information into neural networks. We prove theoretically that GFINNs are sufficiently expressive to learn the underlying equations, hence establishing the universal approximation theorem. We demonstrate the performance of GFINNs in three simulation problems: gas containers exchanging heat and volume, thermoelastic double pendulum and the Langevin dynamics. In all the examples, GFINNs outperform existing methods, hence demonstrating good accuracy in predictions for both deterministic and stochastic systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Hybrid Deep Learning Approach to Cosmological Constraints from Galaxy Redshift Surveys

We present a deep machine learning (ML)–based technique for accurately determining σ g and Ω m from mock 3D galaxy surveys. The mock surveys are built from the AbacusCosmos suite of N -body simulations, which comprises 40 cosmological volume simulations spanning a range of cosmological parameter values, and we account for uncertainties in galaxy formation scenarios through the use of generalized halo occupation distributions (HODs). We explore a trio of ML models: a 3D convolutional neural network (CNN), a power spectrum–based fully connected network, and a hybrid approach that merges the two to combine physically motivated summary statistics with flexible CNNs. We describe best practices for training a deep model on a suite of matched-phase simulations, and we test our model on a completely independent sample that uses previously unseen initial conditions, cosmological parameters, and HOD parameters. Despite the fact that the mock observations are quite small (~0.07 h -3 Gpc 3 ) and the training data span a large parameter space (six cosmological and six HOD parameters), the CNN and hybrid CNN can constrain estimates of σ g and Ω m to ~3% and ~4%, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Automating Discovery of Physics-Informed Neural State Space Models via Learning and Evolution

Recent works exploring deep learning application to dynamical systems modeling have demonstrated that embedding physical priors into neural networks can yield more effective, physically-realistic, and data-efficient models. However, in the absence of complete prior knowledge of a dynamical system's physical characteristics, determining the optimal structure and optimization strategy for these models can be difficult. In this work, we explore methods for discovering neural state space dynamics models for system identification. Starting with a design space of block-oriented state space models and structured linear maps with strong physical priors, we encode these components into a model genome alongside network structure, penalty constraints, and optimization hyperparameters. Demonstrating the overall utility of the design space, we employ an asynchronous genetic search algorithm that alternates between model selection and optimization and obtains accurate physically consistent models of three physical systems: an aerodynamics body, a continuous stirred tank reactor, and a two tank interacting system.

genetic algorithms, neural architecture search, ne↗
DOE OSTI2022

Stability Analysis of Substituted Cobaltocenium [Bis(cyclopentadienyl)cobalt(III)] Employing Chemistry-Informed Neural Networks

Cobaltocenium derivatives are promising components of the anion exchange membranes due to their excellent thermal and alkaline stability under the operating conditions of a fuel cell. Here we present an efficient modeling approach of assessing the chemical stability of substituted cobaltocenium CoCp 2 + based on the computed electronic structure enhanced by machine learning techniques. Within the aqueous environment, the positive charge of the metal cation is balanced by the hydroxide anion through formation of the CoCp 2 + OH¯ complexes, whose dissociation is studied within the implicit solvent employing density functional theory. The data set of about 118 species based on 42 substituent groups characterized by a range of electron- donating (ED) and electron-withdrawing (EW) properties is constructed and analyzed. Given 12 carefully chosen chemistry-informed descriptors of the complexes and relevant fragments, the stability of the complexes is found to strongly correlate with the energies of the highest occupied and lowest unoccupied molecular orbitals, modulated by a switching function of the Hirshfeld charge. The latter is used as a measure of the electron withdrawing-donating character of the substituents. Based on this observation from the conventional regression analysis, two fully connected, feed-forward neural network (FNN) models with different unit structures, called the chemistry-informed (CINN) and the quadratic (QNN) neural networks, are developed. Both models predict the bond dissociation energies of the cobaltocenium complexes with mean relative errors less than 5.40% and average absolute errors less than 0.94 kcal/mol. The results show the potential of QNN to efficiently capture more complex relationships. Here, the concept of incorporating the domain (chemical) knowledge/insight into the neural network structure paves the way to applications of machine learning techniques with small data sets, ultimately leading to better predictive models compared to the conventional regression analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Solving sparse finite element problems on neuromorphic hardware

The finite element method (FEM) is one of the most important and ubiquitous numerical methods for solving partial differential equations (PDEs) on computers for scientific and engineering discovery. Applying the FEM to larger and more detailed scientific models has driven advances in high-performance computing for decades. Here we demonstrate that scalable spiking neuromorphic hardware can directly implement the FEM by constructing a spiking neural network that solves the large, sparse, linear systems of equations at the core of the FEM. We show that for the Poisson equation, a fundamental PDE in science and engineering, our neural circuit achieves meaningful levels of numerical accuracy and close to ideal scaling on modern, inherently parallel and energy-efficient neuromorphic hardware, specifically Intel’s Loihi 2 neuromorphic platform. We illustrate extensions to irregular mesh geometries in both two and three dimensions as well as other PDEs such as linear elasticity. Our spiking neural network is constructed from a recurrent network model of the brain’s motor cortex and, in contrast to black-box deep artificial neural network-based methods for PDEs, directly translates the well-understood and trusted mathematics of the FEM to a natively spiking neuromorphic algorithm.

Applied mathematics↗
DOE OSTI2023

Demonstration of acoustic monitoring for structural health of microreactors: Through use of neural networks and resonant ultrasound spectroscopy

Nuclear microreactors prioritize modularity and portability and are intended to be a cost-effective technology for non-conventional nuclear markets. As such, the development of microreactors into a safe and feasible solution for energy security applications will necessitate the development of non-destructive technologies to monitor the integrity of inaccessible reactors components during operation. This demonstration applies linear and nonlinear acoustic techniques, in combination with machine learning, to detect and classify mechanical changes (stress and damage) in a test article which are broadly representative of potential operating challenges within a functioning microreactor. All necessary data has been collected for this demonstration, with minor experimental issues identified that can be addressed in follow-on work. Motivated by the expected conditions within a functioning microreactor, we have demonstrated our monitoring techniques on a core-block-like test article using an unstructured excitation source that approximates the noisy acoustic environment expected during reactor operation. At all stress states mechanically applied to the test article, a machine learning model using an artificial neural network was able to classify with 100% accuracy whether a 3D laser vibrometry point measurement was made on an intact or artificially defective test article. Further, model predictions about whether the defect interface was rough or smooth were 95% accurate, indicating the ability of acoustic techniques to recover defect characteristics. Resonant ultrasound spectroscopy (RUS) was also applied to the dataset to provide further quantitative insights about material properties. RUS analysis was ultimately hampered by several minor experimental and data issues, limiting results to certain cases for this demonstration. Last, analysis using nonlinear RUS exhibited sensitivity to changing levels of applied stresses for each intact and defective state. As presented in this demonstration, acoustic monitoring exhibits sensitivity to stress changes, which are of concern due to high thermal gradients expected during startup and operation. Further, our techniques distinguish between measurements made on intact and damaged test articles.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Clarifying trust of materials property predictions using neural networks with distribution-specific uncertainty quantification

It is critical that machine learning (ML) model predictions be trustworthy for high-throughput catalyst discovery approaches. Uncertainty quantification (UQ) methods allow estimation of the trustworthiness of an ML model, but these methods have not been well explored in the field of heterogeneous catalysis. Herein, we investigate different UQ methods applied to a crystal graph convolutional neural network to predict adsorption energies of molecules on alloys from the Open Catalyst 2020 dataset, the largest existing heterogeneous catalyst dataset. We apply three UQ methods to the adsorption energy predictions, namely k-fold ensembling, Monte Carlo dropout, and evidential regression. The effectiveness of each UQ method is assessed based on accuracy, sharpness, dispersion, calibration, and tightness. Evidential regression is demonstrated to be a powerful approach for rapidly obtaining tunable, competitively trustworthy UQ estimates for heterogeneous catalysis applications when using neural networks. Recalibration of model uncertainties is shown to be essential in practical screening applications of catalysts using uncertainties.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Growing grasses in unprofitable areas of US Midwest croplands could increase species richness

The US has large potential to grow perennial energy crops, but because these crops are rarely grown in current agricultural landscapes, it is unclear how biodiversity may be affected. Over time, as agriculture has increased, many grassland species have declined. In addition, not all agricultural land is profitable for growing annual crops. Unprofitable areas were responsible for a loss of approximately $110 million USD per year from 2013 to 2016. Based on this, we want to know how converting less-profitable portions of agricultural fields to switchgrass, a native prairie grass, would influence species occurrence. To address this question, we developed an alternative landscape in which clustered corn/soy acres with a low return on investment (ROI) were replaced with grassland. We also developed and validated species distribution models to predict changes in species occurrence for 28 avian species in Iowa in response to landscape management. Furthermore, we compared results for three different models: Random forest (RF), Stochastic gradient boosting (GBM), and Neural network (Nnet) and found that all models performed well and predicted similar species distribution. Predicted species richness increased by 3.66% (RF), 2.79% (GBM), and 7.51% (Nnet) when we simulated a change in management for ~3% of Iowa's low ROI corn/soybean areas to grassland. If harvested, these areas could generate approximately 7.6 million dry tons/year of switchgrass for bioenergy, thereby increasing farmers earnings. Unprofitable areas tended to occur along streams, which suggest that incorporating partially harvested riparian buffers can benefit avian biodiversity, while improving water quality and reducing unnecessary costs for farmers.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A comparison of neural network architectures for data-driven reduced-order modeling

The popularity of deep convolutional autoencoders (CAEs) has engendered new and effective reduced-order models (ROMs) for the simulation of large-scale dynamical systems. Despite this, it is still unknown whether deep CAEs provide superior performance over established linear techniques or other network-based methods in all modeling scenarios. To elucidate this, the effect of autoencoder architecture on its associated ROM is studied through the comparison of deep CAEs against two alternatives: a simple fully connected autoencoder, and a novel graph convolutional autoencoder. Through benchmark experiments, it is shown that the superior autoencoder architecture for a given ROM application is highly dependent on the size of the latent space and the structure of the snapshot data, with the proposed architecture demonstrating benefits on data with irregular connectivity when the latent space is sufficiently large.

42 ENGINEERING↗
DOE OSTI2026

Time-resolved spray characterization via unified optical flow and binarization technique

This work leverages an unsupervised machine learning and advanced image processing techniques to characterize the breakup of fuel sprays in a small-scale combustor under reacting conditions, providing valuable insights into near-nozzle flow phenomenology. The proposed methodology integrates an improved optical flow model on a convolutional neural network to extract flow vectors with a binarization technique to assess droplets’ size and shape across the region of interest. The velocimetry approach demonstrates superior performance compared to a state-of-the-art optical flow model when applied to high-speed X-ray phase contrast spray images, achieving more accurate and reliable flow predictions. Moreover, breakup processes are quantified by breakup length and sphericity in accordance with velocity estimations, allowing a more complete characterization of the flow. This study establishes a robust methodology for analyzing spray morphology and primary breakup in compact combustors, contributing valuable means of understanding and optimizing fuel spray behavior in advanced combustion systems.

42 ENGINEERING↗