Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine learning efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Real-Time Highly Resolved Spatial-Temporal Vehicle Energy Consumption Estimation Using Machine Learning and Probe Data

Real-time highly resolved spatial-temporal vehicle energy consumption is a key missing dimension in transportation data. Most roadway link-level vehicle energy consumption data are estimated using average annual daily traffic measures derived from the Highway Performance Monitoring System; however, this method does not reflect day-to-day energy consumption fluctuations. As transportation planners and operators are becoming more environmentally attentive, they need accurate real-time link-level vehicle energy consumption data to assess energy and emissions; to incentivize energy-efficient routing; and to estimate energy impact caused by congestion, major events, and severe weather. This paper presents a computational workflow to automate the estimation of time-resolved vehicle energy consumption for each link in a road network of interest using vehicle probe speed and count data in conjunction with machine learning methods in real time. The real-time pipeline can deliver energy estimates within a couple seconds on query to its interface. The proposed method was evaluated on the transportation network of the metropolitan area of Chattanooga, Tennessee. The volume estimation results were validated with ground truth traffic volume data collected in the field. To demonstrate the effectiveness of the proposed method, the energy consumption pipeline was applied to real-world data to quantify road transportation-related energy reduction because of mitigation policies to slow the spread of COVID-19 and to measure energy loss resulting from congestion.

Severino, Joseph↗
DOE OSTI2024

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗
DOE OSTI2022

Physiochemical Machine Learning Models Predict Operational Lifetimes of CH3NH3PbI3 Perovskite Solar Cells

Halide perovskites are promising photovoltaic (PV) materials with the potential to lower the cost of electricity and greatly expand the penetration of PV if they can demonstrate long-term stability under illumination in the presence of moisture and oxygen. The solar cell service lifetime as quantified by the T80 (the time required for the power conversion efficiency to drop to 80% of its starting value) is a useful metric to assess stability. The T80 for utility, commercial, or residential PV systems needs to be several decades in order to yield low-cost electricity, and thus it is not practical to directly measure the T80. It would be useful if T80 could be predicted from the initial dynamics of a solar cell’s performance, but until now no models have been developed to forecast T80. In this work, we report the development of machine learning models to predict T80 of ITO/NiOx/CH3NH3PbI3/C60/BCP/Ag solar cells operating at maximum power point under 1-sun equivalent photon flux in air at varying temperatures and relative humidities. Efficiency losses are driven by short-circuit current and fill factor, indicating that chemical decomposition of the perovskite is a major contributor to degradation. Spatial patterns evident from in situ dark field optical microscopy suggest that the electric field gradient at device edges plays a significant role in perovskite decomposition, along with photochemical reactions with O2 and H2O. Models are trained using a menu of features from three distinct categories: (i) features based on measurements of the initial rates of change of device parameters, (ii) features based on the ambient conditions during operation (temperature, & partial pressure of H2O), and (iii) features based on underlying physics and chemistry. We show that a theory-based physiochemical feature derived from a model of the chemical reaction kinetics of the rate of degradation of the CH3NH3PbI3 is particularly valuable for prediction. This physiochemical feature was selected as the first or second most dominant feature in the best performing models. With a dataset consisting of 45 accelerated degradation experiments with T80 that range over a factor of 30, the model predicts T80 with an accuracy of about 40% (|predicted T80 - observed T80| / observed T80) on samples not used in training. This hybrid ML approach should be effective when applied to other compositions, device architectures, and advanced packaging schemes.

14 SOLAR ENERGY↗
DOE OSTI2022

Physiochemical Machine Learning Models Predict Operational Lifetimes of CH3NH3PbI3 Perovskite Solar Cells

Halide perovskites are promising photovoltaic (PV) materials with the potential to lower the cost of electricity and greatly expand the penetration of PV if they can demonstrate long-term stability under illumination in the presence of moisture and oxygen. The solar cell service lifetime as quantified by the T80 (the time required for the power conversion efficiency to drop to 80% of its starting value) is a useful metric to assess stability. The T80 for utility, commercial, or residential PV systems needs to be several decades in order to yield low-cost electricity, and thus it is not practical to directly measure the T80. It would be useful if T80 could be predicted from the initial dynamics of a solar cell’s performance, but until now no models have been developed to forecast T80. In this work, we report the development of machine learning models to predict T80 of ITO/NiOx/CH3NH3PbI3/C60/BCP/Ag solar cells operating at maximum power point under 1-sun equivalent photon flux in air at varying temperatures and relative humidities. Efficiency losses are driven by short-circuit current and fill factor, indicating that chemical decomposition of the perovskite is a major contributor to degradation. Spatial patterns evident from in situ dark field optical microscopy suggest that the electric field gradient at device edges plays a significant role in perovskite decomposition, along with photochemical reactions with O2 and H2O. Models are trained using a menu of features from three distinct categories: (i) features based on measurements of the initial rates of change of device parameters, (ii) features based on the ambient conditions during operation (temperature, & partial pressure of H2O), and (iii) features based on underlying physics and chemistry. We show that a theory-based physiochemical feature derived from a model of the chemical reaction kinetics of the rate of degradation of the CH3NH3PbI3 is particularly valuable for prediction. This physiochemical feature was selected as the first or second most dominant feature in the best performing models. With a dataset consisting of 45 accelerated degradation experiments with T80 that range over a factor of 30, the model predicts T80 with an accuracy of about 40% (|predicted T80 - observed T80| / observed T80) on samples not used in training. This hybrid ML approach should be effective when applied to other compositions, device architectures, and advanced packaging schemes.

14 SOLAR ENERGY↗
DOE OSTI2023

Large-Scale Materials Modeling at Quantum Accuracy: Ab Initio Simulations of Quasicrystals and Interacting Extended Defects in Metallic Alloys

Ab initio electronic-structure has remained dichotomous between achievable accuracy and length-scale. Quantum many-body (QMB) methods realize quantum accuracy but fail to scale. Density functional theory (DFT) scales favorably but remains far from quantum accuracy. We present a framework that breaks this dichotomy by use of three interconnected modules: (i) invDFT: a methodological advance in inverse DFT linking QMB methods to DFT; (ii) MLXC: a machine-learned density functional trained with invDFT data, commensurate with quantum accuracy; (iii) DFT-FE-MLXC: an adaptive higher-order spectral finite-element (FE) based DFT implementation that integrates MLXC with efficient solver strategies and HPC innovations in FE-specific dense linear algebra, mixed-precision algorithms, and asynchronous compute-communication. Furthermore, we demonstrate a paradigm shift in DFT that not only provides an accuracy commensurate with QMB methods in ground-state energies, but also attains an unprecedented performance of 659.7 PFLOPS (43.1% peak FP64 performance) on 619,124 electrons using 8,000 GPU nodes of Frontier supercomputer.

density functional theory↗
NASA NTRSDate not supplied

QuantifyML: How good is my machine learning model?

This paper presents an approach, QuantifyML, which employs model counting to assess the learnability and robustness of machine learning models. Typically the efficacy of machine learning models is determined by computing their accuracy statistically on test data sets. However, this may be misleading, if the test data is not representative of the problem that is being studied. Further, two different models may have the same accuracy on a given data set, measured statistically, but may be very different in their behavior on unseen data. Also, models with high accuracy could have poor adversarial robustness. In QuantifyML, our goal is to precisely quantify the extent to which machine learning models have learned and generalized from the given data. In QuantifyML, a trained model is translated into a C program, which is fed to the CBMC model checking tool to produce a formula in Conjunctive Normal Form (CNF), which in turn is analyzed with state-of-the-art model counters to efficiently obtain precise counts w.r.t different outputs. QuantifyML enables i) evaluating the learnability of models by comparing the counts for the outputs to ground truth, expressed as logical predicates (if available), ii) comparing the performance of different models that may be built with different machine learning algorithms (e.g., decision-trees vs. neural networks), and iii) quantifying the robustness of trained models around given inputs. Our evaluation demonstrates these applications of QuantifyML on decision trees and neural networks trained to learn relational properties of graphs, for which we know the ground truth, and to perform image classification, for which we do not have the ground truth, but we can quantify local robustness.

Deep Neural Networks↗
DOE OSTI2025

Quantum graph learning and algorithms applied in quantum computer sciences and image classification

Graph and network theory play a fundamental role in quantum computer sciences, including quantum information and computation. Random graphs and complex network theory are pivotal in predicting novel quantum phenomena, where entangled links are represented by edges. Quantum algorithms have been developed to enhance solutions for various network problems, giving rise to quantum graph computing and quantum graph learning (QGL). Here, in this review, we explore graph theory and graph learning methods as powerful tools for quantum computers to generate efficient solutions to problems beyond the reach of classical systems. We delve into the development of quantum complex network theory and its applications in quantum computation, materials discovery, and research. We also discuss quantum machine learning (QML) methodologies for effective image classification using qubits, quantum gates, and quantum circuits. Additionally, the paper addresses the challenges of QGL and algorithms, emphasizing the steps needed to develop flexible QGL solvers. This review presents a comprehensive overview of the fields of QGL and QML, highlights recent advancements, and identifies opportunities for future research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Target Selection and Sample Characterization for the DESI LOW-Z Secondary Target Program

Abstract We introduce the DESI LOW- Z Secondary Target Survey, which combines the wide-area capabilities of the Dark Energy Spectroscopic Instrument (DESI) with an efficient, low-redshift target selection method. Our selection consists of a set of color and surface brightness cuts, combined with modern machine-learning methods, to target low-redshift dwarf galaxies ( z < 0.03) between 19 < r < 21 with high completeness. We employ a convolutional neural network (CNN) to select high-priority targets. The LOW- Z survey has already obtained over 22,000 redshifts of dwarf galaxies ( M * < 10 9 M ⊙ ), comparable to the number of dwarf galaxies discovered in the Sloan Digital Sky Survey DR8 and GAMA. As a spare fiber survey, LOW- Z currently receives fiber allocation for just ∼50% of its targets. However, we estimate that our selection is highly complete: for galaxies at z < 0.03 within our magnitude limits, we achieve better than 95% completeness with ∼1% efficiency using catalog-level photometric cuts. We also demonstrate that our CNN selections z < 0.03 galaxies from the photometric cuts subsample at least 10 times more efficiently while maintaining high completeness. The full 5 yr DESI program will expand the LOW- Z sample, densely mapping the low-redshift Universe, providing an unprecedented sample of dwarf galaxies, and providing critical information about how to pursue effective and efficient low-redshift surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Bayesian Adaptive Polynomial Chaos Expansions

Polynomial chaos expansions (PCEs) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully Bayesian formulations remain rare—especially with implementations in R. Motivated by the success of adaptive Bayesian machine learning models such as BART, BASS and BPPR, we develop a new fully Bayesian adaptive PCE method with an efficient and accessible R implementation: khaos. Our approach includes a novel proposal distribution that enables data-driven interaction selection and supports a modified g-prior tailored to PCE structure. Through simulation studies and real-world UQ applications, we demonstrate that the Bayesian adaptive PCE provides competitive performance for surrogate modeling, global sensitivity analysis and ordinal regression tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

PAIReD jet: A multi-pronged resonance tagging strategy across all Lorentz boosts

We propose a new approach of jet-based event reconstruction that aims to optimally exploit correlations between the products of a hadronic multi-pronged decay across all Lorentz boost regimes. The new approach utilizes clustered small-radius jets as seeds to define unconventional jets, referred to as PAIReD jets. The constituents of these jets are subsequently used as inputs to machine learning-based algorithms to identify the flavor content of the jet. We demonstrate that this approach achieves higher efficiencies in the reconstruction of signal events containing heavy-flavor jets compared to other event reconstruction strategies at all Lorentz boost regimes. Classifiers trained on PAIReD jets also have significantly better background rejections compared to those based on traditional event reconstruction approaches using small-radius jets at low Lorentz boost regimes. The combined effect of a higher signal reconstruction efficiency and better classification performance results in a two to four times stronger rejection of light-flavor jets compared to conventional strategies at low Lorentz-boosts, and rejection rates similar to classifiers based on large-radius multi-pronged jets at high Lorentz-boost regimes.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

A deep learning interatomic potential developed for atomistic simulation of carbon materials

Interatomic potentials based on neural-network machine learning method have attracted considerable attention in recent years owing to their outstanding ability to balance the accuracy and efficiency in atomistic simulations. In this work, a neural-network potential (NNP) for carbon is generated to simulate the structural properties of various carbon structures. The potential is trained using a database consisting of crystalline and liquid structures obtained by the first-principles density functional theory (DFT) calculations. The developed potential accurately predicts the energies and forces in crystalline and liquid carbon structures, the energetic stability of defected graphene, and the structures of amorphous carbon as the function of density. As a result, the excellent accuracy and transferability of the NNP provide a promising tool for accurate atomistic simulations of various carbon materials with faster speed and much lower cost.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Scalable graphene sensor array for real-time toxins monitoring in flowing water

Abstract Risk management for drinking water often requires continuous monitoring of various toxins in flowing water. While they can be readily integrated with existing water infrastructure, two-dimensional (2D) electronic sensors often suffer from device-to-device variations due to the lack of an effective strategy for identifying faulty devices from preselected uniform devices based on electronic properties alone, resulting in sensor inaccuracy and thus slowing down their real-world applications. Here, we report the combination of wet transfer, impedance and noise measurements, and machine learning to facilitate the scalable nanofabrication of graphene-based field-effect transistor (GFET) sensor arrays and the efficient identification of faulty devices. Our sensors were able to perform real-time detection of heavy-metal ions (lead and mercury) and E. coli bacteria simultaneously in flowing tap water. This study offers a reliable quality control protocol to increase the potential of electronic sensors for monitoring pollutants in flowing water.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Enabling deeper learning on big data for materials informatics applications

Abstract The application of machine learning (ML) techniques in materials science has attracted significant attention in recent years, due to their impressive ability to efficiently extract data-driven linkages from various input materials representations to their output properties. While the application of traditional ML techniques has become quite ubiquitous, there have been limited applications of more advanced deep learning (DL) techniques, primarily because big materials datasets are relatively rare. Given the demonstrated potential and advantages of DL and the increasing availability of big materials datasets, it is attractive to go for deeper neural networks in a bid to boost model performance, but in reality, it leads to performance degradation due to the vanishing gradient problem. In this paper, we address the question of how to enable deeper learning for cases where big materials data is available. Here, we present a general deep learning framework based on Individual Residual learning (IRNet) composed of very deep neural networks that can work with any vector-based materials representation as input to build accurate property prediction models. We find that the proposed IRNet models can not only successfully alleviate the vanishing gradient problem and enable deeper learning, but also lead to significantly (up to 47%) better model accuracy as compared to plain deep neural networks and traditional ML techniques for a given input materials representation in the presence of big data.

36 MATERIALS SCIENCE↗
DOE OSTI2021

OptML

OptML is an open-source Python package that provides modeling and solution capabilities for optimization problems with embedded machine learning models. OptML is a collaborative open-source project that includes advanced algorithms from the academic community for efficient solution of these problems. Sandia contributions to this package include the development of interfaces between these algorithms and Pyomo. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-10861 O

Jalving, Jordan↗
DOE OSTI2024

Implementation of Detailed Polyethylene Pyrolysis Kinetics into CFD Simulations using Machine Learning

Municipal solid waste (MSW) and waste plastics have received significant attention due to the issues of waste generation and storage, as well as their potential as an energy resource. High-density polyethylene (HDPE) makes up a large portion of plastic waste and has been the subject of several conversion studies. However, the mechanisms associated with converting HDPE through pyrolysis and gasification are extensive and complex making them difficult to implement into high-fidelity computational fluid dynamic (CFD) simulations. For this project, a primary pyrolysis mechanism containing 42 unique species and 737 heterogeneous reactions was used to generate kinetic data over a range of operating conditions. A machine learning (ML) model was developed to replicate the results of the detailed pyrolysis mechanism while significantly increasing the computational efficiency. A deep operator network (DeepONet) architecture was adopted to train the model using time steps relevant to CFD simulations. The ML used physics-based loss functions to ensure mass conservation. The ML model has been deployed in simple MFiX CFD simulations, single particle, and an experimental drop tube reactor, and has shown promising performance compared to the original scheme.

Houston, Ross↗
DOE OSTI2026

TCF Base Technology-Specific Final Report: Engineering Enzymes for Crystalline PET Substrate

The primary objective of this project was to develop a new polyethylene terephthalate (PET) hydrolase enzyme to depolymerize relevant PET substrates for Birch Biosciences, using high-throughput protein expression, purification, and assaying systems and machine learning-guided enzyme design. As a secondary project objective, we also aimed to develop a more energy-efficient ethylene glycol (EG) recovery strategy relative to distillation.

09 BIOMASS FUELS↗
DOE OSTI2026

Learning Latent Representations to Bridge Coarse-Grained and Atomistic Resolutions in Polymer Simulations

We present a machine-learning-based framework for learning reduced-order representations of polymer chain conformations across coarse-grained (CG) and united-atom (UA) fidelities. By employing linear singular value decomposition and nonlinear autoencoders, we compress high-dimensional polymer configurations into latent spaces with minimal loss of structural accuracy. Crucially, we demonstrate a near-perfect linear mapping between CG and UA latent spaces, enabling an efficient super-resolution back-mapping procedure that reconstructs high-fidelity UA configurations from CG simulations. While minor structural inaccuracies occur, they are effectively corrected through a brief molecular dynamics relaxation, forming a practical hybrid machine learning−physics scheme. This approach establishes the key structural prerequisites for accelerated polymer dynamics simulations: a compact and accurate latent encoding of polymer chain conformations and a validated multi-fidelity mapping that permits reconstruction of UA structures from CG configurations. The extension of this framework to explicit time evolution within the latent space, enabling dynamics to be propagated at CG fidelity and decoded to UA resolution only when required, represents a natural and well-motivated direction for future work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRSDate not supplied

QuantifyML: How Good is My Machine Learning Model?

We present QuantifyML, which applies model counting to assess the learn ability, safety, and robustness of machine learning models. Typically, the efficacy of machine learning models is determined by computing their accuracy statistically on test datasets. However, this may be misleading, if the test data is not representative of the problem that is being studied. With QuantifyML we aim to precisely quantify the extent to which machine learning models have learned and generalized from the given data. In QuantifyML, a trained model is translated into aC program, which is fed to the CBMC model checking tool to produce a formula in Conjunctive Normal Form (CNF), which in turn is analyzed with state-of-the-art model counters to efficiently obtain precise countsw.r.t different outputs. QuantifyML enables i) evaluating the learnability of models by comparing the counts for the outputs to ground truth, ex-pressed as logical predicates (if available), ii) comparing the performance of different models that may be built with different machine learning algorithms (e.g., decision-trees vs. neural networks), and iii) quantifying the safety and robustness of trained models.

Deep Neural Networks↗