Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

When less is more: How increasing the complexity of machine learning strategies for geothermal energy assessments may not lead toward better estimates

Previous moderate- and high-temperature geothermal resource assessments of the western United States utilized data-driven methods and expert decisions to estimate resource favorability. Although expert decisions can add confidence to the modeling process by ensuring reasonable models are employed, expert decisions also introduce human and, thereby, model bias. This bias can present a source of error that reduces the predictive performance of the models and confidence in the resulting resource estimates. Our study aims to develop robust data-driven methods with the goals of reducing bias and improving predictive ability. We present and compare nine favorability maps for geothermal resources in the western United States using data from the U.S. Geological Survey's 2008 geothermal resource assessment. Two favorability maps are created using the expert decision-dependent methods from the 2008 assessment (i.e., weight-of-evidence and logistic regression). With the same data, we then create six different favorability maps using logistic regression (without underlying expert decisions), XGBoost, and support-vector machines paired with two training strategies. The training strategies are customized to address the inherent challenges of applying machine learning to the geothermal training data, which have no negative examples and severe class imbalance. We also create another favorability map using an artificial neural network. We demonstrate that modern machine learning approaches can improve upon systems built with expert decisions. We also find that XGBoost, a non-linear algorithm, produces greater agreement with the 2008 results than linear logistic regression without expert decisions, because the expert decisions in the 2008 assessment rendered the otherwise linear approaches non-linear despite the fact that the 2008 assessment used only linear methods. The F1 scores for all approaches appear low (F1 score < 0.10), do not improve with increasing model complexity, and, therefore, indicate the fundamental limitations of the input features (i.e., training data). Until improved feature data are incorporated into the assessment process, simple non-linear algorithms (e.g., XGBoost) perform equally well or better than more complex methods (e.g., artificial neural networks) and remain easier to interpret.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

STEPs-SOL, a Peptoid Force Field Parameterization to Include Solvent Effects

As peptoids (N-substituted glycines) continue to gain popularity as a class of biomimetic polymers, the importance and demand for accurate force fields in molecular simulations also grow. Building on the vacuum-optimized Systematic and Extensible Force Field for Peptoids (STEPs) force field, here we present STEPs-SOL, a novel peptoid force field parametrization that effectively incorporates solvent effects to enhance the accuracy of peptoid simulations. The development of STEPs-SOL is based on the need for precise electrostatic modeling achieved through solvent-specific partial charge optimization. Here, our systematic approach significantly improves agreement with experimental measurements, reducing the mean absolute error in cis/trans ratio predictions (ΔG c/t ) by an average of 38% across multiple peptoid residues and solvent environments. This improved parametrization addresses computational challenges associated with nonbonded energies while maintaining a workflow that relies on high-level quantum mechanical data rather than depending solely on limited experimental equilibrium properties. By evaluating the effects of conformational bias in restrained electrostatic potential (RESP) charge generation and examining their impact on peptoid conformations in various solvents, we enhance our understanding of peptoid structural dynamics while providing a more accurate modeling framework.

force field↗
DOE OSTI2024

Quantifying Streambed Grain Size, Uncertainty, and Hydrobiogeochemical Parameters Using Machine Learning Model YOLO

Abstract Streambed grain sizes control river hydro‐biogeochemical (HBGC) processes and functions. However, measuring their quantities, distributions, and uncertainties is challenging due to the diversity and heterogeneity of natural streams. This work presents a photo‐driven, artificial intelligence (AI)‐enabled, and theory‐based workflow for extracting the quantities, distributions, and uncertainties of streambed grain sizes from photos. Specifically, we first trained You Only Look Once, an object detection AI, using 11,977 grain labels from 36 photos collected from nine different stream environments. We demonstrated its accuracy with a coefficient of determination of 0.98, a Nash–Sutcliffe efficiency of 0.98, and a mean absolute relative error of 6.65% in predicting the median grain size of 20 ground‐truth photos representing nine typical stream environments. The AI is then used to extract the grain size distributions and determine their characteristic grain sizes, including the 10th, 50th, 60th, and 84th percentiles, for 1,999 photos taken at 66 sites within a watershed in the Northwest US. The results indicate that the 10th, median, 60th, and 84th percentiles of the grain sizes follow log‐normal distributions, with most likely values of 2.49, 6.62, 7.68, and 10.78 cm, respectively. The average uncertainties associated with these values are 9.70%, 7.33%, 9.27%, and 11.11%, respectively. These data allow for the computation of the quantities, distributions, and uncertainties of streambed HBGC parameters, including Manning's coefficient, Darcy‐Weisbach friction factor, top layer interstitial velocity magnitude, and nitrate uptake velocity. Additionally, major sources of uncertainty in grain sizes and their impact on HBGC parameters are examined.

58 GEOSCIENCES↗
DOE OSTI2020

Accelerating massively parallel hemodynamic models of coarctation of the aorta using neural networks

Comorbidities such as anemia or hypertension and physiological factors related to exertion can influence a patient’s hemodynamics and increase the severity of many cardiovascular diseases. Observing and quantifying associations between these factors and hemodynamics can be difficult due to the multitude of co-existing conditions and blood flow parameters in real patient data. Machine learning-driven, physics-based simulations provide a means to understand how potentially correlated conditions may affect a particular patient. Here, we use a combination of machine learning and massively parallel computing to predict the effects of physiological factors on hemodynamics in patients with coarctation of the aorta. We first validated blood flow simulations against in vitro measurements in 3D-printed phantoms representing the patient’s vasculature. We then investigated the effects of varying the degree of stenosis, blood flow rate, and viscosity on two diagnostic metrics – pressure gradient across the stenosis (ΔP) and wall shear stress (WSS) - by performing the largest simulation study to date of coarctation of the aorta (over 70 million compute hours). Using machine learning models trained on data from the simulations and validated on two independent datasets, we developed a framework to identify the minimal training set required to build a predictive model on a per-patient basis. We then used this model to accurately predict ΔP (mean absolute error within 1.18 mmHg) and WSS (mean absolute error within 0.99 Pa) for patients with this disease.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Machine learning assisted prediction of the Young’s modulus of compositionally complex alloys

We identify compositionally complex alloys (CCAs) that offer exceptional mechanical properties for elevated temperature applications by employing machine learning (ML) in conjunction with rapid synthesis and testing of alloys for validation to accelerate alloy design. The advantages of this approach are scalability, rapidity, and reasonably accurate predictions. ML tools were implemented to predict Young’s modulus of refractory-based CCAs by employing different ML models. Our results, in conjunction with experimental validation, suggest that average valence electron concentration, the difference in atomic radius, a geometrical parameter λ and melting temperature of the alloys are the key features that determine the Young’s modulus of CCAs and refractory-based CCAs. The Gradient Boosting model provided the best predictive capabilities (mean absolute error of 6.15 GPa) among the models studied. Our approach integrates high-quality validation data from experiments, literature data for training machine-learning models, and feature selection based on physical insights. It opens a new avenue to optimize the desired materials property for different engineering applications.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Sub 20 cm -1 computational prediction of the CH bond energy – a case of systematic error in computational thermochemistry

Here, the bond dissociation energy of methylidyne, D 0 (CH), is studied using an improved version of the High-Accuracy Extrapolated ab initio Thermochemistry (HEAT) approach as well as the Feller–Peterson–Dixon (FPD) model chemistry. These calculations, which include basis sets up to nonuple (aug-cc-pCV9Z) quality, are expected to be capable of providing results substantially more accurate than the ca. 1 kJ mol -1 level that is characteristic of standard high-accuracy protocols for computational thermochemistry. The calculated 0 K CH bond energy (27 954 ± 15 cm -1 for HEAT and 27 956 ± 15 cm -1 for FPD), along with equivalent treatments of the CH ionization energy and the CH + dissociation energy (85 829 ± 15 cm -1 and 32 946 ± 15 cm -1 , respectively), were compared to the existing benchmarks from Active Thermochemical Tables (ATcT), uncovering an unexpected difference for D 0 (CH). This has prompted a detailed reexamination of the provenance of the corresponding ATcT benchmark, allowing the discovery and subsequent correction of a systematic error present in several published high-level calculations, ultimately yielding an amended ATcT benchmark for D 0 (CH). Finally, the current theoretical results were added to the ATcT Thermochemical Network, producing refined ATcT estimates of 27 957.3 ± 6.0 cm -1 for D0(CH), 32 946.7 ± 0.6 cm -1 for D 0 (CH + ), and 85 831.0 ± 6.0 cm -1 for IE(CH).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Data-driven linear time advance operators for the acceleration of plasma physics simulation

In this study, we demonstrate the application of data-driven linear operator construction for time advance with a goal of accelerating plasma physics simulation. We apply dynamic mode decomposition (DMD) to data produced by the nonlinear SOLPS-ITER (Scrape-off Layer Plasma Simulator - International Thermonuclear Experimental Reactor) plasma boundary code suite in order to estimate a series of linear operators and monitor their predictive accuracy via online error analysis. We find that this approach defines when these dynamics can be represented by a sequence of approximate linear operators and is essential for providing consistent projections when compared to an unconstrained application. For linear diffusion and advection–diffusion fluid test problems, we construct and apply operators within explicit and implicit time advance schemes, demonstrating that stability can be robustly guaranteed in each case. We further investigate the use of the linear time advance operators within several integration methods including forward Euler, backward Euler, and the matrix exponential. The application of this method to simulation data from SOLPS-ITER, with varying levels of Markov chain Monte Carlo numerical noise, shows that constrained DMD operators yield a capability to identify, extract, and integrate a (slow) subset of the present timescales. Example applications show that for projected speedup factors of [Formula: see text], and [Formula: see text], a mean relative error of 3%, 5%, and 8% and maximum relative error less than 20% are achievable, which appears acceptable for typical SOLPS-ITER steady-state simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Improving gas adsorption modeling for MOFs by local calibration of Hubbard U parameters

While computational screening with density functional theory (DFT) is frequently employed for the screening of metal–organic frameworks (MOFs) for gas separation and storage, commonly applied generalized gradient approximations (GGAs) exhibit self-interaction errors, which hinder the predictions of adsorption energies. We investigate the Hubbard U parameter to augment DFT calculations for full periodic MOFs, targeting a more precise modeling of gas molecule–MOF interactions, specifically for N2, CO2, and O2. We introduce a calibration scheme for the U parameter, which is tailored for each MOF, by leveraging higher-level calculations on the secondary building unit (SBU) of the MOF. When applied to the full periodic MOF, the U parameter calibrated against hybrid HSE06 calculations of SBUs successfully reproduces hybrid-quality calculations of the adsorption energy of the periodic MOF. The mean absolute deviation of adsorption energies reduces from 0.13 eV for a standard GGA treatment to 0.06 eV with the calibrated U, demonstrating the utility of the calibration procedure when applied to the full MOF structure. Furthermore, attempting to use coupled cluster singles and doubles with perturbative triples calculations of isolated SBUs for this calibration procedure shows varying degrees of success in predicting the experimental heat of adsorption. It improves accuracy for N2 adsorption for cases of overbinding, whereas its impact on CO2 is minimal, and ambiguities in spin state assignment hinder consistent improvements of O2 adsorption. Our findings emphasize the limitations of cluster models and advocate the use of full periodic MOF systems with a calibrated U parameter, providing a more comprehensive understanding of gas adsorption in MOFs.

Chemistry↗
DOE OSTI2024

Dark sink enhances the direct detection of freeze-in dark matter

We describe a simple dark sector structure which, if present, has implications for the direct detection of dark matter (DM); the dark sink. A dark sink transports energy density from the DM into light dark-sector states that do not appreciably contribute to the DM density. As an example, we consider a light, neutral fermion ψ which interacts solely with DM Χ via the exchange of a heavy scalar Φ. We illustrate the impact of a dark sink by adding one to a DM freeze-in model in which Χ couples to a light dark photon γ' which kinetically mixes with the Standard Model (SM) photon. This freeze-in model (absent the sink) is itself a benchmark for ongoing experiments. In some cases, the literature for this benchmark has contained errors; we correct the predictions and provide them as a public code. We then analyze how the dark sink modifies this benchmark, solving coupled Boltzmann equations for the dark-sector energy density and DM yield. We check the contribution of the dark sink ψ’s to dark radiation; consistency with existing data limits the maximum attainable cross section. For DM with a mass between MeV –Ο⁡(10 GeV), adding the dark sink can increase predictions for the direct detection cross section all the way up to the current limits.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Temperature effects on the neutron matter equation of state obtained from chiral effective field theory

Temperature effects on the neutron matter equation of state (EoS) are investigated in the framework of chiral effective field theory. Recently, state-of-the-art chiral two-nucleon forces are applied from third to fifth order in the chiral expansion together with chiral three-nucleon forces, allowing for a determination of the truncation error of the theoretical predictions. The thermodynamic quantities considered include the chemical potential, the internal energy, the entropy, and the free energy. In general, good order-by-order convergence of all predictions is observed. As to be expected, temperature effects are largest at low density. Finally, the temperature dependence of the chiral three-nucleon force turns out to be weak.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Fusion RF Modeling Machine Learning (FusionML_RF) v1.0

FusionML_RF consists of multiple codes and trained machine learning (ML) models that perform low-cost output modeling from the Genray-CQL3D. Three machine learning techniques (multilayer perceptron, random forest, and Gaussian process) provide fast surrogate models for lower hybrid current drive (LHCD) simulations. For example, completing a single GENRAY/CQL3D simulation without radial diffusion of fast electrons requires several minutes of wall-clock time. On the other hand, these ML models achieve ~ms of inference time with high accuracy across the input parameter space. This software collection consists of multiple components. (1) codes that use ML methods and precomputed Genray-CQL3D simulation output to build regression models that enable approximate computations of Genray-CLQ3D outputs from arbitrary but physically meaningful input parameters (surrogate modeling); (2) three trained models created by the team, using a database of 16,000+ GENRAY/CQL3D simulations, to study the performance of ML models for surrogate modeling; (3) codes that load the trained models and simulation data, and then compute mean squared error between the models' predictions and the ground truth of simulation output data. This collection is being made available in conjunction with a scientific publication about the work to promote reusability and provide an artifact of the scientific work.

Bai, Zhe↗
DOE OSTI2020

An Accelerated Approach for Computationally Efficient Evaluation of Deflagration Time During Abnormal Thermal Events

The challenges of modeling abnormal thermal events for explosives of interest to LLNL can be simplified by an accelerated approach to calculate Prout-Tompkins (P-T) parameters describing autocatalytic deflagration. Rather than depending on detailed modeling in multiphysics codes that include chemical reactivity (e.g. ALE3D), the accelerated approach can calculate P-T parameters based solely on experimental time of deflagration measurements for the explosive of interest. We compare deflagration time for five explosives with previously known P-T parameters at conditions typical of abnormal thermal events and demonstrate that the accelerated approach produces deflagration predictions with a maximum error of 3% and an average error of 1.7%. While the accelerated approach may not be applicable to all experimental conditions, it holds promise of rapid derivation of P-T parameters for accurate modeling of abnormal thermal events of interest to LLNL.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Uncertainty Quantification in Scientific ML

The intricate interactions between data sampling, model selection and the inherent randomness in complex systems strongly emphasize the need for a rigorous characterization of ML algorithms. In conventional statistics, uncertainty quantification (UQ) provides this characterization by measuring how accurately a model reflects the physical reality and by studying the impact of different error sources on the prediction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Extending Petsc's Composable Hierarchically Nested Linear Solvers

The Contributions from the RELACS group at both Rice University and the University at Buffalo in this phase of the PETSc Composable Solvers effort have centered around four main areas: scalable mesh processing, mesh adaptivity, solvers for subsurface flow, and performance modeling. The prominence of mesh processing demonstrates the tight relationship between meshing and discretization on the one hand, and optimal solvers on the other. All optimal solvers that we consider depend on some notion of hierarchy, and we express this using the DMPlex abstraction in PETSc. This relationship demands tight integration between the DM and SNES/TS components in PETSc that is the foundation of much of this work. In addition, interpretation of performance results for scalable solvers necessitates that information from the discretization and solver enter the performance model. Without this, comparing different solvers can be a fruitless exercise. Some major accomplishment of the past three years in these areas include: scalable mesh loading in PETSc on more than 10K cores, integrated mesh adaptivity using both p4est and Pragmatic, scalable multigrid for DG discretizations of subsurface flow, and predictive performance modeling incorporating error estimates.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Understanding Uncertainty in Microstructure Evolution and Constitutive Properties in Additive Process Modeling

Coupled process–microstructure–property modeling, and understanding the sources of uncertainty and their propagation toward error in part property prediction, are key steps toward full utilization of additive manufacturing (AM) for predictable quality part development. The OpenFOAM model for process conditions, the ExaCA model for as-solidified grain structure, and the ExaConstit model for constitutive mechanical properties are used as part of the ExaAM modeling framework to examine a few of the various sources of uncertainty in the modeling workflow. In addition to “random” uncertainty (due to random number generation in the orientations and locations of grains present), the heterogeneous nucleation density N 0 and the mean substrate grain spacing S 0 are varied to examine their impact of grain area development as a function of build height in the simulated microstructure. While mean grain area after 1 mm of build is found to be sensitive to N 0 and S 0 , particularly at small N 0 and large S 0 (despite some convergence toward similar values), the resulting grain shapes and overall textures develop in a reasonably similar manner. As a result of these similar textures, ExaConstit simulation using ExaCA representative volume elements (RVEs) from various permutations of N 0 , S 0 , and location within the build resulted in similar yield stress, stress–strain curve shape, and stress triaxiality distributions. It is concluded that for this particular material and scan pattern, 15 layers is sufficient for ExaCA texture and ExaConstit predicted properties to become relatively independent of additional layer simulation, provided that reasonable estimates for N 0 and S 0 are used. However, additional layers of ExaCA will need to be run to obtain mean grain areas independent of build height and baseplate structure.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Fluid temperature predictions of geothermal borefields using load estimations via state observers

Fluid temperature predictions of geothermal borefields usually involves temporal superposition of its characteristic g-function, using load aggregation schemes to reduce computational times. Assuming that the ground has linear properties, it can be modeled as a linear state space system where the states are the aggregated loads. However, the application and accuracy of these models is compromised when the borefield is already operating and its load history is not registered or there are gaps in the data. This paper assesses the performance of state observers to estimate the borefield load history and obtain accurate fluid predictions. Results show that both Time-Varying Kalman Filter (TVKF) and Moving Horizon Estimator (MHE) provide predictions with average and maximum errors below 0.1 $^\circ C$ and 1 $^\circ C$ respectively. MHE outperforms TVKF in terms of n-step ahead output predictions and load history profile at the expenses of about 5 times more computational time.

Figueroa, Iago C.↗
DOE OSTI2023

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗