Search NASA⌕ Search

SEARCH · Search NASA

Results for “error models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Quantifying correlated truncation errors in effective field theory

Effective field theories (EFTs) organize the description of complex systems into an infinite sequence of decreasing importance. Predictions are made with a finite number of terms, which induces a truncation error that is often left unquantified. Here, we formalize the notion of EFT convergence and propose a Bayesian truncation error model for predictions that are correlated across the independent variables, e.g., energy or scattering angle. Central to our approach are Gaussian processes that encode both the naturalness and correlation structure of EFT coefficients. Our use of Gaussian processes permits efficient and accurate assessment of credible intervals, allows EFT fits to easily include correlated theory errors, and provides analytic posteriors for physical EFT-related quantities such as the expansion parameter. Furthermore, we demonstrate that model-checking diagnostics—applied to the case of multiple curves—are powerful tools for EFT validation. As an example, we assess a set of nucleon-nucleon scattering observables in chiral EFT. In an effort to be self-contained, appendices include thorough derivations of our statistical results. Our methods are packaged in Python code, called gsum, that is available for download on GitHub.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Active learning for SNAP interatomic potentials via Bayesian predictive uncertainty

Bayesian inference with a simple Gaussian error model is used to efficiently compute prediction variances for energies, forces, and stresses in the linear SNAP interatomic potential. Here, the prediction variance is shown to have a strong correlation with the absolute error over approximately 24 orders of magnitude. Using this prediction variance, an active learning algorithm is constructed to iteratively train a potential by selecting the structures with the most uncertain properties from a pool of candidate structures. The relative importance of the energy, force, and stress errors in the objective function is shown to have a strong impact upon the trajectory of their respective net error metrics when running the active learning algorithm. Batched training of different batch sizes is also tested against singular structure updates, and it is found that batches can be used to significantly reduce the number of retraining steps required with only minor impact on the active learning trajectory.

97 MATHEMATICS AND COMPUTING↗

A framework for feasibility-level validation of high-resolution wave hindcast models

The value of long-term wave hindcasts for investigating wave climates, wave energy resources, and extreme wave conditions has motivated research developing, calibrating and validating wave hindcast models. Past hindcast model validation studies examined the accuracy in modeling bulk wave parameters of overall sea states without considering the dependency of the model's skill within different sea states. In the present study, a framework for wave hindcast model validation is developed by examining the model accuracy for the most frequently occurring sea states, sea states contributing the most energy to total wave power, sea states associated with hurricane events, and those with the largest model error. Here, validations using bulk wave parameters and frequency-directional spectra at these key sea states and extreme wave conditions based on univariate and bivariate-contour methods provide insights to improve model accuracy, identifying the model's strong and weak points, and pathways for improvement, e.g., modeling wave-current interactions and adjusting wind data. This study adds to a growing body of research demonstrating that a carefully calibrated and verified spectral wave hindcast model can be used to estimate key wave energy parameters over a wide range of wave energy climates, as well as their spatial, temporal, frequency, directional, and probabilistic distributions.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning Prediction of the Critical Cooling Rate for Metallic Glasses from Expanded Datasets and Elemental Features

In this study, we use a random forest (RF) model to predict the critical cooling rate (R C ) for glass formation of various alloys from features of their constituent elements. The RF model was trained on a database that integrates multiple sources of direct and indirect R C data for metallic glasses to expand the directly measured R C database of less than 100 values to a training set of over 2000 values. The model error on 5-fold cross-validation (CV) is 0.66 orders of magnitude in K/s. The error on leave-out-one-group CV on alloy system groups is 0.59 log units in K/s when the target alloy constituents appear more than 500 times in training data. Using this model, we make predictions for the set of compositions with melt-spun glasses in the database and for the full set of quaternary alloys that have constituents which appear more than 500 times in training data. These predictions identify a number of potential new bulk metallic glass systems for future study, but the model is most useful for the identification of alloy systems likely to contain good glass formers rather than detailed discovery of bulk glass composition regions within known glassy systems.

36 MATERIALS SCIENCE↗

Stochastic Error Cancellation in Analog Quantum Simulation

Analog quantum simulation is a promising path towards solving classically intractable problems in many-body physics on near-term quantum devices. However, the presence of noise limits the size of the system and the length of time that can be simulated. In our work, we consider an error model in which the actual Hamiltonian of the simulator differs from the target Hamiltonian we want to simulate by small local perturbations, which are assumed to be random and unbiased. We analyze the error accumulated in observables in this setting and show that, due to stochastic error cancellation, with high probability the error scales as the square root of the number of qubits instead of linearly. We explore the concentration phenomenon of this error as well as its implications for local observables in the thermodynamic limit. Moreover, we show that stochastic error cancellation also manifests in the fidelity between the target state at the end of time-evolution and the actual state we obtain in the presence of noise. This indicates that, to reach a certain fidelity, more noise can be tolerated than implied by the worst-case bound if the noise comes from many statistically independent sources.

Analog quantum simulation↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Measuring the Loschmidt Amplitude for Finite-Energy Properties of the Fermi-Hubbard Model on an Ion-Trap Quantum Computer

Calculating the equilibrium properties of condensed-matter systems is one of the promising applications of near-term quantum computing. Recently, hybrid quantum-classical time-series algorithms have been proposed to efficiently extract these properties from a measurement of the Loschmidt amplitude ⟨ ψ | e − i H ^ t | ψ ⟩ from initial states | ψ ⟩ and a time evolution under the Hamiltonian H ^ up to short times t . In this work, we study the operation of this algorithm on a present-day quantum computer. Specifically, we measure the Loschmidt amplitude for the Fermi-Hubbard model on a 16 -site ladder geometry (32 orbitals) on the Quantinuum H2-1 trapped-ion device. We assess the effect of noise on the Loschmidt amplitude and implement algorithm-specific error-mitigation techniques. By using a thus-motivated error model, we numerically analyze the influence of noise on the full operation of the quantum-classical algorithm by measuring expectation values of local observables at finite energies. Finally, we estimate the resources needed for scaling up the algorithm. Published by the American Physical Society 2024

Physics↗

Intensity Modulated Proton Therapy for Craniospinal Irradiation: Organ-at-Risk Exposure and a Low-Gradient Junctioning Technique

Purpose: To compare field junction robustness and sparing of organs at risk (OARs) during craniospinal irradiation (CSI) using intensity modulated proton therapy (IMPT) to conventional passively scattered proton therapy (PSPT). Methods and Materials: Ten patients, 5 adult and 5 pediatric patients, previously treated with PSPT-based CSI were selected for comparison. Anterior oblique cranial fields, using a superior couch rotation, and posterior spinal fields were used for IMPT planning. To facilitate low-gradient field junctioning along the spine, the inverse-planning IMPT technique was divided into 3 stages. Dose indices describing target coverage and normal tissue dose, in silico error modeling, and film dosimetry were used to assess plan quality. Results: Field junction robustness along the spine was improved using the staged IMPT planning technique, reducing the worst case impact of a 4-mm setup error from 25% in PSPT to <5% of prescription dose. This was verified by film dosimetry for clinical delivery. Exclusive of thyroid dose in adult patients, IMPT plans demonstrated sparing of organs at risk as good or better than PSPT. Coverage of the cribriform plate for pediatric (V95% [percentage of volume of the target receiving at least 95% of the prescribed dose]; 87 ± 11 vs 92 ± 7) and adult (V95%; 94 ± 7 vs 100 ± 1) patients and the clinical target in pediatric (V95%; 98 ± 2 vs 100 ± 1) and adult (V95%; 100 ± 1 vs 100 ± 1) patients for PSPT and IMPT plans, respectively, were comparable or improved. For adult patients, IMPT target dose inhomogeneity was increased, as determined by heterogeneity index (HI) and inhomogeneity coefficient (IC). IMPT lowered maximum spinal cord dose, improved spinal dose homogeneity, and reduced exposure to other OARs. Conclusions: IMPT has the potential to improve CSI plan quality and the homogeneity of intrafractional dose at match lines. The IMPT approach developed may also simplify treatments and reduce workload per patient relative to PSPT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Teleconnections of the Quasi–Biennial Oscillation in a multi–model ensemble of QBO–resolving models

The quasi-biennial oscillation (QBO) dominates the interannual variability of the tropical stratosphere and influences other regions of the atmosphere. The high predictability of the QBO implies that its teleconnections could lead to in-creased skill of seasonal and decadal forecasts provided the relevant mechanisms are accurately represented in models. Here modelling and sampling uncertainties of QBO teleconnections are examined using a multi-model ensemble of QBO-resolving atmospheric general circulation models that have carried out a set of coordinated experiments as part of the Stratosphere-troposphere Processes And their Role in Climate (SPARC) QBO initiative (QBOi). During Northern Hemisphere winter the stratospheric polar vortex in most of these models strengthens when the QBO near 50 hPa is westerly and weakens when it is easterly, consistent with, but weaker than, the observed response. These weak responses are likely due to model errors, such as systematically weak QBO amplitudes near 50 hPa, affecting the teleconnection. The teleconnection to the North Atlantic Oscillation is less well captured overall, but of similar strength to the observed signal in the few models that do show it. Furthermore, the models do not show clear evidence of a QBO teleconnection to the Northern Hemisphere Pacific sector subtropical jet.

54 ENVIRONMENTAL SCIENCES↗

Improving Lidar Turbulence Estimates for Wind Energy

Remote sensing devices (e.g., lidars) are quickly becoming a cost-effective and reliable alternative to meteorological towers for wind energy applications. Although lidars can measure mean wind speeds accurately, these devices measure different values of turbulence intensity (TI) than an instrument on a tower. In response to these issues, a lidar TI error reduction model was recently developed for commercially available lidars. The TI error model first applies physics-based corrections to the lidar measurements, then uses machine-learning techniques to further reduce errors in lidar TI estimates. The model was tested at two sites in the Southern Plains where vertically profiling lidars were collocated with meteorological towers. Results indicate that the model works well under stable conditions but cannot fully mitigate the effects of variance contamination under unstable conditions. To understand how variance contamination affects lidar TI estimates, a new set of equations was derived in previous work to characterize the actual variance measured by a lidar. Terms in these equations were quantified using a lidar simulator and modeled wind field, and the new equations were then implemented into the TI error model.

17 WIND ENERGY↗

Behavior and mechanisms of Doppler wind lidar error in varying stability regimes

Abstract. Wind lidars are widespread and important tools in atmospheric observations. An intrinsic part of lidar measurement error is due to atmospheric variability in the remote-sensing scan volume. This study describes and quantifies the distribution of measurement error due to turbulence in varying atmospheric stability. While the lidar error model is general, we demonstrate the approach using large ensembles of virtual WindCube V2 lidar performing a profiling Doppler-beam-swinging scan in quasi-stationary large-eddy simulations (LESs) of convective and stable boundary layers. Error trends vary with the stability regime, time averaging of results, and observation height. A systematic analysis of the observation error explains dominant mechanisms and supports the findings of the empirical results. Treating the error under a random variable framework allows for informed predictions about the effect of different configurations or conditions on lidar performance. Convective conditions are most prone to large errors (up to 1.5 m s−1 in 1 Hz wind speed in strong convection), driven by the large vertical velocity variances in convective conditions and the high elevation angle of the scanning beams (62∘). Range-gate weighting induces a negative bias into the horizontal wind speeds near the surface shear layer (−0.2 m s−1 in the stable test case). Errors in the horizontal wind speed and direction computed from the wind components are sensitive to the background wind speed but have negligible dependence on the relative orientation of the instrument. Especially during low winds and in the presence of large errors in the horizontal velocity estimates, the reported wind speed is subject to a systematic positive bias (up to 0.4 m s−1 in 1 Hz measurements in strong convection). Vector time-averaged measurements can improve the behavior of the error distributions (reducing the 10 min wind speed error standard deviation to <0.3 m s−1 and the bias to <0.1 m s−1 in strong convection) with a predictable effectiveness related to the number of decorrelated samples in the time window. Hybrid schemes weighting the 10 min scalar- and vector-averaged lidar measurements are shown to be effective at reducing the wind speed biases compared to cup measurements in most of the simulated conditions, with time averages longer than 10 min recommended for best use in some unstable conditions. The approach in decomposing the error mechanisms with the help of the LES flow field could be extended to more complex measurement scenarios and scans.

17 WIND ENERGY↗

Global sensitivity analysis, probabilistic calibration, and predictive assessment for the data assimilation linked ecosystem carbon model

In this paper we propose a probabilistic framework for an uncertainty quantification (UQ) study of a carbon cycle model and focus on the comparison between steady-state and transient simulation setups. A global sensitivity analysis (GSA) study indicates the parameters and parameter couplings that are important at different times of the year for quantities of interest (QoIs) obtained with the data assimilation linked ecosystem carbon (DALEC) model. We then employ a Bayesian approach and a statistical model error term to calibrate the parameters of DALEC using net ecosystem exchange (NEE) observations at the Harvard Forest site. The calibration results are employed in the second part of the paper to assess the predictive skill of the model via posterior predictive checks.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of a New Chemical Mechanism for 2-Amino-2-methyl-1-propanol in a Reactive Environment from CSIRO Smog Chamber Experiments

Amines are considered as an emerging class of atmospheric pollutants that are of great importance to atmospheric chemistry and new particle formation. As a typical amine, 2-amino-2-methyl-1-propanol (AMP) is one of the proposed solvents for capturing CO 2 from flue gas streams in amine-based post-combustion CO 2 capture plants, and it is expected to result in AMP emission and secondary products formation in the atmosphere. However, the current knowledge of its atmospheric chemistry and kinetics is poorly understood, particularly in a reactive environment. As such, in this work we used the CSIRO smog chamber to study the photo-oxidation of AMP in the presence of VOCs–NOx surrogate mixtures over a range of initial amine concentrations. O 3 formation was significantly inhibited when AMP was added to the surrogate VOCs–NOx mixtures, implying that AMP could alter known atmospheric chemical reaction pathways and the prevailing reactivity. Simultaneously, a large amount of AMP-derived secondary aerosol was formed, with a considerably high aerosol mass yield (i.e. ratio of aerosol formed to reacted AMP) of 1.06±0.20. Based on updated knowledge of its kinetics, oxidation pathways and product yields, we have developed a new mechanism (designated as CSIAMP-19) and integrated into the Carbon Bond 6 (CB6) chemical mechanism, and evaluated it against available smog chamber data. Compared with the existing AMP mechanism (designated as CarterAMP-08), the modified CB6 with CSIAMP-19 mechanism improves prediction against AMP–VOCs–NOx experiments across a range of initial AMP concentrations, within ±10% model error for gross ozone production. Our results contribute to scientific understanding of AMP photochemistry and to the development of the chemical mechanism of other amines. The updated AMP chemical reactions scheme can be further embedded into the chemical transport model for regional modelling scenarios where AMP-related emissions are of concern.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NEW CONSTRAINTS ON THE BLACK HOLE LOW/HARD STATE INNER ACCRETION FLOW WITH NuSTAR

We report on an observation of the Galactic black hole candidate GRS 1739–278 during its 2014 outburst, obtained with NuSTAR. The source was captured at the peak of a rising ''low/hard'' state, at a flux of ∼0.3 Crab. A broad, skewed iron line and disk reflection spectrum are revealed. Fits to the sensitive NuSTAR spectra with a number of relativistically blurred disk reflection models yield strong geometrical constraints on the disk and hard X-ray ''corona''. Two models that explicitly assume a ''lamp post'' corona find its base to have a vertical height above the black hole of h=5{sub −2}{sup +7} GM/c{sup 2} and h = 18 ± 4 GM/c {sup 2} (90% confidence errors); models that do not assume a ''lamp post'' return emissivity profiles that are broadly consistent with coronae of this size. Given that X-ray microlensing studies of quasars and reverberation lags in Seyferts find similarly compact coronae, observations may now signal that compact coronae are fundamental across the black hole mass scale. All of the models fit to GRS 1739–278 find that the accretion disk extends very close to the black hole—the least stringent constraint is r{sub in}=5{sub −4}{sup +3} GM/c{sup 2}. Only two of the models deliver meaningful spin constraints, but a = 0.8 ± 0.2 is consistent with all of the fits. Overall, the data provide especially compelling evidence of an association between compact hard X-ray coronae and the base of relativistic radio jets in black holes.

79 ASTRONOMY AND ASTROPHYSICS↗

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence↗

Regularized machine learning on molecular graph model explains systematic error in DFT enthalpies

Abstract A major goal of materials research is the discovery of novel and efficient heterogeneous catalysts for various chemical processes. In such studies, the candidate catalyst material is modeled using tens to thousands of chemical species and elementary reactions. Density Functional Theory (DFT) is widely used to calculate the thermochemistry of these species which might be surface species or gas-phase molecules. The use of an approximate exchange correlation functional in the DFT framework introduces an important source of error in such models. This is especially true in the calculation of gas phase molecules whose thermochemistry is calculated using the same planewave basis set as the rest of the surface mechanism. Unfortunately, the nature and magnitude of these errors is unknown for most practical molecules. Here, we investigate the error in the enthalpy of formation for 1676 gaseous species using two different DFT levels of theory and the ‘ground truth values’ obtained from the NIST database. We featurize molecules using graph theory. We use a regularized algorithm to discover a sparse model of the error and identify important molecular fragments that drive this error. The model is robust to rigorous statistical tests and is used to correct DFT thermochemistry, achieving more than an order of magnitude improvement.

36 MATERIALS SCIENCE↗

Tools for analysis of optimization models

The software is code for analyzing, debugging, and solving optimization models. The code implements several algorithms and provides convenient APIs to apply these algorithms to optimization models. The algorithms are primarily based on graph theory. They compute well-known partitions of graphs, and use these partitions to provide the user information about their optimization model, including diagnosing certain types of structural modeling errors. Some algorithms may be used as a subroutine to solve an optimization problem, and may call an optimization solver to facilitate this. Well-known linear algebra routines are called to provide further diagnostics. The software contains no data and no models other than toy models used for testing.

Parker, Robert↗