Search NASA⌕ Search

SEARCH · Search NASA

Results for “error modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Quantum information encoding, protection, and correction from trace-norm isometries

We introduce the notion of trace-norm isometric encoding and explore its implications for passive and active methods for protecting quantum information against errors. Beside providing an operational foundation to the 'subsystems principle' [E. Knill, Phys. Rev. A 74, 042301 (2006)] for faithfully realizing quantum information in physical systems, our approach allows additional explicit connections between noiseless, protectable, and correctable quantum codes to be identified. Robustness properties of isometric encodings against imperfect initialization and/or deviations from the intended error models are also analyzed.

07 ISOTOPE AND RADIATION SOURCES↗

Exploring the contamination of the DES-Y1 cluster sample with SPT-SZ selected clusters

ABSTRACT We perform a cross validation of the cluster catalogue selected by the red-sequence Matched-filter Probabilistic Percolation algorithm (redMaPPer) in Dark Energy Survey year 1 (DES-Y1) data by matching it with the Sunyaev–Zel’dovich effect (SZE) selected cluster catalogue from the South Pole Telescope SPT-SZ survey. Of the 1005 redMaPPer selected clusters with measured richness $\hat{\lambda }\gt 40$ in the joint footprint, 207 are confirmed by SPT-SZ. Using the mass information from the SZE signal, we calibrate the richness–mass relation using a Bayesian cluster population model. We find a mass trend λ ∝ MB consistent with a linear relation (B ∼ 1), no significant redshift evolution and an intrinsic scatter in richness of σλ = 0.22 ± 0.06. By considering two error models, we explore the impact of projection effects on the richness–mass modelling, confirming that such effects are not detectable at the current level of systematic uncertainties. At low richness SPT-SZ confirms fewer redMaPPer clusters than expected. We interpret this richness dependent deficit in confirmed systems as due to the increased presence at low richness of low-mass objects not correctly accounted for by our richness-mass scatter model, which we call contaminants. At a richness $\hat{\lambda }=40$, this population makes up ${\gt}12{{\ \rm per\ cent}}$ (97.5 percentile) of the total population. Extrapolating this to a measured richness $\hat{\lambda }=20$ yields ${\gt}22{{\ \rm per\ cent}}$ (97.5 percentile). With these contamination fractions, the predicted redMaPPer number counts in different plausible cosmologies are compatible with the measured abundance. The presence of such a population is also a plausible explanation for the different mass trends (B ∼ 0.75) obtained from mass calibration using purely optically selected clusters. The mean mass from stacked weak lensing (WL) measurements suggests that these low-mass contaminants are galaxy groups with masses ∼3–5 × 1013 M⊙ which are beyond the sensitivity of current SZE and X-ray surveys but a natural target for SPT-3G and eROSITA.

79 ASTRONOMY AND ASTROPHYSICS↗

Analysis of Polarized Dust Emission Using Data from the First Flight of SPIDER

Using data from the first flight of Spider and from the Planck High Frequency Instrument, we probe the properties of polarized emission from interstellar dust in the Spider observing region. Component-separation algorithms operating in both the spatial and harmonic domains are applied to probe their consistency and to quantify modeling errors associated with their assumptions. Analyses of diffuse Galactic dust emission spanning the full Spider region demonstrate (i) a spectral energy distribution that is broadly consistent with a modified-blackbody (MBB) model with a spectral index of β d = 1.45 ± 0.05 (1.47 ± 0.06) for E (B)-mode polarization, slightly lower than that reported by Planck for the full sky; (ii) an angular power spectrum broadly consistent with a power law; and (iii) no significant detection of line-of-sight polarization decorrelation. Tests of several modeling uncertainties find only a modest impact (~10% in σ r ) on Spider's sensitivity to the cosmological tensor-to-scalar ratio. The size of the Spider region further allows for a statistically meaningful analysis of the variation in foreground properties within it. Assuming a fixed dust temperature T d = 19.6 K, an analysis of two independent subregions of that field results in inferred values of β d = 1.52 ± 0.06 and β d = 1.09 ± 0.09, which are inconsistent at the 3.9σ level. Furthermore, a joint analysis of Spider and Planck 217 and 353 GHz data within one subregion is inconsistent with a simple MBB at more than 3σ, assuming a common morphology of polarized dust emission over the full range of frequencies. This evidence of variation may inform the component-separation approaches of future cosmic microwave background polarization experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

Quantifying correlated truncation errors in effective field theory

Effective field theories (EFTs) organize the description of complex systems into an infinite sequence of decreasing importance. Predictions are made with a finite number of terms, which induces a truncation error that is often left unquantified. Here, we formalize the notion of EFT convergence and propose a Bayesian truncation error model for predictions that are correlated across the independent variables, e.g., energy or scattering angle. Central to our approach are Gaussian processes that encode both the naturalness and correlation structure of EFT coefficients. Our use of Gaussian processes permits efficient and accurate assessment of credible intervals, allows EFT fits to easily include correlated theory errors, and provides analytic posteriors for physical EFT-related quantities such as the expansion parameter. Furthermore, we demonstrate that model-checking diagnostics—applied to the case of multiple curves—are powerful tools for EFT validation. As an example, we assess a set of nucleon-nucleon scattering observables in chiral EFT. In an effort to be self-contained, appendices include thorough derivations of our statistical results. Our methods are packaged in Python code, called gsum, that is available for download on GitHub.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Active learning for SNAP interatomic potentials via Bayesian predictive uncertainty

Bayesian inference with a simple Gaussian error model is used to efficiently compute prediction variances for energies, forces, and stresses in the linear SNAP interatomic potential. Here, the prediction variance is shown to have a strong correlation with the absolute error over approximately 24 orders of magnitude. Using this prediction variance, an active learning algorithm is constructed to iteratively train a potential by selecting the structures with the most uncertain properties from a pool of candidate structures. The relative importance of the energy, force, and stress errors in the objective function is shown to have a strong impact upon the trajectory of their respective net error metrics when running the active learning algorithm. Batched training of different batch sizes is also tested against singular structure updates, and it is found that batches can be used to significantly reduce the number of retraining steps required with only minor impact on the active learning trajectory.

97 MATHEMATICS AND COMPUTING↗

A framework for feasibility-level validation of high-resolution wave hindcast models

The value of long-term wave hindcasts for investigating wave climates, wave energy resources, and extreme wave conditions has motivated research developing, calibrating and validating wave hindcast models. Past hindcast model validation studies examined the accuracy in modeling bulk wave parameters of overall sea states without considering the dependency of the model's skill within different sea states. In the present study, a framework for wave hindcast model validation is developed by examining the model accuracy for the most frequently occurring sea states, sea states contributing the most energy to total wave power, sea states associated with hurricane events, and those with the largest model error. Here, validations using bulk wave parameters and frequency-directional spectra at these key sea states and extreme wave conditions based on univariate and bivariate-contour methods provide insights to improve model accuracy, identifying the model's strong and weak points, and pathways for improvement, e.g., modeling wave-current interactions and adjusting wind data. This study adds to a growing body of research demonstrating that a carefully calibrated and verified spectral wave hindcast model can be used to estimate key wave energy parameters over a wide range of wave energy climates, as well as their spatial, temporal, frequency, directional, and probabilistic distributions.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning Prediction of the Critical Cooling Rate for Metallic Glasses from Expanded Datasets and Elemental Features

In this study, we use a random forest (RF) model to predict the critical cooling rate (R C ) for glass formation of various alloys from features of their constituent elements. The RF model was trained on a database that integrates multiple sources of direct and indirect R C data for metallic glasses to expand the directly measured R C database of less than 100 values to a training set of over 2000 values. The model error on 5-fold cross-validation (CV) is 0.66 orders of magnitude in K/s. The error on leave-out-one-group CV on alloy system groups is 0.59 log units in K/s when the target alloy constituents appear more than 500 times in training data. Using this model, we make predictions for the set of compositions with melt-spun glasses in the database and for the full set of quaternary alloys that have constituents which appear more than 500 times in training data. These predictions identify a number of potential new bulk metallic glass systems for future study, but the model is most useful for the identification of alloy systems likely to contain good glass formers rather than detailed discovery of bulk glass composition regions within known glassy systems.

36 MATERIALS SCIENCE↗

Stochastic Error Cancellation in Analog Quantum Simulation

Analog quantum simulation is a promising path towards solving classically intractable problems in many-body physics on near-term quantum devices. However, the presence of noise limits the size of the system and the length of time that can be simulated. In our work, we consider an error model in which the actual Hamiltonian of the simulator differs from the target Hamiltonian we want to simulate by small local perturbations, which are assumed to be random and unbiased. We analyze the error accumulated in observables in this setting and show that, due to stochastic error cancellation, with high probability the error scales as the square root of the number of qubits instead of linearly. We explore the concentration phenomenon of this error as well as its implications for local observables in the thermodynamic limit. Moreover, we show that stochastic error cancellation also manifests in the fidelity between the target state at the end of time-evolution and the actual state we obtain in the presence of noise. This indicates that, to reach a certain fidelity, more noise can be tolerated than implied by the worst-case bound if the noise comes from many statistically independent sources.

Analog quantum simulation↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Measuring the Loschmidt Amplitude for Finite-Energy Properties of the Fermi-Hubbard Model on an Ion-Trap Quantum Computer

Calculating the equilibrium properties of condensed-matter systems is one of the promising applications of near-term quantum computing. Recently, hybrid quantum-classical time-series algorithms have been proposed to efficiently extract these properties from a measurement of the Loschmidt amplitude ⟨ ψ | e − i H ^ t | ψ ⟩ from initial states | ψ ⟩ and a time evolution under the Hamiltonian H ^ up to short times t . In this work, we study the operation of this algorithm on a present-day quantum computer. Specifically, we measure the Loschmidt amplitude for the Fermi-Hubbard model on a 16 -site ladder geometry (32 orbitals) on the Quantinuum H2-1 trapped-ion device. We assess the effect of noise on the Loschmidt amplitude and implement algorithm-specific error-mitigation techniques. By using a thus-motivated error model, we numerically analyze the influence of noise on the full operation of the quantum-classical algorithm by measuring expectation values of local observables at finite energies. Finally, we estimate the resources needed for scaling up the algorithm. Published by the American Physical Society 2024

Physics↗

Intensity Modulated Proton Therapy for Craniospinal Irradiation: Organ-at-Risk Exposure and a Low-Gradient Junctioning Technique

Purpose: To compare field junction robustness and sparing of organs at risk (OARs) during craniospinal irradiation (CSI) using intensity modulated proton therapy (IMPT) to conventional passively scattered proton therapy (PSPT). Methods and Materials: Ten patients, 5 adult and 5 pediatric patients, previously treated with PSPT-based CSI were selected for comparison. Anterior oblique cranial fields, using a superior couch rotation, and posterior spinal fields were used for IMPT planning. To facilitate low-gradient field junctioning along the spine, the inverse-planning IMPT technique was divided into 3 stages. Dose indices describing target coverage and normal tissue dose, in silico error modeling, and film dosimetry were used to assess plan quality. Results: Field junction robustness along the spine was improved using the staged IMPT planning technique, reducing the worst case impact of a 4-mm setup error from 25% in PSPT to <5% of prescription dose. This was verified by film dosimetry for clinical delivery. Exclusive of thyroid dose in adult patients, IMPT plans demonstrated sparing of organs at risk as good or better than PSPT. Coverage of the cribriform plate for pediatric (V95% [percentage of volume of the target receiving at least 95% of the prescribed dose]; 87 ± 11 vs 92 ± 7) and adult (V95%; 94 ± 7 vs 100 ± 1) patients and the clinical target in pediatric (V95%; 98 ± 2 vs 100 ± 1) and adult (V95%; 100 ± 1 vs 100 ± 1) patients for PSPT and IMPT plans, respectively, were comparable or improved. For adult patients, IMPT target dose inhomogeneity was increased, as determined by heterogeneity index (HI) and inhomogeneity coefficient (IC). IMPT lowered maximum spinal cord dose, improved spinal dose homogeneity, and reduced exposure to other OARs. Conclusions: IMPT has the potential to improve CSI plan quality and the homogeneity of intrafractional dose at match lines. The IMPT approach developed may also simplify treatments and reduce workload per patient relative to PSPT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Teleconnections of the Quasi–Biennial Oscillation in a multi–model ensemble of QBO–resolving models

The quasi-biennial oscillation (QBO) dominates the interannual variability of the tropical stratosphere and influences other regions of the atmosphere. The high predictability of the QBO implies that its teleconnections could lead to in-creased skill of seasonal and decadal forecasts provided the relevant mechanisms are accurately represented in models. Here modelling and sampling uncertainties of QBO teleconnections are examined using a multi-model ensemble of QBO-resolving atmospheric general circulation models that have carried out a set of coordinated experiments as part of the Stratosphere-troposphere Processes And their Role in Climate (SPARC) QBO initiative (QBOi). During Northern Hemisphere winter the stratospheric polar vortex in most of these models strengthens when the QBO near 50 hPa is westerly and weakens when it is easterly, consistent with, but weaker than, the observed response. These weak responses are likely due to model errors, such as systematically weak QBO amplitudes near 50 hPa, affecting the teleconnection. The teleconnection to the North Atlantic Oscillation is less well captured overall, but of similar strength to the observed signal in the few models that do show it. Furthermore, the models do not show clear evidence of a QBO teleconnection to the Northern Hemisphere Pacific sector subtropical jet.

54 ENVIRONMENTAL SCIENCES↗

Improving Lidar Turbulence Estimates for Wind Energy

Remote sensing devices (e.g., lidars) are quickly becoming a cost-effective and reliable alternative to meteorological towers for wind energy applications. Although lidars can measure mean wind speeds accurately, these devices measure different values of turbulence intensity (TI) than an instrument on a tower. In response to these issues, a lidar TI error reduction model was recently developed for commercially available lidars. The TI error model first applies physics-based corrections to the lidar measurements, then uses machine-learning techniques to further reduce errors in lidar TI estimates. The model was tested at two sites in the Southern Plains where vertically profiling lidars were collocated with meteorological towers. Results indicate that the model works well under stable conditions but cannot fully mitigate the effects of variance contamination under unstable conditions. To understand how variance contamination affects lidar TI estimates, a new set of equations was derived in previous work to characterize the actual variance measured by a lidar. Terms in these equations were quantified using a lidar simulator and modeled wind field, and the new equations were then implemented into the TI error model.

17 WIND ENERGY↗

Behavior and mechanisms of Doppler wind lidar error in varying stability regimes

Abstract. Wind lidars are widespread and important tools in atmospheric observations. An intrinsic part of lidar measurement error is due to atmospheric variability in the remote-sensing scan volume. This study describes and quantifies the distribution of measurement error due to turbulence in varying atmospheric stability. While the lidar error model is general, we demonstrate the approach using large ensembles of virtual WindCube V2 lidar performing a profiling Doppler-beam-swinging scan in quasi-stationary large-eddy simulations (LESs) of convective and stable boundary layers. Error trends vary with the stability regime, time averaging of results, and observation height. A systematic analysis of the observation error explains dominant mechanisms and supports the findings of the empirical results. Treating the error under a random variable framework allows for informed predictions about the effect of different configurations or conditions on lidar performance. Convective conditions are most prone to large errors (up to 1.5 m s−1 in 1 Hz wind speed in strong convection), driven by the large vertical velocity variances in convective conditions and the high elevation angle of the scanning beams (62∘). Range-gate weighting induces a negative bias into the horizontal wind speeds near the surface shear layer (−0.2 m s−1 in the stable test case). Errors in the horizontal wind speed and direction computed from the wind components are sensitive to the background wind speed but have negligible dependence on the relative orientation of the instrument. Especially during low winds and in the presence of large errors in the horizontal velocity estimates, the reported wind speed is subject to a systematic positive bias (up to 0.4 m s−1 in 1 Hz measurements in strong convection). Vector time-averaged measurements can improve the behavior of the error distributions (reducing the 10 min wind speed error standard deviation to <0.3 m s−1 and the bias to <0.1 m s−1 in strong convection) with a predictable effectiveness related to the number of decorrelated samples in the time window. Hybrid schemes weighting the 10 min scalar- and vector-averaged lidar measurements are shown to be effective at reducing the wind speed biases compared to cup measurements in most of the simulated conditions, with time averages longer than 10 min recommended for best use in some unstable conditions. The approach in decomposing the error mechanisms with the help of the LES flow field could be extended to more complex measurement scenarios and scans.

17 WIND ENERGY↗

Global sensitivity analysis, probabilistic calibration, and predictive assessment for the data assimilation linked ecosystem carbon model

In this paper we propose a probabilistic framework for an uncertainty quantification (UQ) study of a carbon cycle model and focus on the comparison between steady-state and transient simulation setups. A global sensitivity analysis (GSA) study indicates the parameters and parameter couplings that are important at different times of the year for quantities of interest (QoIs) obtained with the data assimilation linked ecosystem carbon (DALEC) model. We then employ a Bayesian approach and a statistical model error term to calibrate the parameters of DALEC using net ecosystem exchange (NEE) observations at the Harvard Forest site. The calibration results are employed in the second part of the paper to assess the predictive skill of the model via posterior predictive checks.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of a New Chemical Mechanism for 2-Amino-2-methyl-1-propanol in a Reactive Environment from CSIRO Smog Chamber Experiments

Amines are considered as an emerging class of atmospheric pollutants that are of great importance to atmospheric chemistry and new particle formation. As a typical amine, 2-amino-2-methyl-1-propanol (AMP) is one of the proposed solvents for capturing CO 2 from flue gas streams in amine-based post-combustion CO 2 capture plants, and it is expected to result in AMP emission and secondary products formation in the atmosphere. However, the current knowledge of its atmospheric chemistry and kinetics is poorly understood, particularly in a reactive environment. As such, in this work we used the CSIRO smog chamber to study the photo-oxidation of AMP in the presence of VOCs–NOx surrogate mixtures over a range of initial amine concentrations. O 3 formation was significantly inhibited when AMP was added to the surrogate VOCs–NOx mixtures, implying that AMP could alter known atmospheric chemical reaction pathways and the prevailing reactivity. Simultaneously, a large amount of AMP-derived secondary aerosol was formed, with a considerably high aerosol mass yield (i.e. ratio of aerosol formed to reacted AMP) of 1.06±0.20. Based on updated knowledge of its kinetics, oxidation pathways and product yields, we have developed a new mechanism (designated as CSIAMP-19) and integrated into the Carbon Bond 6 (CB6) chemical mechanism, and evaluated it against available smog chamber data. Compared with the existing AMP mechanism (designated as CarterAMP-08), the modified CB6 with CSIAMP-19 mechanism improves prediction against AMP–VOCs–NOx experiments across a range of initial AMP concentrations, within ±10% model error for gross ozone production. Our results contribute to scientific understanding of AMP photochemistry and to the development of the chemical mechanism of other amines. The updated AMP chemical reactions scheme can be further embedded into the chemical transport model for regional modelling scenarios where AMP-related emissions are of concern.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NEW CONSTRAINTS ON THE BLACK HOLE LOW/HARD STATE INNER ACCRETION FLOW WITH NuSTAR

We report on an observation of the Galactic black hole candidate GRS 1739–278 during its 2014 outburst, obtained with NuSTAR. The source was captured at the peak of a rising ''low/hard'' state, at a flux of ∼0.3 Crab. A broad, skewed iron line and disk reflection spectrum are revealed. Fits to the sensitive NuSTAR spectra with a number of relativistically blurred disk reflection models yield strong geometrical constraints on the disk and hard X-ray ''corona''. Two models that explicitly assume a ''lamp post'' corona find its base to have a vertical height above the black hole of h=5{sub −2}{sup +7} GM/c{sup 2} and h = 18 ± 4 GM/c {sup 2} (90% confidence errors); models that do not assume a ''lamp post'' return emissivity profiles that are broadly consistent with coronae of this size. Given that X-ray microlensing studies of quasars and reverberation lags in Seyferts find similarly compact coronae, observations may now signal that compact coronae are fundamental across the black hole mass scale. All of the models fit to GRS 1739–278 find that the accretion disk extends very close to the black hole—the least stringent constraint is r{sub in}=5{sub −4}{sup +3} GM/c{sup 2}. Only two of the models deliver meaningful spin constraints, but a = 0.8 ± 0.2 is consistent with all of the fits. Overall, the data provide especially compelling evidence of an association between compact hard X-ray coronae and the base of relativistic radio jets in black holes.

79 ASTRONOMY AND ASTROPHYSICS↗