Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Enhancing Model Predictability for a Scramjet Using Probabilistic Learning on Manifolds

In this study, the computational burden of a large-eddy simulation for reactive flows is exacerbated in the presence of uncertainty in flow conditions or kinetic variables. A comprehensive statistical analysis, with a sufficiently large number of samples, remains elusive. Statistical learning is an approach that allows for extracting more information using fewer samples. Such procedures, if successful, will greatly enhance the predictability of models in the sense of improving exploration and characterization of uncertainty due to model error and input dependencies, all while being constrained by the size of the associated statistical samples. In this paper, it is shown how a recently developed procedure for probabilistic learning on manifolds can serve to improve the predictability in a probabilistic framework of a scramjet simulation. The estimates of the probability density functions of the quantities of interest are improved together with estimates of the statistics of their maxima. Lastly, it is also demonstrated how the improved statistical model adds critical insight to the performance of the model.

42 ENGINEERING↗

An experimental study of nonlinear dynamic system identification

A technique for robust identification of nonlinear dynamic systems is developed and illustrated using both simulations and analog experiments. The technique is based on the Minimum Model Error optimal estimation approach. A detailed literature review is included in which fundamental differences between the current approach and previous work is described. The most significant feature of the current work is the ability to identify nonlinear dynamic systems without prior assumptions regarding the form of the nonlinearities, in constrast to existing nonlinear identification approaches which usually require detailed assumptions of the nonlinearities. The example illustrations indicate that the method is robust with respect to prior ignorance of the model, and with respect to measurement noise, measurement frequency, and measurement record length.

Stry, Greselda I.↗

Modeling of the Mode S tracking system in support of aircraft safety research

This report collects, documents, and models data relating the expected accuracies of tracking variables to be obtained from the FAA's Mode S Secondary Surveillance Radar system. The data include measured range and azimuth to the tracked aircraft plus the encoded altitude transmitted via the Mode S data link. A brief summary is made of the Mode S system status and its potential applications for aircraft safety improvement including accident analysis. FAA flight test results are presented demonstrating Mode S range and azimuth accuracy and error characteristics and comparing Mode S to the current ATCRBS radar tracking system. Data are also presented that describe the expected accuracy and error characteristics of encoded altitude. These data are used to formulate mathematical error models of the Mode S variables and encoded altitude. A brief analytical assessment is made of the real-time tracking accuracy available from using Mode S and how it could be improved with down-linked velocity.

Sorensen, J. A.↗

Advocating Feedback Control for Human-Earth System Applications

This paper proposes a feedback control perspective for Human-Earth Systems (HESs) which essentially are complex systems that capture the interactions between humans and nature. Recent attention in HES research has been directed towards devising strategies for climate change mitigation and adaptation, aimed at achieving environmental and societal objectives. However, existing approaches heavily rely on HES models, which inherently suffer from inaccuracies due to the complexity of the system. Moreover, overly detailed models often prove impractical for optimization tasks. We propose a framework inheriting from feedback control strategies the robustness against model errors, because inaccuracies are mitigated using measurements retrieved from the field. The framework comprises two nested control loops. The outer loop computes the optimal inputs to the HES, which are then implemented by actuators controlled in the inner loop. Potential fields of applications are also identified and a numerical example is provided.

biological system modeling↗

View Angle Effects on MODIS Snow Mapping in Forests

Binary snow maps and fractional snow cover data are provided routinely from MODIS (Moderate Resolution Imaging Spectroradiometer). This paper investigates how the wide observation angles of MODIS influence the current snow mapping algorithm in forested areas. Theoretical modeling results indicate that large view zenith angles (VZA) can lead to underestimation of fractional snow cover (FSC) by reducing the amount of the ground surface that is viewable through forest canopies, and by increasing uncertainties during the gridding of MODIS data. At the end of the MODIS scan line, the total modeled error can be as much as 50% for FSC. Empirical analysis of MODIS/Terra snow products in four forest sites shows high fluctuation in FSC estimates on consecutive days. In addition, the normalized difference snow index (NDSI) values, which are the primary input to the MODIS snow mapping algorithms, decrease as VZA increases at the site level. At the pixel level, NDSI values have higher variances, and are correlated with the normalized difference vegetation index (NDVI) in snow covered forests. These findings are consistent with our modeled results, and imply that consideration of view angle effects could improve MODIS snow monitoring in forested areas.

MODIS↗

Global-Scale Comparison of Passive (SMOS) and Active (ASCAT) Satellite Based Microwave Soil Moisture Retrievals with Soil Moisture Simulations (MERRA-Land)

Global surface soil moisture (SSM) datasets are being produced based on active and passive microwave satellite observations and simulations from land surface models (LSM). This study investigates the consistency of two global satellite-based SSM datasets based on microwave remote sensing observations from the passive Soil Moisture and Ocean Salinity (SMOS;SMOSL3 version 2.5) and the active Advanced Scatterometer (ASCAT; version TUWien- WARP 5.5) with respect to LSM SSM from the MERRA-Land data product. The relationship between the global-scale SSM products was studied during the 2010-2012 period using (1) a time series statistics (considering both original SSM data and anomalies), (2) a space-time analysis using Hovmoller diagrams, and (3) a triple collocation error model. The SMOSL3 and ASCAT retrievals are consistent with the temporal dynamics of modeled SSM (correlation R (is) greater than 0.70 for original SSM) in the transition zones between wet and dry climates, including the Sahel, the Indian subcontinent, the Great Plains of North America, eastern Australia, and southeastern Brazil. Over relatively dense vegetation covers, a better consistency with MERRA-Land was obtained with ASCAT than with SMOSL3. However, it was found that ASCAT retrievals exhibit negative correlation versus MERRA-Land in some arid regions (e.g., the Sahara and the Arabian Peninsula). In terms of anomalies, SMOSL3 better captures the short term SSM variability of the reference dataset (MERRA-Land) than ASCAT over regions with limited radio frequency interference (RFI) effects (e.g., North America, South America, and Australia). The seasonal and latitudinal variations of SSM are relatively similar for the three products, although the MERRALand SSM values are generally higher and their seasonal amplitude is much lower than for SMOSL3 and ASCAT. Both SMOSL3 and ASCAT have relatively comparable triple collocation errors with similar spatial error patterns: (i) lowest errors in arid regions (e.g., Sahara and Arabian Peninsula), due to the very low natural variability of soil moisture in these areas, and Central America, and (ii) highest errors over most of the vegetated regions (e.g., northern Australia, India, central Asia, and South America). However, the ASCAT SSM product is prone to larger random errors in some regions (e.g., north-western Africa, Iran, and southern South Africa). Vegetation density was found to be a key factor to interpret the consistency with MERRA-Land between the two remotely sensed products (SMOSL3 and ASCAT) which provides complementary information on SSM. This study shows that both SMOS and ASCAT have thus a potential for data fusion into long-term data records.

ASCAT↗

Direct sensitivity analysis on the parameterization of crystal plasticity models

Various methods for calibrating crystal plasticity finite element (CPFE) models lead to non-unique input parameter values, which subsequently introduce uncertainty in the predicted mechanical response. Sensitivity analysis (SA) conducted on crystal plasticity models is used to identify how variability in these parameters contribute to output uncertainty. Traditional SA on CPFE parameters uses simplified surrogate models to save computational time. However, the accuracy of the surrogate models depends on the quantity of training data used, and any modeling error can propagate into the SA results, potentially affecting their reliability. In this work, the elementary effects test (EET) method, a global SA technique using direct CPFE simulations was employed, and the results obtained were compared with the First Order Second Moment (FOSM) method. ExaConstit, an open-source GPU-enabled CPFE code, was used to perform the simulations and direct SA. The EET method was accurately able to capture the non-linear effects of all the input parameters on the output and is a valuable approach for reliably attributing parameter sensitivities in CPFE models. Based on the results, efficient strategies to perform future parameter calibration and SA are discussed. Additionally, the SA trends observed in different single crystal orientations closely mirrored the activity of the slip systems.

Elementary Effects Test↗

Two-level structural sparsity regularization for identifying lattices and defects in noisy images

Here, this paper presents a regularized regression model with a two-level structural sparsity penalty applied to locate individual atoms in a noisy scanning transmission electron microscopy image (STEM). In crystals, the locations of atoms is symmetric, condensed into a few lattice groups. Therefore, by identifying the underlying lattice in a given image, individual atoms can be accurately located. We propose to formulate the identification of the lattice groups as a sparse group selection problem. Furthermore, real atomic scale images contain defects and vacancies, so atomic identification based solely on a lattice group may result in false positives and false negatives. To minimize error, model includes an individual sparsity regularization in addition to the group sparsity for a within-group selection, which results in a regression model with a two-level sparsity regularization. We propose a modification of the group orthogonal matching pursuit (gOMP) algorithm with a thresholding step to solve the atom finding problem. The convergence and statistical analyses of the proposed algorithm are presented. The proposed algorithm is also evaluated through numerical experiments with simulated images. The applicability of the algorithm on determination of atom structures and identification of imaging distortions and atomic defects was demonstrated using three real STEM images. In conclusion, we believe this is an important step toward automatic phase identification and assignment with the advent of genomic databases for materials.

36 MATERIALS SCIENCE↗

Analysis of ETMS Data Quality for Traffic Flow Management Decisions

The data needed for air traffic flow management decision support tools is provided by the Enhanced Traffic Management System (ETMS). This includes both the tools that are in current use and the ones being developed for future deployment. Since the quality of decision support provided by all these tools will be influenced by the quality of the input ETMS data, an assessment of ETMS data quality is needed. Motivated by this desire, ETMS data quality is examined in this paper in terms of the unavailability of flight plans, deviation from the filed flight plans, departure delays, altitude errors and track data drops. Although many of these data quality issues are not new, little is known about their extent. A goal of this paper is to document the magnitude of data quality issues supported by numerical analysis of ETMS data. Guided by this goal, ETMS data for a 24-hour period were processed to determine the number of aircraft with missing flight plan messages at any given instant of time. Results are presented for aircraft above 18,000 feet altitude and also at all altitudes. Since deviation from filed flight plan is also a major cause of trajectory-modeling errors, statistics of deviations are presented. Errors in proposed departure times and ETMS-generated vertical profiles are also shown. A method for conditioning the vertical profiles for improving demand prediction accuracy is described. Graphs of actual sector counts obtained using these vertical profiles are compared with those obtained using the Host data for sectors in the Fort Worth Center to demonstrate the benefit of preprocessing. Finally, results are presented to quantify the extent of data drops. A method for propagating track positions during ETMS data drops is also described.

Chatterji, Gano B.↗

Investigating Tropical Versus Extratropical Influences on the Southern Hemisphere Tropical Edge in the Unified Model

Abstract Since the late 1970s, observations have shown a widening of the tropical Hadley cell (HC) circulation. State‐of‐the‐art climate models reproduce the general trend along with a projected continuous expansion. Discrepancies in expansion rates of observation‐ and model‐based studies have been attributed to differences in applied methods, natural variability and model shortcomings. Furthermore, the driving influence of tropical or extratropical processes on these changes is not well understood. All of this highlights the dynamical mechanisms and the region of origin controlling the tropical width are still insufficiently understood. Here we examine the influence of systematic model biases of the atmosphere‐only Unified Model (UM) onto the simulation of the Southern Hemisphere (SH) tropical edge. We utilize nudged experiments with prescribed sea surface temperatures, where potential temperature and horizontal winds are relaxed back to ERA‐Interim reanalysis for a 20‐year period in selected regions. Correcting model biases in the tropics and extratropics separately allows us to dissect the dominant remote impacts of present model errors onto the SH tropical edge simulation. The experiments are applied to established tropical width metrics ranging from near‐surface to upper‐level metrics capturing the poleward flank of the HC. We find both regions work remotely to reduce errors in the UM fields and location of the tropical edge. Surprisingly, correcting the extratropical biases, south of 45°S, more consistently improves the tropical width across the metrics and seasons than nudging the tropics (10°N–10°S). These findings demonstrate the substantial role of extratropical influences in locating the SH tropical edge.

54 ENVIRONMENTAL SCIENCES↗

EFFECT OF MODEL-DEPENDENT COVARIANCE MATRIX FOR STUDYING BARYON ACOUSTIC OSCILLATIONS

Large-scale structures in the universe are a powerful tool to test cosmological models and constrain cosmological parameters. A particular feature of interest comes from baryon acoustic oscillations (BAOs), which are sound waves traveling in the hot plasma of the early universe that stopped at the recombination time. This feature can be observed as a localized bump in the correlation function at the scale of the sound horizon r{sub s} . As such, it provides a standard ruler and a lot of constraining power in the correlation function analysis of galaxy surveys. Moreover, the detection of BAOs at the expected scale gives strong support to cosmological models. Both of these studies (BAO detection and parameter constraints) rely on a statistical modeling of the measured correlation function {xi}-circumflex. Usually {xi}-circumflex is assumed to be Gaussian, with a mean {xi}{sub {theta}} depending on the cosmological model and a covariance matrix C generally approximated as a constant (i.e., independent of the model). In this article, we study whether a realistic model-dependent C {sub {theta}} changes the results of cosmological parameter constraints compared to the approximation of a constant covariance matrix C. For this purpose, we use a new procedure to generate lognormal realizations of the luminous red galaxy sample of the Sloan Digital Sky Survey Data Release 7 to obtain a model-dependent C {sub {theta}} in a reasonable time. The approximation of C {sub {theta}} as a constant creates small changes in the cosmological parameter constraints on our sample. We quantify this modeling error using a lot of simulations and find that it only has a marginal influence on cosmological parameter constraints for current and next-generation galaxy surveys. It can be approximately taken into account by extending the 1{sigma} intervals by a factor Almost-Equal-To 1.3.

79 ASTRONOMY AND ASTROPHYSICS↗

A Three-Dimensional Variational Data Assimilation Scheme for the Regional Ocean Modeling System: Implementation and Basic Experiments

A three-dimensional variational data assimilation scheme for the Regional Ocean Modeling System (ROMS), named ROMS3DVAR, has been described in the work of Li et al. (2008). In this paper, ROMS3DVAR is applied to the central California coastal region, an area characterized by inhomogeneity and anisotropy, as well as by dynamically unbalanced flows. A method for estimating the model error variances from limited observations is presented, and the construction of the inhomogeneous and anisotropic error correlations based on the Kronecker product is demonstrated. A set of single observation experiments illustrates the inhomogeneous and anisotropic error correlations and weak dynamic constraints used. Results are presented from the assimilation of data gathered during the Autonomous Ocean Sampling Network (AOSN) experiment during August 2003. The results show that ROMS3DVAR is capable of reproducing complex flows associated with upwelling and relaxation, as well as the rapid transitions between them. Some difficulties encountered during the experiment are also discussed.

California coastal ocean↗

Dynamic Stochastic Superresolution of sparsely observed turbulent systems

Real-time capture of the relevant features of the unresolved turbulent dynamics of complex natural systems from sparse noisy observations and imperfect models is a notoriously difficult problem. The resulting lack of observational resolution and statistical accuracy in estimating the important turbulent processes, which intermittently send significant energy to the large-scale fluctuations, hinders efficient parameterization and real-time prediction using discretized PDE models. This issue is particularly subtle and important when dealing with turbulent geophysical systems with an vast range of interacting spatio-temporal scales and rough energy spectra near the mesh scale of numerical models. Here, we introduce and study a suite of general Dynamic Stochastic Superresolution (DSS) algorithms and show that, by appropriately filtering sparse regular observations with the help of cheap stochastic exactly solvable models, one can derive stochastically ‘superresolved’ velocity fields and gain insight into the important characteristics of the unresolved dynamics, including the detection of the so-called black swans. The DSS algorithms operate in Fourier domain and exploit the fact that the coarse observation network aliases high-wavenumber information into the resolved waveband. It is shown that these cheap algorithms are robust and have significant skill on a test bed of turbulent solutions from realistic nonlinear turbulent spatially extended systems in the presence of a significant model error. In particular, the DSS algorithms are capable of successfully capturing time-localized extreme events in the unresolved modes, and they provide good and robust skill for recovery of the unresolved processes in terms of pattern correlation. Moreover, we show that DSS improves the skill for recovering the primary modes associated with the sparse observation mesh which is equally important in applications. The skill of the various DSS algorithms depends on the energy spectrum of the turbulent signal and the observation time relative to the decorrelation time of the turbulence at a given spatial scale in a fashion elucidated here. The DSS technique exploiting a simple Gaussian closure of the nonlinear stochastic forecast model emerges as the most suitable trade-off between the superresolution skill and computational complexity associated with estimating the cross-correlations between the aliasing modes of the sparsely observed turbulent signal. Such techniques offer a promising and efficient approach to constraining unresolved turbulent fluxes through stochastic superparameterization and a subsequent improvement in coarse-grained filtering and prediction of the next generation atmosphere–ocean system (AOS) models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A general framework for removing point-spread function additive systematics in cosmological weak lensing analysis

ABSTRACT Cosmological weak lensing measurements rely on a precise measurement of the shear two-point correlation function (2PCF) along with a deep understanding of systematics that affect it. In this work, we demonstrate a general framework for detecting and modelling the impact of PSF systematics on the cosmic shear 2PCF and mitigating its impact on cosmological analysis. Our framework can detect PSF leakage and modelling error from all spin-2 quantities contributed by the PSF second and higher moments, rather than just the second moments, using the cross-correlations between galaxy shapes and PSF moments. We interpret null tests using the HSC Year 3 (Y3) catalogs with this formalism and find that leakage from the spin-2 combination of PSF fourth moments is the leading contributor to additive shear systematics, with total contamination that is an order-of-magnitude higher than that contributed by PSF second moments alone. We conducted a mock cosmic shear analysis for HSC Y3 and find that, if uncorrected, PSF systematics can bias the cosmological parameters Ωm and S8 by ∼0.3σ. The traditional second moment-based model can only correct for a 0.1σ bias, leaving the contamination largely uncorrected. We conclude it is necessary to model both PSF second and fourth moment contaminations for HSC Y3 cosmic shear analysis. We also reanalyse the HSC Y1 cosmic shear analysis with our updated systematics model and identify a 0.07σ bias on Ωm when using the more restricted second moment model from the original analysis. We demonstrate how to self-consistently use the method in both real space and Fourier space, assess shear systematics in tomographic bins, and test for PSF model overfitting.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Quantum error mitigation by hidden inverses protocol in superconducting quantum devices

We present a method to improve the convergence of variational algorithms based on hidden inverses (HIs) to mitigate coherent errors. In the context of error mitigation, this means replacing the hardware implementation of certain Hermitian gates with their inverses. Doing so results in noise cancellation and a more resilient quantum circuit. This approach improves performance in a variety of two-qubit error models where the noise operator also inverts with the gate inversion. We apply the mitigation scheme on superconducting quantum processors running the variational quantum eigensolver (VQE) algorithm to find the H 2 ground-state energy. When implemented on superconducting hardware we find that the mitigation scheme effectively reduces the energy fluctuations in the parameter learning path in VQE, reducing the number of iterations for a converged value. We also provide a detailed numerical simulation of VQE performance under different noise models and explore how HIs and randomized compiling affect the underlying loss landscape of the learning problem. These simulations help explain our experimental hardware outcomes, helping to connect lower-level gate performance to application-specific behavior in contrast to metrics like fidelity which often do not provide an intuitive insight into observed high level performance.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Microscopic constraints for the equation of state and structure of neutron stars: A Bayesian model mixing framework

Bayesian model mixing (BMM) is a statistical technique that can combine constraints from different regions of an input space in a principled way. Here we extend our BMM framework for the equation of state (EOS) of strongly interacting matter from symmetric nuclear matter to asymmetric matter, specifically focusing on zero-temperature, charge-neutral, 𝛽-equilibrated matter. We use Gaussian processes (GPs) to infer constraints on the neutron-star matter EOS at intermediate densities from two different microscopic theories: chiral effective-field theory (𝜒⁢EFT) at baryon densities around nuclear saturation, 𝑛 𝐵 ∼ 𝑛 0 , and perturbative QCD at asymptotically high baryon densities, 𝑛 𝐵 ⩾ 20⁢𝑛 0 . The uncertainties of the 𝜒⁢EFT and pQCD EOSs are obtained using the BUQEYE truncation error model. We demonstrate the flexibility of our framework through the use of two categories of GP kernels: conventional stationary kernels and a nonstationary changepoint kernel. We use the latter to explore potential constraints on the dense matter EOS by including exogenous data representing theory predictions and heavy-ion collision measurements at densities ⩾ 2⁢𝑛 0 . We also use our EOSs to obtain neutron-star mass-radius relations and their uncertainties. Finally, our framework, whose implementation will be available through a GitHub repository, provides a prior distribution for the EOS that can be used in large-scale neutron-star inference frameworks.

Bayesian methods↗

Spatially Dependent Multiple Testing Under Model Misspecification, With Application to Detection of Anthropogenic Influence on Extreme Climate Events

The Weather Risk Attribution Forecast (WRAF) is a forecasting tool that uses output from global climate models to make simultaneous attribution statements about whether and how greenhouse gas emissions have contributed to extreme weather across the globe. However, in conducting a large number of simultaneous hypothesis tests, the WRAF is prone to identifying false “discoveries.” A common technique for addressing this multiple testing problem is to adjust the procedure in a way that controls the proportion of true null hypotheses that are incorrectly rejected, or the false discovery rate (FDR). Unfortunately, generic FDR procedures suffer from low power when the hypotheses are dependent, and techniques designed to account for dependence are sensitive to misspecification of the underlying statistical model. In this paper, we develop a Bayesian decision-theoretical approach for dependent multiple testing and a nonparametric hierarchical statistical model that flexibly controls false discovery and is robust to model misspecification. We illustrate the robustness of our procedure to model error with a simulation study, using a framework that accounts for generic spatial dependence and allows the practitioner to flexibly specify the decision criteria. Finally, we apply our procedure to several seasonal forecasts and discuss implementation for the WRAF workflow. Lastly, supplementary materials for this article, including a standardized description of the materials available for reproducing the work, are available as an online supplement.

54 ENVIRONMENTAL SCIENCES↗

Stochastic Richardson Extrapolation Based Numerical Error Estimation for Kinetic Plasma Simulations

We present a numerical error estimation technique specifically formulated to deal with stochastic code output with multiple discretization parameters. This method is based on multiple fits to an error model with arbitrary convergence rates and cross-coupling terms, performed using nonlinear optimization. The fitting approach varies by the type of residual norm which influences the importance of outliers, and weights which influences the relative importance of data points in the coarse and refined regions of discretization parameter space. To account for the influence of stochastic noise, these fits are performed on multiple bootstrap values based on the underlying response data set. Using an automated discretization domain selection scheme, the fits are performed on a series of reduced sets of discretization levels in order to find an optimal fully-converged result estimate in the minimum variance sense; this automated approach enables straightforward analysis of multiple quantities of interest and/or time and spatially-dependent response data. The overall numerical error analysis method is useful for verification and validation problems for stochastic simulation methods and forms a key component in the overall uncertainty quantification process. The method was demonstrated for steady and unsteady electron diode problems simulated using a particle-in-cell kinetic plasma code, demonstrating excellent results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗