Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Data Assimilation - Advances and Applications

This presentation provides an overview of data assimilation (model calibration) for complex computer experiments. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Utilization of surrogate models and empirical adjustment for model form error in code calibration form the basis for the statistical methodology considered. The role of probabilistic code calibration in supporting code validation is discussed. Incorporation of model form uncertainty in rigorous uncertainty quantification (UQ) analyses is also addressed. Design criteria used within a batch sequential design algorithm are introduced for efficiently achieving predictive maturity and improved code calibration. Predictive maturity refers to obtaining stable predictive inference with calibrated computer codes. These approaches allow for augmentation of initial experiment designs for collecting new physical data. A standard framework for data assimilation is presented and techniques for updating the posterior distribution of the state variables based on particle filtering and the ensemble Kalman filter are introduced.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Methods for Incorporating Model Uncertainty into Exoplanet Atmospheric Analysis

A key goal of exoplanet spectroscopy is to measure atmospheric properties, such as abundances of chemical species, in order to connect them to our understanding of atmospheric physics and planet formation. In this new era of high-quality JWST data, it is paramount that these measurement methods are robust. When comparing atmospheric models to observations, multiple candidate models may produce reasonable fits to the data. Typically, conclusions are reached by selecting the best-performing model according to some metric. This ignores model uncertainty in favor of specific model assumptions, potentially leading to measured atmospheric properties that are overconfident and/or incorrect. In this paper, we compare three ensemble methods for addressing model uncertainty by combining posterior distributions from multiple analyses: Bayesian model averaging, a variant of Bayesian model averaging using leave-one-out predictive densities, and stacking of predictive distributions. We demonstrate these methods by fitting the Hubble Space Telescope (HST) + Spitzer transmission spectrum of the hot Jupiter HD 209458b using models with different cloud and haze prescriptions. All of our ensemble methods lead to uncertainties on retrieved parameters that are larger but more realistic and consistent with physical and chemical expectations. Since they have not typically accounted for model uncertainty, uncertainties of retrieved parameters from HST spectra have likely been underreported. We recommend stacking as the most robust model combination method. Our methods can be used to combine results from independent retrieval codes and from different models within one code. They are also widely applicable to other exoplanet analysis processes, such as combining results from different data reductions.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulation of Oxygen Disintegration and Mixing With Hydrogen or Helium at Supercritical Pressure

The simulation of high-pressure turbulent flows, where the pressure, p, is larger than the critical value, p(sub c), for the species under consideration, is relevant to a wide array of propulsion systems, e.g. gas turbine, diesel, and liquid rocket engines. Most turbulence models, however, have been developed for atmospheric-p turbulent flows. The difference between atmospheric-p and supercritical-p turbulence is that, in the former situation, the coupling between dynamics and thermodynamics is moderate to negligible, but for the latter it is very significant, and can dominate the flow characteristics. The reason for this stems from the mathematical form of the equation of state (EOS), which is the perfect-gas EOS in the former case, and the real-gas EOS in the latter case. For flows at supercritical pressure, p, the large eddy simulation (LES) equations consist of the differential conservation equations coupled with a real-gas EOS. The equations use transport properties that depend on the thermodynamic variables. Compared to previous LES models, the differential equations contain not only the subgrid scale (SGS) fluxes, but also new SGS terms, each denoted as a correction. These additional terms, typically assumed null for atmospheric pressure flows, stem from filtering the differential governing equations, and represent differences between a filtered term and the same term computed as a function of the filtered flow field. In particular, the energy equation contains a heat-flux correction (q-correction) that is the difference between the filtered divergence of the heat flux and the divergence of the heat flux computed as a function of the filtered flow field. In a previous study, there was only partial success in modeling the q-correction term, but in this innovation, success has been achieved by using a different modeling approach. This analysis, based on a temporal mixing layer Direct Numerical Simulation database, shows that the focus in modeling the q-correction should be on reconstructing the primitive variable gradients rather than their coefficients, and proposes the approximate deconvolution model (ADM) as an effective means of flow field reconstruction for LES heat flux calculation. Further, results for a study conducted for temporal mixing layers initially containing oxygen in the lower stream, and hydrogen or helium in the upper stream, show that, for any LES, including SGS-flux models (constant-coefficient Gradient or Scale-Similarity models, dynamic-coefficient Smagorinsky/Yoshizawa or mixed Smagorinsky/Yoshizawa/Gradient models), the inclusion of the q-correction in the LES leads to the theoretical maximum reduction of the SGS heat-flux difference. The remaining error in modeling this new subgrid term is thus irreducible.

Bellan, Josette↗

TOPEX/POSEIDON orbit maintenance maneuver design

The Ocean Topography Experiment (TOPEX/POSEIDON) mission orbit requirements are outlined, as well as its control and maneuver spacing requirements including longitude and time targeting. A ground-track prediction model dealing with geopotential, luni-solar gravity, and atmospheric-drag perturbations is considered. Targeting with all modeled perturbations is discussed, and such ground-track prediction errors as initial semimajor axis, orbit-determination, maneuver-execution, and atmospheric-density modeling errors are assessed. A longitude targeting strategy for two extreme situations is investigated employing all modeled perturbations and prediction errors. It is concluded that atmospheric-drag modeling errors are the prevailing ground-track prediction error source early in the mission during high solar flux, and that low solar-flux levels expected late in the experiment stipulate smaller maneuver magnitudes.

Bhat, R. S.↗

Stratospheric wind errors, initial states and forecast skill in the GLAS general circulation model

Relations between stratospheric wind errors, initial states and 500 mb skill are investigated using the GLAS general circulation model initialized with FGGE data. Erroneous stratospheric winds are seen in all current general circulation models, appearing also as weak shear above the subtropical jet and as cold polar stratospheres. In this study it is shown that the more anticyclonic large-scale flows are correlated with large forecast stratospheric winds. In addition, it is found that for North America the resulting errors are correlated with initial state jet stream accelerations while for East Asia the forecast winds are correlated with initial state jet strength. Using 500 mb skill scores over Europe at day 5 to measure forecast performance, it is found that both poor forecast skill and excessive stratospheric winds are correlated with more anticyclonic large-scale flows over North America. It is hypothesized that the resulting erroneous kinetic energy contributes to the poor forecast skill, and that the problem is caused by a failure in the modeling of the stratospheric energy cycle in current general circulation models independent of vertical resolution.

Tenenbaum, J.↗

Imperfect slope measurements drive overestimation in a geometric cone model of lake and reservoir depth

Lake and reservoir (waterbody) depth is a critical characteristic that influences many important ecological processes. Unfortunately, depth measurements are labor-intensive to gather and are only available for a small fraction of waterbodies globally. Therefore, scientists have tried to predict depth from characteristics easily obtained for all waterbodies, such as surface area or the slope of the surrounding land. One approach for predicting waterbody depth simulates basins using a geometric cone model where the nearshore land slope and distance to the center of the waterbody are assumed to be representative proxies for in-lake slope and distance to the deepest point respectively. We tested these assumptions using bathymetry data from ~5000 lakes and reservoirs to examine whether differences in waterbody type or shape influenced depth prediction error. Here, we found that nearshore land slope was not representative of in-lake slope, and using it for prediction increases error substantially relative to models using true in-lake slope for all waterbody types and shapes. Predictions were biased toward overprediction in concave waterbodies (i.e., bowl-shaped; up to 18% of the study population) and reservoir waterbodies (up to 30% of the study population). Despite this systematic overprediction, model errors were fewer (in absolute and relative terms, irrespective of any specific slope covariate) for concave than convex waterbodies, suggesting the geometric cone model is an adequate representation of depth for these waterbodies. But because convex waterbodies are far more common (>72% of our study population), minimizing overall depth prediction error remains a challenge.

54 ENVIRONMENTAL SCIENCES↗

Spatio-temporal distribution of Oklahoma earthquakes: Exploring relationships using a nearest-neighbor approach: Nearest-neighbor analysis of Oklahoma

Determining the spatiotemporal characteristics of natural and induced seismic events holds the opportunity to gain new insights into why these events occur. Linking the seismicity characteristics with other geologic, geographic, natural, or anthropogenic factors could help to identify the causes and suggest mitigation strategies that reduce the risk associated with such events. The nearest-neighbor approach utilized in this work represents a practical first step toward identifying statistically correlated clusters of recorded earthquake events. Detailed study of the Oklahoma earthquake catalog’s inherent errors, empirical model parameters, and model assumptions is presented. We found that the cluster analysis results are stable with respect to empirical parameters (e.g., fractal dimension) but were sensitive to epicenter location errors and seismicity rates. Most critically, we show that the patterns in the distribution of earthquake clusters in Oklahoma are primarily defined by spatial relationships between events. This observation is a stark contrast to California (also known for induced seismicity) where a comparable cluster distribution is defined by both spatial and temporal interactions between events. These results highlight the difficulty in understanding the mechanisms and behavior of induced seismicity but provide insights for future work.

58 GEOSCIENCES↗

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗

Observing the earth radiation budget from satellites - Past, present, and a look to the future

Satellite measurements of the radiative exchange between the planet earth and space have been the objective of many experiments since the beginning of the space age in the late 1950's. The on-going mission of the Earth Radiation Budget (ERB) experiments has been and will be to consider flight hardware, data handling and scientific analysis methods in a single design strategy. Research and development on observational data has produced an analysis model of errors associated with ERB measurement systems on polar satellites. Results show that the variability of reflected solar radiation from changing meteorology dominates measurement uncertainties. As an application, model calculations demonstrate that measurement requirements for the verification of climate models may be satisfied with observations from one polar satellite, provided there is information on diurnal variations of the radiation budget from the ERBE mission.

House, F. B.↗

Estimation of coarse dead wood stocks in intact and degraded forests in the Brazilian Amazon using airborne lidar

Coarse dead wood is an important component of forest carbon stocks, but it is rarely measured in Amazon forests and is typically excluded from regional forest carbon budgets. Our study is based on line intercept sampling for fallen coarse dead wood conducted along 103 transects with a total length of 48 km matched with forest inventory plots where standing coarse dead wood was measured in the footprints of larger areas of airborne lidar acquisitions. We developed models to relate lidar metrics and Landsat time series variables to coarse dead wood stocks for intact, logged, burned, or logged and burned forests. Canopy characteristics such as gap area produced significant individual relations for logged forests. For total fallen plus standing coarse dead wood (hereafter defined as total coarse dead wood), the relative root mean square error for models with only lidar metrics ranged from 33 % in logged forest to up to 36 % in burned forests. The addition of historical information improved model performance slightly for intact forests (31 % against 35 % relative root mean square error), not justifying the use of a number of disturbance events from historical satellite images (Landsat) with airborne lidar data. Lidar-derived estimates of total coarse dead wood compared favorably with independent ground-based sampling for areas up to several hundred hectares. The relations found between total coarse dead wood and variables quantifying forest structure derived from airborne lidar highlight the opportunity to quantify this important but rarely measured component of forest carbon over large areas in tropical forests.

Brazilian Amazon↗

Hierarchical Modeling and Statistical Calibration for Photometric Redshifts

The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet these requirements. Standard template fitting delivers interpretable models and errors, but lacks the flexibility to learn inaccuracies in the observed photometry or spectral templates. Machine learning addresses those issues, but requires representative training data, and the resulting models and uncertainties cannot be interpreted in the context of a physical model or outside of the training data. We present a hierarchical modeling approach simultaneously addressing the issues of flexibility, interpretability, and generalization. It combines template fitting with flexible (machine-learning-like) models to correct the spectral templates, model their redshift distributions, and recalibrate the photometric observations. By optimizing the full posterior distribution of the model and solving for its (thousands of) parameters, one can perform a global statistical calibration of the data and the spectral energy distribution (SED) model. We apply this approach to the public Dark Energy Survey Science Verification data and show that it provides more accurate and compact redshift posterior distributions than existing methods, as well as insights into residual photometric and SED systematics. Here, the model is causal and makes predictions for future data (e.g., additional photometric bandpasses), and its internal parameters and components are interpretable. This approach does not formally require the training data to be complete or representative; in principle, it can even work in regimes in which few or no spectroscopic redshifts are available.

79 ASTRONOMY AND ASTROPHYSICS↗

Time-variable Earth's albedo model characteristics and applications to satellite sampling errors

Characteristics of the time variable Earth albedo model are described. With the cloud cover multiplying factor adjusted to produce a global annual average albedo of 30.3, the global annual average cloud cover is 45.5 percent. Global annual average sunlit cloud cover is 48.5 percent; nighttime cloud cover is 42.7 percent. Month-to-month global average albedo is almost sinusoidal with maxima in June and December and minima in April and October. Month-to-month variation of sunlit cloud cover is similar, but not in all details. The diurnal variation of global albedo is greatest from November to March; the corresponding variation of sunlit cloud cover is greatest from May to October. Annual average zonal albedos and monthly average zonal albedos are in good agreement with satellite-measured values, with notable differences in the polar regions in some months and at 15 S. The albedo of some 10 deg by 10 deg. areas of the Earth versus zenith angle are described. Satellite albedo measurement sampling effects are described in local time and in Greenwich mean time.

Bartman, F. L.↗

The SMAP Level-4 ECO Project: Improving Terrestrial Flux Estimates Through Coupled Hydrology-Vegetation Data Assimilation

Simulations of hydrologic and vegetation states as well as water, energy and carbon fluxes from the land surface to the atmosphere are crucial for a wide range of applications, including agricultural advisories, forecasts of (short-term) atmospheric behavior and seasonal weather predictions including forecasts of extreme events, such as heatwaves or droughts. The NASA Soil Moisture Active Passive (SMAP) mission Level-4 Eco-Hydrology (L4-ECO) project aims to improve modeled estimates of the terrestrial water, energy and carbon fluxes and states by developing a fully-coupled hydrology-vegetation data assimilation system. This system is developed around the NASA Goddard Earth Observing System (GEOS) Catchment-CN land surface model, which combines land hydrology and energy balance components of the GEOS Catchment model with dynamic vegetation components of the Community Land Model version 4. Catchment-CN fully couples the terrestrial water, energy and carbon cycles, allowing feedbacks from the land hydrology to the biosphere and vice versa.Here, we implement a calibration of the Catchment-CN vegetation parameterization against observations of the fraction of absorbed photosynthetically active radiation (FPAR) from the Moderate Resolution Imaging Spectroradiometer (MODIS) to improve the model's standalone skill. Later, the DA algorithm used to produce the SMAP L4 soil moisture product will be adapted to Catchment-CN to assimilate SMAP brightness temperatures and inform the model's land hydrology component. Finally, the DA system will be further extended to assimilate MODIS FPAR observations in order to constrain the model's dynamic vegetation component.In this presentation, we demonstrate that the Catchment-CN parameter calibration leads to more realistic vegetation simulations and reduces the root mean squared error between modeled and observed vegetation states across the model's various plant functional types. We also show that the assimilation of SMAP observations is able to improve the average correlation, bias and unbiased RMSE between the modeled surface and root zone soil moisture estimates, and ground observations from the SMAP core validation sites.

Kolassa, Jana↗

A simulator for evaluating methods for the detection of lesion-deficit associations

Although much has been learned about the functional organization of the human brain through lesion-deficit analysis, the variety of statistical and image-processing methods developed for this purpose precludes a closed-form analysis of the statistical power of these systems. Therefore, we developed a lesion-deficit simulator (LDS), which generates artificial subjects, each of which consists of a set of functional deficits, and a brain image with lesions; the deficits and lesions conform to predefined distributions. We used probability distributions to model the number, sizes, and spatial distribution of lesions, to model the structure-function associations, and to model registration error. We used the LDS to evaluate, as examples, the effects of the complexities and strengths of lesion-deficit associations, and of registration error, on the power of lesion-deficit analysis. We measured the numbers of recovered associations from these simulated data, as a function of the number of subjects analyzed, the strengths and number of associations in the statistical model, the number of structures associated with a particular function, and the prior probabilities of structures being abnormal. The number of subjects required to recover the simulated lesion-deficit associations was found to have an inverse relationship to the strength of associations, and to the smallest probability in the structure-function model. The number of structures associated with a particular function (i.e., the complexity of associations) had a much greater effect on the performance of the analysis method than did the total number of associations. We also found that registration error of 5 mm or less reduces the number of associations discovered by approximately 13% compared to perfect registration. The LDS provides a flexible framework for evaluating many aspects of lesion-deficit analysis.

NASA Program Biomedical Research and Countermeasur↗

A Data-Driven Methodology for Probabilistic Wind Power Ramp Forecasting

With increasing wind penetration, wind power ramps (WPRs) are currently drawing great attention to balancing authorities, since these wind ramps largely affect power system operations. To help better manage and dispatch the wind power, this paper develops a data-driven probabilistic WPR forecasting (p-WPRF) method based on a large number of simulated scenarios. A machine learning technique is first adopted to forecast the basic wind power forecasting scenario and produce the historical forecasting errors. To accurately model the distribution of wind power forecasting errors, a generalized Gaussian mixture model is developed and the cumulative distribution function (CDF) is also analytically deduced. The inverse transform method based on the CDF is used to generate a large number of forecasting error scenarios. An optimized swinging door algorithm is adopted to extract all the WPRs from the complete set of wind power forecasting scenarios. The p-WPRF is generated based on all generated scenarios under different weather and time conditions. Numerical simulations on publicly available wind power data show that the developed p-WPRF method can predict WPRs with a high level of reliability and accuracy.

17 WIND ENERGY↗

Development of an open-source regional data assimilation system in PEcAn v. 1.7.2: application to carbon cycle reanalysis across the contiguous US using SIPNET

Abstract. The ability to monitor, understand, and predict the dynamics of the terrestrial carbon cycle requires the capacity to robustly and coherently synthesize multiple streams of information that each provide partial information about different pools and fluxes. In this study, we introduce a new terrestrial carbon cycle data assimilation system, built on the PEcAn model–data eco-informatics system, and its application for the development of a proof-of-concept carbon “reanalysis” product that harmonizes carbon pools (leaf, wood, soil) and fluxes (GPP, Ra, Rh, NEE) across the contiguous United States from 1986–2019. We first calibrated this system against plant trait and flux tower net ecosystem exchange (NEE) using a novel emulated hierarchical Bayesian approach. Next, we extended the Tobit–Wishart ensemble filter (TWEnF) state data assimilation (SDA) framework, a generalization of the common ensemble Kalman filter which accounts for censored data and provides a fully Bayesian estimate of model process error, to a regional-scale system with a calibrated localization. Combined with additional workflows for propagating parameter, initial condition, and driver uncertainty, this represents the most complete and robust uncertainty accounting available for terrestrial carbon models. Our initial reanalysis was run on an irregular grid of ∼ 500 points selected using a stratified sampling method to efficiently capture environmental heterogeneity. Remotely sensed observations of aboveground biomass (Landsat LandTrendr) and leaf area index (LAI) (MODIS MOD15) were sequentially assimilated into the SIPNET model. Reanalysis soil carbon, which was indirectly constrained based on modeled covariances, showed general agreement with SoilGrids, an independent soil carbon data product. Reanalysis NEE, which was constrained based on posterior ensemble weights, also showed good agreement with eddy flux tower NEE and reduced root mean square error (RMSE) compared to the calibrated forecast. Ultimately, PEcAn's new open-source regional data assimilation framework provides a scalable workflow for harmonizing multiple data constraints and providing a uniform synthetic platform for carbon monitoring, reporting, and verification (MRV) as well as accelerating terrestrial carbon cycle research.

54 ENVIRONMENTAL SCIENCES↗

Effects of constraint on crack growth under aircraft spectrum loading

The objective is to study the effects of constraint on fatigue crack growth under aircraft spectrum loading. A plasticity-induced crack-closure model that accounts for constraint variations during the transition from flat-to-slant crack growth was used to correlate crack-growth rate data under constant-amplitude loading and to calculate crack growth under simulated aircraft spectrum loading. The model was applied to several thin-sheet aluminum alloy materials. Under laboratory air conditions, the transition was shown to be related to the size of the cyclic plastic zone based on the effective stress-intensity factor range for several sheet materials and thicknesses. Results from three-dimensional, elastic-plastic, finite-element analyses of a flat, straight-through crack in a thin-sheet aluminum alloy specimen showed a constraint loss similar to that assumed in the model. Using test data and the closure model, the location of the constraint-loss regime in terms of growth rate and the value of the constraint factor at these rates were determined by trial and error. The model was then used to calculate crack growth under the TWIST spectrum. The calculated results agreed reasonably well with test data. In general, the model predicted shorter crack-growth lives than tests under the TWIST spectrum by about 40 percent. For the TWIST spectrum clipped at Level 3, the calculated lives were within about 20 percent. The results demonstrated that constraint variations, especially for thin-sheet alloys, should be accounted for to predict crack growth under typical aircraft spectra.

Newman, J. C., Jr.↗

The SMAP Level-4 ECO Product - Phase 1: Improving Vegetation Simulations Through Observation-Driven Parameter Estimation

Simulations of hydrological fields as well as water, energy and carbon fluxes from the land surface to the atmosphere are crucial for a wide range of applications, including agricultural advisories, forecasts of (short-term) atmospheric behavior and seasonal weather predictions including forecasts of extreme events, such as heatwaves or droughts. The NASA Soil Moisture Active Passive (SMAP) mission Level-4 (L4) Eco-Hydrology (ECO) project aims to improve modeled estimates of the terrestrial water, energy and carbon fluxes and states by developing a fully-coupled hydrology-vegetation data assimilation (DA) algorithm. The DA system is developed for the NASA Goddard Earth Observing System version 5 (GEOS-5) Catchment-CN land surface model, which combines land hydrology components of the GEOS-5 Catchment model with dynamic vegetation components of the Community Land Model version 4. Catchment-CN fully couples the terrestrial water, energy and carbon cycles, allowing feedbacks from the land hydrology to the biosphere and vice versa. For SMAP L4 ECO a calibration of the Catchment-CN vegetation parameterization against observations of the fraction of absorbed photosynthetically active radiation (FPAR) from the Moderate Resolution Imaging Spectroradiometer (MODIS) is implemented to improve the model's standalone skill. Next, the DA algorithm used to produce the SMAP L4 soil moisture product is adapted to Catchment-CN to assimilate SMAP brightness temperatures and inform the model's land hydrology component. The DA system is further extended to assimilate MODIS FPAR observations in order to constrain the model's dynamic vegetation component. In this presentation, we demonstrate that the Catchment-CN parameter calibration leads to more realistic vegetation simulations and reduces the root mean squared error between modeled and observed vegetation states across the model's various plant functional types. We also show that the assimilation of SMAP observations is able to improve the average correlation, bias and unbiased RMSE between the modeled surface and root zone soil moisture estimates, and ground observations from the SMAP core validation sites.

Kolassa, J.↗