Search NASA⌕ Search

SEARCH · Search NASA

Results for “modeling discrepancy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Parameter Estimation for Electrode Degradation: Learning in the Face of Model-Experiment Discrepancies

Use of physics-based models to interpret battery degradation data over the course of cycling can provide deeper physical insight into the internal states of the system and how they evolve. We present a neural network trained on simulations generated by a previously published physics-based model for a lithium trivanadate (LVO) cathode to estimate parameters that evolve over the course of cycling. We focus on the robustness of the neural network through two case studies that probe different kinds of discrepancies between model and experiment: nonideal data and imperfect model. In the former, the experimental protocols do not meet the assumption made in the training data generated by the physics-based model, while in the latter, the physics-based model fails to describe all of the measured cathode behavior even under ideal conditions. When there is total model-experiment agreement, a neural network estimates parameters with improved accuracy compared to a maximum likelihood analysis using the same set of simulations. However, in both types of model-experiment discrepancy, the neural network returned biased parameter estimates. We introduce a data augmentation procedure into the neural network training to mitigate these effects and improve robustness, and employ it to estimate parameters for a cycling LVO cathode.

Mayilvahanan, Karthik S. (ORCID:0000000316282332)↗
NASA NTRS2022

Understanding Model-Observation Discrepancies in Satellite Retrievals of Atmospheric Temperature Using GISS ModelE

We examine multiple factors in the representation of satellite-retrieved atmospheric temperature diagnostics in historical simulations of climate change during the satellite era (specifically 1979–2021) using GISS ModelE contributions to the Coupled Model Intercomparison Project (Phase 6) (CMIP6). The tropospheric and stratospheric trends in these diagnostics are affected by greenhouse gases (notably carbon dioxide and ozone), coupling with the ocean, volcanic aerosols, solar activity and compositional and dynamic feedbacks. We explore the impacts of internal variability, changing forcing specifications, composition interactivity, the quality of the stratospheric circulation, vertical resolution, and possible impacts of the mis-specification of volcanic aerosol optical depths. Overall temperature trends throughout the satellite period are well captured, but discrepancies at all levels exist and have multiple distinct causes. We find that stratospheric comparisons (using Stratospheric Sounding Unit (SSU) retrievals and successor instruments) are most affected by variations in the representation of ozone depletion and feedbacks, followed by the volcanic signals. Tropospheric skill (using the Microwave Sounding Unit (MSU) retrievals) is affected by the trends in ocean heat uptake and tropospheric aerosols, but also by the representation of stratospheric processes through the impact of the Brewer-Dobson circulation on the height of the tropical tropopause. We demonstrate that no single factor is the dominant cause of the discrepancies and that almost all observations lie within the broad envelope of structural uncertainty.

satellite retrievals of atmospheric temperature↗
DOE OSTI2020

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fingerprints of external forcings on Sahel rainfall: aerosols, greenhouse gases, and model-observation discrepancies

Over the 20th and 21st centuries, both anthropogenic greenhouse gas increases and changes in anthropogenic aerosols have affected rainfall in the Sahel. Using multiple characteristics of Sahel precipitation, we construct a multivariate fingerprint that allows us to distinguish between the model-predicted responses to greenhouse gases and anthropogenic aerosols. Models project the emergence of a detectable signal of aerosol forcing in the middle of the 20th century and a detectable signal of greenhouse gas forcing at the beginning of the 21st. However, the signals of both aerosol and greenhouse gas forcing in observations emerge earlier and are stronger than in the models, far stronger in the case of aerosols. The similarity between the response to aerosol forcing and the leading mode of internal variability makes it difficult to attribute this model-observation discrepancy to errors in the forcing, errors in the forced response, model inability to capture the amplitude of internal variability, or some combination of these. For greenhouse gases, however, the forced response is distinct from internal variability as estimated by models, and the observations are largely commensurate with the model projections.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2020

Fingerprints of External Forcing Agents on Sahel Rainfall: Aerosols, Greenhouse Gases, and Model-Observation Discrepancies

Over the 20th and 21st centuries, both anthropogenic greenhouse gas increases and changes in anthropogenic aerosols have affected rainfall in the Sahel. Using multiple characteristics of Sahel precipitation, we construct a multivariate fingerprint that allows us to distinguish between the model-predicted responses to greenhouse gases and anthropogenic aerosols. Models project the emergence of a detectable signal of aerosol forcing in the middle of the 20th century and a detectable signal of greenhouse gas forcing at the beginning of the 21st. However, the signals of both aerosol and greenhouse gas forcing in observations emerge earlier and are stronger than in the models, far stronger in the case of aerosols. The similarity between the response to aerosol forcing and the leading mode of internal variability makes it difficult to attribute this model-observation discrepancy to errors in the forcing, errors in the forced response, model inability to capture the amplitude of internal variability, or some combination of these. For greenhouse gases, however, the forced response is distinct from internal variability as estimated by models, and the observations are largely commensurate with the model projections.

Sahel↗
DOE OSTI2022

Computer Model Calibration with Time Series Data Using Deep Learning and Quantile Regression

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Model-observation discrepancies in Arctic moisture intrusions: causes and pathways for improved simulation

Arctic moisture intrusions (MIs), narrow filaments of strong moisture transport, are key drivers of poleward moisture flux and Arctic weather extremes, yet their representation in climate models is poorly understood. Using a new Arctic MI detection algorithm, we document persistent biases across three CMIP generations (CMIP3–CMIP6): models overestimate MI occurrence over the Pacific sector and underestimate it over the Atlantic sector. These errors stem from misrepresented midlatitude westerly jets, with an equatorward North Atlantic jet associated with too few Atlantic MIs, and a poleward, weakened North Pacific jet linked to too many Pacific MIs. Experiments that correct sea surface temperature and sea ice concentration biases and increase atmospheric resolution improve jet structure and MI statistics, while a cloud-locking simulation indicates that better high-frequency cloud–radiation–circulation interactions can yield further gains. Our results clarify pathways to reducing long-standing MI and jet biases, providing guidance for improving simulations of Arctic and midlatitude climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Modeling Systematic Discrepancies in Nuclear-Data Measurements with Machine Learning

Nuclear data and their associated co-variances are constantly being reevaluated as techniques improve and as new experimental data, as well as nuclearmodel developments, emerge. A standard technique used to evaluate mean values in nuclear data, and their associated covariances, is the generalized linear least squares (GLLS) method. Aligning with recent efforts to incorporate measurement features into nuclear data evaluation, we augment GLLS by including a linear term which attempts to predict potential systematic discrepancies in experimental data as related to the measurement features. Due to the general nature of this augmentation, we are able to apply this evaluation to three key observables: neutroninduced fission cross sections, the average prompt neutron multiplicity, and the prompt-fission neutron spectrum of ²³⁹Pu.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2003

Understanding Vibration Spectra of Planetary Gear Systems for Fault Detection

An understanding of the vibration spectra is very useful for any gear fault detection scheme based upon vibration measurements. The vibration measured from planetary gears is complicated. Sternfeld noted the presence of sidebands about the gear mesh harmonics spaced at the planet passage frequency in spectra measured near the ring gear of a CH-47 helicopter. McFadden proposes a simple model of the vibration transmission that predicts high spectral amplitudes at multiples of the planet passage frequency, for planetary gears with evenly spaced planets. This model correctly predicts no strong signal at the meshing frequency when the number of teeth on the ring gear is not an integer multiple of the number of planets. This paper will describe a model for planetary gear vibration spectra developed from the ideas started in reference. This model predicts vibration to occur only at frequencies that are multiples of the planet repetition passage frequency and clustered around gear mesh harmonics. Vibration measurements will be shown from tri-axial accelerometers mounted on three different planetary gear systems and compared with the model. The model correctly predicts the frequencies with large components around the first several gear mesh harmonics in measurements for systems with uniformly and nonuniformly spaced planet gears. Measurements do not confirm some of the more detailed features predicted by the model. Discrepancies of the ideal model to the measurements are believed due to simplifications in the model and will be discussed. Fault detection will be discussed applying the understanding will be discussed.

Mosher, Marianne↗
NASA NTRS2018

Remote Sensing of Evapotranspiration over the Central Arizona Irrigation and Drainage District, USA

Knowledge of baseline water use for irrigated crops in the U.S. Southwest is important for understanding how much water is consumed under normal farm management and to help manage scarce resources. Remote sensing of evapotranspiration (ET) is an effective way to gain that knowledge: multispectral data can provide synoptic and time-repetitive estimates of crop-specific water use, and could be especially useful for this arid region because of dominantly clear skies and minimal precipitation. Although multiple remote sensing ET approaches have been developed and tested, there is not consensus on which of them should be preferred because there are still few intercomparison studies within this environment. To help build the experience needed to gain consensus, a remote sensing study using three ET models was conducted over the Central Arizona Irrigation and Drainage District (CAIDD). Aggregated ET was assessed for 137 wheat plots (winter/spring crop), 183 cotton plots (summer crop), and 225 alfalfa plots (year-round). The employed models were the Satellite-Based Energy Balance for Mapping Evapotranspiration with Internalized Calibration (METRIC), the Two Source Energy Balance (TSEB), and Vegetation Index ET for the US Southwest (VISW). Remote sensing data were principally Landsat 5, supplemented by Landsat 7, MODIS Terra, MODIS Aqua, and ASTER. Using district-wide model averages, seasonal use (excluding surface evaporation) was 742 mm (millimeters) for wheat, 983 mm for cotton, and 1427 mm for alfalfa. All three models produced similar daily ET for wheat, with 6-8 mm per day mid-season. Model estimates diverged for cotton and alfalfa sites. Considering ET over cotton, TSEB estimates were 9.5 mm per day, METRIC 6 mm per day, and VISW 8 mm per day. For alfalfa, the ET values from TSEB were 8.0 mm per day, METRIC 5 mm per day, and VISW 6 mm per day. Lack of local validation information unfortunately made it impossible to rank model performance. However, by averaging results from all of them, ET model outliers could be identified. They ranged from minus 10 percent to plus 18 percent, values that represent expected ET modeling discrepancies. Relative to the model average, standardized ET-estimators - potential ET (ET (sub 0)), FAO-56 ET, and USDA-SW gravimetric-ET - showed still greater deviations, up to 35 percent of annual crop water use for summer and year-round crops, suggesting that remote sensing of actual ET could lead to significantly improved estimates of crop water use. Results from this study highlight the need for conducting multi-model experiments during summer-months over sites with independent ground validation.

Alfalfa↗
DOE OSTI2023

Model metamers reveal divergent invariances between biological and artificial neural networks

Deep neural network models of sensory systems are often proposed to learn representational transformations with invariances like those in the brain. To reveal these invariances, we generated ‘model metamers’, stimuli whose activations within a model stage are matched to those of a natural stimulus. Metamers for state-of-the-art supervised and unsupervised neural network models of vision and audition were often completely unrecognizable to humans when generated from late model stages, suggesting differences between model and human invariances. Targeted model changes improved human recognizability of model metamers but did not eliminate the overall human–model discrepancy. The human recognizability of a model’s metamers was well predicted by their recognizability by other models, suggesting that models contain idiosyncratic invariances in addition to those required by the task. Metamer recognizability dissociated from both traditional brain-based benchmarks and adversarial vulnerability, revealing a distinct failure mode of existing sensory models and providing a complementary benchmark for model assessment.

59 BASIC BIOLOGICAL SCIENCES↗