Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

A multi-year short-range hindcast experiment with CESM1 for evaluating climate model moist processes from diurnal to interannual timescales

Abstract. We present a multi-year short-range hindcast experiment and its experimental design for better evaluation of both the mean state and variability of atmospheric moist processes in climate models from diurnal to interannual timescales and facilitate model development. We used the Community Earth System Model version 1 as the base model and performed a suite of 3 d hindcasts initialized every day starting at 00:00 Z from 1997 to 2012. Three processes – the diurnal cycle of clouds during different cloud regimes over the central US, precipitation and diabatic heating associated with the Madden–Julian Oscillation (MJO), and the response of precipitation, surface radiative and heat fluxes, as well as zonal wind stress to sea surface temperature anomalies associated with the El Niño–Southern Oscillation – are evaluated as examples to demonstrate how one can better utilize simulations from this experiment to gain insights into model errors and their connection to physical parameterizations or large-scale state. This is achieved by comparing the hindcasts with corresponding long-term observations for periods based on different phenomena. These analyses can only be done through this multi-year hindcast approach to establish robust statistics of the processes under well-controlled large-scale environment because these phenomena are either a result of interannual climate variability or only happen a few times in a given year (e.g., MJO, or cloud regime types). Furthermore, comparison of hindcasts to the typical simulations in climate mode with the same model allows one to infer what portion of a model's climate error directly comes from fast errors in the parameterizations of moist processes. As demonstrated here, model biases in the mean state and variability associated with parameterized moist processes usually develop within a few days and manifest within weeks to affect the simulations of large-scale circulation and ultimately the climate mean state and variability. Therefore, model developers can achieve additional useful understanding of the underlying problems in model physics by conducting a multi-year hindcast experiment.

54 ENVIRONMENTAL SCIENCES↗

Dark Energy Survey Year 6 Results: Point-Spread Function Modeling

We present the point-spread function (PSF) modeling for weak lensing shear measurement using the full six years of the Dark Energy Survey (DES Y6) data. We review the PSF estimation procedure using the PIFF (PSFs In the Full FOV) software package and describe the key improvements made to PIFF and modeling diagnostics since the DES year three (Y3) analysis: (i) use of external Gaia and infrared photometry catalogs to ensure higher purity of the stellar sample used for model fitting, (ii) addition of color-dependent PSF modeling, the first for any weak lensing analysis, and (iii) inclusion of model diagnostics inspecting fourth-order moments, which can bias weak lensing measurements to a similar degree as second-order modeling errors. Through a comprehensive set of diagnostic tests, we demonstrate the improved accuracy of the Y6 models evident in significantly smaller systematic errors than those of the Y3 analysis, in which all g band data were excluded due to insufficiently accurate PSF models. For the Y6 weak lensing analysis, we include g band photometry data in addition to the riz bands, providing a fourth band for photometric redshift estimation. Looking forward to the next generation of wide-field surveys, we describe several ongoing improvements to PIFF, which will be the default PSF modeling software for weak lensing analyses for the Vera C. Rubin Observatory’s Legacy Survey of Space and Time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Accounting for correlated errors in inverse radiation transport problems.

Inverse radiation transport focuses on identifying the configuration of an unknown radiation source given its observed radiation signatures. The inverse problem is solved by finding the set of transport model variables that minimizes a weighted sum of the squared differences by channel between the observed signature and the signature predicted by the hypothesized model parameters. The weights per channel are inversely proportional to the sum of the variances of the measurement and model errors at a given channel. In the current treatment, the implicit assumption is that the errors (differences between the modeled and observed radiation signatures) are independent across channels. In this paper, an alternative method that accounts for correlated errors between channels is described and illustrated for inverse problems based on gamma spectroscopy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling human response errors in synthetic flight simulator domain

This paper presents a control theoretic approach to modeling human response errors (HRE) in the flight simulation domain. The human pilot is modeled as a supervisor of a highly automated system. The synthesis uses the theory of optimal control pilot modeling for integrating the pilot's observation error and the error due to the simulation model (experimental error). Methods for solving the HRE problem are suggested. Experimental verification of the models will be tested in a flight quality handling simulation.

Ntuen, Celestine A.↗

On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models

The present study examines the correspondence between short- and long-term systematic errors in five atmospheric models by comparing the 16 five-day hindcast ensembles from the Transpose Atmospheric Model Intercomparison Project II (Transpose-AMIP II) for July–August 2009 (short term) to the climate simulations from phase 5 of the Coupled Model Intercomparison Project (CMIP5) and AMIP for the June–August mean conditions of the years of 1979–2008 (long term). Because the short-term hindcasts were conducted with identical climate models used in the CMIP5/AMIP simulations, one can diagnose over what time scale systematic errors in these climate simulations develop, thus yielding insights into their origin through a seamless modeling approach. The analysis suggests that most systematic errors of precipitation, clouds, and radiation processes in the long-term climate runs are present by day 5 in ensemble average hindcasts in all models. Errors typically saturate after few days of hindcasts with amplitudes comparable to the climate errors, and the impacts of initial conditions on the simulated ensemble mean errors are relatively small. This robust bias correspondence suggests that these systematic errors across different models likely are initiated by model parameterizations since the atmospheric large-scale states remain close to observations in the first 2–3 days. However, biases associated with model physics can have impacts on the large-scale states by day 5, such as zonal winds, 2-m temperature, and sea level pressure, and the analysis further indicates a good correspondence between short- and long-term biases for these large-scale states. Therefore, improving individual model parameterizations in the hindcast mode could lead to the improvement of most climate models in simulating their climate mean state and potentially their future projections.

54 ENVIRONMENTAL SCIENCES↗

The rigorous upscaling of advection-dominated transport in heterogeneous porous media via the Method of Finite Averages

Systems involving advection-dominated transport through heterogeneous porous and fractured media are ubiquitous in subsurface engineering applications. However, upscaling such systems continues to challenge rigorous modeling efforts, particularly when advection is stronger than diffusion at fine spatial scales (i.e., when the Péclet number is greater than one at length scales that characterize a system’s unit-cells, representative elementary volumes, or averaging regions). Here, in this work, we propose and validate a strategy for extending the Method of Finite Averages (MoFA), a rigorous upscaling methodology for heterogeneous porous media, to upscale transport systems experiencing stronger advection than diffusion at fine scales (i.e., fine-scale Péclet numbers greater than one). We detail the strategy, the physical conditions under which it can be applied while retaining a priori modeling error guarantees, and implement the strategy to obtain a MoFA model for advective-diffusive transport that accommodates advective physics at fine spatial scales. We then perform two numerical experiments considering systems with system-scale Péclet numbers of 300 and 1000 — which correspond to fine-scale Péclet numbers of 30 and 100, respectively — to verify that the error guarantees are met under the strategy. After, we conduct a numerical study to demonstrate the strategy’s advantages over the original MoFA methodology. The results suggest that rigorously-upscaled transport models for heterogeneous porous media experiencing advective physics at finer spatial scales can be derived through MoFA and resolved orders of magnitude faster than their pore-scale counterparts. The results also suggest that the presented strategy is limited to modeling shallow concentration gradients when there are large differences between the time scales related to advection and a system’s temporally-varying boundary conditions. This limitation hinders the strategy’s practicality in modeling more advective systems, and as such, opportunity exists for developing additional strategies that accommodate rapidly-varying boundary conditions — and consequentially, steeper concentration gradients — while modeling advective systems with MoFA.

36 MATERIALS SCIENCE↗

TQEA: Temporal Quantum Error Analysis

For the last few years quantum computers have captured researchers’ interest in solving complicated problems in finance, chemistry, machine learning, and many other NP problems. Quantum computing benefits from parallel computation, entanglement, and calculation speedup compared to classical computing. Even though the operations and number of qubits in quantum computers are limited, previous research showed that using quantum computers can be beneficial. These benefits gained researchers’ interest to work on the improvement of quantum computers and overcome the limitations by building more advanced quantum computers with fault tolerance capability, more physical qubits, and better operational gates. In practice, Quantum applications would be translated into Quantum Circuits and each circuit can contain one or many entanglements (s), single qubits operations, and readouts. The importance of running Quantum applications with controlled errors or without errors is critical to the desired result from Quantum readout. In this paper, we study the characteristics of superconducting quantum machines along with the previously proposed methods of Quantum error detection/correction and in order to build a better error model we propose a temporal method for analyzing the the behavior of qubits errors (T1 and T2), frequency of operation, entanglement errors, and readout errors. In order to detect and predict the behavior of each machine, we use simple exponential smoothing analysis on heuristic calibration data. Finally, based on observation, we show that based on frequency, qubits, readout and single operation errors we can build a temporal based model to study and predict the outcome of runs on each Quantum machine.

Baheri, Betis↗

INFERRING THE GALACTIC POTENTIAL WITH GAIA AND FRIENDS: SYNERGIES WITH OTHER SURVEYS

In the coming decade, the Gaia satellite will precisely measure the positions and velocities of millions of stars in the Galactic halo, including stars in many tidal streams. These streams, the products of hierarchical accretion of satellite galaxies by the Milky Way (MW), can be used to infer the Galactic gravitational potential thanks to their initial compactness in phase space. Plans for observations to extend Gaia’s radial velocity (RV) measurements to faint stars, and to determine precise distances to RR Lyrae in streams, would further extend the power of Gaia’s kinematic catalog to characterize the MW’s potential at large Galactocentric distances. In this work I explore the impact of these extra data on the ability to fit the potential using the method of action clustering, which statistically maximizes the information content (clumpiness) of the action space of tidal streams, eliminating the need to determine stream membership for individual stars. Using a mock halo in a toy spherical potential, updated post-launch error models for Gaia, and estimates for RV and distance errors for the tracers to be followed up, I show that combining either form of additional information with the Gaia catalog greatly reduces the bias in determining the scale radius and total mass of the Galaxy compared to the use of Gaia data alone.

79 ASTRONOMY AND ASTROPHYSICS↗

Line-of-sight control of the CSI evolutionary model - mu control

The design, analysis, and simulation of a control law that guarantees a fine pointing performance under external disturbances and model uncertainties are investigated. The authors examine the achievable performance and modeling errors for the control-structure interaction (CSI) evolutionary model structure and highlight the importance of accurate knowledge of structural frequencies and damping values for very lightly damped structures. Numerical results indicate that a limited but significant line-of-sight pointing performance robustness can be attained in spite of modeled structured and unstructured uncertainties in the system. The simulation results reported demonstrate typical performance levels, types of uncertainties and their magnitudes, and design tradeoffs for a realistic laboratory model of a large flexible space structure.

Lim, K. B.↗

Progress in simulating industrial flows using two-equation models: Can more be achieved with further research?

This viewgraph presentation provides a brief review of two-equation eddy-viscosity models (TEM's) from the perspective of applied CFD. It provides objective assessment of both well-known and newer models, compares model predictions from various TEM's with experiments, identifies sources of modeling error and gives historical perspective of their effects on model performance and assessment, and recommends directions for future research on TEM's.

Haroutunian, Vahe↗

Advanced Payload Transfer Measurement System (APT-MS) Mechanical Features

During the last two feet or so of transfer, for a large or heavy payload to its restraining fixture, the consequences of unplanned contact (or impact) between payload and support structure can range from merely annoying to something approaching disaster. Current transfer methods employ technicians with meter sticks stationed at the various hold-down locations to estimate the distances to contact. This information is communicated orally to the crane operator. It is understandable that this work proceeds carefully and therefore slowly. The objectives of this study are (1) to explore mechanical sources of measurement error; and (2) to develop an improved prototype design that is compact, inexpensive, and addresses the measurement error issues. APT is a relatively inexpensive electro-mechanical device that reduces both time and manpower required to make shuttle payload transfers. APT measurement system would provide a GUI for the 'move-conductor' (crane operator) so he could see the displacements of all hold-down interfaces as they move together and thus have a more accurate, comprehensive and 'real-time' picture of the engagement activity. An error model attempts to include all estimatable sources of mechanical error and design features were introduced to reduce or eliminate major sources of error.

Brewer, William V.↗

An IR Sounding-Based Analysis of the Saharan Air Layer in North Africa

Intense daytime surface heating over barren-to-sparsely vegetated surfaces results in dry convective mixing. In the absence of external forcing such as mountain waves, the dry convection can produce a deep, well-mixed, nearly isentropic boundary layer that becomes a well-mixed residual layer in the evening. These well-mixed layers (WML) retain their unique mid-tropospheric thermal and humidity structure for several days. To detect the SAL and characterize its properties, AIRS Level 2 Ver. 6 temperature and humidity products (2003-Present) are evaluated against rawinsondes and compared to model analysis at each of the 55 rawinsonde stations in northern Africa. To distinguish WML from Saharan air layers (WMLs of Saharan origin), the detection involved a two-step process: 1) algorithm-based detection of WMLs in dry environments (less than 7 g per kilogram mixing ratio) 2) identification of Sahara air layers (SAL) by applying Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT) back trajectories to determine the history of each WML. WML occurrence rates from AIRS closely resemble that from rawinsondes, yet rates from model analysis were up to 30% higher than observations in the Sahara due to model errors. Despite the overly frequent occurrence of WMLs from model analysis, HYSPLIT trajectory analysis showed that SAL occurrence rates (given a WML exists) from rawinsondes, AIRS, and model analysis were nearly identical. Although the number of WMLs varied among the data sources, the proportion of WMLs which were classified as SAL was nearly the same. The analysis of SAL bulk properties showed that AIRS and model analysis exhibited a slight warm and moist bias relative to rawinsondes in non-Saharan locations, but model analysis was notably warmer than rawinsondes and AIRS within the Sahara. The latter result is likely associated with the dearth of available data assimilated by model analysis in the Sahara. The variability of SAL thicknesses was reasonably captured by both AIRS and model analysis, but the former favor layers than are thinner than observations. Finally, further analysis of HYSPLIT trajectories revealed that fewer than 10% and 33% of all SAL back trajectories passed through regions with notable precipitation (>100 mm accumulated along the trajectory path) or Aerosol Optical Depth (AOD greater than 0.4, 75th percentile of AOD) on average, respectively. Trajectory analysis indicated that only 57% of Saharan and 24% of non-Saharan WMLs are definitively of Saharan origin (Saharan requirement: Two consecutive days in Sahara and 24 or more of those hours within 72 hours of detection). Non-SAL WMLs either originate from local-to-regionally generated residual layers or from mid-latitude air streams that do not linger over the Sahara for a sufficient time period. Initial analysis shows these non-SAL WMLs tend to be both notably cooler and slightly moister than their SAL counter parts. Continuing analysis will address what role Saharan and non-Saharan air masses characteristics may play on local and regional environmental conditions.

Nicholls, Stephen D.↗

Effect of Cross-Correlation of Orbital Error on Probability of Collision Determination

This paper discusses the effect of global model error on probability of collision (Pc) determination. Modifications to the Pc formulation for cross-correlation of orbital error in prediction are developed and assessed for recent conjunctions. While specific geometries can be identified or constructed to produce significant change in Pc for the modified formulation, it is of operational interest to quantify the relative occurrence of such cases for satellite conjunction risk assessment. Such analysis is feasible per data collections in place over the past year.

Cross-correlation↗

Effect of Cross-Correlation of Orbital Error on Probability of Collision Determination

This paper discusses the effect of global model error on probability of collision (Pc) determination. Modifications to the Pc formulation for cross-correlation of orbital error in prediction are developed and assessed for recent conjunctions. While specific geometries can be identified or constructed to produce significant change in Pc for the modified formulation, it is of operational interest to quanti- fy the relative occurrence of such cases for satellite conjunction risk assessment. Large-scale analysis is feasible per data collections in place over the past year.

Steve Casali↗

Improved Representation of the Global Dust Cycle Using Observational Constraints on Dust Properties and Abundance

Even though desert dust is the most abundant aerosol by mass in Earth’s atmosphere, atmospheric models 25 struggle to accurately represent its spatial and temporal distribution. These model errors are partially caused byfundamental difficulties in simulating dust emission in coarse-resolution models and in accurately representing dust microphysical properties. Here we mitigate these problems by developing a new methodology that yields an improved representation of the global dust cycle. We present an analytical framework that uses inverse modeling to integrate an ensemble of global model simulations with observational constraints on the dust size distribution, 30 extinction efficiency, and regional dust aerosol optical depth. We then compare the inverse model results against independent measurements of dust surface concentration and deposition flux and find that errors are reduced by approximately a factor of two relative to current model simulations of the Northern Hemisphere dust cycle. The inverse model results show smaller improvements in the less dusty Southern Hemisphere, most likely because both the model simulations and the observational constraints used in the inverse model are less accurate. On a global 35 basis, we find that the emission flux of dust with geometric diameter up to 20 μm (PM20) is approximately 5,000 Tg/year, which is greater than most models account for. This larger PM20 dust flux is needed to match observational constraints showing a large atmospheric loading of coarse dust. We obtain gridded data sets of dust emission, vertically integrated loading, dust aerosol optical depth, (surface) concentration, and wet and dry deposition fluxes that are resolved by season and particle size. As our results indicate that this data set is more accurate than current 40 model simulations and the MERRA-2 dust reanalysis product, it can be used to improve quantifications of dust impacts on the Earth system.

aerosols, dust↗

Views from the 6 Aircraft Campaigns: ACT-America, HIPPO, CONTRAIL, ATom, ORCAS, and ABoVE

This presentation describes the assimilation of airborne measurements of carbon dioxide (CO2) into the Goddard Earth Observing System (GEOS) general circulation model. The main goal is to construct observationally constrained fields of CO2 starting from the bottom of the atmosphere and extending through the entire vertical column. These fields can then be compared directly to retrievals of column CO2 (XCO2) from the Greenhouse Gases Observing Satellite (GOSAT) and the Orbiting Carbon Observatory 2 (OCO-2) by using the averaging kernel and a priori profile. This approach does not equire a direct satellite overpass, but rather an overpass of the much broader region impacted by the assimilation, which alleviates some of the jeopardy of coordinating flights with satellite tracks. Furthermore, checking if the story stays the same or if it changes when the unassimilated fields are compared to the satellite soundings allows us to separate model errors from retrieval errors. This work attempts to answer a number of questions including: What are the possible causes of systematic differences between model and satellite XCO2 over the Pacific Ocean? What is the contribution of tratospheric uncertainty to XCO2 errors? What is the impact of errors in boundary layer physics on modeled XCO2?

Weir, B.↗

Stochastic Models of Human Errors

Humans play an important role in the overall reliability of engineering systems. More often accidents and systems failure are traced to human errors. Therefore, in order to have meaningful system risk analysis, the reliability of the human element must be taken into consideration. Describing the human error process by mathematical models is a key to analyzing contributing factors. Therefore, the objective of this research effort is to establish stochastic models substantiated by sound theoretic foundation to address the occurrence of human errors in the processing of the space shuttle.

Elshamy, Maged↗