Search NASA⌕ Search

SEARCH · Search NASA

Results for “error modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

A Logarithmic Bayesian Approach to Quantum Error Detection

We consider the problem of continuous quantum error correction from a Bayesian perspective, proposing a pair of digital filters using logarithmic probabilities that are able to achieve near-optimal performance on a three-qubit bit-flip code, while still being reasonable to implement on low-latency hardware. These practical filters are approximations of an optimal filter that we derive explicitly for finite time steps, in contrast with previous work that has relied on stochastic differential equations such as the Wonham filter. By utilizing logarithmic probabilities, we are able to eliminate the need for explicit normalization and can reduce the Gaussian noise distribution to a simple quadratic expression. The state transitions induced by the bit-flip errors are modeled using a Markov chain, which for log-probabilities must be evaluated using a LogSumExp function. We develop the two versions of our filter by constraining this LogSumExp to have either one or two inputs, which favors either simplicity or accuracy, respectively. Using simulated data, we demonstrate that the single-term and two-term filters are able to significantly outperform both a double threshold scheme and a linearized version of the Wonham filter in tests of error detection under a wide variety of error rates and time steps.

97 MATHEMATICS AND COMPUTING↗

Another Approach to Enhance Airline Safety: Using Management Safety Tools

The ultimate goal of conducting an accident investigation is to prevent similar accidents from happening again and to make operations safer system-wide. Based on the findings extracted from the investigation, the "lesson learned" becomes a genuine part of the safety database making risk management available to safety analysts. The airline industry is no exception. In the US, the FAA has advocated the usage of the System Safety concept in enhancing safety since 2000. Yet, in today s usage of System Safety, the airline industry mainly focuses on risk management, which is a reactive process of the System Safety discipline. In order to extend the merit of System Safety and to prevent accidents beforehand, a specific System Safety tool needs to be applied; so a model of hazard prediction can be formed. To do so, the authors initiated this study by reviewing 189 final accident reports from the National Transportation Safety Board (NTSB) covering FAR Part 121 scheduled operations. The discovered accident causes (direct hazards) were categorized into 10 groups Flight Operations, Ground Crew, Turbulence, Maintenance, Foreign Object Damage (FOD), Flight Attendant, Air Traffic Control, Manufacturer, Passenger, and Federal Aviation Administration. These direct hazards were associated with 36 root factors prepared for an error-elimination model using Fault Tree Analysis (FTA), a leading tool for System Safety experts. An FTA block-diagram model was created, followed by a probability simulation of accidents. Five case studies and reports were provided in order to fully demonstrate the usefulness of System Safety tools in promoting airline safety.

Lu, Chien-tsug↗

Applications of the Dulmage–Mendelsohn decomposition for debugging nonlinear optimization problems

Nonlinear modeling and optimization is a valuable tool for aiding decisions by engineering practitioners, but programming an optimization problem based on a complex electrical, mechanical, or chemical process is a time-consuming and error-prone activity. Therefore, there is a need for model analysis and debugging tools that can detect and diagnose modeling errors. One such tool is the Dulmage–Mendelsohn decomposition, which identifies structurally under- and over-determined subsets in systems of equations and variables by partitioning the bipartite graph of the system. This work provides the necessary background to understand the Dulmage–Mendelsohn decomposition and its application to the analysis of nonlinear optimization problems, demonstrates its use in diagnosing a variety of modeling errors, and introduces software implementations for analyzing nonlinear optimization problems in the Pyomo and JuMP algebraic modeling languages.

42 ENGINEERING↗

Comparisons of subsonic drag estimates derived from Pioneer Venus probes flight data with wind-tunnel results

Subsonic drag coefficients have been obtained from flight data for the Pioneer Venus multiprobes. The technique used to extract the information from the data consisted of utilizing in situ pressure and temperature measurements. Analysis of the major model parameter error sources indicates overall error levels of five percent or less in the flight values of the drag coefficient. Comparisons of the flight coefficients with preflight wind-tunnel test data showed generally good agreement except for the Sounder descent probe configuration. To preclude atmospheric phenomena as a possible explanation of this difference, additional wind-tunnel tests were performed on the Sounder descent probe. Special attempts were made to duplicate the probe geometry for tests in a high Reynolds number environment in order to achieve as realistic model and flight conditions as practical. Preliminary results from this testing in the NASA LaRC Low Turbulence Pressure Tunnel produced a drag coefficient of 0.68 at 0 deg angle of attack which is within the expected accuracy limits of the flight derived drag coefficient value of 0.72 + or - 0.04, thus eliminating atmospheric phenomena as the explanation for the initial difference.

Blanchard, R. C.↗

Assimilation of Satellite Ozone Observations

This talk will discuss assimilation of ozone data from satellite-borne instruments. Satellite observations of ozone total columns and profiles have been measured by a series of Total Ozone Mapping Spectrometer (TOMS), Solar Backscatter Ultraviolet (SBUV) instruments, and more recently by the Global Ozone Monitoring Experiment. Additional profile data are provided by instruments on NASA's Upper Atmosphere Research Satellite and by occultation instruments on other platforms. Instruments on Envisat' and future EOS Aura satellite will supply even more comprehensive data about the ozone distribution. Satellite data contain a wealth of information, but they do not provide synoptic global maps of ozone fields. These maps can be obtained through assimilation of satellite data into global chemistry and transport models. In the ozone system at NASA's Data Assimilation Office (DAO) any combination of TOMS, SBUV, and Microwave Limb sounder (MLS) data can be assimilated. We found that the addition of MLS to SBUV and TOMS data in the system helps to constrain the ozone distribution, especially in the polar night region and in the tropics. The assimilated ozone distribution in the troposphere and lower stratosphere is sensitive also to finer changes in the SBUV and TOMS data selection and to changes in error covariance models. All results are established by comparisons of assimilated ozone with independent profiles from ozone sondes and occultation instruments.

Stajner, I.↗

Constraining Black Carbon Aerosol over Asia using OMI Aerosol Absorption Optical Depth and the Adjoint of GEOS-Chem

Accurate estimates of the emissions and distribution of black carbon (BC) in the region referred to here as Southeastern Asia (70degE-l50degE, 11degS-55degN) are critical to studies of the atmospheric environment and climate change. Analysis of modeled BC concentrations compared to in situ observations indicates levels are underestimated over most of Southeast Asia when using any of four different emission inventories. We thus attempt to reduce uncertainties in BC emissions and improve BC model simulations by developing top-down, spatially resolved, estimates of BC emissions through assimilation of OMI observations of aerosol absorption optical depth (AAOD) with the GEOS-Chem model and its adjoint for April and October of 2006. Overwhelming enhancements, up to 500%, in anthropogenic BC emissions are shown after optimization over broad areas of Southeast Asia in April. In October, the optimization of anthropogenic emissions yields a slight reduction (1-5%) over India and parts of southern China, while emissions increase by 10-50% over eastern China. Observational data from in situ measurements and AERONET observations are used to evaluate the BC inversions and assess the bias between OMI and AERONET AAOD. Low biases in BC concentrations are improved or corrected in most eastern and central sites over China after optimization, while the constrained model still underestimates concentrations in Indian sites in both April and October, possibly as a. consequence of low prior emissions. Model resolution errors may contribute up to a factor of 2.5 to the underestimate of surface BC concentrations over northern India. We also compare the optimized results using different anthropogenic emission inventories and discuss the sensitivity of top-down constraints on anthropogenic emissions with respect to biomass burning emissions. In addition, the impacts of brown carbon, the formulation of the observation operator, and different a priori constraints on the optimization are investigated. Overall, despite these limitations and uncertainties, using OMI AAOD to constrain BC sources improves model representation of BC distributions, particularly over China.

Aerosols↗

Software reliability: A comparison of results obtained from established software reliability models

Two models of the software error detection process are compared, the Jelinski-Moranda model and a Bayes inference model. Simulation techniques are used to generate software related system failure data which is analyzed by both models. Point estimates and confidence limits are compared. It is demonstrated that uncertainty may be considerable for reasonable samples sizes and should be considered in any application of these techniques. The Jelinski-Moranda model is sensitive to the failure of data to follow internal assumptions of the model, often not providing any point estimates, a factor which may limit its usefulness in many real world situations. The Bayes model is shown to respond to the introduction of additional errors in the software correction process, a condition where error counting models such as the Jelinski-Moranda generally fail to converge.

Horn, M. H.↗

An open-access CMIP5 pattern library for temperature and precipitation: Description and methodology

Pattern scaling is used to efficiently emulate general circulation models and explore uncertainty in climate projections under multiple forcing scenarios. Pattern scaling methods assume that local climate changes scale with a global mean temperature increase, allowing for spatial patterns to be generated for multiple models for any future emission scenario. For uncertainty quantification and probabilistic statistical analysis, a library of patterns with descriptive statistics for each file would be beneficial, but such a library does not presently exist. Of the possible techniques used to generate patterns, the two most prominent are the delta and least squared regression methods. We explore the differences and statistical significance between patterns generated by each method and assess performance of the generated patterns across methods and scenarios. Differences in patterns across seasons between methods and epochs were largest in high latitudes (60-90°N/S). Bias and mean errors between modeled and pattern predicted output from the linear regression method were smaller than patterns generated by the delta method. Across scenarios, differences in the linear regression method patterns were more statistically significant, especially at high latitudes. We found that pattern generation methodologies were able to approximate the forced signal of change to within ≤ 0.5°C, but choice of pattern generation methodology for pattern scaling purposes should be informed by user goals and criteria. As a result, this paper describes our library of least squared regression patterns from all CMIP5 models for temperature and precipitation on an annual and sub-annual basis, along with the code used to generate these patterns.

54 ENVIRONMENTAL SCIENCES↗

Analysis and Forecast of Two Storms Characterized by Extreme Deepening Rates

Between 25 and 27 December 1999 two very intense cyclones, named Lothar and Martin, swept across northern and western France causing substantial life and property loss. In this work, the finite volume general circulation model and data assimilation system (fvDAS) developed at the Data Assimilation Office of the NASA Goddard Space and Flight Center is being used to investigate these storms. In the first part of this article the dynamics of the storms is analyzed, and some important mechanisms are unveiled. The second part describes a set of eleven data assimilation experiments to study the impact of different data types on the automated analyses. Cloud-track winds provided by EUMETSAT and surface winds from QuikSCAT are being used. These data are assimilated with a range of different parameter settings of the forecast error covariance model. The results show that generally the additional wind data set have positive impacts on the analyses: particularly, the analysis of Lothar can be slightly improved by using the Eumetsat winds, and the analysis of Martin can be strongly improved by using the full-resolution QuikSCAT winds with a more localized influence. The third part of this article is focused on the forecast of Lothar which is very well predicted in the 1-5 day range by the fvDAS system.

Reale, Oreste↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

Hybrid Guidance Control for a Hypervelocity Small Size Asteroid Interceptor Vehicle

Near-Earth Objects (NEOs) are comets and/or asteroids that have orbits in proximity with Earth's own orbit. NEOs have collided with the Earth in the past, which can be seen at such places as Chicxulub crater, Barringer crater, and Manson crater, and will continue in the future with potentially significant and devastating results. Fortunately such NEO collisions with Earth are infrequent, but can happen at any time. Therefore it is necessary to develop and validate techniques as well as technologies necessary to prevent them. One approach to mitigate future NEO impacts is the concept of high-speed interceptor. This concept is to alter the NEO's trajectory via momentum exchange by using kinetic impactors as well as nuclear penetration devices. The interceptor has to hit a target NEO at relative velocity which imparts a sufficient change in NEO velocity. NASA's Deep Impact mission has demonstrated this scenario by intercepting Comet Temple 1, 5 km in diameter, with an impact relative speed of approximately 10 km/s. This paper focuses on the development of hybrid guidance navigation and control (GNC) algorithms for precision hypervelocity intercept of small sized NEOs. The spacecraft's hypervelocity and the NEO's small size are critical challenges for a successful mission as the NEO will not fill the field of view until a few seconds before intercept. The investigation needs to consider the error sources modeled in the navigation simulation such as spacecraft initial state uncertainties in position and velocity. Furthermore, the paper presents three selected spacecraft guidance algorithms for asteroid intercept and rendezvous missions. The selected algorithms are classical Proportional Navigation (PN) based guidance that use a first order difference to compute the derivatives, Three Plane Proportional Navigation (TPPN), and the Kinematic Impulse (KI). A manipulated Bennu orbit that has been changed to impact Earth will be used as a demonstrative example to compare the three methods. In addition, a hybrid approach that is a combination between proportional navigation and kinematic impulse will be investigated to find an effective, error tolerant, and power saving approach. A 3-dimension mission scenario for both the asteroid and the interceptor spacecraft software simulator is developed for testing of the controllers. The current result demonstrates that a miss distance magnitude of less than 10m is found using the PN and TPPN guidance laws for small asteroid in the presence of error in the spacecraft states. Moreover, the paper presents these results and also the hybrid control approach simulation results.

asteroid↗

Airborne Lidar Measurements of XCO 2 in Synoptically Active Environment and Associated Comparisons With Numerical Simulations

Frontal boundaries have been shown to cause large changes in CO 2 mole-fractions, but clouds and the complex vertical structure of fronts make these gradients difficult to observe. It remains unclear how the column average CO 2 dry air mole-fraction (XCO 2 ) changes spatially across fronts, and how well airborne lidar observations, data assimilation systems, and numerical models without assimilation capture XCO 2 frontal contrasts (ΔXCO 2 , i.e., warm minus cold sector average of XCO 2 ). We demonstrated the potential of airborne Multifunctional Fiber Laser Lidar (MFLL) measurements in heterogeneous weather conditions (i.e., frontal environment) to investigate the ΔXCO 2 during four seasonal field campaigns of the Atmospheric Carbon and Transport-America (ACT-America) mission. Most frontal cases in summer (winter) reveal higher (lower) XCO 2 in the warm (cold) sector than in the cold (warm) sector. During the transitional seasons (spring and fall), no clear signal in ΔXCO 2 was observed. Intercomparison among the MFLL, assimilated fields from NASA's Global Modeling and Assimilation Office (GMAO), and simulations from the Weather Research and Forecasting-—Chemistry (WRF-Chem) showed that (a) all products had a similar sign of ΔXCO 2 though with different levels of agreement in ΔXCO 2 magnitudes among seasons; (b) ΔXCO 2 in summer decreases with altitude; and (c) significant challenges remain in observing and simulating XCO 2 frontal contrasts. A linear regression analyses between ΔXCO 2 for MFLL versus GMAO, and MFLL versus WRF-Chem for summer-2016 cases yielded a correlation coefficient of 0.95 and 0.88, respectively. The reported ΔXCO 2 variability among four seasons provide guidance to the spatial structures of XCO 2 transport errors in models and satellite measurements of XCO 2 in synoptically-active weather systems.

54 ENVIRONMENTAL SCIENCES↗

Sensitivity of the Assimilated Ozone in the UTLS to Model and Data Selection Changes

This presentation will discuss the sensitivity of assimilated ozone fields in the upper troposphere and lower stratosphere (UTLS) to a number of factors, focusing mainly on aspects of data selection and the prediction model. This is important, because assimilation represents an attempt to construct our best estimates of the true ozone field; however, inaccuracies in the UTLS ozone distribution translate into an uncertainty in factors such as the calculated radiative forcing of climate or the inferred stratosphere-troposphere exchange (STE) of ozone. The 3D ozone data assimilation system, from NASA's Global Modeling and Assimilation Office (GMAO), combines observations of total ozone column and stratospheric profiles with predictions from an off-line, parameterized chemistry and transport model (pCTM) to produce six-hourly, global analyses. The first experiments discussed assimilate ozone retrievals from the Earth-Probe Total Ozone Mapping Spectrometer (EPTOMS) and stratospheric profiles from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument. The SBUV/2 ozone data have a coarse vertical resolution, with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the UTLS region are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Sensitivity studies have been conducted to examine the responses to TOMS and SBUV/2 data selection, modifications of the forecast and observation error covariance models, and the model formulation (turning off chemistry or using different wind analyses in the pCTM). The second set of experiments includes an additional data type: ozone retrieved from infrared limb-emission by MIPAS on Envisat. These data offer not only improved vertical resolution in the stratosphere, but also give measurements in the polar night. Comparisons of the assimilated ozone fields from both sets of experiments with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes. It is shown that many of the changes have a significant impact on the UTLS ozone estimates. Implications for interpretation of STE and radiative forcing of climate are discussed.

Pawson, Steven↗

Data-Driven Modeling and Correction of Vehicle Dynamics

We develop a data-driven framework for learning and correcting nonautonomous vehicle dynamics. Physics-based vehicle models are often simplified for tractability and therefore exhibit inherent model-form uncertainty, motivating the need for data-driven correction. Moreover, nonautonomous dynamics are governed by time-dependent control inputs, which pose challenges in learning predictive models directly from temporal snapshot data. To address these, we reformulate the vehicle dynamics via a local parameterization of the time-dependent inputs, yielding a modified system composed ofa sequence of local parametric dynamical systems. Here, we approximate these parametric systems using two complementary approaches. First, we employ the dimension reduction and interpolation in parameter space (DRIPS) methodology to construct efficient linear surrogate models, equipped with lifted observable spaces and manifold-based operator interpolation. This enables data-efficient learning of vehicle models whose dynamics admit accurate linear representations in the lifted spaces. Second, for more strongly nonlinear systems, we employ flow map learning (FML), a deep neural network (DNN) approach that approximates the parametric evolution map without requiring special treatment of nonlinearities. We further extend FML with a transfer-learning-based model correction procedure, enabling the correction of misspecified prior models using only a sparse set of high-fidelity or experimental measurements, without assuming a prescribed form for the correction term. Through a suite of numerical experiments on unicycle, simplified bicycle, and slip-based bicycle models, we demonstrate that DRIPS offers robust and highly data-efficient learning of nonautonomous vehicle dynamics, while FML provides expressive nonlinear modeling and effective correction of model-form errors under severe data scarcity.

data-driven modeling↗

An improved error assessment for the GEM-T1 gravitational model

Several tests have been designed to estimate the correct error variances for the GEM-T1 gravitational solution that was derived exclusively from satellite tracking data. The basic method uses both independent and dependent subset data solutions and produces a coefficient-by-coefficient estimate of the model uncertainties. The GEM-T1 errors have been further analyzed using a method based on eigenvalue-eigenvector analysis, which calibrates the entire covariance matrix. Dependent satellite data sets and independent altimetric, resonant satellite, and surface gravity data sets all confirm essentially the same error assessment. The calibration test results yield very stable calibration factors, which vary only by approximately 10 percent over the range of tests performed. Based on these calibrated error estimates, GEM-T1 is a significantly improved solution, which to degree and order 8 is twice as accurate as earlier satellite derived models like GEM-L2. Also, by being complete to degree and order 36, GEM-T1 is more complete and has significantly reduced aliasing effects that were present in previous models.

Lerch, F. J.↗

Can Assimilation of Satellite Ozone Data Contribute to the Understanding of the Lower Stratospheric Ozone?

We study the quality of lower stratospheric ozone fields from a three- dimensional global ozone assimilation system. Ozone in this region is important for the forcing of climate, but its global distribution is not fully known because of its large temporal and vertical variability. Modeled fields often have biases due to the inaccurate representation of transport processes in this region with strong gradients. Accurate ozonesonde or satellite occultation measurements have very limited coverage. Nadir measurements, such as those from the Solar Backscatter Ultraviolet/2 (SBUV/2) instrument that provide wide latitudinal coverage, lack the vertical resolution needed to represent sharp vertical features. Limb measurements, such as those from the Michelson Interferometer for Passive Atmospheric Sounding (MIPAS), provide a finer vertical resolution. We show that assimilation of MIPAS data in addition to SBUV/2 data leads to better estimates of ozone in comparison with independent high quality satellite, aircraft, and ozone sonde measurements. Other modifications to the statistical analysis that have an impact on the lower stratospheric ozone will be mentioned: error covariance modeling and data selection. Direct and indirect impacts of transport and chemistry models will be discussed. Implications for multi-year analyses and short-tern prediction will be addressed.

Stajner, I.↗

The Effect of Errors in Snow Assimilation on Land Surface Modeling

The accurate portrayal of the hydrological cycle is extremely important in land surface modeling. Central to this effort is the treatment of snow, as errors in the representation of this quantity can impact practically all other modeled quantities through alterations in the water and energy balances. Although land surface model (LSM) simulations can benefit from the assimilation of snow cover and snow depth observations, they can be negatively impacted if such observations contain errors or if a model bias exists in the simulation of surface or soil temperatures. Both cases may lead to excessive melting or growth of snow packs, and to large alterations in both the energy and water balances. Such problems in the snow assimilation process, made evident by the repeated melting and replenishing of snow pack over significant areas of the United States, exists in the Eta Data Assimilation System and is a product of the EDAS system's direct insertion assimilation of snow data. Occurring on a 24 hour cycle, the repeated melting infuses the soil column with a large quantity of water that upsets the hydrological cycle. In an effort to quantify the impacts of such errors in snow assimilation on water and energy budgets, a series of Mosaic LSM simulations were performed over the 12 month period covering October 1998 to October 1999.

Cosgrove, Brian A.↗

Error detection and rectification in digital terrain models

Digital terrain models produced by computer correlation of stereo images are likely to contain occasional gross errors in terrain elevation. These errors typically result from having mismatched sub-areas of the two images, a problem which can occur for a variety of image- and terrain-related reasons. Such elevation errors produce undesirable effects when the models are further processed, and should be detected and corrected as early in the processing as possible. Algorithms have been developed to detect and correct errors in digital terrain models. These algorithms focus on the use of constraints on both the allowable slope and the allowable change in slope in local areas around each point. Relaxation-like techniques are employed in the iteration of the detection and correction phases to obtain best results.

Hannah, M. J.↗