Search NASA⌕ Search

SEARCH · Search NASA

Results for “error modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

A framework for feasibility-level validation of high-resolution wave hindcast models

The value of long-term wave hindcasts for investigating wave climates, wave energy resources, and extreme wave conditions has motivated research developing, calibrating and validating wave hindcast models. Past hindcast model validation studies examined the accuracy in modeling bulk wave parameters of overall sea states without considering the dependency of the model's skill within different sea states. In the present study, a framework for wave hindcast model validation is developed by examining the model accuracy for the most frequently occurring sea states, sea states contributing the most energy to total wave power, sea states associated with hurricane events, and those with the largest model error. Here, validations using bulk wave parameters and frequency-directional spectra at these key sea states and extreme wave conditions based on univariate and bivariate-contour methods provide insights to improve model accuracy, identifying the model's strong and weak points, and pathways for improvement, e.g., modeling wave-current interactions and adjusting wind data. This study adds to a growing body of research demonstrating that a carefully calibrated and verified spectral wave hindcast model can be used to estimate key wave energy parameters over a wide range of wave energy climates, as well as their spatial, temporal, frequency, directional, and probabilistic distributions.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning Prediction of the Critical Cooling Rate for Metallic Glasses from Expanded Datasets and Elemental Features

In this study, we use a random forest (RF) model to predict the critical cooling rate (R C ) for glass formation of various alloys from features of their constituent elements. The RF model was trained on a database that integrates multiple sources of direct and indirect R C data for metallic glasses to expand the directly measured R C database of less than 100 values to a training set of over 2000 values. The model error on 5-fold cross-validation (CV) is 0.66 orders of magnitude in K/s. The error on leave-out-one-group CV on alloy system groups is 0.59 log units in K/s when the target alloy constituents appear more than 500 times in training data. Using this model, we make predictions for the set of compositions with melt-spun glasses in the database and for the full set of quaternary alloys that have constituents which appear more than 500 times in training data. These predictions identify a number of potential new bulk metallic glass systems for future study, but the model is most useful for the identification of alloy systems likely to contain good glass formers rather than detailed discovery of bulk glass composition regions within known glassy systems.

36 MATERIALS SCIENCE↗

Stochastic Error Cancellation in Analog Quantum Simulation

Analog quantum simulation is a promising path towards solving classically intractable problems in many-body physics on near-term quantum devices. However, the presence of noise limits the size of the system and the length of time that can be simulated. In our work, we consider an error model in which the actual Hamiltonian of the simulator differs from the target Hamiltonian we want to simulate by small local perturbations, which are assumed to be random and unbiased. We analyze the error accumulated in observables in this setting and show that, due to stochastic error cancellation, with high probability the error scales as the square root of the number of qubits instead of linearly. We explore the concentration phenomenon of this error as well as its implications for local observables in the thermodynamic limit. Moreover, we show that stochastic error cancellation also manifests in the fidelity between the target state at the end of time-evolution and the actual state we obtain in the presence of noise. This indicates that, to reach a certain fidelity, more noise can be tolerated than implied by the worst-case bound if the noise comes from many statistically independent sources.

Analog quantum simulation↗

Model reduction for flexible structures

Several conditions for a near-optimal reduction of general dynamic systems are presented focusing on the reduction in balanced and modal coordinates. It is shown that model and balanced reductions give very different results for the flexible structure with closely-spaced natural frequencies. In general, balanced reduction is found to give better results. A robust model reduction technique was developed to study the sensitivity of modeling error to variations in the damping of a structure. New concepts of grammians defined over a finite time and/or a frequency interval are proposed including computational procedures for evaluating them. Application of the model reduction technique to these grammians is considered to lead to a near-optimal reduced model which closely reproduces the full system output in the time and/or frequency interval.

Gawronski, Wodek↗

Orbit Determination Sensitivity Analysis for the Europa Multiple Flyby Mission Concept

This paper details the results of parametric variations on the notional Europa Mission Concept tour navigation strategy on orbit determination delivery and knowledge errors and the associated statistical ∆V consumption. Approach maneuver placement at encounter minus two and a half days and at encounter minus three and a half days is compared to the reference encounter minus three days location as well as variations to the data cutoff for approach maneuver design, which is baselined one day prior to maneuver execution. An execution error model with fixed and proportional components assigned to the magnitude and pointing directions is applied to each maneuver in a Monte Carlo simulation. Variations on the fixed and proportional contributions to both component errors are simulated and analyzed to show the effect of varying thruster characterization levels. The effects of varying levels of a priori satellite ephemeris errors are also characterized in this study.

Boone, Dylan R.↗

Improved Stratospheric Temperature Retrievals for Climate Reanalysis

The Data Assimilation Office (DAO) is embarking on plans to generate a twenty year reanalysis data set of climatic atmospheric variables. One of the focus points will be in the evaluation of the dynamics of the stratosphere. The Stratospheric Sounding Unit (SSU), flown as part of the TIROS Operational Vertical Sounder (TOVS), is one of the primary stratospheric temperature sensors flown consistently throughout the reanalysis period. Seven unique sensors made the measurements over time, with individual instrument characteristics that need to be addressed. The stratospheric temperatures being assimilated across satellite platforms will profoundly impact the reanalysis dynamical fields. To attempt to quantify aspects of instrument and retrieval bias we are carefully collecting and analyzing all available information on the sensors, their instrument anomalies, forward model errors and retrieval biases. For the retrieval of stratospheric temperatures, we adapted the minimum variance approach of Jazwinski (1970) and Rodgers (1976) and applied it to the SSU soundings. In our algorithm, the state vector contains an initial guess of temperature from a model six hour forecast provided by the Goddard EOS Data Assimilation System (GEOS/DAS). This is combined with an a priori covariance matrix, a forward model parameterization, and specifications of instrument noise characteristics. A quasi-Newtonian iteration is used to obtain convergence of the retrieved state to the measurement vector. This algorithm also enables us to analyze and address the systematic errors associated with the unique characteristics of the cell pressures on the individual SSU instruments and the resolving power of the instruments to vertical gradients in the stratosphere. The preliminary results of the improved retrievals and their assimilation as well as baseline calculations of bias and rms error between the NESDIS operational product and col-located ground measurements will be presented.

Rokke, L.↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Measuring the Loschmidt Amplitude for Finite-Energy Properties of the Fermi-Hubbard Model on an Ion-Trap Quantum Computer

Calculating the equilibrium properties of condensed-matter systems is one of the promising applications of near-term quantum computing. Recently, hybrid quantum-classical time-series algorithms have been proposed to efficiently extract these properties from a measurement of the Loschmidt amplitude ⟨ ψ | e − i H ^ t | ψ ⟩ from initial states | ψ ⟩ and a time evolution under the Hamiltonian H ^ up to short times t . In this work, we study the operation of this algorithm on a present-day quantum computer. Specifically, we measure the Loschmidt amplitude for the Fermi-Hubbard model on a 16 -site ladder geometry (32 orbitals) on the Quantinuum H2-1 trapped-ion device. We assess the effect of noise on the Loschmidt amplitude and implement algorithm-specific error-mitigation techniques. By using a thus-motivated error model, we numerically analyze the influence of noise on the full operation of the quantum-classical algorithm by measuring expectation values of local observables at finite energies. Finally, we estimate the resources needed for scaling up the algorithm. Published by the American Physical Society 2024

Physics↗

Satellite interferometer as an advanced navigation/communication system

An orthogonal system of interferometry baselines aboard a geostationary satellite is proposed to be used for navigation, surveillance, and traffic control. Position determination is based on the relationship between the measured phase differences, the known and unknown transmitter locations, and other systematic error model parameters using a generalized least-squares estimation procedure. It is shown that position accuracy is critically dependent on the baseline length and on the magnitude of the random component of the measuring errors. Several trade-offs with respect to the system accuracies, the number of users, data rates, hardware costs, etc., are examined. Simultaneous use of the same channels for navigation and data transfer is found feasible and five candidate or 'strawman' interferometer system proposals are presented. It is concluded that the system's performance is excellent in comparison with present or planned systems, and that it is viable in meeting potential user's requirements.

Gopalapillai, G. S.↗

New Total Ozone Algorithm for Application to the Total Ozone Mapping Spectrometer

The Total Ozone Mapping Spectrometer (TOMS) series comprises four instruments providing a total of 25 years of daily global stratospheric ozone data over the sunlit portion of the Earth. A new retrieval algorithm has been developed for TOMS, designated Version 8. The algorithm is based on differential absorption across a pair of wavelength channels chosen close together to minimize the impact of wavelength dependent forward modeling errors. Version 8 enhancements include correction for the presence of tropospheric aerosols and sun glint from water surfaces, a better treatment of variability due to tropospheric ozone and temperature dependence, and an improved forward model, particularly in regions of persistent snow and ice. Among other things, the Version 8 enhancements have reduced latitudinal dependence seen previously in TOMS - Dobson comparisons, predominantly in the Southern Hemisphere's summer, when the tropospheric ozone, temperature, and snow/ice corrections are additive. The basic components of the algorithm and its impact on derived total ozone will be discussed.

Wellemeyer, C.↗

Application of the multiple PRF technique to resolve Doppler centroid estimation ambiguity for spaceborne SAR

Estimation of the Doppler centroid ambiguity is a necessary element of the signal processing for SAR systems with large antenna pointing errors. Without proper resolution of the Doppler centroid estimation (DCE) ambiguity, the image quality will be degraded in the system impulse response function and the geometric fidelity. Two techniques for resolution of DCE ambiguity for the spaceborne SAR are presented; they include a brief review of the range cross-correlation technique and presentation of a new technique using multiple pulse repetition frequencies (PRFs). For SAR systems, where other performance factors control selection of the PRF's, an algorithm is devised to resolve the ambiguity that uses PRF's of arbitrary numerical values. The performance of this multiple PRF technique is analyzed based on a statistical error model. An example is presented that demonstrates for the Shuttle Imaging Radar-C (SIR-C) C-band SAR, the probability of correct ambiguity resolution is higher than 95 percent for antenna attitude errors as large as 3 deg.

Chang, C. Y.↗

Influence of structural and aerodynamic modeling on optimization with flutter constraint

The influences of structural and aerodynamic modeling on multidisciplinary optimization in an aeroelastic environment are not well understood. Therefore, optimizations with flutter and frequency constraints were performed to investigate the effects these modeling factors have on various representative wings. To this end, the Automated Structural Optimization System (ASTROS) was used as a tool to minimize the weight of various fully built-up finite element wing models in subsonic and supersonic flow under given flutter and frequency constraints. First, the performance of the optimization module was tested against results from other codes on a straight and uniform wing widely used for optimization with flutter constraints. Then, fully built-up finite element models of various wings with different aspect ratios were investigated for the influence on the structural optimization for minimum weight of the following modeling factors: finite element selection, structural grid refinement; number of selected modes, retention of breathing modes; selection of reduced frequencies to be used in flutter analysis; aerodynamic panel size and placement; splining of the aerodynamic grid to the structural grid selection of extra points of the structural wing box for splining; and number of constraints to be retained. Knowledge of these influences as well as of the program behavior is important, since optimization can be made more efficient by the selection of reasonable initial models. Also, it was shown previously that modeling has an impact on the results of modal and aeroelastic analyses. Thus, if modeling errors can negatively affect the analyses, a minimum weight optimization can be jeopardized and result in an optimal design that is rather unreliable. In the following, selected results are presented and the influences of some modeling parameters on optimization are pointed out.

Striz, Alfred G.↗

Teleconnections of the Quasi–Biennial Oscillation in a multi–model ensemble of QBO–resolving models

The quasi-biennial oscillation (QBO) dominates the interannual variability of the tropical stratosphere and influences other regions of the atmosphere. The high predictability of the QBO implies that its teleconnections could lead to in-creased skill of seasonal and decadal forecasts provided the relevant mechanisms are accurately represented in models. Here modelling and sampling uncertainties of QBO teleconnections are examined using a multi-model ensemble of QBO-resolving atmospheric general circulation models that have carried out a set of coordinated experiments as part of the Stratosphere-troposphere Processes And their Role in Climate (SPARC) QBO initiative (QBOi). During Northern Hemisphere winter the stratospheric polar vortex in most of these models strengthens when the QBO near 50 hPa is westerly and weakens when it is easterly, consistent with, but weaker than, the observed response. These weak responses are likely due to model errors, such as systematically weak QBO amplitudes near 50 hPa, affecting the teleconnection. The teleconnection to the North Atlantic Oscillation is less well captured overall, but of similar strength to the observed signal in the few models that do show it. Furthermore, the models do not show clear evidence of a QBO teleconnection to the Northern Hemisphere Pacific sector subtropical jet.

54 ENVIRONMENTAL SCIENCES↗

Assessment of Error in Aerosol Optical Depth Measured by AERONET Due to Aerosol Forward Scattering

We present an analysis of the effect of aerosol forward scattering on the accuracy of aerosol optical depth (AOD) measured by CIMEL Sun photometers. The effect is quantified in terms of AOD and solar zenith angle using radiative transfer modeling. The analysis is based on aerosol size distributions derived from multi-year climatologies of AERONET aerosol retrievals. The study shows that the modeled error is lower than AOD calibration uncertainty (0.01) for the vast majority of AERONET level 2 observations, ~99.53%. Only ~0.47% of the AERONET database corresponding mostly to dust aerosol with high AOD and low solar elevations has larger biases. We also show that observations with extreme reductions in direct solar irradiance do not contribute to level 2 AOD due to low Sun photometer digital counts below a quality control cutoff threshold.

AERONET↗

Improving Lidar Turbulence Estimates for Wind Energy

Remote sensing devices (e.g., lidars) are quickly becoming a cost-effective and reliable alternative to meteorological towers for wind energy applications. Although lidars can measure mean wind speeds accurately, these devices measure different values of turbulence intensity (TI) than an instrument on a tower. In response to these issues, a lidar TI error reduction model was recently developed for commercially available lidars. The TI error model first applies physics-based corrections to the lidar measurements, then uses machine-learning techniques to further reduce errors in lidar TI estimates. The model was tested at two sites in the Southern Plains where vertically profiling lidars were collocated with meteorological towers. Results indicate that the model works well under stable conditions but cannot fully mitigate the effects of variance contamination under unstable conditions. To understand how variance contamination affects lidar TI estimates, a new set of equations was derived in previous work to characterize the actual variance measured by a lidar. Terms in these equations were quantified using a lidar simulator and modeled wind field, and the new equations were then implemented into the TI error model.

17 WIND ENERGY↗

Behavior and mechanisms of Doppler wind lidar error in varying stability regimes

Abstract. Wind lidars are widespread and important tools in atmospheric observations. An intrinsic part of lidar measurement error is due to atmospheric variability in the remote-sensing scan volume. This study describes and quantifies the distribution of measurement error due to turbulence in varying atmospheric stability. While the lidar error model is general, we demonstrate the approach using large ensembles of virtual WindCube V2 lidar performing a profiling Doppler-beam-swinging scan in quasi-stationary large-eddy simulations (LESs) of convective and stable boundary layers. Error trends vary with the stability regime, time averaging of results, and observation height. A systematic analysis of the observation error explains dominant mechanisms and supports the findings of the empirical results. Treating the error under a random variable framework allows for informed predictions about the effect of different configurations or conditions on lidar performance. Convective conditions are most prone to large errors (up to 1.5 m s−1 in 1 Hz wind speed in strong convection), driven by the large vertical velocity variances in convective conditions and the high elevation angle of the scanning beams (62∘). Range-gate weighting induces a negative bias into the horizontal wind speeds near the surface shear layer (−0.2 m s−1 in the stable test case). Errors in the horizontal wind speed and direction computed from the wind components are sensitive to the background wind speed but have negligible dependence on the relative orientation of the instrument. Especially during low winds and in the presence of large errors in the horizontal velocity estimates, the reported wind speed is subject to a systematic positive bias (up to 0.4 m s−1 in 1 Hz measurements in strong convection). Vector time-averaged measurements can improve the behavior of the error distributions (reducing the 10 min wind speed error standard deviation to <0.3 m s−1 and the bias to <0.1 m s−1 in strong convection) with a predictable effectiveness related to the number of decorrelated samples in the time window. Hybrid schemes weighting the 10 min scalar- and vector-averaged lidar measurements are shown to be effective at reducing the wind speed biases compared to cup measurements in most of the simulated conditions, with time averages longer than 10 min recommended for best use in some unstable conditions. The approach in decomposing the error mechanisms with the help of the LES flow field could be extended to more complex measurement scenarios and scans.

17 WIND ENERGY↗

Effect of gyro verticality error on lateral autoland tracking performance for an inertially smoothed control law

The results of a simulation study performed to determine the effects of gyro verticality error on lateral autoland tracking and landing performance are presented. A first order vertical gyro error model was used to generate the measurement of the roll attitude feedback signal normally supplied by an inertial navigation system. The lateral autoland law used was an inertially smoothed control design. The effect of initial angular gyro tilt errors (2 deg, 3 deg, 4 deg, and 5 deg), introduced prior to localizer capture, were investigated by use of a small perturbation aircraft simulation. These errors represent the deviations which could occur in the conventional attitude sensor as a result of the maneuver-induced spin-axis misalinement and drift. Results showed that for a 1.05 deg per minute erection rate and a 5 deg initial tilt error, ON COURSE autoland control logic was not satisfied. Failure to attain the ON COURSE mode precluded high control loop gains and localizer beam path integration and resulted in unacceptable beam standoff at touchdown.

Thibodeaux, J. J.↗

Lunar Reconnaissance Orbiter Orbit Determination Accuracy Analysis

Results from operational OD produced by the NASA Goddard Flight Dynamics Facility for the LRO nominal and extended mission are presented. During the LRO nominal mission, when LRO flew in a low circular orbit, orbit determination requirements were met nearly 100% of the time. When the extended mission began, LRO returned to a more elliptical frozen orbit where gravity and other modeling errors caused numerous violations of mission accuracy requirements. Prediction accuracy is particularly challenged during periods when LRO is in full-Sun. A series of improvements to LRO orbit determination are presented, including implementation of new lunar gravity models, improved spacecraft solar radiation pressure modeling using a dynamic multi-plate area model, a shorter orbit determination arc length, and a constrained plane method for estimation. The analysis presented in this paper shows that updated lunar gravity models improved accuracy in the frozen orbit, and a multiplate dynamic area model improves prediction accuracy during full-Sun orbit periods. Implementation of a 36-hour tracking data arc and plane constraints during edge-on orbit geometry also provide benefits. A comparison of the operational solutions to precision orbit determination solutions shows agreement on a 100- to 250-meter level in definitive accuracy.

Gravitation↗