Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Robust Controller Synthesis for Vision-based Spacecraft Guidance and Control

This work develops a method for Robust Controller for Vision-based Spacecraft (RCVS) guidance and control, integral to the robust autonomy framework for multi-spacecraft for- mation control and reconfiguration applications. The method is built around the use of a photo-realistic simulator, where a camera is deployed on a tracking spacecraft (ego) in order to observe an uncontrolled spacecraft (target) in a Low Earth Orbit (LEO). In this direction, the proposed approach performs the relative state (attitude and position) estimation of the target spacecraft using Convolutional Neural Network (CNN). The state estimation error is then modeled and the corresponding error-bounds are obtained around a nominal trajectory of the ego and target spacecraft. Next, this work proposes a linear matrix inequalities (LMIs) based approach to controller synthesis, guaranteed to be robust against both model uncertainties and measurement errors, resulting from vision-based estimation. This controller is comprised of two distinct components, one synthesized based on the nominal trajectory, while the “robust” component corrects for deviations from the nominal trajectory. Finally, a tracking scenario that directly utilize the image data for spacecraft guidance and control, is presented to showcase the performance of the proposed robust autonomy framework.

Rahmani, Amir↗

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗

An Efficient Silent Data Corruption Detection Method with Error-Feedback Control and Even Sampling for HPC Applications

The silent data corruption (SDC) problem is attracting more and more attentions because it is expected to have a great impact on exascale HPC applications. SDC faults are hazardous in that they pass unnoticed by hardware and can lead to wrong computation results. In this work, we formulate SDC detection as a runtime one-step-ahead prediction method, leveraging multiple linear prediction methods in order to improve the detection results. The contributions are twofold: (1) we propose an error feedback control model that can reduce the prediction errors for different linear prediction methods, and (2) we propose a spatial-data-based even-sampling method to minimize the detection overheads (including memory and computation cost). We implement our algorithms in the fault tolerance interface, a fault tolerance library with multiple checkpoint levels, such that users can conveniently protect their HPC applications against both SDC errors and fail-stop errors. We evaluate our approach by using large-scale traces from well-known, large-scale HPC applications, as well as by running those HPC applications on a real cluster environment. Experiments show that our error feedback control model can improve detection sensitivity by 34-189% for bit-flip memory errors injected with the bit positions in the range [20,30], without any degradation on detection accuracy. Furthermore, memory size can be reduced by 33% with our spatial-data even-sampling method, with only a slight and graceful degradation in the detection sensitivity.

Di, Sheng↗

Sampling Versus Filtering in Large-Eddy Simulations

A LES formalism in which the filter operator is replaced by a sampling operator is proposed. The unknown quantities that appear in the LES equations originate only from inadequate resolution (Discretization errors). The resulting viewpoint seems to make a link between finite difference approaches and finite element methods. Sampling operators are shown to commute with nonlinearities and to be purely projective. Moreover, their use allows an unambiguous definition of the LES numerical grid. The price to pay is that sampling never commutes with spatial derivatives and the commutation errors must be modeled. It is shown that models for the discretization errors may be treated using the dynamic procedure. Preliminary results, using the Smagorinsky model, are very encouraging.

Debliquy, O.↗

SU-E-T-377: Inaccurate Positioning Might Introduce Significant MapCheck Calibration Error in Flatten Filter Free Beams

Purpose: This study investigates the calibration error of detector sensitivity for MapCheck due to inaccurate positioning of the device, which is not taken into account by the current commercial iterative calibration algorithm. We hypothesize the calibration is more vulnerable to the positioning error for the flatten filter free (FFF) beams than the conventional flatten filter flattened beams. Methods: MapCheck2 was calibrated with 10MV conventional and FFF beams, with careful alignment and with 1cm positioning error during calibration, respectively. Open fields of 37cmx37cm were delivered to gauge the impact of resultant calibration errors. The local calibration error was modeled as a detector independent multiplication factor, with which propagation error was estimated with positioning error from 1mm to 1cm. The calibrated sensitivities, without positioning error, were compared between the conventional and FFF beams to evaluate the dependence on the beam type. Results: The 1cm positioning error leads to 0.39% and 5.24% local calibration error in the conventional and FFF beams respectively. After propagating to the edges of MapCheck, the calibration errors become 6.5% and 57.7%, respectively. The propagation error increases almost linearly with respect to the positioning error. The difference of sensitivities between the conventional and FFF beams was small (0.11 ± 0.49%). Conclusion: The results demonstrate that the positioning error is not handled by the current commercial calibration algorithm of MapCheck. Particularly, the calibration errors for the FFF beams are ~9 times greater than those for the conventional beams with identical positioning error, and a small 1mm positioning error might lead to up to 8% calibration error. Since the sensitivities are only slightly dependent of the beam type and the conventional beam is less affected by the positioning error, it is advisable to cross-check the sensitivities between the conventional and FFF beams to detect potential calibration errors due to inaccurate positioning. This work was partially supported by a DOD Grant No.; DOD W81XWH1010862.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach

Training an effective deep learning model to learn ocean processes involves careful choices of various hyperparameters. We leverage DeepHyper’s advanced search algorithms for multiobjective optimization, streamlining the development of neural networks tailored for ocean modeling. The focus is on optimizing Fourier neural operators (FNOs), a data-driven model capable of simulating complex ocean behaviors. Selecting the correct model and tuning the hyperparameters are challenging tasks, requiring much effort to ensure model accuracy. DeepHyper allows efficient exploration of hyperparameters associated with data preprocessing, FNO architecture-related hyperparameters, and various model training strategies. We aim to obtain an optimal set of hyperparameters leading to the most performant model. Moreover, on top of the commonly used mean squared error for model training, we propose adopting the negative anomaly correlation coefficient as the additional loss term to improve model performance and investigate the potential trade-off between the two terms. The numerical experiments show that the optimal set of hyperparameters enhanced model performance in single timestepping forecasting and greatly exceeded the baseline configuration in the autoregressive rollout for long-horizon forecasting up to 30 days. Utilizing DeepHyper, we demonstrate an approach to enhance the use of FNO in ocean dynamics forecasting, offering a scalable solution with improved precision.

97 MATHEMATICS AND COMPUTING↗

Parametric Cost Modeling of Space Missions Using the Develop New Projects (DMP) Implementation Process

This paper presents an overview of a parametric cost model that has been built at JPL to estimate costs of future, deep space, robotic science missions. Due to the recent dramatic changes in JPL business practices brought about by an internal reengineering effort known as develop new products (DNP), high-level historic cost data is no longer considered analogous to future missions. Therefore, the historic data is of little value in forecasting costs for projects developed using the DNP process. This has lead to the development of an approach for obtaining expert opinion and also for combining actual data with expert opinion to provide a cost database for future missions. In addition, the DNP cost model has a maximum of objective cost drivers which reduces the likelihood of model input error. Version 2 is now under development which expands the model capabilities, links it more tightly with key design technical parameters, and is grounded in more rigorous statistical techniques. The challenges faced in building this model will be discussed, as well as it's background, development approach, status, validation, and future plans.

Rosenberg, Leigh↗

Comparisons of Two Spatial Implementations of a Crop Model Using Remotely Sensed Observations over Southeastern United States

Global food security is one of the most pressing issues of the current century, particularly for developing nations. Agricultural simulation models can be a key component in testing new technologies, seeds and cultivars etc. However, inaccurate input information, model related errors and the mode of implementation can also add to model uncertainties. In this study, the crop model is implemented in two separate fashions: a)gridded (GriDSSAT model) and b) using random spatial ensembles (RHEAS model). This is done in the Southeastern US to evaluate and understand the modelperformance over a region data availabilities. Once the model performance is assessed, multiple satellite based earth observation parameters such as soil moisture, vegetation index etc. can be assimilated into crop models to reduce input and model related uncertainties particularly in data limited regions. In this study, the National Agricultural Statistical Services (NASS) reported yield data at county levels are used for comparison andvalidation purposes. The GriDSSAT model estimation of corn yields in comparison with the reported NASS yields showed an overall RMSD of nearly 3720 (kg/ha) whereas RMSD for the RHEAS model implementation was 3550 (kg/ha). Overall the GriDSSAT model had negative bias of nearly 2400 kg/ha (except for 2013) while RHEAS had a slight positive bias of 400 kg/ha (approx.).

SERVIR↗

TPSAS-NF1676L-17931-DND

Many geophysical variables including temperature, clouds, and precipitation exhibit robust diurnal cycles in response to the daily cycle of solar insolation. Due to the fundamental nature of this variability, it is critical that weather and climate models accurately represent the diurnal cycle. Numerical model, however, have difficulty reproducing this observed diurnal cycle behavior, which leads to systematic errors in model representation of earth energy budget terms: including TOA and surface radiation, precipitation, and surface latent and sensible heat fluxes. This study evaluates the regional diurnal cycle in the Tropics within reanalysis models (ERA-Interim and MERRA) and quantifies systematic errors in the simulated TOA flux and precipitation due to biases in the diurnal cycle representation. The focus of this study is to quantify the importance of diurnal cycle simulation to systematic bias in reanalysis data set climatologies.

Patrick C Taylor↗

Case study: Accounting for response measurement error in fitting a regression model

This article presents a case study motivated by a plot of data that suggested an emerging trend that the authors were faced with explaining. When the measurement error of the data is accounted for, it turns out there was no real trend. Furthermore, this article shows how to use a Bayesian modeling approach to account for the measurement error.

42 ENGINEERING↗

A Reduced Dimension Static, Linearized Kalman Filter and Smoother

An approximate Kalman filter and smoother, based on approximations of the state estimation error covariance matrix, is described. Approximations include a reduction of the effective state dimension, use of a static asymptotic error limit, and a time-invariant linearization of the dynamic model for error integration. The approximations lead to dramatic computational savings in applying estimation theory to large complex systems. Examples of use come from TOPEX/POSEIDON.

Kalman filter smoother modeling ocean simulation↗

NCAR CCM2 simulation of the modern Antarctic climate

The National Center for Atmospheric Research (NCAR) community climate model version 2 (CCM2) simulation of the circumpolar trough, surface air temperature, the polar vortex, cloudiness, winds, and atmospheric moisture and energy budgets are examined to validate the model's representation of the present-day Antarctic climate. The results show that the CCM2 can well simulate many important climate features over Antarctica, such as the location and intensity of the circumpolar trough, the coreless winter over the plateau, the intensity and horizontal distribution of the surface inversion, the speed and streamline pattern of the katabatic winds, the double jet stream feature over the southern Indian and Pacific oceans, and the arid climate over the continent. However, there are also some serious errors in the model. Some are due to old problems but some are caused by the new parameterizations in the model. The model errors over high southern latitudes can be summarized as follows: The circumpolar trough, the polar vertex, and the westerlies in midlatitudes are too strong; the semiannual cycle of the circumpolar trough is distorted compared to the observations; the low centers of the circumpolar trough and the troughs in the middle and upper troposphere are shifted eastward by 15 deg - 40 deg longitude; the surface temperatures are too cold over the plateau in summer and over the coastline in winter; the polar tropopause continues to have a cold bias; and the cloudiness is too high over the continent. These biases are induced by two major factors: (1) the cloud optical properties in tropical and middle latitudes, which cause the eastward shift of troughs and surface low centers and the error in the semiannual cycle, and (2) the cold bias of the surface air temperature, which is attributed to the oversimulation of cloudiness over the continent, especially during summer, and the uniform 2-m-thick sea ice. The constant thickness of sea ice suppresses the energy flux from the ocean to the atmosphere and hence reduces the air temperature near the coast during winter. Finally, although the simulated Antarctic climate still suffers these biases, the overall performance of the CCM2 is much better than that of the CCM1-T42. Therefore the CCM2 is good enough to be used for climate change studies, especially over Antarctica.

Tzeng, Ren-Yow↗

Error Reduction Methods for Integrated-path Differential-absorption Lidar Measurements

We report new modeling and error reduction methods for differential-absorption optical-depth (DAOD) measurements of atmospheric constituents using direct-detection integrated-path differential-absorption lidars. Errors from laser frequency noise are quantified in terms of the line center fluctuation and spectral line shape of the laser pulses, revealing relationships verified experimentally. A significant DAOD bias is removed by introducing a correction factor. Errors from surface height and reflectance variations can be reduced to tolerable levels by incorporating altimetry knowledge and "log after averaging", or by pointing the laser and receiver to a fixed surface spot during each wavelength cycle to shorten the time of "averaging before log".

averging before log↗

Integrated Sensing and Controls for Coal Gasification - Development of Model-Based Controls for GE's Gasifier and Syngas Cooler (Final Technical Report)

This report summarizes the achievements and final results of this program. The objective of this program is to develop a comprehensive systems approach to integrated design of sensing and control systems for an Integrated Gasification Combined Cycle (IGCC) plant, using advanced model-based techniques. In particular, this program is focused on the model-based sensing and control system design for the core gasification section of an IGCC plant. The overall approach consists of (i) developing a first-principles physics-based dynamic model of the gasification section, (ii) performing model-reduction where needed to derive low-order models suitable for controls analysis and design, (iii) developing a sensing system solution combining online sensors with model-based estimation for important process variables not measured directly, and (iv) optimizing the steady-state and transient operation of the plant for normal operation as well as for startup using model predictive controls (MPC). Initially, available process unit models were implemented in a common platform using Matlab/Simulink{reg_sign}, and appropriate model reduction and model updates were performed to obtain the overall gasification section dynamic model. Also, a set of sensor packages were developed through extensive lab testing and implemented in the Tampa Electric Company IGCC plant at Polk power station in 2009, to measure temperature and strain in the radiant syngas cooler (RSC). Plant operation data was also used to validate the overall gasification section model. The overall dynamic model was then used to develop a sensing solution including a set of online sensors coupled with model-based estimation using nonlinear extended Kalman filter (EKF). Its performance in terms of estimating key unmeasured variables like gasifier temperature, carbon conversion, etc., was studied through extensive simulations in the presence sensing errors (noise and bias) and modeling errors (e.g. unknown gasifier kinetics, RSC fouling). In parallel, an MPC solution was initially developed using ideal sensing to optimize the plant operation during startup pre-heating as well as steady state and transient operation under normal high-pressure conditions, e.g. part-load, base-load, load transition and fuel changes. The MPC simulation studies showed significant improvements both for startup pre-heating and for normal operation. Finally, the EKF and MPC solutions were coupled to achieve the integrated sensing and control solution and its performance was studied through extensive steady state and transient simulations in the presence of sensor and modeling errors. The results of each task in the program and overall conclusions are summarized in this final report.

01 COAL, LIGNITE, AND PEAT↗

Explaining Multimodal Deceptive News Prediction Models

Social media plays a valuable role in rapid news dissemination, but it also serves as a vehicle to propagate unverified information. For example, news shared on Facebook or Twitter may actually contain disinformation, propaganda, hoaxes, conspiracies, clickbait or satire. This paper presents an in-depth analysis of the behavior of suspicious news classification models including error analysis and prediction confidence. We consider five deep learning architectures that leverage combinations of text, linguistic and image input signals from tweets. The behavior of these models is analyzed across four suspicious news prediction tasks. Our findings include that models leveraging only the text of tweets outperform those leveraging only the image (by 3-13% absolute in F-measure), and that models that combine image and text signals with linguistic cues e.g., biased and subjective language markers can, but do not always, perform even better. Finally, our main contribution is a series of analyses, in which we characterize text and image traits of our classes of suspicious news and analyze patterns of errors made by the various models to inform the design of future deceptive news prediction models.

deep learning, social media, deception↗

Model Test Bed for Evaluating Unstructured-Grid Wave Models for Resource Assessment and Characterization

Recent development of unstructured-grid wave models demonstrates the advantage of using an unstructured-grid modeling framework in wave modeling, especially in coastal areas that have complex coastlines, islands, shallow-water bays, and estuaries. This study evaluated the performance of unstructured-grid models in comparison to structured-grid models for predicting the IEC wave energy resource parameters at a common test bed site. Model skill was assessed using a set of model performace error statistics. Sensitivity of open boundary conditions and ]wind forcing on model results, computational efficiency, and the advantage and limitation of the unstructured-grid model are summarized in the report.

16 TIDAL AND WAVE POWER↗

Evaluation of Thompson-type trend and monthly weather data models for corn yields in Iowa, Illinois, and Indiana

An evaluation was made of Thompson-Type models which use trend terms (as a surrogate for technology), meteorological variables based on monthly average temperature, and total precipitation to forecast and estimate corn yields in Iowa, Illinois, and Indiana. Pooled and unpooled Thompson-type models were compared. Neither was found to be consistently superior to the other. Yield reliability indicators show that the models are of limited use for large area yield estimation. The models are objective and consistent with scientific knowledge. Timely yield forecasts and estimates can be made during the growing season by using normals or long range weather forecasts. The models are not costly to operate and are easy to use and understand. The model standard errors of prediction do not provide a useful current measure of modeled yield reliability.

French, V.↗

Analysis of shuttle oscillation in the Mach Number = 1.7 to Mach Number = 1.0 range

The first five flights of the Space Transportation System (STS) have exhibited unexpected lateral oscillations in the Mach Number = 1.7 to Mach Number = 1.0 region of the descent trajectory. These oscillations can be split into two parts: a predominantly rolling oscillation referred to as the quarter hertz motion and a long-priod, large-amplitude oscillation in sideslips, roll rate, and yaw rate. These motions are analyzed in this paper in order to determine their source and the mechanism driving them. They will first be examined to determine how much of the motion can be explained using the set of equations that contain linear aerodynamic parameters. Then differences between measured moments and those calculated using linear aerodynamics which are considered to be due to unmodeled moments will be exained. Possible error sources such as not inluding nonlinear aerodynamics in the vehicle model, measurement errors, and the effect of pressure gradients will be considered. Based on these analyses, conclusions as to the nature and cause of the Shuttle lateral oscillations will be drawn.

Suit, W. T.↗