Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Backus Effect on a Perpendicular Errors in Harmonic Models of Real vs. Synthetic Data

Measurements of geomagnetic scalar intensity on a thin spherical shell alone are not enough to separate internal from external source fields; moreover, such scalar data are not enough for accurate modeling of the vector field from internal sources because of unmodeled fields and small data errors. Spherical harmonic models of the geomagnetic potential fitted to scalar data alone therefore suffer from well-understood Backus effect and perpendicular errors. Curiously, errors in some models of simulated 'data' are very much less than those in models of real data. We analyze select Magsat vector and scalar measurements separately to illustrate Backus effect and perpendicular errors in models of real scalar data. By using a model to synthesize 'data' at the observation points, and by adding various types of 'noise', we illustrate such errors in models of synthetic 'data'. Perpendicular errors prove quite sensitive to the maximum degree in the spherical harmonic expansion of the potential field model fitted to the scalar data. Small errors in models of synthetic 'data' are found to be an artifact of matched truncation levels. For example, consider scalar synthetic 'data' computed from a degree 14 model. A degree 14 model fitted to such synthetic 'data' yields negligible error, but amplifies 4 nT (rmss) added noise into a 60 nT error (rmss); however, a degree 12 model fitted to the noisy 'data' suffers a 492 nT error (rmms through degree 12). Geomagnetic measurements remain unaware of model truncation, so the small errors indicated by some simulations cannot be realized in practice. Errors in models fitted to scalar data alone approach 1000 nT (rmss) and several thousand nT (maximum).

Voorhies, C. V.↗

Kinetic isotope effects significantly influence intracellular metabolite 13 C labeling patterns and flux determination

Rigorous mathematical modeling of carbon-labeling experiments allows estimation of fluxes through the pathways of central carbon metabolism, yielding powerful information for basic scientific studies as well as for a wide range of applications. However, the mathematical models that have been developed for flux determination from 13 C labeling data have commonly neglected the influence of kinetic isotope effects on the distribution of 13 C label in intracellular metabolites, as these effects have often been assumed to be inconsequential. We have used measurements of the 13 C isotope effects on the pyruvate dehydrogenase enzyme from the literature to model isotopic fractionation at the pyruvate node and quantify the modeling errors expected to result from the assumption that isotope effects are negligible. We show that under some conditions kinetic isotope effects have a significant impact on the 13 C labeling patterns of intracellular metabolites, and the errors associated with neglecting isotope effects in 13 C-metabolic flux analysis models can be comparable in size to measurement errors associated with GC–MS. Thus, kinetic isotope effects must be considered in any rigorous assessment of errors in 13 C labeling data, goodness-of-fit between model and data, confidence intervals of estimated metabolic fluxes, and statistical significance of differences between estimated metabolic flux distributions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Theoretical computation of trace gases retrieval random error from measurements of high spectral resolution infrared sounder

The purpose of this paper is to demonstrate the trace gas profiling capabilities of future passive high spectral resolution (1 cm(exp -1) or better) infrared (600 to 2700 cm(exp -1)) satellite tropospheric sounders. These sounders, such as the grating spectrometer, Atmospheric InfRared Sounders (AIRS) (Chahine et al., 1990) and the interferometer, GOES High Resolution Interferometer Sounder (GHIS), (Smith et al., 1991) can provide these unique infrared spectra which enable us to conduct this analysis. In this calculation only the total random retrieval error component is presented. The systematic error components contributed by the forward and inverse model error are not considered (subject of further studies). The total random errors, which are composed of null space error (vertical resolution component error) and measurement error (instrument noise component error), are computed by assuming one wavenumber spectral resolution with wavenumber span from 1100 cm(exp -1) to 2300 cm(exp -1) (the band 600 cm(exp -1) to 1100 cm(exp -1) is not used since there is no major absorption of our three gases here) and measurement noise of 0.25 degree at reference temperature of 260 degree K. Temperature, water vapor, ozone and mixing ratio profiles of nitrous oxide, carbon monoxide and methane are taken from 1976 US Standard Atmosphere conditions (a FASCODE model). Covariance matrices of the gases are 'subjectively' generated by assuming 50 percent standard deviation of gaussian perturbation with respect to their US Standard model profiles. Minimum information and maximum likelihood retrieval solutions are used.

Huang, Hung-Lung↗

The Impact of All-Sky Hyperspectral Infrared Radiance Assimilation on the Simulation and Forecast of Hurricane Sally in GEOS

Hyperspectral infrared (IR) radiance observations have been one of the major data sources assimilated in the data assimilation system over the last 20 years. However, observations peaking in the lower and mid-troposphere are underutilized in clear-sky radiance data assimilation as the quality control procedure removes a significant portion of cloud-affected observations from the assimilation. To include these cloud-affected observations, one approach is to assimilate them directly under all-sky conditions. The framework for all-sky assimilation of hyperspectral IR radiance observations has been developed in GEOS. The preliminary evaluation of simulated cloud-affected IR observations has been conducted, along with the corresponding sensitivities with respect to all hydrometeors. The symmetric cloud effect has been used as a cloud proxy in the observation error modeling, providing a balanced representation that mitigates the discrepancies between observations and model simulations for IR all-sky assimilation. The observation errors vary for different cloud conditions and have been modeled as cloud amount dependent and inter-channel correlated. Preliminary evaluation of model simulations for IR all-sky assimilation indicates that the simulated brightness temperature tends to have broader structures and lacks small-scale details. Excessive clouds generated by the model are also observed. To address this issue, Hurricane Sally (2020), which formed near the Bahamas, is used as a case study. Several cloud overlap schemes and cloud lookup tables (LUTs), along with other important aspects of all-sky IR radiance assimilation, will be evaluated and tested, aiming to improve the impact on Hurricane Sally's simulation and forecast.

Wei Gu↗

Quasi-stationary Planetary Scale Waves in Modern Climate Models

We evaluate climate model simulations of geopotential height at the largest space-time scales, considering the first Fourier components (in longitude) of long-term climatological means. Quasi-stationary planetary scale waves emerge from this analysis. Variations of these waves are important components of climate change, for example associated with regional drought. Systematic examination of their long-term climatology provides context for understanding their evolution in time. We compare four reanalysis datasets with “historical runs” from the latest version of the Coupled Model Intercomparison Project (CMIP) and find general agreement, but we also identify model errors outside the range of both observational uncertainty and the uncertainty implied by interannual variability. Errors in wave phase have possible implications for climate model projections of regional climate and of shifting weather patterns. One model in the set we examine, originally created nearly 20 years before the others, exhibits noticeably greater errors.

54 ENVIRONMENTAL SCIENCES↗

Machine‐learning‐based construction of barrier functions and models for safe model predictive control

Abstract In this paper, we propose a control Lyapunov‐barrier function‐based model predictive control method utilizing a feed‐forward neural network specified control barrier function (CBF) and a recurrent neural network (RNN) predictive model to stabilize nonlinear processes with input constraints, and to guarantee that safety requirements are met for all times. The nonlinear system is first modeled using RNN techniques, and a CBF is characterized by constructing a feed‐forward neural network (FNN) model with unique structures and properties. The FNN model for the CBF is trained based on data samples collected from safe and unsafe operating regions, and the resulting FNN model is verified to demonstrate that the safety properties of the CBF are satisfied. Given sufficiently small bounded modeling errors for both the FNN and the RNN models, the proposed control system is able to guarantee closed‐loop stability while preventing the closed‐loop states from entering unsafe regions in state‐space under sample‐and‐hold control action implementation. We provide the theoretical analysis for bounded unsafe sets in state‐space, and demonstrate the effectiveness of the proposed control strategy using a nonlinear chemical process example with a bounded unsafe region.

Chen, Scarlett↗

Data-assisted combustion simulations with dynamic submodel assignment using random forests

This investigation outlines a data-assisted approach that employs random forest classifiers for local and dynamic submodel assignment in turbulent-combustion simulations. This method is demonstrated in simulations of a single-element GOX/GCH4 rocket combustor; a priori as well as a posteriori assessments are conducted to (i) evaluate the accuracy and adjustability of the classifier for targeting different quantities of interest (QoIs), and (ii) assess improvements, resulting from the data-assisted combustion model assignment, in predicting target QoIs during simulation runtime. Results from the a priori study show that random forests, trained with local flow properties as input variables and combustion model errors as training labels, assign three different combustion models – finite-rate chemistry (FRC), flamelet progress variable (FPV) model, and inert mixing (IM) – with reasonable classification performance even when targeting multiple QoIs. Applications in a posteriori studies demonstrate improved predictions from data-assisted simulations, in temperature and CO mass fraction, when compared with monolithic FPV calculations. An additional a posteriori data-assisted simulation of a modified configuration demonstrates that the present approach can be successfully applied to different configurations, as long as thermophysical behavior can be represented by the training data. Furthermore, these results demonstrate that this data-driven framework holds promise for dynamic combustion submodel assignments in reacting flow simulations.

42 ENGINEERING↗

Impact of Seasonal Snow-Cover Change on the Observed and Simulated State of the Atmospheric Boundary Layer in a High-Altitude Mountain Valley

The structure and evolution of the atmospheric boundary layer (ABL) under clear-sky fair weather conditions over mountainous terrain is dominated by the diurnal cycle of the surface energy balance and thus strongly depends on surface snow cover. We use data from three passive ground-based infrared spectrometers deployed in the East River Valley in Colorado's Rocky Mountains to investigate the response of the thermal ABL structure to changes in surface energy balance during the seasonal transition from low to high snow cover. Temperature profiles were retrieved from the infrared radiances using the optimal estimation physical retrieval Tropospheric Remotely Observed Profiling via Optimal Estimation. A nocturnal surface inversion formed in the valley during clear-sky days, which was subsequently mixed out during daytime with the development of a convective boundary layer when snow cover was low. Over high snow cover, a very shallow convective boundary layer formed, above which the inversion persisted through the daytime hours. We compare these observations to NOAA's operational High-Resolution-Rapid-Refresh model and find large warm biases on clear-sky days resulting from the model's inability to form strong nocturnal inversions and to maintain the stable stratification in the valley during daytime when there was snow on the ground. We suggest several factors contributing to the large model errors. These are (a) the inability of the model to represent well-developed thermally driven flows likely due to the too coarse horizontal grid spacing (3 km), (b) too much convective mixing during daytime, and (c) too strong vertical coupling between the valley atmosphere and the free troposphere.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of column-averaged methane in models and TCCON with a focus on the stratosphere

The distribution of methane (CH 4 ) in the stratosphere can be a major driver of spatial variability in the dry-air column-averaged CH 4 mixing ratio (XCH 4 ), which is being measured increasingly for the assessment of CH 4 surface emissions. Chemistry-transport models (CTMs) therefore need to simulate the tropospheric and stratospheric fractional columns of XCH 4 accurately for estimating surface emissions from XCH 4 . Simulations from three CTMs are tested against XCH 4 observations from the Total Carbon Column Network (TCCON). We analyze how the model–TCCON agreement in XCH 4 depends on the model representation of stratospheric CH 4 distributions. Model equivalents of TCCON XCH 4 are computed with stratospheric CH 4 fields from both the model simulations and from satellite-based CH 4 distributions from MIPAS (Michelson Interferometer for Passive Atmospheric Sounding) and MIPAS CH 4 fields adjusted to ACE-FTS (Atmospheric Chemistry Experiment Fourier Transform Spectrometer) observations. Using MIPAS-based stratospheric CH 4 fields in place of model simulations improves the model–TCCON XCH 4 agreement for all models. For the Atmospheric Chemistry Transport Model (ACTM) the average XCH 4 bias is significantly reduced from 38.1 to 13.7 ppb, whereas small improvements are found for the models TM5 (Transport Model, version 5; from 8.7 to 4.3 ppb) and LMDz (Laboratoire de Météorologie Dynamique model with zooming capability; from 6.8 to 4.3 ppb). Replacing model simulations with MIPAS stratospheric CH 4 fields adjusted to ACE-FTS reduces the average XCH 4 bias for ACTM (3.3 ppb), but increases the average XCH 4 bias for TM5 (10.8 ppb) and LMDz (20.0 ppb). These findings imply that model errors in simulating stratospheric CH 4 contribute to model biases. Current satellite instruments cannot definitively measure stratospheric CH 4 to sufficient accuracy to eliminate these biases. Applying transport diagnostics to the models indicates that model-to-model differences in the simulation of stratospheric transport, notably the age of stratospheric air, can largely explain the inter-model spread in stratospheric CH 4 and, hence, its contribution to XCH 4 . Furthermore, it would be worthwhile to analyze how individual model components (e.g., physical parameterization, meteorological data sets, model horizontal/vertical resolution) impact the simulation of stratospheric CH 4 and XCH 4 .

54 ENVIRONMENTAL SCIENCES↗

Nonlinearities in spacecraft structural dynamics

In considering nonlinearities in spacecraft structural dynamics, the following are examined: (1) SCOLE Configuration-Equations of Motion; (2) Modeling Error Sources; (3) Approximate Solutions; (4) Comparison of Model Accuracy; (5) Linear and Nonlinear Damping; (6) Experimental Results; and, (7) Future Work.

Taylor, Larry↗

Comparison of Response Surface and Kriging Models in the Multidisciplinary Design of an Aerospike Nozzle

The use of response surface models and kriging models are compared for approximating non-random, deterministic computer analyses. After discussing the traditional response surface approach for constructing polynomial models for approximation, kriging is presented as an alternative statistical-based approximation method for the design and analysis of computer experiments. Both approximation methods are applied to the multidisciplinary design and analysis of an aerospike nozzle which consists of a computational fluid dynamics model and a finite element analysis model. Error analysis of the response surface and kriging models is performed along with a graphical comparison of the approximations. Four optimization problems are formulated and solved using both approximation models. While neither approximation technique consistently outperforms the other in this example, the kriging models using only a constant for the underlying global model and a Gaussian correlation function perform as well as the second order polynomial response surface models.

Simpson, Timothy W.↗

Comparison of Response Surface and Kriging Models for Multidisciplinary Design Optimization

In this paper, we compare and contrast the use of second-order response surface models and kriging models for approximating non-random, deterministic computer analyses. After reviewing the response surface method for constructing polynomial approximations, kriging is presented as an alternative approximation method for the design and analysis of computer experiments. Both methods are applied to the multidisciplinary design of an aerospike nozzle which consists of a computational fluid dynamics model and a finite-element model. Error analysis of the response surface and kriging models is performed along with a graphical comparison of the approximations, and four optimization problems m formulated and solved using both sets of approximation models. The second-order response surface models and kriging models-using a constant underlying global model and a Gaussian correlation function-yield comparable results.

Simpson, Timothy W.↗

Models of Sector Flows Under Local, Regional and Airport Weather Constraints

Recently, the ATM community has made important progress in collaborative trajectory management through the introduction of a new FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). FAA can use CTOPs to manage air traffic under multiple constraints (manifested as flow constrained areas or FCAs) in the system, and it allows flight operators to indicate their preferences for routing and delay options. CTOPs also permits better management of the overall trajectory of flights by considering both routing and departure delay options simultaneously. However, adoption of CTOPs in airspace has been hampered by many factors that include challenges in how to identify constrained areas and how to set rates for the FCAs. Decision support tools providing assistance would be particularly helpful in effective use of CTOPs. Such DSTs tools would need models of demand and capacity in the presence of multiple constraints. This study examines different approaches to using historical data to create and validate models of maximum flows in sectors and other airspace regions in the presence of multiple constraints. A challenge in creating an empirical model of flows under multiple constraints is a lack of sufficient historical data that captures diverse situations involving combinations of multiple constraints especially those with severe weather. The approach taken here to deal with this is two-fold. First, we create a generalized sector model encompassing multiple sectors rather than individual sectors in order to increase the amount of data used for creating the model by an order of magnitude. Secondly, we decompose the problem so that the amount of data needed is reduced. This involves creating a baseline demand model plus a separate weather constrained flow reduction model and then composing these into a single integrated model. A nominal demand model is a flow model (gdem) in the presence of clear local weather. This defines the flow as a function of weather constraints in neighboring regions, airport constraints and weather in locations that can cause re-routes to the location of interest. A weather constrained flow reduction model (fwx-red) is a model of reduction in baseline counts as a function of local weather. Because the number of independent variables associated with each of the two decomposed models is smaller than that with a single model, need for amount of data is reduced. Finally, a composite model that combines these two can be represented as fwx-red (gdem(e), l) where e represents non-local constraints and l represents local weather. The approaches studied to developing these models are divided into three categories: (1) Point estimation models (2) Empirical models (3) Theoretical models. Errors in predictions of these different types of models have been estimated. In situations when there is abundant data, point estimation models tend to be very accurate. In contrast, empirical models do better than theoretical models when there is some data available. The biggest benefit of theoretical models is their general applicability in wider range situations once the degree of accuracy of these has been established.

Kulkarni, Deepak↗

Models of Sector Aircraft Counts in the Presence of Local, Regional and Airport Constraints

Recently, the ATM community has made important progress in collaborative trajectory management through the introduction of a new FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). FAA can use CTOPs to manage air traffic under multiple constraints (manifested as flow constrained areas or FCAs) in the system, and it allows flight operators to indicate their preferences for routing and delay options. CTOPs also permits better management of the overall trajectory of flights by considering both routing and departure delay options simultaneously. However, adoption of CTOPs in airspace has been hampered by many factors that include challenges in how to identify constrained areas and how to set rates for the FCAs. Decision support tools providing assistance would be particularly helpful in effective use of CTOPs. Such DSTs tools would need models of demand and capacity in the presence of multiple constraints. This study examines different approaches to using historical data to create and validate models of maximum flows in sectors and other airspace regions in the presence of multiple constraints. A challenge in creating an empirical model of flows under multiple constraints is a lack of sufficient historical data that captures diverse situations involving combinations of multiple constraints especially those with severe weather. The approach taken here to deal with this is two-fold. First, we create a generalized sector model encompassing multiple sectors rather than individual sectors in order to increase the amount of data used for creating the model by an order of magnitude. Secondly, we decompose the problem so that the amount of data needed is reduced. This involves creating a baseline demand model plus a separate weather constrained flow reduction model and then composing these into a single integrated model. A nominal demand model is a flow model (gdem) in the presence of clear local weather. This defines the flow as a function of weather constraints in neighboring regions, airport constraints and weather in locations that can cause re-routes to the location of interest. A weather constrained flow reduction model (fwx-red) is a model of reduction in baseline counts as a function of local weather. Because the number of independent variables associated with each of the two decomposed models is smaller than that with a single model, need for amount of data is reduced. Finally, a composite model that combines these two can be represented as fwx-red (gdem(e), l) where e represents non-local constraints and l represents local weather. The approaches studied to developing these models are divided into three categories: (1) Point estimation models (2) Empirical models (3) Theoretical models. Errors in predictions of these different types of models have been estimated. In situations when there is abundant data, point estimation models tend to be very accurate. In contrast, empirical models do better than theoretical models when there is some data available. The biggest benefit of theoretical models is their general applicability in wider range situations once the degree of accuracy of these has been established.

Kulkarni, Deepak↗

Attribution of multi-annual to decadal changes in the climate system: The Large Ensemble Single Forcing Model Intercomparison Project (LESFMIP)

Multi-annual to decadal changes in climate are accompanied by changes in extreme events that cause major impacts on society and severe challenges for adaptation. Early warnings of such changes are now potentially possible through operational decadal predictions. However, improved understanding of the causes of regional changes in climate on these timescales is needed both to attribute recent events and to gain further confidence in forecasts. Here we document the Large Ensemble Single Forcing Model Intercomparison Project that will address this need through coordinated model experiments enabling the impacts of different external drivers to be isolated. We highlight the need to account for model errors and propose an attribution approach that exploits differences between models to diagnose the real-world situation and overcomes potential errors in atmospheric circulation changes. The experiments and analysis proposed here will provide substantial improvements to our ability to understand near-term changes in climate and will support the World Climate Research Program Lighthouse Activity on Explaining and Predicting Earth System Change.

decadal climate↗

SU-E-J-234: Application of a Breathing Motion Model to ViewRay Cine MR Images

Purpose: A respiratory motion model previously used to generate breathing-gated CT images was used with cine MR images. Accuracy and predictive ability of the in-plane models were evaluated. Methods: Sagittalplane cine MR images of a patient undergoing treatment on a ViewRay MRI/radiotherapy system were acquired before and during treatment. Images were acquired at 4 frames/second with 3.5 × 3.5 mm resolution and a slice thickness of 5 mm. The first cine frame was deformably registered to following frames. Superior/inferior component of the tumor centroid position was used as a breathing surrogate. Deformation vectors and surrogate measurements were used to determine motion model parameters. Model error was evaluated and subsequent treatment cines were predicted from breathing surrogate data. A simulated CT cine was created by generating breathing-gated volumetric images at 0.25 second intervals along the measured breathing trace, selecting a sagittal slice and downsampling to the resolution of the MR cines. A motion model was built using the first half of the simulated cine data. Model accuracy and error in predicting the remaining frames of the cine were evaluated. Results: Mean difference between model predicted and deformably registered lung tissue positions for the 28 second preview MR cine acquired before treatment was 0.81 +/− 0.30 mm. The model was used to predict two minutes of the subsequent treatment cine with a mean accuracy of 1.59 +/− 0.63 mm. Conclusion: Inplane motion models were built using MR cine images and evaluated for accuracy and ability to predict future respiratory motion from breathing surrogate measurements. Examination of long term predictive ability is ongoing. The technique was applied to simulated CT cines for further validation, and the authors are currently investigating use of in-plane models to update pre-existing volumetric motion models used for generation of breathing-gated CT planning images.

60 APPLIED LIFE SCIENCES↗

Cloud Influence on ERA5 and AMPS Surface Downwelling Longwave Radiation Biases in West Antarctica

The surface downwelling longwave radiation component (LW[down arrow]) is crucial for the determination of the surface energy budget and has significant implications for the resilience of ice surfaces in the polar regions. Accurate model evaluation of this radiation component requires knowledge about the phase, vertical distribution, and associated temperature of water in the atmosphere, all of which control the LW[down arrow] signal measured at the surface. In this study, we examine the LW[down arrow] model errors found in the Antarctic Mesoscale Prediction System (AMPS) operational forecast model and the ERA5 reanalysis model relative to observations from the AWARE campaign at McMurdo Station and the West Antarctic Ice Sheet (WAIS) Divide. The errors are calculated separately for observed clear-sky conditions, ice-cloud occurrences, and liquid-bearing cloud layer (LBCL) occurrences. The analysis results show a tendency in both models at each site to underestimate the LW[down arrow] during clear sky conditions, high error variability (standard deviations > 20 W/m[exp2]) during any type of cloud occurrence, and negative LW biases when LBCLs are observed (bias magnitudes > 15 W/m[exp2] in tenuous LBCL cases; > 43 W/m[exp2] in optically thick/opaque LBCLs instances). We suggest that a generally dry and liquid-deficient atmosphere responsible for the identified LW[down arrow] biases in both models is the result of excessive ice formation and growth, which could stem from model initial and lateral boundary conditions, microphysics scheme, aerosol representation, and/or limited vertical resolution.

Israel Silber↗

Structural error and identifiability

In most identification problems, the possibility of identifying a model from the observation of input and output is approached by first assuming that the model is an exact representation of the process. Since models are only approximations to a real process, this paper presents a concrete way of taking into account the difference in structure between the model and the process it represents. The identifiability problem is reformulated on the basis of equivalence and near-equivalence between model and process. Necessary and sufficient conditions under which the differences between the outputs of the process and a model remains within a desired bound in the presence of modeling error are given. Necessary and sufficient conditions for the identifiability of parameters are presented.

Hadaegh, F. Y.↗