Search NASA⌕ Search

SEARCH · Search NASA

Results for “error modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Developing a Radar Signal Simulator for the Community Radiative Transfer Model

Active radar instruments provide vertically resolved clouds and precipitation measurements that cannot be provided by the passive instruments. These active measurements are not conventionally assimilated into the data assimilation systems because of the lack of fast forward radiative transfer models and also difficulties in the error modelling of the measurements. This paper describes the development, evaluation, and sensitivity analysis for a forward radar model implemented in the Community Radiative Transfer Model (CRTM). The scattering properties required by the forward model are provided by the hydrometeor lookup tables that were generated using the discrete dipole approximation. The model is able to calculate both the reflectivity and the attenuated reflectivity for any given radar instrument at any given zenith angles as long as CRTM instrument specific coefficients are available. The evaluation using CloudSat measurements shows a very good agreement between the simulations and measurements as long as the input profiles of hydrometeors are consistent with the measured reflectivity profiles. Major sources contributing to the differences between the measured and simulated reflectivities are input hydrometeor profiles, scattering lookup tables, lack of melting layer in the forward model, CRTM scattering solvers, and attenuation calculations. In addition to the forward model, both Tangent Linear and Adjoint of the model are also implemented and tested within CRTM. These components may be required by some data assimilation systems for the assimilation of radar measurements.

radar↗

The Badhwar-O'Neill 2020 Model

The Badhwar-O'Neill (BON) model has been used for some time to describe the galactic cosmic ray (GCR) environment encountered in deep space by astronauts and sensitive electronics. The most recent version of the model, BON2014, was calibrated to available measurements to reduce model errors for particles and energies of significance to astronaut exposure. Although subsequent studies showed the model to be reasonably accurate for such applications, modifications to the sunspot number (SSN) classification system and a large number of new high precision measurements suggested the need to develop an improved and more capable model. In this work, the BON2020 model is described. The new model relies on daily integral flux from the Advanced Composition Explorer Cosmic Ray Isotope Spectrometer (ACE/CRIS) to describe solar activity. For time periods not covered by ACE/CRIS, the updated international SSN database is used. Parameters in the new model are calibrated to available data, which includes the new Alpha Magnetic Spectrometer (AMS-02) and Payload for Antimatter Matter Exploration and Light-nuclei Astrophysics (PAMELA) high-precision measurements. It is found that the BON2020 model is a significant improvement over BON2014. Systematic errors associated with BON2014 have been removed. The average relative error of the BON2020 model compared to all available measurements is found to be <1%, and BON2020 is found to be within ±15% of a large fraction of the available measurements (26,269 of 27,646 → 95%).

Slaba, Tony C.↗

The Badhwar-O'Neill 2020 Model

The Badhwar-O’Neill (BON) model has been used for some time to describe the galactic cosmic ray (GCR) environment encountered in deep space by astronauts and sensitive electronics. The most recent version of the model, BON2014, was calibrated to available measurements to reduce model errors for particles and energies of significance to astronaut exposure. Although subsequent studies showed the model to be reasonably accurate for such applications, modifications to the sunspot number (SSN) classification system and a large number of new high-precision measurements suggested the need to develop an improved and more capable model. In this work, the BON2020 model is described. The new model relies on daily integral flux from the Advanced Composition Explorer Cosmic Ray Isotope Spectrometer (ACE/CRIS) to describe solar activity. For time periods not covered by ACE/CRIS, the updated international SSN database is used. Parameters in the new model are calibrated to available data, which includes the new Alpha Magnetic Spectrometer (AMS-02) and Payload for Antimatter Matter Exploration and Light-nuclei Astrophysics (PAMELA) high-precision measurements. It is found that the BON2020 model is a significant improvement over BON2014. Systematic errors associated with BON2014 have been removed. The average relative error of the BON2020 model compared to all available measurements is found to be <1%, and BON2020 is found to be within +15% of a large fraction of the available measurements (26,269 of 27,646  95%.

T C Slaba↗

Deep Learning for Multigroup Cross-Section Representation in Two-Step Core Calculations

Here we investigate using deep learning, a type of machine-learning algorithm employing multiple layers of artificial neurons, for the mathematical representation of multigroup cross sections for use in the Griffin reactor multiphysics code for two-step deterministic neutronics calculations. A three-dimensional fuel element typical of a high-temperature gas reactor as well as a two-dimensional sodium-cooled fast reactor lattice are modeled using the Serpent Monte Carlo code, and multigroup macroscopic cross sections are generated for various state parameters to produce a training data set and a separate validation data set. A fully connected, feedforward neural network is trained using the open-source PyTorch machine-learning framework, and its accuracy is compared against the standard piecewise linear interpolation model. Additionally, we provide in this work a generic technique for propagating the cross-section model errors up to the k eff using sensitivity coefficients with the first-order uncertainty propagation rule. Quantifying the eigenvalue error due to the cross-section regression errors is especially practical for appropriately selecting the mathematical representation of the cross sections. We demonstrate that the artificial neural network model produces lower errors and therefore enables better accuracy relative to the piecewise linear model when the cross sections exhibit nonlinear dependencies; especially when a coarse grid is employed, where the errors can be halved by the artificial neural network. However, for linearly dependent multigroup cross sections as found for the sodium-cooled fast reactor case, a simpler linear regression outperforms deeper networks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Fast and Efficient Version of the TwO-Moment Aerosol Sectional (TOMAS) Global Aerosol Microphysics Model

This study develops more computationally efficient versions of the TwO-Moment Aerosol Sectional (TOMAS) microphysics algorithms, collectively called Fast TOMAS. Several methods for speeding up the algorithm were attempted, but only reducing the number of size sections was adopted. Fast TOMAS models, coupled to the GISS GCM II-prime, require a new coagulation algorithm with less restrictive size resolution assumptions but only minor changes in other processes. Fast TOMAS models have been evaluated in a box model against analytical solutions of coagulation and condensation and in a 3-D model against the original TOMAS (TOMAS-30) model. Condensation and coagulation in the Fast TOMAS models agree well with the analytical solution but show slightly more bias than the TOMAS-30 box model. In the 3-D model, errors resulting from decreased size resolution in each process (i.e., emissions, cloud processing wet deposition, microphysics) are quantified in a series of model sensitivity simulations. Errors resulting from lower size resolution in condensation and coagulation, defined as the microphysics error, affect number and mass concentrations by only a few percent. The microphysics error in CN70CN100 (number concentrations of particles larger than 70100 nm diameter), proxies for cloud condensation nuclei, range from 5 to 5 in most regions. The largest errors are associated with decreasing the size resolution in the cloud processing wet deposition calculations, defined as cloud-processing error, and range from 20 to 15 in most regions for CN70CN100 concentrations. Overall, the Fast TOMAS models increase the computational speed by 2 to 3 times with only small numerical errors stemming from condensation and coagulation calculations when compared to TOMAS-30. The faster versions of the TOMAS model allow for the longer, multi-year simulations required to assess aerosol effects on cloud lifetime and precipitation.

Lee, Yunha↗

Similarity Metrics for Closed Loop Dynamic Systems

To what extent and in what ways can two closed-loop dynamic systems be said to be "similar?" This question arises in a wide range of dynamic systems modeling and control system design applications. For example, bounds on error models are fundamental to the controller optimization with modern control design methods. Metrics such as the structured singular value are direct measures of the degree to which properties such as stability or performance are maintained in the presence of specified uncertainties or variations in the plant model. Similarly, controls-related areas such as system identification, model reduction, and experimental model validation employ measures of similarity between multiple realizations of a dynamic system. Each area has its tools and approaches, with each tool more or less suited for one application or the other. Similarity in the context of closed-loop model validation via flight test is subtly different from error measures in the typical controls oriented application. Whereas similarity in a robust control context relates to plant variation and the attendant affect on stability and performance, in this context similarity metrics are sought that assess the relevance of a dynamic system test for the purpose of validating the stability and performance of a "similar" dynamic system. Similarity in the context of system identification is much more relevant than are robust control analogies in that errors between one dynamic system (the test article) and another (the nominal "design" model) are sought for the purpose of bounding the validity of a model for control design and analysis. Yet system identification typically involves open-loop plant models which are independent of the control system (with the exception of limited developments in closed-loop system identification which is nonetheless focused on obtaining open-loop plant models from closed-loop data). Moreover the objectives of system identification are not the same as a flight test and hence system identification error metrics are not directly relevant. In applications such as launch vehicles where the open loop plant is unstable it is similarity of the closed-loop system dynamics of a flight test that are relevant.

Whorton, Mark S.↗

Listening to the Forest: An Artificial Neural Network‐Based Model of Carbon Uptake at Harvard Forest

Abstract The terrestrial biosphere strongly modulates atmospheric CO 2 mixing ratios, whose inexorable rise propels anthropogenic climate change. Modeling and mechanistically understanding C uptake by the terrestrial biosphere are thus of broad societal concerns. Yet despite considerable progress, scaling up point observations to landscape and larger scales continues to frustrate analyses of the anthropogenically perturbed global C cycle. While that up‐scaling is our overarching motivation, here we focus on one of its elements, modeling C uptake at a given site. We devise a novel artificial neural network (ANN)‐based model of C uptake at Harvard Forest that combines locally observed and remotely sensed variables. Most of our model predictors are those used by an established ecosystem C uptake model, the Vegetation Photosynthesis and Respiration Model (VPRM), easing comparisons. To those, we add observed cumulative antecedent precipitation and soil temperature. We find that model errors are much larger in winter, indicating that better understanding and modeling of respiration will likely discernibly improve model performance. Comparing the ANN and VPRM results reveals errors attributed to unrealistic treatment of temperature in the VPRM formulation, indicating that better representation of temperature dependencies is also likely to enhance model skill. By judiciously comparing VPRM and ANN errors we thus overcome ANNs' notoriety for concealing the mechanisms underlying their predictive skills. We demonstrate their ability to identify outstanding ecosystem science knowledge gaps and particularly fruitful corresponding model development directions, improving site specific and up‐scaling flux modeling and understanding of the climate impacts of the northern forest.

Eshel, Gidon↗

Integrated Nondestructive Assay Systems to Estimate Plutonium in Spent Fuel Assemblies

An integrated nondestructive assay (NDA) system combining active (neutron generator) and passive neutron detection and passive gamma (PG) detection is being analyzed in order to estimate the amount of plutonium, verify initial enrichment, burnup, and cooling time, and detect partial defects in a spent fuel assembly (SFA). Active signals are measured using the differential die-away (DDA), delayed neutron (DN), and delayed gamma (DG) techniques. Passive signals are measured using total neutron (TN) counts and both gross and spectral resolved gamma counts. To quantify how a system of several NDA techniques is expected to perform, all of the relevant NDA techniques listed above were simulated as a function of various reactor conditions such as initial enrichment, burnup, cooling time, assembly shuffling pattern, reactor operating conditions (including temperature, pressure, and the presence of burnable poisons) by simulating the NDA response for five sets of light water reactor assemblies. In this study, we compare the performance of several exploratory model-fitting options (including neural networks, adaptive regression with splines, iterative bias reduction smoothing, projection pursuit regression, and regression with quadratic terms and interaction terms) to relate data simulated with measurement and model error effects from various subsets of the NDA techniques to the total Pu mass. Isotope masses for SFAs and expected detector responses (DRs) for several NDA techniques are simulated using MCNP, and the DRs become inputs to the fitting process. Such responses include eight signals from DDA, one from DN, one from TN, and up to seven from PG; the DG signal will be examined separately. Results are summarized using the root-mean-squared estimation error for plutonium mass in held-out subsets of the data for a range of model and measurement error variances. Different simulation assumptions lead to different spent fuel libraries relating DRs to Pu mass. Some results for training with one library and testing with another library are also given.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Doppler-Lidar Evaluation of HRRR-Model Skill at Simulating Summertime Wind Regimes in the Columbia River Basin during WFIP2

Complex-terrain locations often have repeatable near-surface wind patterns, such as synoptic gap flows and local thermally forced flows. An example is the Columbia River Valley in east-central Oregon-Washington, a significant wind-energy-generation region and the site of the Second Wind-Forecast Improvement Project (WFIP2). Data from three Doppler lidars deployed during WFIP2 define and characterize summertime wind regimes and their large-scale contexts, and provide insight into NWP model errors by examining differences in the ability of a model [NOAA’s High-Resolution Rapid-Refresh (HRRR-version1)] to forecast wind-speed profiles for different regimes. Seven regimes were identified based on daily time series of the lidar-measured rotor-layer winds, which then suggested two broad categories. First, in three regimes the primary dynamic forcing was the large-scale pressure gradient. Second, in two regimes the dominant forcing was the diurnal heating-cooling cycle (regional sea-breeze-type dynamics), including the marine intrusion previously described, which generates strong nocturnal winds over the region. The other two included a hybrid regime and a non-conforming regime. For the large-scale pressure-gradient regimes, HRRR had wind-speed biases of ~1 m s -1 and RMSEs of 2-3 m s -1 . Errors were much larger for the thermally forced regimes, owing to the premature demise of the strong nocturnal flow in HRRR. Thus, the more dominant the role of surface heating in generating the flow, the larger the errors. Major errors could result from surface heating of the atmosphere, boundary-layer responses to that heating, and associated terrain interactions. Finally, measurement/modeling research programs should be aimed at determining which modeled processes produce the largest errors, so those processes can be improved and errors reduced.

17 WIND ENERGY↗

An analytic technique for statistically modeling random atomic clock errors in estimation

Minimum variance estimation requires that the statistics of random observation errors be modeled properly. If measurements are derived through the use of atomic frequency standards, then one source of error affecting the observable is random fluctuation in frequency. This is the case, for example, with range and integrated Doppler measurements from satellites of the Global Positioning and baseline determination for geodynamic applications. An analytic method is presented which approximates the statistics of this random process. The procedure starts with a model of the Allan variance for a particular oscillator and develops the statistics of range and integrated Doppler measurements. A series of five first order Markov processes is used to approximate the power spectral density obtained from the Allan variance.

Fell, P. J.↗

Modeling SMAP Spacecraft Attitude Control Estimation Error Using Signal Generation Model

Two ground simulation software are used to model the SMAP spacecraft dynamics. The CAST software uses a higher fidelity model than the ADAMS software. The ADAMS software models the spacecraft plant, controller and actuator models, and assumes a perfect sensor and estimator model. In this simulation study, the spacecraft dynamics results from the ADAMS software are used as CAST software is unavailable. The main source of spacecraft dynamics error in the higher fidelity CAST software is due to the estimation error. A signal generation model is developed to capture the effect of this estimation error in the overall spacecraft dynamics. Then, this signal generation model is included in the ADAMS software spacecraft dynamics estimate such that the results are similar to CAST. This signal generation model has similar characteristics mean, variance and power spectral density as the true CAST estimation error. In this way, ADAMS software can still be used while capturing the higher fidelity spacecraft dynamics modeling from CAST software.

Soil Moisture Active Passive↗

The Economic Impact of Battery Degradation Modelling Uncertainty

Battery energy storage systems (BESS) are used for a variety of applications, with their economic benefit often being the decisive factor for deployment. A multitude of physico-chemical aging mechanisms lead to capacity fade over a BESS life cycle. The models that are used to describe this capacity fade are prone to inherent model errors. Through a holistic techno-economic modelling approach, we investigate the impact of battery degradation modelling uncertainty on the economic benefit of representative BESS applications. Here, it is shown how improved parameter fit quality can reduce the resulting economic uncertainty. Furthermore, we highlight that the consideration of degradation modelling uncertainty is especially crucial when: (i) the cash flow highly depends on the available battery capacity, (ii) a fixed, e.g. warranty mandated, state of health limit acts as the threshold for battery end-of-life, (iii) long evaluation periods and low discount rates are the focus of economic evaluation.

aging↗

Performance-based earthquake early warning for tall buildings

The ShakeAlert Earthquake Early Warning (EEW) system aims to issue an advance warning to residents on the West Coast of the United States seconds before the ground shaking arrives, if the expected ground shaking exceeds a certain threshold. However, residents in tall buildings may experience much greater motion due to the dynamic response of the buildings. Therefore, there is an ongoing effort to extend ShakeAlert to include the contribution of building response to provide a more accurate estimation of the expected shaking intensity for tall buildings. Currently, the supposedly ideal solution of analyzing detailed finite element models of buildings under predicted ground-motion time histories is not theoretically or practically feasible. The authors have recently investigated existing simple methods to estimate peak floor acceleration (PFA) and determined these simple formulas are not practically suitable. Instead, this article explores another approach by extending the Pacific Earthquake Engineering Research Center (PEER) performance-based earthquake engineering (PBEE) to EEW, considering that every component involved in building response prediction is uncertain in the EEW scenario. Additionally, while this idea is not new and has been proposed by other researchers, it has two shortcomings: (1) the simple beam model used for response prediction is prone to modeling uncertainty, which has not been quantified, and (2) the ground motions used for probabilistic demand models are not suitable for EEW applications. In this article, we address these two issues by incorporating modeling errors into the parameters of the beam model and using a new set of ground motions, respectively. We demonstrate how this approach could practically work using data from a 52-story building in downtown Los Angeles. Using the criteria and thresholds employed by previous researchers, we show that if peak ground acceleration (PGA) is accurately estimated, this approach can predict the expected level of human comfort in tall buildings.

58 GEOSCIENCES↗

Ephemeris of a highly eccentric orbit - Explorer 28.

An ephemeris has been obtained for Explorer 28 (IMP 3) which agrees well with 2 years of radio observations and with SAO observations a year later. This ephemeris is generated over the 3 year lifetime by a numerical integration method utilizing a set of initial conditions at launch and without requiring further differential correction. Because highly eccentric orbits are difficult to compute with acceptable accuracy and because a long continuous arc has been obtained which compares with actual data to a known precision, this ephemeris may be used as a standard for computing highly eccentric orbits in the earth-moon system. Orbit improvement was used to obtain the initial conditions which generated the ephemeris. This improvement was based on correcting the energy by adjusting the semimajor axis to match computed times of perigee passage with the observed. This procedure may generate errors in semimajor axis to compensate for model errors in the energy; however, this compensation error is also implicit in orbit determination itself.

Lowrey, B. E.↗

Identification of large space structures: A state-of-practice report

An outline of this work is presented. It begins with a schematic flow diagram and a logical flow diagram of the identification process for large space structures (LSS). Next, the task is defined by a structure model definition. A matrix polynomial formulation with a node displacement equation and a state variable formulation with node displacement and velocities are outlined. Further outlined is the identification of LSS on orbit; modeling errors and uncertainties; verification and validation of model; and noise, computations, and data collection.

Source record↗

Flight Evaluation of Center-TRACON Automation System Trajectory Prediction Process

Two flight experiments (Phase 1 in October 1992 and Phase 2 in September 1994) were conducted to evaluate the accuracy of the Center-TRACON Automation System (CTAS) trajectory prediction process. The Transport Systems Research Vehicle (TSRV) Boeing 737 based at Langley Research Center flew 57 arrival trajectories that included cruise and descent segments; at the same time, descent clearance advisories from CTAS were followed. Actual trajectories of the airplane were compared with the trajectories predicted by the CTAS trajectory synthesis algorithms and airplane Flight Management System (FMS). Trajectory prediction accuracy was evaluated over several levels of cockpit automation that ranged from a conventional cockpit to performance-based FMS vertical navigation (VNAV). Error sources and their magnitudes were identified and measured from the flight data. The major source of error during these tests was found to be the predicted winds aloft used by CTAS. The most significant effect related to flight guidance was the cross-track and turn-overshoot errors associated with conventional VOR guidance. FMS lateral navigation (LNAV) guidance significantly reduced both the cross-track and turn-overshoot error. Pilot procedures and VNAV guidance were found to significantly reduce the vertical profile errors associated with atmospheric and airplane performance model errors.

Williams, David H.↗

On the Evaluation of Global Sea-Salt Aerosol Models at Coastal/Orographic Sites

Sea-salt aerosol global models are typically evaluated against concentration observations at coastal stations that are unaffected by local surf conditions and thus considered representative of open ocean conditions. Despite recent improvements in sea-salt source functions, studies still show significant model errors in specific regions. Using a multiscale model, we investigated the effect of high model resolution (0.1deg x 0.1deg vs. 1deg x 1.4deg) upon sea-salt patterns in four stations from the University of Miami Network: Baring Head, Chatam Island, and Invercargill in New Zealand, and Marion Island in the sub-antarctic Indian Ocean. Normalized biases improved from +63.7% to +3.3% and correlation increased from 0.52 to 0.84. The representation of sea/land interfaces, mesoscale circulations, and precipitation with the higher resolution model played a major role in the simulation of annual concentration trends. Our results recommend caution when comparing or constraining global models using surface concentration observations from coastal stations.

sea-salt aerosol↗

Numerical Investigation and Optimization of a Flushwall Injector for Scramjet Applications at Hypervelocity Flow Conditions

An investigation utilizing Reynolds-averaged simulations (RAS) was performed in order to demonstrate the use of design and analysis of computer experiments (DACE) methods in Sandia’s DAKOTA software package for surrogate modeling and optimization. These methods were applied to a flow- path fueled with an interdigitated flushwall injector suitable for scramjet applications at hyper- velocity conditions and ascending along a constant dynamic pressure flight trajectory. The flight Mach number, duct height, spanwise width, and injection angle were the design variables selected to maximize two objective functions: the thrust potential and combustion efficiency. Because the RAS of this case are computationally expensive, surrogate models are used for optimization. To build a surrogate model a RAS database is created. The sequence of the design variables comprising the database were generated using a Latin hypercube sampling (LHS) method. A methodology was also developed to automatically build geometries and generate structured grids for each design point. The ensuing RAS analysis generated the simulation database from which the two objective functions were computed using a one-dimensionalization (1D) of the three-dimensional simulation data. The data were fitted using four surrogate models: an artificial neural network (ANN), a cubic polynomial, a quadratic polynomial, and a Kriging model. Variance-based decomposition showed that both objective functions were primarily driven by changes in the duct height. Multiobjective design optimization was performed for all four surrogate models via a genetic algorithm method. Optimal solutions were obtained at the upper and lower bounds of the flight Mach number range. The Kriging model predicted an optimal solution set that exhibited high values for both objective functions. Additionally, three challenge points were selected to assess the designs on the Pareto fronts. Further sampling among the designs of the Pareto fronts may be required to lower the surrogate model errors and perform more accurate surrogate-model-based optimization.

Shenoy, Rajiv R.↗