Search NASA⌕ Search

SEARCH · Search NASA

Results for “model accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Implementation of a Hybrid Edge Node-Centroid Node Approach for the Generation of Reduced Thermal Models

Reduced thermal models are often required for delivery to organizations that manage models at the highest levels of assembly. The effort to generate/verify these models against their detailed counterparts is a challenge not yet conclusively solved. Higher level organizations often place a limit on the node count for delivered models, assuming smaller models result in faster computation. The burden of producing and verifying the accuracy of reduced models is primarily on the lower-level organizations, which consumes resources to produce these models. Limiting the number of allowable nodes may prevent users from taking full advantage of software capabilities that allow for faster generation of models, such as finite elements, which require more nodes than centroid based models. A methodology using Thermal Desktop was described in 2010 using: (1) finite elements and edge nodes for the conduction matrix, (2) centroid nodes for capacitance and radiative computations, and (3) the super network feature to produce a conduction matrix based only on the centroid nodes. While the methodology was clear, the implementation would have had to be done manually; with the inclusion of the OpenTD Application Programming Interface, this methodology can now be implemented programmatically and be a viable approach for the generation of reduced models. The approach was implemented at NASA-Goddard for the Capture-Containment-and-Return-System (CCRS) payload, resulting in the TCYEE tool. CCRS requires delivery with node limitations through the European Space Agency to its contractors. TCYEE generated the reduced model for delivery and the predictions compared favorably to the detailed model. Furthermore, TCYEE is being explored for potential use on the Roman Space Telescope (RST) for the generation of reduced models for delivery to the launch provider, which also has node limit requirements. This paper describes the methodology, implementation, and the performance of reduced models compared to their detailed counterparts.

Computer Programming and Software↗

Basic Diagnosis and Prediction of Persistent Contrail Occurrence using High-resolution Numerical Weather Analyses/Forecasts and Logistic Regression. Part I: Effects of Random Error

Straightforward application of the Schmidt-Appleman contrail formation criteria to diagnose persistent contrail occurrence from numerical weather prediction data is hindered by significant bias errors in the upper tropospheric humidity. Logistic models of contrail occurrence have been proposed to overcome this problem, but basic questions remain about how random measurement error may affect their accuracy. A set of 5000 synthetic contrail observations is created to study the effects of random error in these probabilistic models. The simulated observations are based on distributions of temperature, humidity, and vertical velocity derived from Advanced Regional Prediction System (ARPS) weather analyses. The logistic models created from the simulated observations were evaluated using two common statistical measures of model accuracy, the percent correct (PC) and the Hanssen-Kuipers discriminant (HKD). To convert the probabilistic results of the logistic models into a dichotomous yes/no choice suitable for the statistical measures, two critical probability thresholds are considered. The HKD scores are higher when the climatological frequency of contrail occurrence is used as the critical threshold, while the PC scores are higher when the critical probability threshold is 0.5. For both thresholds, typical random errors in temperature, relative humidity, and vertical velocity are found to be small enough to allow for accurate logistic models of contrail occurrence. The accuracy of the models developed from synthetic data is over 85 percent for both the prediction of contrail occurrence and non-occurrence, although in practice, larger errors would be anticipated.

Duda, David P.↗

Multimodel Ensembles of Wheat Growth: More Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

wheat↗

Multimodel Ensembles of Wheat Growth: Many Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop model scan give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 2438 for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

model intercomparison↗

Approximate methods for finding CO2 15-micron band transmission in planetary atmospheres

Physical band models that use simplifying assumptions about the structure of the CO2 15-micron band are described and compared with the accurate line-by-line model of Fels and Schwarzkopf (1981). The methods have application to the models of the atmospheres of Venus, earth, and Mars. The narrow-band methods include a general random model and techniques employing the Malkmus (1967) line-strength distribution, and the accuracy of these models at low pressure is found to be sensitive to the line-strength distribution and the line shape. When combined with a simple Voigt parameterization, the more efficient approximate methods represented by an exponential wideband model are found to be almost as accurate as the expensive narrow-band models. Empirical logarithmic wideband models used in climate-modeling studies are found to be very efficient, but of limited range of validity.

Crisp, David↗

Cryogenic Thermal Distortion Model Validation for the JWST ISIM Structure

The James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM) Structure is a precision optical metering structure for the JWST science instruments. Optomechanical performance requirements place stringent limits on the allowable thermal distortion of the metering structure. A significant effort was completed to develop capabilities to predict and metrologize cryogenic thermal distortion of the ISIM Structure. This paper focuses on thermal distortion finite element modeling, analysis, and model validation. Extensive thermal distortion analysis was completed during the design phase for the ISIM Structure to demonstrate that thermal distortion requirements were achieved. Comparison of measurements from recently completed cryogenic testing and model predictions demonstrate the adequacy of thermal distortion modeling uncertainty factors adopted during the design phase, and provide bounds on the accuracy of the model predictions. This paper will provide an overview of the test configurations, describe the thermal distortion models of the tests, and provide a comparison of test results and analytical predictions from the models.

Johnston, John D.↗

Validation of Accurate Cryogenic Fluid Vapor-Liquid Boundary Conditions Via Molecular Simulations

Vapor-liquid interfaces drive many important phenomena in cryogenic fluid management, including heat transfer, evaporation, and capillary flow. Design of cryogenic fluid systems, such as propellant storage, requires accurate predictions of fluid behavior, including evaporation rates. Many models have been proposed for heat and mass transfer at vapor liquid interfaces, but the accuracy of these models in the context of cryogenic fluids has not been performed. We use molecular dynamics simulations, which allow for nanometer scale resolution of fluid phenomena, to evaluate the accuracy of a variety of vapor-liquid boundary conditions at evaporating and condensing interfaces. We find that an anisotropic temperature distribution is a critical ingredient for accurate prediction of intensive evaporation and condensation.

Daniel Vigil↗

Efficient On-Orbit Singularity-Free Geopotential Estimation

For vehicles in orbital cruise, either in orbit around a body or in a transfer orbit, gravity is the primary external force; therefore, the complexity of the geopotential model heavily influences the accuracy of the navigation state. As this type of spacecraft requires a highly accurate geopotential model and performs the computation numerous times a second, this calculation needs to be efficient. This calculation needs to include the first and second derivatives of the geopotential because navigation systems can require both the gravitational acceleration and gradient for inertial integration and state filtering. The most efficient method for calculating the geopotential, the forward column method, is discussed in detail, as well as a method to avoid the singularities that exist when using this method. This is shown to decrease the computation time of the geopotential compared to other popular methods. In addition, methods for first and second order propagation are discussed, which decrease the rate at which the full geopotential model needs to be calculated while maintaining the accuracy required of navigation systems. These estimation methods are shown to decrease the necessary computation of the gravity model by multiple orders of magnitude. This method decreases the computation time of the Exploration Upper Stage navigation system geopotential model by potentially an order of magnitude compared with the previous model without affecting the navigation error. A properly implemented geopotential model can have the accuracy of an 8 by 8 model while approaching the computational requirement as using only the J234 coefficients.

Amert, Joel↗

Opening Loads Analyses for Various Disk-Gap-Band Parachutes

Detailed opening loads data is presented for 18 tests of Disk-Gap-Band (DGB) parachutes of varying geometry with nominal diameters ranging from 43.2 to 50.1 ft. All of the test parachutes were deployed from a mortar. Six of these tests were conducted via drop testing with drop test vehicles weighing approximately 3,000 or 8,000 lb. Twelve tests were conducted in the National Full-Scale Aerodynamics Complex 80- by 120-foot wind tunnel at the NASA Ames Research Center. The purpose of these tests was to structurally qualify the parachute for the Mars Exploration Rover mission. A key requirement of all tests was that peak parachute load had to be reached at full inflation to more closely simulate the load profile encountered during operation at Mars. Peak loads measured during the tests were in the range from 12,889 to 30,027 lb. Of the two test methods, the wind tunnel tests yielded more accurate and repeatable data. Application of an apparent mass model to the opening loads data yielded insights into the nature of these loads. Although the apparent mass model could reconstruct specific tests with reasonable accuracy, the use of this model for predictive analyses was not accurate enough to set test conditions for either the drop or wind tunnel tests. A simpler empirical model was found to be suitable for predicting opening loads for the wind tunnel tests to a satisfactory level of accuracy. However, this simple empirical model is not applicable to the drop tests.

Cruz, J. R.↗

Mapping the Daily Progression of Large Wildland Fires Using MODIS Active Fire Data

High temporal resolution information on burned area is a prerequisite for incorporating bottom-up estimates of wildland fire emissions in regional air transport models and for improving models of fire behavior. We used the Moderate Resolution Imaging Spectroradiometer (MODIS) active fire product (MO(Y)D14) as input to a kriging interpolation to derive continuous maps of the evolution of nine large wildland fires. For each fire, local input parameters for the kriging model were defined using variogram analysis. The accuracy of the kriging model was assessed using high resolution daily fire perimeter data available from the U.S. Forest Service. We also assessed the temporal reporting accuracy of the MODIS burned area products (MCD45A1 and MCD64A1). Averaged over the nine fires, the kriging method correctly mapped 73% of the pixels within the accuracy of a single day, compared to 33% for MCD45A1 and 53% for MCD64A1.

Aqua↗

Comparison of rigorous and simple vibrational models for the CO2 gasdynamic laser

The accuracy of a simple vibrational model for computing the gain in a CO2 gasdynamic laser is assessed by comparing results computed from it with results computed from a rigorous vibrational model. The simple model is that of Anderson et al. (1971), in which the vibrational kinetics are modeled by grouping the nonequilibrium vibrational degrees of freedom into two modes, to each of which there corresponds an equation describing vibrational relaxation. The two models agree fairly well in the computed gain at low temperatures, but the simple model predicts too high a gain at the higher temperatures of current interest. The sources of error contributing to the overestimation given by the simple model are determined by examining the simplified relaxation equations.

Monson, D. J.↗

Run Time Improvement Efforts for the Roman Space Telescope Thermal Analysis

"Observatory thermal models for large, complex missions, such as the Wide Field InfraRed Survey Telescope (WFIRST) mission, produce an immense amount of data to be processed. Configuration management of the model throughout the project life cycle has mainly focused on which versions of the subsystem models form the current observatory level configuration. However, the results produced by the model are not nearly as well The Roman Space Telescope (RST), formerly known as the Wide Field InfraRed Survey Telescope, is the next great astrophysics observatory mission to follow the James Webb Space Telescope with a planned launch in 2026. As a large scale, flagship mission for NASA with challenging wave front error stability requirements, a single model approach for both thermal discipline analysis and thermo-optical distortion analysis has been used since the early days of the project. In alleviating the need to maintain two separate models for different analysis types, it imposes run time penalties on the thermal analysis with a large model with significant radiation heat exchange. Throughout the lifecycle of the project, the component models have steadily grown in size, resulting in a continuous growth of the overall observatory model with each update and consequently a considerable increase in the model run time. While ongoing efforts to reduce run time are continuously investigated, previous efforts had primarily focused on timestep size and total simulation time to reach quasi-equilibrium. More recently, studies were performed on the total number of radiation couplings (radks) included in the model, which has a nearly linear impact on run time, but increases exponentially with node count. As standard practice for spacecraft analysis, small radks were excluded from the temperature solution based on the assumption that their interchange/view factors have a negligible impact on heat flow. Four approaches were investigated to reduce the model run time while minimizing the impact on accuracy: (1) the Equivalent Radiation Network node, (2) Progressive Radk Inclusion as solution proceeds, (3) Targeted Radk Filtering for critical/non critical areas, and lastly (4) Representation of culled radks with Backloads. Furthermore, the investigation of model run time also revealed that cold cases took noticeably longer to run than hot cases; the root computational inefficiencies were explored along with the computation penalty of linearization of the external radks and recalculation of temperature dependent linear couplings at each timestep. This paper outlines the details of each of the above approaches and their impact on run time and model accuracy.

Thermal Analysis↗

Run Time Improvement Efforts for the Roman Space Telescope Thermal Analysis

Observatory thermal models for large, complex missions, such as the Wide Field InfraRed Survey Telescope (WFIRST) mission, produce an immense amount of data to be processed. Configuration management of the model throughout the project life cycle has mainly focused on which versions of the subsystem models form the current observatory level configuration. However, the results produced by the model are not nearly as well The Roman Space Telescope (RST), formerly known as the Wide Field InfraRed Survey Telescope, is the next great astrophysics observatory mission to follow the James Webb Space Telescope with a planned launch in 2026. As a large scale, flagship mission for NASA with challenging wave front error stability requirements, a single model approach for both thermal discipline analysis and thermo-optical distortion analysis has been used since the early days of the project. In alleviating the need to maintain two separate models for different analysis types, it imposes run time penalties on the thermal analysis with a large model with significant radiation heat exchange. Throughout the lifecycle of the project, the component models have steadily grown in size, resulting in a continuous growth of the overall observatory model with each update and consequently a considerable increase in the model run time. While ongoing efforts to reduce run time are continuously investigated, previous efforts had primarily focused on timestep size and total simulation time to reach quasi-equilibrium. More recently, studies were performed on the total number of radiation couplings (radks) included in the model, which has a nearly linear impact on run time, but increases exponentially with node count. As standard practice for spacecraft analysis, small radks were excluded from the temperature solution based on the assumption that their interchange/view factors have a negligible impact on heat flow. Four approaches were investigated to reduce the model run time while minimizing the impact on accuracy: (1) the Equivalent Radiation Network node, (2) Progressive Radk Inclusion as solution proceeds, (3) Targeted Radk Filtering for critical/non critical areas, and lastly (4) Representation of culled radks with Backloads. Furthermore, the investigation of model run time also revealed that cold cases took noticeably longer to run than hot cases; the root computational inefficiencies were explored along with the computation penalty of linearization of the external radks and recalculation of temperature dependent linear couplings at each timestep. This paper outlines the details of each of the above approaches and their impact on run time and model accuracy.

Thermal Analysis↗

A model for active control of helicopter air resonance in hover and forward flight

A coupled rotor/fuselage helicopter analysis is presented. The accuracy of the model is verified by comparing it with the experimental data. The sensitivity of the open loop damping of the unstable air resonance mode to such modeling effects as blade torsional flexibility, unsteady aerodynamics, forward flight, periodic terms, and trim solution is illustrated by numerous examples. Subsequently, the model is used in conjunction with linear optimal control theory to stabilize the air resonance mode. The influence of the modeling effects mentioned before on active air resonance control is then investigated.

Takahashi, M. D.↗

The Seasat altimeter data and its accuracy assessment

A description is given of the Seasat satellite radar altimeter, which was designed to measure (1) the altitude of the satellite above the ocean surface, (2) surface wave height, and (3) the ocean-surface backscatter coefficient from which wind speed may be inferred. The atmospheric and geophysical effects influencing radar altimeter measurement accuracies and the attendant correction models adopted for the altimeter geophysical data record are summarized, along with Seasat Altimeter/Precision Orbit Determination Experiment Team activities directed towards the validation and improvement of these models and investigations assessing the accuracy of both the altimeter measurements and the computed satellite altitude ephemeris.

Tapley, B. D.↗

LDEF Satellite Radiation Analyses

Model calculations and analyses have been carried out to compare with several sets of data (dose, induced radioactivity in various experiment samples and spacecraft components, fission foil measurements, and LET spectra) from passive radiation dosimetry on the Long Duration Exposure Facility (LDEF) satellite, which was recovered after almost six years in space. The calculations and data comparisons are used to estimate the accuracy of current models and methods for predicting the ionizing radiation environment in low earth orbit. The emphasis is on checking the accuracy of trapped proton flux and anisotropy models.

Armstrong, T. W.↗

Modifying high-order aeroelastic math model of a jet transport using maximum likelihood estimation

The design of control laws to damp flexible structural modes requires accurate math models. Unlike the design of control laws for rigid body motion (e.g., where robust control is used to compensate for modeling inaccuracies), structural mode damping usually employs narrow band notch filters. In order to obtain the required accuracy in the math model, maximum likelihood estimation technique is employed to improve the accuracy of the math model using flight data. Presented here are all phases of this methodology: (1) pre-flight analysis (i.e., optimal input signal design for flight test, sensor location determination, model reduction technique, etc.), (2) data collection and preprocessing, and (3) post-flight analysis (i.e., estimation technique and model verification). In addition, a discussion is presented of the software tools used and the need for future study in this field.

Anissipour, Amir A.↗