Search NASASearch

SEARCH · Search NASA

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Cost Model Comparison: A Study of Internally and Commercially Developed Cost Models in Use by NASA

NASA makes use of numerous cost models to accurately estimate the cost of various components of a mission - hardware, software, mission/ground operations - during the different stages of a mission's lifecycle. The purpose of this project was to survey these models and determine in which respects they are similar and in which they are different. The initial survey included a study of the cost drivers for each model, the form of each model (linear/exponential/other CER, range/point output, capable of risk/sensitivity analysis), and for what types of missions and for what phases of a mission lifecycle each model is capable of estimating cost. The models taken into consideration consisted of both those that were developed by NASA and those that were commercially developed: GSECT, NAFCOM, SCAT, QuickCost, PRICE, and SEER. Once the initial survey was completed, the next step in the project was to compare the cost models' capabilities in terms of Work Breakdown Structure (WBS) elements. This final comparison was then portrayed in a visual manner with Venn diagrams. All of the materials produced in the process of this study were then posted on the Ground Segment Team (GST) Wiki.

cost models

The Southern Ocean Sea Surface Temperature Response to Ozone Depletion: A Multi-Model Comparison

The effect of the Antarctic ozone hole extends downwards from the stratosphere, with clear signatures in surface weather patterns including a positive trend in the Southern Annular Mode (SAM). Several recent studies have used coupled climate models to investigate the impact of these changes on Southern Ocean sea surface temperature (SST), notably motivated by the observed cooling from the late 1970s. Here we examine the robustness of these model results through comparison of both previously published and new simulations. We focus on the calculation of ‘climate response functions' (CRFs), transient responses to an instantaneous step-change in ozone concentrations. The CRF for most models consists of a rapid cooling of SST, followed by a slower warming trend. However, inter-model comparison reveals large uncertainties, such that even the sign of the impact of ozone depletion on historical SST, when reconstructed from the CRF, remains unconstrained. Comparison of these CRFs with SST responses to a hypothetical step-change in the SAM, inferred through lagged linear regression, shows broadly similar results. Causes of uncertainty are explored by examining relationships between model climatologies and their CRFs. The inter-model spread in CRFs can be reproduced by varying a single subgrid-scale mixing parameter within a single model. Antarctic sea-ice CRFs are also calculated: these do not generally exhibit the two-time-scale behavior of SST, suggesting a complex relationship between the two. Finally, by constraining model climatology-response relationships with observational values, we conclude that ozone depletion in unlikely to have been the primary driver of the observed SST cooling trend.

Climate response functions (CRF)

Diurnal Variations of Stratospheric Ozone Measured by Ground-Based Microwave Remote Sensing at the Mauna Loa NDACC Site: Measurement Validation and GEOSCCM Model Comparison

There is presently renewed interest in diurnal variations of stratospheric and mesospheric ozone for the purpose of supporting homogenization of records of various ozone measurements that are limited by the technique employed to being made at certain times of day. We have made such measurements for 19 years using a passive microwave remote sensing technique at the Mauna Loa Observatory (MLO) in Hawaii, which is a primary station in the Network for Detection of Atmospheric Composition Change (NDACC). We have recently reprocessed these data with hourly time resolution to study diurnal variations. We inspected differences between pairs of the ozone spectra (e.g., day and night) from which the ozone profiles are derived to determine the extent to which they may be contaminated by diurnally varying systematic instrumental or measurement effects. These are small, and we have reduced them further by selecting data that meet certain criteria that we established. We have calculated differences between profiles measured at different times: morning-night, afternoon-night, and morning-afternoon and have intercompared these with like profiles derived from the Aura Microwave Limb Sounder (Aura-MLS), the Upper Atmosphere Research Satellite Microwave Limb Sounder (UARS-MLS),t he Superconducting Submillimeter-Wave Limb-Emission Sounder (SMILES), and Solar Backscatter Ultraviolet version 2 (SBUV2) measurements. Differences between averages of coincident profiles are typically less than 1.5 percent of typical nighttime values over most of the covered altitude range with some exceptions. We calculated averages of ozone values for each hour from the Mauna Loa microwave data, and normalized these to the average for the first hour after midnight for comparison with corresponding values calculated with the Goddard Earth Observing System Chemistry Climate Model (GEOSCCM). We found that the measurements and model output mostly agree to better than 1.5 percent of the midnight value, with one noteworthy exception: The measured morning-night values are significantly (2-3 percent) higher than the modeled ones from 3.2 to 1.8 hPa (approximately 39-43 km), and there is evidence that the measured values are increasing compared to the modeled values before sunrise in this region.

GEOSCCM model comparison

Magnetospheric substorm models - Comparison with neutral sheet magnetic field observations

Four models for geomagnetic substorms, a quiet tail model, and models incorporating structural effects of the tail are examined for consistency with magnetic-field data during satellite crossings of the tail neutral sheet/plasma sheet. For this data the tearing mode instability model is always consistent, and inward moving distant neutral line is sometimes consistent, quasi-steady reconnection with slow shock and intermediate wave structure and locally quiet tail rarely consistent, and an outward propagating rarefaction wave is never consistent with the magnetic observations. In several cases structural effects of the tail are consistent with key features of the magnetic signatures.

Speiser, T. W.

The GEOS Chemistry Climate Model: Comparisons to Satellite Data

The Goddard Earth Observing System Chemistry Climate Model (GEOS CCM) has been developed by combining the atmospheric chemistry and transport modules developed over the years at Goddard and the GEOS general circulation model, also developed at Goddard. We will compare model simulations of ozone, and the minor constituents that affect ozone, for the period around 1980 with newly released revised data from the Limb Infrared Monitor of the Stratosphere (LIMS) instrument on Nimbus 4. We will also compare model simulations for the period of the early 2000s with the data from the Microwave Limb Sounder (MLS) and the High Resolution Dynamic Limb Sounder (HRDLS) on the Aura satellite. We will use these comparisons to examine the performance of the model for the present atmosphere and for the change that has occurred during the last 2 decades of ozone loss due to chlorine and bromine compounds released from chlorofluorocarbons and halons.

Stolarski, Richard S.

A Model-Model and Data-Model Comparison for the Early Eocene Hydrological Cycle

A range of proxy observations have recently provided constraints on how Earth's hydrological cycle responded to early Eocene climatic changes. However, comparisons of proxy data to general circulation model (GCM) simulated hydrology are limited and inter-model variability remains poorly characterised. In this work, we undertake an intercomparison of GCM-derived precipitation and P - E distributions within the extended EoMIP ensemble (Eocene Modelling Intercomparison Project; Lunt et al., 2012), which includes previously published early Eocene simulations performed using five GCMs differing in boundary conditions, model structure, and precipitation-relevant parameterisation schemes. We show that an intensified hydrological cycle, manifested in enhanced global precipitation and evaporation rates, is simulated for all Eocene simulations relative to the preindustrial conditions. This is primarily due to elevated atmospheric paleo-CO2, resulting in elevated temperatures, although the effects of differences in paleogeography and ice sheets are also important in some models. For a given CO2 level, globally averaged precipitation rates vary widely between models, largely arising from different simulated surface air temperatures. Models with a similar global sensitivity of precipitation rate to temperature (dP=dT ) display different regional precipitation responses for a given temperature change. Regions that are particularly sensitive to model choice include the South Pacific, tropical Africa, and the Peri-Tethys, which may represent targets for future proxy acquisition. A comparison of early and middle Eocene leaf-fossil-derived precipitation estimates with the GCM output illustrates that GCMs generally underestimate precipitation rates at high latitudes, although a possible seasonal bias of the proxies cannot be excluded. Models which warm these regions, either via elevated CO2 or by varying poorly constrained model parameter values, are most successful in simulating a match with geologic data. Further data from low-latitude regions and better constraints on early Eocene CO2 are now required to discriminate between these model simulations given the large error bars on paleoprecipitation estimates. Given the clear differences between simulated precipitation distributions within the ensemble, our results suggest that paleohydrological data offer an independent means by which to evaluate model skill for warm climates.

Boundary conditions

A critical examination of the dendrite growth models Comparison of theory with experimental data

Three dendrite growth models for directionally solidified succinonitrile-acetone, succinonitrile-salol, aluminum-copper, and lead-paladium alloys are evaluated. The characteristics of the Burden and Hunt (1974) model, the Laxmanan (1985) model, and the Trivedi (1980) model are described. The dendrite tip temperature, tip radius, liquid composition, and primary arm spacing for the alloys are analyzed in terms of growth speed, alloy composition, and temperature gradient. It is observed that the Burden and Hunt model accurately predicts the proper behavior of the parameters, but does not provide good quantitative predictions. A good fit between the experimental data and the Trivedi and Laxmanan models is detected. The advantages of the Trivedi marginal stability analysis and the Laxmanan minimum dendrite tip undercooling approaches are discussed.

Tewari, S. N.

Infrared cooling rate calculations in operational general circulation models - Comparisons with benchmark computations

The performance of several parameterized models is described with respect to numerical prediction and climate research at GFDL, NCAR, and GISS. The radiation codes of the models were compared to benchmark calculations and other codes for the intercomparison of radiation codes in climate models (ICRCCM). Cooling rates and fluxes calculated from the models are examined in terms of their application to established general circulation models (GCMs) from the three research institutions. The newest radiation parameterization techniques show the most significant agreement with the benchmark line-by-line (LBL) results. The LBL cooling rates correspond to cooling rate profiles from the models, but the parameterization of the water vapor continuum demonstrates uncertain results. These uncertainties affect the understanding of some lower tropospheric cooling, and therefore more accurate parameterization of the water vapor continuum, as well as the weaker absorption bands of CO2 and O3 is recommended.

Kiehl, J. T.

Turbulence Model Comparisons for a High-Speed Aircraft

Four turbulence models are described and evaluated for transonic flows over the High-Speed Research/industry baseline configuration known as Reference H by using the thin-layer, upwind, Navier-Stokes solver known as CFL3D. The turbulence models studied are the equilibrium model of Baldwin-Lomax (B-L) with the Degani-Schiff (D-S) modifications, the one-equation Baldwin-Barth (B-B) model, the one-equation Spalart-Allmaras (S-A) model, and Menter's two-equation Shear Stress Transport (SST) model. The flow conditions, which correspond to tests performed in the National Transonic Facility (NTF) at Langley Research Center, are a Mach number of 0.90 and a Reynolds number of 30 x 10 (exp. 6) based on mean aerodynamic chord for angles of attack of 1 deg., 5 deg., and 10 deg. The effects of grid topology and the representation of the actual wind tunnel model geometry are also investigated. Computed forces and surface pressures compare reasonably well with the experimental data for all four turbulence models.

Rivers, Melissa B.

Radicals and Reservoirs in the GMI Chemistry and Transport Model: Comparison to Measurements

The most important use of atmospheric chemistry and transport models is to predict the future composition of the atmosphere. The amounts of gases like chlorofluorcarbons, methyl bromide, nitrous oxide and methane are changing and the stratospheric ozone layer will change because these gases are changing. Methyl bromide, nitrous oxide and methane all have natural sources, and also change because of human activity. Chlorofluorcarbons are man-made gases; these are known to decrease stratospheric ozone and future production is banned. They are long-lived gases, and many decades will pass before they are insignificant in the atmosphere. The models are used to predict changes in ozone and other gases; this is a straightforward application. The models must be also tested using observations for the present day atmosphere. This is a challenging task, because the model contains more than 50 species and more than 150 chemical reactions. Data from satellites, ground stations, aircraft and balloons are used to evaluate the model. Different models that are used in international assessments produce different results; in the most recent assessment some predict that ozone will return to 1980 levels by 2025 and others predict that this will not happen until 2050. Since all the parts of the models are conceptually the same, there must be differences in implementation that produce these differences, This work takes a single model, two different sets of winds and temperatures, and repeats the same prediction for the future. Here we compare the results for these two simulations with many observations. The purpose is to identify differences in the model results for the present atmosphere that will lead to different predictions. This sort of controlled comparison will reduce uncertainty in the predictions for stratospheric ozone.

Douglas, Anne R.

A cometary hydrogen model - Comparison with OGO-5 measurements of Comet Bennett /1970 II/

A model is constructed for the hydrogen cloud of Comet Bennett (1970 II) based on highly sensitive observations of its Lyman alpha emission by a photometer on board OGO-5 and taking into account the cometary motion, field gradients, solar L-alpha profile, and finite lifetime of the H atoms along their trajectories. The solar L-alpha flux is determined independently of instrumental calibration using the strong curvature of the hydrogen cloud in the orbital plane of the comet, and the cometary production rate of hydrogen atoms is calculated. The combination of two equally weighted Maxwellian velocity distributions with mean velocities of 7 and 21 km/sec is found to match the photometer scans across the comet better than any single Maxwellian distribution. A complete L-alpha isophote map is presented for the model hydrogen cloud on Mar. 20, 1970.

Keller, H. U.

Multi-Layer Arctic Mixed-Phase Clouds Simulated by a Cloud-Resolving Model: Comparison with ARM Observations and Sensitivity Experiments

A cloud-resolving model (CRM) is used to simulate the multiple-layer mixed-phase stratiform (MPS) clouds that occurred during a three-and-a-half day subperiod of the Department of Energy-Atmospheric Radiation Measurement Program s Mixed-Phase Arctic Cloud Experiment (M-PACE). The CRM is implemented with an advanced two-moment microphysics scheme, a state-of-the-art radiative transfer scheme, and a complicated third-order turbulence closure. Concurrent meteorological, aerosol, and ice nucleus measurements are used to initialize the CRM. The CRM is prescribed by time-varying large-scale advective tendencies of temperature and moisture and surface turbulent fluxes of sensible and latent heat. The CRM reproduces the occurrences of the single- and double-layer MPS clouds as revealed by the M-PACE observations. However, the simulated first cloud layer is lower and the second cloud layer thicker compared to observations. The magnitude of the simulated liquid water path agrees with that observed, but its temporal variation is more pronounced than that observed. As in an earlier study of single-layer cloud, the CRM also captures the major characteristics in the vertical distributions and temporal variations of liquid water content (LWC), total ice water content (IWC), droplet number concentration and ice crystal number concentration (nis) as suggested by the aircraft observations. However, the simulated mean values differ significantly from the observed. The magnitude of nis is especially underestimated by one order of magnitude. Sensitivity experiments suggest that the lower cloud layer is closely related to the surface fluxes of sensible and latent heat; the upper cloud layer is probably initialized by the large-scale advective cooling/moistening and maintained through the strong longwave (LW) radiative cooling near the cloud top which enhances the dynamical circulation; artificially turning off all ice-phase microphysical processes results in an increase in LWP by a factor of 3 due to interactions between the excessive LW radiative cooling and extra cloud water; heating caused by phase change of hydrometeors could affect the LWC and cloud top height by partially canceling out the LW radiative cooling. It is further shown that the resolved dynamical circulation appears to contribute more greatly to the evolution of the MPS cloud layers than the parameterized subgrid-scale circulation.

Luo, Yali

Calibration of radiation codes in climate models: Comparison of calculations with observations from the SPECtral Radiation Experiment (SPECTRE)

The primary goal of SPECTRE is to: close the loopholes by which longwave radiation models have eluded incisive comparisons with measurements. Likewise, the experimental approach was quite simple in concept, namely: accurately measure the zenith infrared radiance at high spectral resolution while simultaneously profiling the radiatively important atmospheric properties with conventional and remote sensing devices. The field phase of SPECTRE was carried out as part of FIRE Cirrus II, and detailed spectra of the down welling radiance were obtained by several interferometers simultaneous to the measurement of the optical properties of the atmosphere. We are now well along in the process of analyzing the data and calibrating radiation codes so that they may be used more effectively in climate related studies. The calibration is being done with models ranging from the most detailed (line-by-line) to the broad-band parameterizations used in climate models. This paper summarizes our progress in the calibration for clear-sky conditions. When this stage is completed, we will move on to the calibration for cirrus conditions.

Ellingson, R. G.

Jet-Surface Interaction Noise Models Comparison to TMP17 and Next Steps

A set of empirical jet-surface interaction noise models, developed for single-stream round nozzles exhausting over a simple surface in a static ambient, are evaluated for use in more realistic applications that include multi-stream nozzle systems with chevrons and dihedral surface geometries. The simple-single-stream models have several advantages when used in system-level noise studies: they are robust, they are quickly computed, and they are generally applicable to a wide range of configurations. However, these models rely on a fixed noise source distribution that does not account for the presence of chevrons at the nozzle exit. The effect of this omission on the prediction accuracy is shown by this comparison to experimental data. This motivates discussion of future work to develop a more robust modeling framework that can account for generalized source distributions and more complex airframe geometries. Re: Top-Mounted Propulsion (TMP17) Test Plans.

Propulsion Noise

Radicals and Reservoirs in the GMI Chemistry and Transport Model: Comparison to Measurements

We have used a three-dimensional chemistry and transport model (CTM), developed under the Global Modeling Initiative (GMI), to carry out two simulations of the composition of the stratosphere under changing halogen loading for 1995 through 2030. The two simulations differ only in that one uses meteorological fields from a general circulation model while the other uses meteorological fields from a data assimilation system. A single year's winds and temperatures are repeated for each 36-year simulation. We compare results from these two simulations with an extensive collection of data from satellite and ground-based measurements for 1993-2000. Comparisons of simulated fields with observations of radical and reservoir species for some of the major ozone-destroying compounds are of similar quality for both simulations. Differences in the upper stratosphere, caused by transport of total reactive nitrogen and methane, impact the balance among the ozone loss processes and the sensitivity of the two simulations to the change in composition.

Douglass, Anne R.

Significant Findings: Seasonal Distributions of Global Ocean Chlorophyll and Nutrients With a Coupled Ocean General Circulation, Biogeochemical, and Radiative Model: Comparisons With Satellite and In Situ Data - 2

A coupled ocean general circulation, biogeochemical, and radiative model was constructed to evaluate and understand the nature of seasonal variability of chlorophyll and nutrients in the global oceans. Biogeochemical processes in the model were determined from the influences of circulation and turbulence dynamics, irradiance availability, and the interactions among three functional phytoplankton groups (diatoms, chlorophytes, and picoplankton) and three nutrients (nitrate, ammonium, and silicate). Basin scale (>1000 km) model chlorophyll seasonal distributions were statistically positively correlated with CZCS chlorophyll in 10 of 12 major oceanographic regions, and with SeaWiFS in all 12. Notable disparities in magnitudes occurred, however, in the tropical Pacific, the spring/summer bloom in the Antarctic, autumn in the northern high latitudes, and during the southwest monsoon in the North Indian Ocean. Synoptic scale (100-1000 km) comparisons of satellite and in situ data exhibited broad agreement, although occasional departures were apparent. Model nitrate distributions agreed with in situ data, including seasonal dynamics, except for the equatorial Atlantic. The overall agreement of the model with satellite and in situ data sources indicated that the model dynamics offer a reasonably realistic simulation of phytoplankton and nutrient dynamics on basin and synoptic scales.

Gregg, Watson W.