Search NASA⌕ Search

SEARCH · Search NASA

Results for “model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Subhourly Clipping Correction Model Comparison

This work will compare the Allen method and Walker method of accounting for subhourly inverter clipping power losses in hourly PV performance models. The Allen method uses a matrix lookup based on DNI clearness and clipping potential to assign a clipping correction loss at each simulation timestep. The Walker method models the PV DC power input to the inverter as a distribution over the hourly timestep and uses integration over the timestep to determine the amount of clipping that occurs within the timestep. Both these models have been recently implemented in the System Advisor Model's (SAM) open-source code, and will be applied to hourly SURFRAD datasets to analyze the subhourly clipping loss predicted by each model for different system designs and inverter loading conditions. Both models will be compared to "true" 1-minute SURFRAD data simulations to see their accuracy against more accurate 1-minute clipping correction loss predictions. This model comparisons will be investigated in more detail at the PVSC conference in Seattle, Washington June 2024.

ENERGY PLANNING, POLICY, AND ECONOMY,MATHEMATICS A↗

Conductance Effects on Inner Magnetospheric Plasma Morphology: Model Comparisons with IMAGE EUV, MENA, and HENA Data

Modeling results of the inner magnetosphere showing the influence of the ionospheric conductance on the inner magnetospheric electric fields during the April 17, 2002 magnetic storm are presented. Kinetic plasma transport code results are analyzed in combination with observations of the inner magnetospheric plasma populations, in particular those from the IMAGE satellite. Qualitative and quantitative comparisons are made with the observations from EW, MENA, and HENA, covering the entire energy range simulated by the model (0 to 300 keV). The electric field description, and in particular the ionospheric conductance, is the only variable between the simulations. Results from the data-model comparisons are discussed, detailing the strengths and weaknesses of each conductance choice for each energy channel.

Liemohn, M.↗

Cost Model Comparison: A Study of Internally and Commercially Developed Cost Models in Use by NASA

NASA makes use of numerous cost models to accurately estimate the cost of various components of a mission - hardware, software, mission/ground operations - during the different stages of a mission's lifecycle. The purpose of this project was to survey these models and determine in which respects they are similar and in which they are different. The initial survey included a study of the cost drivers for each model, the form of each model (linear/exponential/other CER, range/point output, capable of risk/sensitivity analysis), and for what types of missions and for what phases of a mission lifecycle each model is capable of estimating cost. The models taken into consideration consisted of both those that were developed by NASA and those that were commercially developed: GSECT, NAFCOM, SCAT, QuickCost, PRICE, and SEER. Once the initial survey was completed, the next step in the project was to compare the cost models' capabilities in terms of Work Breakdown Structure (WBS) elements. This final comparison was then portrayed in a visual manner with Venn diagrams. All of the materials produced in the process of this study were then posted on the Ground Segment Team (GST) Wiki.

cost models↗

Robust Statistical Approach for Determination of Graphite Nitridation Using Bayesian Model Comparison

A better estimation of surface reaction efficiency of semiconductor-grade graphite with atomic nitrogen, as well as the calibration error are calculated using Bayesian updating based on experimental data. Compared with a conventional deterministic model, the stochastic model approach is a powerful tool in the sense that the model is capable of taking into account underlying error correlations among the data quantities. In this paper, we investigate four different stochastic models (called “stochastic system model classes” herein) corresponding to different descriptions of modeling and measurement error structures, given one deterministic physical model. These stochastic system model classes differ in the covariance matrix structure that is used in the uncertainty model to represent uncertainties associated with the physical model and experimental measurements. For each model class, Bayesian inference is used to estimate the posterior probabilities of the physical model parameters as well as of the stochastic model parameters. Model comparison and selection are then applied based on two measures including Bayesian evidence and Bayesian information criterion, as well as the deviance information criterion. Both measures suggest the stochastic model class, which considers that a correlation between errors in two data quantities among different data points is the most plausible. With the stochastic model class, the range of uncertainty in surface reaction efficiency is estimated to be about two orders of magnitude at [Formula: see text].

Engineering↗

Non-local gravity and comparison with observational datasets. II. Updated results and Bayesian model comparison with ΛCDM

We present a comprehensive and updated comparison with cosmological observations of two non-local modifications of gravity previously introduced by our group, the so called RR and RT models. We implement the background evolution and the cosmological perturbations of the models in a modified Boltzmann code, using CLASS. We then test the non-local models against the Planck 2015 TT, TE, EE and Cosmic Microwave Background (CMB) lensing data, isotropic and anisotropic Baryonic Acoustic Oscillations (BAO) data, JLA supernovae, H {sub 0} measurements and growth rate data, and we perform Bayesian parameter estimation. We then compare the RR, RT and ΛCDM models, using the Savage-Dickey method. We find that the RT model and ΛCDM perform equally well, while the performance of the RR model with respect to ΛCDM depends on whether or not we include a prior on H {sub 0} based on local measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

The Southern Ocean Sea Surface Temperature Response to Ozone Depletion: A Multi-Model Comparison

The effect of the Antarctic ozone hole extends downwards from the stratosphere, with clear signatures in surface weather patterns including a positive trend in the Southern Annular Mode (SAM). Several recent studies have used coupled climate models to investigate the impact of these changes on Southern Ocean sea surface temperature (SST), notably motivated by the observed cooling from the late 1970s. Here we examine the robustness of these model results through comparison of both previously published and new simulations. We focus on the calculation of ‘climate response functions' (CRFs), transient responses to an instantaneous step-change in ozone concentrations. The CRF for most models consists of a rapid cooling of SST, followed by a slower warming trend. However, inter-model comparison reveals large uncertainties, such that even the sign of the impact of ozone depletion on historical SST, when reconstructed from the CRF, remains unconstrained. Comparison of these CRFs with SST responses to a hypothetical step-change in the SAM, inferred through lagged linear regression, shows broadly similar results. Causes of uncertainty are explored by examining relationships between model climatologies and their CRFs. The inter-model spread in CRFs can be reproduced by varying a single subgrid-scale mixing parameter within a single model. Antarctic sea-ice CRFs are also calculated: these do not generally exhibit the two-time-scale behavior of SST, suggesting a complex relationship between the two. Finally, by constraining model climatology-response relationships with observational values, we conclude that ozone depletion in unlikely to have been the primary driver of the observed SST cooling trend.

Climate response functions (CRF)↗

Bifacial PV Performance Models: Comparison and Field Results

Updated performance models for bifacial PV are being developed at NREL. We are in the process of validating these optical models against field trial configurations, and commercial bifacial models. This presentation provides preliminary field test results, intercomparison of NREL's Ray Tracing and View Factor bifacial modules against PVSyst, and a SolarWorld empirical model. Some specific attributes of bifacial modeling are addressed including edge effects and rear irradiance non-uniformity / mismatch loss.

14 SOLAR ENERGY↗

Climate Impact of Transportation A Model Comparison

Transportation contributes to a significant and rising share of global energy use and GHG emissions. Therefore modeling future travel demand, its fuel use, and resulting CO2 emission is highly relevant for climate change mitigation. In this study we compare the baseline projections for global service demand (passenger-kilometers, ton-kilometers), fuel use, and CO2 emissions of five different global transport models using harmonized input assumptions on income and population. For four models we also evaluate the impact of a carbon tax. All models project a steep increase in service demand over the century. Technology is important for limiting energy consumption and CO2 emissions, but quite radical changes in the technology mix are required to stabilize or reverse the trend. While all models project liquid fossil fuels dominating up to 2050, they differ regarding the use of alternative fuels (natural gas, hydrogen, biofuels, and electricity), because of different fuel price projections. The carbon tax of US$200/tCO2 in 2050 stabilizes or reverses global emission growth in all models. Besides common findings many differences in the model assumptions and projections indicate room for improvement in modeling and empirical description of the transport system.

climate mitigation↗

Transport model comparison studies of intermediate-energy heavy-ion collisions

Transport models are the main method to obtain physics information on the nuclear equation of state and in-medium properties of particles from low to relativistic-energy heavy-ion collisions. The Transport Model Evaluation Project (TMEP) has been pursued to test the robustness of transport model predictions in reaching consistent conclusions from the same type of physical model. To this end, calculations under controlled conditions of physical input and set-up were performed with various participating codes. These included both calculations of nuclear matter in a box with periodic boundary conditions, which test separately selected ingredients of a transport code, and more realistic calculations of heavy-ion collisions. Over the years, six studies have been performed within this project. In this intermediate review, we summarize and discuss the present status of the project. We also provide condensed descriptions of the 26 participating codes, which contributed to some part of the project. These include the major codes in use today. After a compact description of the underlying transport approaches, we review the main results of the studies completed so far. They show, that in box calculations the differences between the codes can be well understood and a convergence of the results can be reached. These studies also highlight the systematic differences between the two families of transport codes, known under the names of Boltzmann–Uehling–Uhlenbeck (BUU) and Quantum Molecular Dynamics (QMD) type codes. However, when the codes were compared in full heavy-ion collisions using different physical models, as recently for pion production, they still yielded substantially different results. This calls for further comparisons of heavy-ion collisions with controlled models and of box comparisons of important ingredients, like momentum-dependent fields, which are currently underway. Furthermore, our evaluation studies often indicate improved strategies in performing transport simulations and thus can provide guidance to code developers. Results of transport simulations of heavy-ion collisions from a given code will have more significance if the code can be validated against benchmark calculations such as the ones summarized in this review.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Charge state evolution in the solar wind. III. Model comparison with observations

We test three theoretical models of the fast solar wind with a set of remote sensing observations and in-situ measurements taken during the minimum of solar cycle 23. First, the model electron density and temperature are compared to SOHO/SUMER spectroscopic measurements. Second, the model electron density, temperature, and wind speed are used to predict the charge state evolution of the wind plasma from the source regions to the freeze-in point. Frozen-in charge states are compared with Ulysses/SWICS measurements at 1 AU, while charge states close to the Sun are combined with the CHIANTI spectral code to calculate the intensities of selected spectral lines, to be compared with SOHO/SUMER observations in the north polar coronal hole. We find that none of the theoretical models are able to completely reproduce all observations; namely, all of them underestimate the charge state distribution of the solar wind everywhere, although the levels of disagreement vary from model to model. We discuss possible causes of the disagreement, namely, uncertainties in the calculation of the charge state evolution and of line intensities, in the atomic data, and in the assumptions on the wind plasma conditions. Last, we discuss the scenario where the wind is accelerated from a region located in the solar corona rather than in the chromosphere as assumed in the three theoretical models, and find that a wind originating from the corona is in much closer agreement with observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Diurnal Variations of Stratospheric Ozone Measured by Ground-Based Microwave Remote Sensing at the Mauna Loa NDACC Site: Measurement Validation and GEOSCCM Model Comparison

There is presently renewed interest in diurnal variations of stratospheric and mesospheric ozone for the purpose of supporting homogenization of records of various ozone measurements that are limited by the technique employed to being made at certain times of day. We have made such measurements for 19 years using a passive microwave remote sensing technique at the Mauna Loa Observatory (MLO) in Hawaii, which is a primary station in the Network for Detection of Atmospheric Composition Change (NDACC). We have recently reprocessed these data with hourly time resolution to study diurnal variations. We inspected differences between pairs of the ozone spectra (e.g., day and night) from which the ozone profiles are derived to determine the extent to which they may be contaminated by diurnally varying systematic instrumental or measurement effects. These are small, and we have reduced them further by selecting data that meet certain criteria that we established. We have calculated differences between profiles measured at different times: morning-night, afternoon-night, and morning-afternoon and have intercompared these with like profiles derived from the Aura Microwave Limb Sounder (Aura-MLS), the Upper Atmosphere Research Satellite Microwave Limb Sounder (UARS-MLS),t he Superconducting Submillimeter-Wave Limb-Emission Sounder (SMILES), and Solar Backscatter Ultraviolet version 2 (SBUV2) measurements. Differences between averages of coincident profiles are typically less than 1.5 percent of typical nighttime values over most of the covered altitude range with some exceptions. We calculated averages of ozone values for each hour from the Mauna Loa microwave data, and normalized these to the average for the first hour after midnight for comparison with corresponding values calculated with the Goddard Earth Observing System Chemistry Climate Model (GEOSCCM). We found that the measurements and model output mostly agree to better than 1.5 percent of the midnight value, with one noteworthy exception: The measured morning-night values are significantly (2-3 percent) higher than the modeled ones from 3.2 to 1.8 hPa (approximately 39-43 km), and there is evidence that the measured values are increasing compared to the modeled values before sunrise in this region.

GEOSCCM model comparison↗

Antarctic ice sheet model comparison with uncurated geological constraints shows that higher spatial resolution improves deglacial reconstructions

Accurately reconstructing past changes to the shape and volume of the Antarctic ice sheet relies on the use of physically based and thus internally consistent ice sheet modeling, benchmarked against spatially limited geologic data. The challenge in model benchmarking against geologic data is diagnosing whether model-data misfits are the result of an inadequate model, inherently noisy or biased geologic data, and/or incorrect association between modeled quantities and geologic observations. In this work we address this challenge by (i) the development and use of a new model-data evaluation framework applied to an uncurated data set of geologic constraints, and (ii) nested high-spatial-resolution modeling designed to test the hypothesis that model resolution is an important limitation in matching geologic data. While previous approaches to model benchmarking employed highly curated datasets, our approach applies an automated screening and quality control algorithm to an uncurated public dataset of geochronological observations (specifically, cosmogenic-nuclide exposure-age measurements from glacial deposits in ice-free areas). This optimizes data utilization by including more geological constraints, reduces potential interpretive bias, and allows unsupervised assimilation of new data as they are collected. We also incorporate a nested model framework in which high-resolution domains are downscaled from a continent-wide ice sheet model. We highlight the application of this framework by applying these methods to a small ensemble of deglacial ice-sheet model simulations, and demonstrate that the nested approach improves the ability of model simulations to match exposure age data collected from areas of complex topography and ice flow. We develop a range of diagnostic model-data comparison metrics to provide more insight into model performance than possible from a single-valued misfit statistic, showing that different metrics capture different aspects of ice sheet deflation.

Geosciences↗

Magnetospheric substorm models - Comparison with neutral sheet magnetic field observations

Four models for geomagnetic substorms, a quiet tail model, and models incorporating structural effects of the tail are examined for consistency with magnetic-field data during satellite crossings of the tail neutral sheet/plasma sheet. For this data the tearing mode instability model is always consistent, and inward moving distant neutral line is sometimes consistent, quasi-steady reconnection with slow shock and intermediate wave structure and locally quiet tail rarely consistent, and an outward propagating rarefaction wave is never consistent with the magnetic observations. In several cases structural effects of the tail are consistent with key features of the magnetic signatures.

Speiser, T. W.↗

The GEOS Chemistry Climate Model: Comparisons to Satellite Data

The Goddard Earth Observing System Chemistry Climate Model (GEOS CCM) has been developed by combining the atmospheric chemistry and transport modules developed over the years at Goddard and the GEOS general circulation model, also developed at Goddard. We will compare model simulations of ozone, and the minor constituents that affect ozone, for the period around 1980 with newly released revised data from the Limb Infrared Monitor of the Stratosphere (LIMS) instrument on Nimbus 4. We will also compare model simulations for the period of the early 2000s with the data from the Microwave Limb Sounder (MLS) and the High Resolution Dynamic Limb Sounder (HRDLS) on the Aura satellite. We will use these comparisons to examine the performance of the model for the present atmosphere and for the change that has occurred during the last 2 decades of ozone loss due to chlorine and bromine compounds released from chlorofluorocarbons and halons.

Stolarski, Richard S.↗

A modeling comparison of deep greenhouse gas emissions reduction scenarios by 2030 in California

California aims to reduce greenhouse gas (GHG) emissions to 40% below 1990 levels by 2030. We compare six energy models that have played various roles in informing the state policymakers in setting climate policy goals and targets. These models adopt a range of modeling structures, including stock-turnover back-casting models, a least-cost optimization model, macroeconomic/macro-econometric models, and an electricity dispatch model. Results from these models provide useful insights in terms of the transformations in the energy system required, including efficiency improvements in cars, trucks, and buildings, electrification of end-uses, low- or zero-carbon electricity and fuels, aggressive adoptions of zero-emission vehicles (ZEVs), demand reduction, and large reductions of non-energy GHG emissions. Some of these studies also suggest that the direct economic costs can be fairly modest or even generate net savings, while the indirect macroeconomic benefits are large, as shifts in employment and capital investments could have higher economic returns than conventional energy expenditures. These models, however, often assume perfect markets, perfect competition, and zero transaction costs. They also do not provide specific policy guidance on how these transformative changes can be achieved. Greater emphasis on modeling uncertainty, consumer behaviors, heterogeneity of impacts, and spatial modeling would further enhance policymakers' ability to design more effective and targeted policies. Here, this paper presents an example of how policymakers, energy system modelers and stakeholders interact and work together to develop and evaluate long-term state climate policy targets. Lastly, even though this paper focuses on California, the process of dialogue and interactions, modeling results, and lessons learned can be generally adopted across different regions and scales.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Projecting spatiotemporally explicit effects of climate change on stream temperature: A model comparison and implications for coldwater fishes

Conservation planners and resource managers seek information about how the availability and locations of cold-water habitats will change in the future and how these predictions vary among models. In this work, we used a physical process-based model to demonstrate the implications of climate change for streamflow and water temperature in two watersheds with distinctive flow regimes: the Snoqualmie watershed (WA) and Siletz watershed (OR), USA. Our model incorporated a downscaled ensemble of global climate model outputs and was calibrated with in situ and remotely sensed water temperatures. Furthermore, we compared predictions from our processed-based model to those from a publicly available and widely used statistical model. The process-based model projected greater changes in summer maximum water temperatures for the mixed-rain-snow Snoqualmie watershed than for the rain-dominated Siletz watershed as a result of the near-complete loss of winter snowpack and significant reduction in summer flow in the Snoqualmie watershed expected by the 2080s. Both models projected generally similar future spatial patterns of maximum water temperature in the two rivers, with cool reaches distributed farther upstream and fewer in number. However, the process-based model projected higher spatial heterogeneity in water temperature due to our spatially explicit simulation of streamflow and because we calibrated the model with spatially continuous remotely sensed water temperature data. We used stream temperature projections to assess the vulnerability of Pacific salmon and trout to changes in the spatial distribution of cold-water habitats during August by the 2080s. Results suggest that salmonids may have fewer summertime cold-water habitats in both watersheds. Projected stream warming may further limit particular species and life stages, especially in the Snoqualmie watershed. Our comparison of models highlights the importance of considering what might be gained by using a process-based model for evaluating and prioritizing management actions that mitigate climate impacts on cold-water habitats for stream fishes.

54 ENVIRONMENTAL SCIENCES↗