Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Crop weather models of corn and soybeans for Agrophysical Units (APU's) in Iowa using monthly meteorological predictors

Models based on multiple regression were developed to estimate corn and soybean yield from weather data for agrophysical units (APU) in Iowa. The predictor variables are derived from monthly average temperature and monthly total precipitation data at meteorological stations in the cooperative network. The models are similar in form to the previous models developed for crop reporting districts (CRD). The trends and derived variables were the same and the approach to select the significant predictors was similar to that used in developing the CRD models. The APU's were selected to be more homogeneous with respect crop to production than the CRDs. The APU models are quite similar to the CRD models, similar explained variation and number of predictor variables. The APU models are to be independently evaluated and compared to the previously evaluated CRD models. That comparison should indicate the preferred model area for this application, i.e., APU or CRD.

Leduc, S.↗

Crop weather models of barley and spring wheat yield for agrophysical units in North Dakota

Models based on multiple regression were developed to estimate barley yield and spring wheat yield from weather data for Agrophysical units(APU) in North Dakota. The predictor variables are derived from monthly average temperature and monthly total precipitation data at meteorological stations in the cooperative network. The models are similar in form to the previous models developed for Crop Reporting Districts (CRD). The trends and derived variables were the same and the approach to select the significant predictors was similar to that used in developing the CRD models. The APU models show sight improvements in some of the statistics of the models, e.g., explained variation. These models are to be independently evaluated and compared to the previously evaluated CRD models. The comparison will indicate the preferred model area for this application, i.e., APU or CRD.

Leduc, S.↗

Near-wall modeling of the dissipation rate equation

Near-wall modeling of the dissipation rate equation is investigated and its asymptotic behavior is studied in detail using a k-epsilon model. It is found that all existing modeled dissipation rate equations predict an incorrect behavior for the dissipation rate near a wall. An improvement is proposed and the resulting near-wall dissipation rate distribution is found to be similar to that given by numerical simulation data. To further validate the improved k-epsilon model, it is used to calculate flat-plate turbulent boundary-layer flows at high- as well as low-turbulence Reynolds numbers, and the results are compared with measurements, numerical simulation data, and the calculations of three different two-equation models. These comparisons show that all the models tested give essentially the same flow properties away from the wall; significant differences only occur in a region very close to the wall. In this region, the calculations of the improved k-epsilon model are in better agreement with measurements and numerical simulation data. In particular, the modeled distribution of the dissipation rate is significantly improved and a maximum is predicted at the wall instead of away from the wall. Furthermore, the improved k-epsilon model is found to be the most asymptotically consistent among the four different two-equation models examined.

So, R. M. C.↗

Microwave Signatures of Snow on Sea Ice: Modeling

Accurate knowledge of snow-depth distribution over sea ice is critical for polar climate studies. Current snow-depth-over-sea-ice retrieval algorithms do not sufficiently account for variations in snow and ice physical properties that can affect the accuracy of retrievals. For this reason, airborne microwave observations were coordinated with ground-based measurements of snow depth and snow properties in the vicinity of Barrow, AK, in March 2003. In this paper, the effects of snowpack properties and ice conditions on microwave signatures are examined using detailed surface-based measurements and airborne observations in conjunction with a thermal microwave-emission model. A comparison of the Microwave Emission Model of Layered Snowpacks (MEMLS) simulations with detailed snowpack and ice data from stakes along the Elson Lagoon and the Beaufort Sea and ra- 'diometer data taken from low-level flights using a Polarimetric Scanning Radiometer (PSR-A) shows that MEMLS can be used to simulate snow on sea ice and is a useful tool for understanding the limitations of the snow-depth algorithm. Analysis of radiance data taken over the Elson Lagoon and the Beaufort Sea using MEMLS suggests that the radiometric differences between the two locations are due to the differences in sea-ice emissivity. Furthermore, measured brightness temperatures suggest that the current snow-depth retrieval algorithm is sufficient for areas of smooth first-year sea ice, whereas new algorithm coefficients are needed for rough first-year sea ice. Snowpack grain size and density remain an unresolved issue for snow-depth retrievals using passive-microwave radiances.

Powell, D. C.↗

Estimating Model Prediction Error: Should You Treat Predictions as Fixed or Random?

Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEP fixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEP uncertain( X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEP uncertain (X) can be estimated using a random effects ANOVA. It is argued that MSEP uncertain (X) is the more informative uncertainty criterion, because it is specific to each prediction situation.

model structure uncertainty↗

VESIcal Part I: An open-source thermodynamic model engine for mixed volatile (H2O-CO2) solubility in silicate melts

Thermodynamics has been fundamental to the interpretation of geologic data and modeling of geologic systems for decades. However, more recent advancements in computational capabilities and a marked increase in researchers’ accessibility to computing tools has outpaced the functionality and extensibility of currently available modeling tools. Here we present VESIcal (Volatile Equilibria and Saturation Identification calculator): the first comprehensive modeling tool for H 2 O, CO 2 , and mixed (H 2 O-CO 2 ) solubility in silicate melts that: a) allows users access to seven commonly used models, plus easy inter-comparison between models; b) provides universal functionality for all models (e.g., functions for calculating saturation pressures, degassing paths, etc.); c) can process large datasets (1,000’s of samples) automatically; d) can output computed data into an excel spreadsheet for simple post-modeling analysis; e) integrates advanced plotting capabilities directly within the tool; and f) provides all of these within the framework of a python library, making the tool extensible by the user and allowing any of the model functions to be incorporated into any other code capable of calling python. The tool is presented within this manuscript, which is a Jupyter notebook containing worked examples accessible to python users with a range of skill levels. The basic functions of VESIcal can also be access via a web app (https://vesical.anvil.app). The VESIcal python library is open-source and available for download at https://github.com/kaylai/VESIcal.

K. Iacovino↗

VESIcal: An Open-source Thermodynamic Model Engine for Mixed Volatile (H2O-CO2) Solubility in Silicate Melts

Modeling the solubility of volatiles in silicate melts is fundamental to the interpretation of volcanic systems and has implications for magma dynamics, eruption style, and material transport between the mantle, crust, and atmosphere. Recent advancements in computational capabilities and access to computing tools has outpaced the functionality and extensibility of previously available modeling platforms. Here we present VESIcal (Volatile Equilibria and Saturation Index calculator), the first comprehensive modeling tool for H2O, CO2, and mixed (H2O-CO2) solubility in silicate melts that: a) allows users access to seven popular models, with easy inter-comparison between models; b) provides universal functionality for all models (e.g., functions for calculating saturation pressures, degassing paths, etc.); c) can process large datasets (1,000’s of samples) automatically; d) can output computed data into an Excel spreadsheet or CSV file for post-modeling analysis; e) integrates plotting capabilities directly within the tool; and f) provides all of this within the framework of a python library, making the tool extensible by the user and allowing any of the model functions to be incorporated into any other code capable of calling python.Here we will provide a demonstration of VESIcal and its capabilities with applications to various volcanic processes affected by volatiles. VESIcal represents the first tool capable of directly comparing multiple solubility models and equations of state. We find that commonly used models predict surprisingly different volatile solubilities, particularly for pure CO2 or mixed CO2-H2O fluids. Even for melt compositions that are well represented in the calibration datasets of multiple models (e.g., MORBs), calculated solubilities for pure CO2 and pure H2O can deviate from one another by factors of >2 leading to 2x deviations in calculated saturation pressures (e.g., 5 to 10 kbar). The solubility of CO2 predicted by different rhyolitic models also differs substantially, overwhelming other sources of uncertainty such as analytical errors on measurements of volatile contents or uncertainties in crustal density profiles. This highlights the importance of model choice when drawing geological conclusions based on volatiles in magmas.

Kayla Iacovino↗

Community Coordinated Modeling Center: Addressing Needs of Operational Space Weather Forecasting

Models are key elements of space weather forecasting. The Community Coordinated Modeling Center (CCMC, http://ccmc.gsfc.nasa.gov) hosts a broad range of state-of-the-art space weather models and enables access to complex models through an unmatched automated web-based runs-on-request system. Model output comparisons with observational data carried out by a large number of CCMC users open an unprecedented mechanism for extensive model testing and broad community feedback on model performance. The CCMC also evaluates model's prediction ability as an unbiased broker and supports operational model selections. The CCMC is organizing and leading a series of community-wide projects aiming to evaluate the current state of space weather modeling, to address challenges of model-data comparisons, and to define metrics for various user s needs and requirements. Many of CCMC models are continuously running in real-time. Over the years the CCMC acquired the unique experience in developing and maintaining real-time systems. CCMC staff expertise and trusted relations with model owners enable to keep up to date with rapid advances in model development. The information gleaned from the real-time calculations is tailored to specific mission needs. Model forecasts combined with data streams from NASA and other missions are integrated into an innovative configurable data analysis and dissemination system (http://iswa.gsfc.nasa.gov) that is accessible world-wide. The talk will review the latest progress and discuss opportunities for addressing operational space weather needs in innovative and collaborative ways.

Kuznetsova, M.↗

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗

Large-database cross-verification and validation of tokamak transport models using baselines for comparison

State-of-the-art 1D transport solvers ASTRA and TRANSP are verified, then validated across a large database of semi-randomly selected, time-dependent DIII-D discharges. Various empirical models are provided as baselines to contextualize the validation figures of merit using statistical hypothesis tests. For predicting plasma temperature profiles, no statistically significant advantage is found for the ASTRA and TRANSP simulators over a baseline empirical (two-parameter) model. For predicting stored energy, a significant advantage is found for the simulators over a baseline empirical model based on confinement time scaling. Uncertainty in the results due to diagnostic and profile fitting uncertainties is approximated and determined to be insignificant due in part to the large quantity of discharges employed in the study. Advantages are discussed for validation methodologies like this one that employ (1) large databases and (2) baselines for comparison that are specific to the intended use-case of the model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Earth Global Reference Atmospheric Model (GRAM) Overview and Comparison to Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2)

Earth-GRAM (Earth-Global Reference Atmospheric Model) Overview: Provides monthly statistics at any point in the atmosphere; Monthly, geographic, altitude variation; Current Version - Earth-GRAM 2016, C++; Output Includes - pressure, density, temperature, horizontal and vertical winds, speed of sound, atmospheric constituents; Used by engineering community to create atmospheric dispersions at a rapid runtime; Not a forecast model. MERRA-2 (Modern-Era Retrospective Analysis for Research and Applications, Version 2) Background: Developed by NASA Goddard Modelling and Assimilation Office; Horizontal Resolution: 0.625 degrees by 0.5 degrees longitude-by-latitude grid (NCEP (National Centers for Environmental Prediction) reanalysis I vs. 2.5 degrees by 2.5 degrees currently used in Earth-GRAM); Vertical resolution: 72 model layers or interpolated to 42 pressure levels to 0.1 hectopascals (hPa) (NCEP reanalysis I, surface to 10hPa at 17 pressure levels).

White, Patrick W.↗

Comparison of gas dynamic model with steady solar wind flow around Venus

A gas dynamic model for solar wind flow around Venus has been compared with Pioneer Venus orbiter plasma analyzer measurements from times when the solar wind flow seemed steadiest. The comparisons were made near the terminator. When the observed and model bow shock locations are matched, the model agrees fairly well with the observed parameters: the components of the flow velocity and magnetic field, and the proton number density and isotropic temperature. However, the Mach numbers required to fit the observed bow shock locations are less than 2/3 those estimated from the measured parameters of the free-stream flow, because the bow shock locations (near the terminator) are farther from Venus than expected. Sometimes the measured flow speeds appear to be retarded near the ionopause.

Mihalov, J. D.↗

Using Atmospheric Trace Gas Vertical Profiles to Evaluate Model Fluxes: A Case Study of Arctic-Cap Observations and Geos Simulations for the ABoVE Domain

Accurate estimates of carbon–climate feedbacks require an independent means for evaluating surface flux models at regional scales. The altitude-integrated enhancement (AIE) derived from the Arctic Carbon Atmospheric Profiles (Arctic-CAP) project demonstrates the utility of this bulk quantity for surface flux model evaluation. This bulk quantity leverages background mole fraction values from the middle free troposphere, is agnostic to uncertainties in boundary layer height, and can be derived from model estimates of mole fractions and vertical gradients. To demonstrate the utility of the bulk quantity, six airborne profiling surveys of atmospheric carbon dioxide (CO2), methane (CH4), and carbon monoxide (CO) throughout Alaska and northwestern Canada between April and November 2017 were completed as part of NASA’s Arctic–Boreal Vulnerability Experiment (ABoVE). The Arctic-CAP sampling strategy involved acquiring vertical profiles of CO2, CH4, and CO from the surface to 5 km altitude at 25 sites around the ABoVE domain on a 4- to 6-week time interval. All Arctic-CAP measurements were compared to a global simulation using the Goddard Earth Observing System (GEOS) modeling system. Comparisons of the AIE bulk quantity from aircraft observations and GEOS simulations of atmospheric CO2, CH4, and CO highlight the fidelity of the modeled surface fluxes. The model–data comparison over the ABoVE domain reveals that while current state-of-the-art models and flux estimates are able to capture broad-scale spatial and temporal patterns in near-surface CO2 and CH4 concentrations, more work is needed to resolve fine-scale flux features that are captured in CO observations

CO2↗

Coronal Physics and the Chandra Emission Line Project

With the launch of the Chandra X-ray Observatory, high resolution X-ray spectroscopy of cosmic sources has begun. Early, deep observations of three stellar coronal sources will provide not only invaluable calibration data, but will also give us benchmarks for plasma spectral modeling codes. These codes are to interpret data from stellar coronae, galaxies and clusters of galaxies. supernova remnants and other astrophysical sources, but they have been called into question in recent years as problems with understanding moderate resolution ASCA and EUVE data have arisen. The Emission Line Project is a collaborative effort to improve the models, with Phase 1 being the comparison of models with observed spectra of Capella, Procyon, and HR, 1099. Goals of these comparisons are (1) to determine and verify accurate and robust diagnostics and (2) to identify and prioritize issues in fundamental spectroscopy which will require further theoretical and/or laboratory work. A critical issue in exploiting the coronal data for these purposes is to understand the extent to which common simplifying assumptions (coronal equilibrium, time-independence, negligible optical depth) apply. We will discuss recent advances in our understanding of stellar coronae in this context.

Brickhouse, Nancy↗

Coronal Physics and the Chandra Emission Line Project

With the launch of the Chandra X-ray Observatory, high resolution X-ray spectroscopy of cosmic sources has begun. Early, deep observations of three stellar coronal sources Capella, Procyon, and HR 1099 are providing not only invaluable calibration data, but also benchmarks for plasma spectral models. These models are needed to interpret data from stellar coronae, galaxies and clusters of galaxies, supernova, remnants and other astrophysical sources. They have been called into question in recent years as problems with understanding low resolution ASCA and moderate resolution Extreme Ultraviolet Explorer Satellite (EUVE) data have arisen. The Emission Line Project is a collaborative effort, to improve the models, with Phase I being the comparison of models with observed spectra of Capella, Procyon, and HR 1099. Goals of these comparisons are (1) to determine and verify accurate and robust diagnostics and (2) to identify and prioritize issues in fundamental spectroscopy which will require further theoretical and/or laboratory work. A critical issue in exploiting the coronal data for these purposes is to understand the extent, to which common simplifying assumptions (coronal equilibrium, negligible optical depth) apply. We will discuss recent, advances in our understanding of stellar coronae, in this context.

Brickhouse, N. S.↗

Automated rendezvous and docking with video imagery

For rendezvous and docking, assessing and tracking relative orientation is necessary within a minimum approach distance. Special target light patterns have previously been considered for use with video sensors for ease of determining relative orientation. A generalization of those approaches is addressed. At certain ranges, the entire structure of the target vehicle constitutes an acceptable target; at closer ranges, substructures will suffice. Acting on the same principle as the human intelligence, these structures can be compared with a memory model to assess the relative orientation and range. Models for comparison are constructed from a CAD facet model and current imagery. This approach requires fast image handling, projection, and comparison techniques which rely on rapidly developing parallel processing technology. Relative orientation and range assessment consists of successful comparison of the perceived target aspect with a known aspect. Generating a known projection from a model within required times, say subsecond times, is only now approaching feasibility. With this capability, rates of comparison used by the human brain can be approached and arbitrary known structures can be compared in reasonable times. Future space programs will have access to powerful computation devices which far exceed even this capability. For example, the possibility will exist to assess unknown structures and then control rendezvous and docking, all at very fast rates. The first step which has the current utility, namely applying this to known structures, is taken.

Rodgers, Mike↗

Comparison of Two Statistical Models for Low Boom Dose-response Relationships with Correlated Responses

This study compares two statistical models to construct summary dose-response curves for low boom community noise surveys. Data from two NASA field surveys are used that consist of multiple responses per survey participant. These data require an approach that accounts for the correlation among repeated annoyance observations from the same participant. A multilevel model accounts for the correlation by allowing estimated parameters to vary with each survey participant. On the other hand, a population average model utilizes generalized estimating equations and accounts for the correlation via a userspecified within-subject correlation structure. A visual comparison of the dose-response curves for these two methods reveals similar results. When comparing specific points along the summary curves, the multilevel model yields more precise confidence bounds than the population average model. The similarity between the summary curves derived from each model lends validity to both approaches for approximating a population representative summary curve, though modeling assumptions may lend favor to the multilevel logistic modeling approach over the population average model.

dose-response↗

Comparisons of Integrated Radiation Transport Models with Microdosimetry Data in Spaceflight

Astronauts are exposed to galactic cosmic rays (GCR), trapped protons, and possible solar particle events (SPE) during spaceflight. For such complicated mixtures of radiation types and kinetic energies, tissue equivalent proportional counters (TEPC's) represent a simple time-dependent approach for radiation monitoring. Of interest in radiation protection is the average quality factor of a radiation field defined as a function of linear energy transfer, LET, Q(sub ave)(LET). However TEPC's measure the average quality factors as a function of lineal energy (y), Q(sub ave)(y) defined as the average energy deposition in a volume divided by the average chord length of the volume. Lineal energy, y deviates from LET due to energy straggling, delta-ray escape or entry, and nuclear fragments produced in the detector. Using integrated space radiation models that includes the transport code HZETRN/BRYNTRN, the quantum nuclear interaction model, QMSFRG, and results from Monte-Carlo track simulations of TEPC's response to ions, we consider comparisons of model calculations to TEPC results from NASA missions in low Earth orbit and make predictions for lunar and Mars missions. Good agreement between the model and measured spectra from past NASA missions is found. A finding of this work is that TEPC's values for trapped or solar protons of Q(sub ave)(y) range from 1.9-2.5, overestimating Q(sub ave)(LET), which ranges from 1.4-1.6 with both quantities increasing with shielding depth due to nuclear secondaries Comparisons for the complete GCR spectra show that Q(sub ave)(LET) for GCR is approximately 3.5-4.5, while TEPC's measure 2.9-3.4 for Q(sub ave)(y) with the GCR values decreasing with depth as heavy ions are absorbed in shielding material. Our results support the use of TEPC's for space radiation environmental monitoring when computational analysis is used for proper data interpretation.

Cucinotta, Francis A.↗