Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Evaluating the Taylor hardening model in polycrystalline Ti using high energy X-ray diffraction microscopy

High energy X-ray diffraction microscopy (HEDM) was employed to index nearly 1000 grains in a polycrystalline Ti specimen and characterize their deformation during an incremental tensile test. For each grain, the positions of its associated diffraction peaks were used for analyzing its evolving crystal orientation and stress tensor. The azimuthal breadth of each peak at different load steps was measured, allowing measurement of initial yielding and providing an estimate of the dislocation density evolution in each grain. Furthermore, the Taylor hardening model was evaluated grain by grain using the above data, indicating that it can represent hardening in most grains. The yield stress and the strain hardening coefficient for all grains were statistically analyzed with respect to grain orientation, grain size, slip systems, and the surrounding neighborhood to examine how the yield stress and hardening are correlated.

36 MATERIALS SCIENCE↗

The development of methods for primary mast cells in vitro and ex vivo: An historical review

Highlights: • Mast cells form a first-line defense of immune system against various challenges. • Over the past few decades, technologies for acquiring mast cells have been continually optimized. • The advantages and applicability of diverse mast cell models evaluated. • It is important to choose a proper cell source for mast cell-related experiments. Mast cells (MCs) are tissue-based stationary effector cells that form the immune system's first-line defense against various challenges. They are developed from the bone marrow-derived progenitors to complete their differentiation and maturation in the tissues where they eventually establish residence. MCs have been implicated in many diseases, such as allergy, parasitic infection, and neoplastic disorders. Immortalized MC lines, such as RBL-2H3, HMC-1, and LAD-2, are useful for investigating the biological functions of MC only to some extents due to the restriction of degranulation evaluation, in vivo injection and other factors. Over the past few decades, technologies for acquiring primarily MCs have been continually optimized, and novel protocols have been proposed. However, no relevant publications have analyzed and summarized these techniques. In this review, the classical approaches for extracting MCs are generalized, and new methods with potential values are introduced. We also evaluate the advantages and applicability of diverse MC models. Since MCs exhibit substantial plasticity and functional diversity due to different origins, it is both necessary and urgent to select a reliable and suitable source of MCs for a particular study.

60 APPLIED LIFE SCIENCES↗

Assessing the accuracy of time-fraction and ductility exhaustion approaches for creep-fatigue damage prediction through feature-test validation

Determining creep-fatigue damage formation is critical for elevated temperature components integrity. This study evaluates creep-fatigue assessments with emphasis on differences between creep damage models. Evaluated are the time-fraction model and the classical and stress-modified ductility exhaustion creep damage models. This work extends the domain of stress-modified ductility exhaustion models by introducing and validating such formalism to Ni-based alloys. The fidelity of the assessments was benchmarked against uniaxial creep-fatigue and multiaxial feature tests of Alloy 617. For uniaxial specimens, best estimate predictions rank ductility exhaustion as the most accurate and precise and time-fraction as markedly conservative. For feature tests, ductility exhaustion predictions are within < 4.0 times difference, whereas time-fraction underpredicts life by factors of 7–14. The observations suggest ductility exhaustion models as alternative to time-fraction models in design codes for situations requiring characterization of the design margin. Further work in employing such models to assess other relevant phenomena (e.g., stress relaxation cracking) is discussed.

creep-fatigue↗

Microbial models with data‐driven parameters predict stronger soil carbon responses to climate change

Abstract Long‐term carbon (C) cycle feedbacks to climate depend on the future dynamics of soil organic carbon ( SOC ). Current models show low predictive accuracy at simulating contemporary SOC pools, which can be improved through parameter estimation. However, major uncertainty remains in global soil responses to climate change, particularly uncertainty in how the activity of soil microbial communities will respond. To date, the role of microbes in SOC dynamics has been implicitly described by decay rate constants in most conventional global carbon cycle models. Explicitly including microbial biomass dynamics into C cycle model formulations has shown potential to improve model predictive performance when assessed against global SOC databases. This study aimed to data‐constrained parameters of two soil microbial models, evaluate the improvements in performance of those calibrated models in predicting contemporary carbon stocks, and compare the SOC responses to climate change and their uncertainties between microbial and conventional models. Microbial models with calibrated parameters explained 51% of variability in the observed total SOC , whereas a calibrated conventional model explained 41%. The microbial models, when forced with climate and soil carbon input predictions from the 5th Coupled Model Intercomparison Project ( CMIP 5), produced stronger soil C responses to 95 years of climate change than any of the 11 CMIP 5 models. The calibrated microbial models predicted between 8% (2‐pool model) and 11% (4‐pool model) soil C losses compared with CMIP 5 model projections which ranged from a 7% loss to a 22.6% gain. Lastly, we observed unrealistic oscillatory SOC dynamics in the 2‐pool microbial model. The 4‐pool model also produced oscillations, but they were less prominent and could be avoided, depending on the parameter values.

Hararuk, Oleksandra↗

ELM model simulations of Plum Island Ecosystems LTER low marsh site 2018-2020

Model simulations using the Department of Energy's Energy Exascale Earth System Model (E3SM) land model (ELM) with improved capabilities to represent vegetation response to salinity and inundation. The simulations were conducted for a tidal salt marsh at Plum Island Ecosystems Long Term Ecological Research (LTER) site near Rowley, Massachusetts, USA; the site is a low marsh dominated by Spartina alterniflora. The model was forced with site-specific meteorology, salinity and tidal cycles from 2018-2020. Four sets of model simulations are included and described below:1. Parameterization of the salinity response function. These simulations tested different combinations of values for optimal salinity and salinity tolerance.2. Model evaluation. This comparison conducted simulations using the default model, the salinity function only, the submergence function only, and both the salinity and submergence functions. 3. Salinity scenarios. These simulations used the 2018 salinity input data varied by -5 to +10 ppt salinity.4. Water level scenarios. These simulations used the tide height varied by -10 to +50 cm. These simulations were used to demonstrate how the salinity and submergence functions better represent carbon uptake by tidal salt marshes.The data package includes netCDF files used as forcing files for tide height and salinity, one for each year 2018-2020 at observed salinity concentrations, and an additional three forcing files in which salinity concentrations were varied 5 ppt lower, 5 ppt higher, and 10 ppt higher than the measured 2018 time series. Also included are python scripts for creating forcing files, plain text parameter and command files for running simulations, model outputs in netCDF format, and python scripts for visualizing outputs. Code for the modified E3SM model is archived in Sulman et al 2023 at doi:10.15485/1991625. More detail about files is provided in the README.md file.

54 ENVIRONMENTAL SCIENCES↗

Perennialization and Cover Cropping Mitigate Soil Carbon Loss from Residue Harvesting

While the US Midwest is expected to serve as a primary feedstock source for cellulosic biofuel production, the impacts of residue harvesting on soil organic carbon (SOC) may greatly limit sustainable production capacity. However, viable feedstock production could be realized through adoption of management practices and cropping systems that offset residue‐harvest‐induced SOC losses. Sequestration of SOC can be enhanced by increasing the duration of crop soil cover through cover or double cropping or cultivation of dedicated perennials. However, assessing the efficacy of such options across sites and over long periods is experimentally challenging. Hence, we use the Environmental Productivity Integrated Climate (EPIC) model to provide such an assessment. Model‐data integration was used to calibrate and evaluate model suitability, which exhibited reasonable effectiveness through R 2 of 0.97 and 0.63 for SOC stock and yield, respectively. Long‐term simulations indicate considerable capacity for offsetting SOC loss. Incorporating rye ( Secale cereal L.) into continuous corn ( Zea mays L.) and corn–soybean [ Glycine max (L.) Merr.] systems offset the SOC losses induced by harvesting 21.2 and 38.3% of available stover, respectively. Similarly, converting 20.4% of corn–soybean land to miscanthus ( Miscanthus × giganteus J.M. Greef & Deuter ex Hodkinson & Renvoize) or 27.5% of land to switchgrass ( Panicum virgatum L.) offset the SOC impacts of harvesting 60% of stover from the remaining corn–soybean lands. These responses indicate that adoption of such measures would sizably affect the life cycle consequences of residue‐derived biofuels and expand estimates of sustainable cellulosic feedstock production capacity from the US Midwest. Core Ideas EPIC suitably assessed SOC under annual, cover, double, and perennial crops. Perennial cultivation offset the SOC losses of considerable residue harvesting. Rye double crops offset sizable residue‐induced SOC losses. Adoption could greatly expand Midwestern sustainable biofuel production capacity.

Jones, Curtis D.↗

Course: 17664 TSQP - Evaluation [Slides]

The purpose of this course is to help you understand evaluation concepts, Kirkpatrick’s Evaluation Model, and to be able to apply basic evaluation techniques to training courses, programs, and processes.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Simulating mixed-phase Arctic stratus clouds: Sensitivity to ice initiationmechanisms

The importance of Arctic mixed-phase clouds on radiation and the Arctic climate is well known. However, the development of mixed-phase cloud parameterization for use in large scale models is limited by lack of both related observations and numerical studies using multidimensional models with advanced microphysics that provide the basis for understanding the relative importance of different microphysical processes that take place in mixed-phase clouds. To improve the representation of mixed-phase cloud processes in the GISS GCM we use the GISS single-column model coupled to a bin resolved microphysics (BRM) scheme that was specially designed to simulate mixed-phase clouds and aerosol-cloud interactions. Using this model with the microphysical measurements obtained from the DOE ARM Mixed-Phase Arctic Cloud Experiment (MPACE) campaign in October 2004 at the North Slope of Alaska, we investigate the effect of ice initiation processes and Bergeron-Findeisen process (BFP) on glaciation time and longevity of single-layer stratiform mixed-phase clouds. We focus on observations taken during October 9th-10th, which indicated the presence of a single-layer mixed-phase clouds. We performed several sets of 12-hour simulations to examine model sensitivity to different ice initiation mechanisms and evaluate model output (hydrometeors concentrations, contents, effective radii, precipitation fluxes, and radar reflectivity) against measurements from the MPACE Intensive Observing Period. Overall, the model qualitatively simulates ice crystal concentration and hydrometeors content, but it fails to predict quantitatively the effective radii of ice particles and their vertical profiles. In particular, the ice effective radii are overestimated by at least 50%. However, using the same definition as used for observations, the effective radii simulated and that observed were more comparable. We find that for the single-layer stratiform mixed-phase clouds simulated, process of ice phase initiation due to freezing of supercooled water in both saturated and subsaturated (w.r.t. water) environments is as important as primary ice crystal origination from water vapor. We also find that the BFP is a process mainly responsible for the rates of glaciation of simulated clouds. These glaciation rates cannot be adequately represented by a water-ice saturation adjustment scheme that only depends on temperature and liquid and solid hydrometeors contents as is widely used in bulk microphysics schemes and are better represented by processes that also account for supersaturation changes as the hydrometeors grow.

54 ENVIRONMENTAL SCIENCES↗

Extracting scene feature vectors through modeling, volume 3

The remote estimation of the leaf area index of winter wheat at Finney County, Kansas was studied. The procedure developed consists of three activities: (1) field measurements; (2) model simulations; and (3) response classifications. The first activity is designed to identify model input parameters and develop a model evaluation data set. A stochastic plant canopy reflectance model is employed to simulate reflectance in the LANDSAT bands as a function of leaf area index for two phenological stages. An atmospheric model is used to translate these surface reflectances into simulated satellite radiance. A divergence classifier determines the relative similarity between model derived spectral responses and those of areas with unknown leaf area index. The unknown areas are assigned the index associated with the closest model response. This research demonstrated that the SRVC canopy reflectance model is appropriate for wheat scenes and that broad categories of leaf area index can be inferred from the procedure developed.

Berry, J. K.↗

Active Control of Space Structures (ACOSS) model 2

A complete description of the active control of space structures model #2 which is a simple but realistic evaluation model is given. The design of this system was driven by the desire to incorporate certain attributes into the overall system characteristics. The desired features were structural design based on realistic sizes and weights; a simple unclassified optical system with associated performance measures and tolerance; and a set of disturbances typical of equipment vibration and attitude control (slew). The resulting model is described in detail along with the resulting mode shapes and natural frequencies of the system. A description of the line-of-sight performance measure including theory and implementation is given.

Henderson, T. C.↗

Adaptive Modeling of the International Space Station Electrical Power System

Software simulations provide NASA engineers the ability to experiment with spacecraft systems in a computer-imitated environment. Engineers currently develop software models that encapsulate spacecraft system behavior. These models can be inaccurate due to invalid assumptions, erroneous operation, or system evolution. Increasing accuracy requires manual calibration and domain-specific knowledge. This thesis presents a method for automatically learning system models without any assumptions regarding system behavior. Data stream mining techniques are applied to learn models for critical portions of the International Space Station (ISS) Electrical Power System (EPS). We also explore a knowledge fusion approach that uses traditional engineered EPS models to supplement the learned models. We observed that these engineered EPS models provide useful background knowledge to reduce predictive error spikes when confronted with making predictions in situations that are quite different from the training scenarios used when learning the model. Evaluations using ISS sensor data and existing EPS models demonstrate the success of the adaptive approach. Our experimental results show that adaptive modeling provides reductions in model error anywhere from 80% to 96% over these existing models. Final discussions include impending use of adaptive modeling technology for ISS mission operations and the need for adaptive modeling in future NASA lunar and Martian exploration.

Thomas, Justin Ray↗

Tropical Cyclone Information System

The JPL Tropical Cyclone Infor ma tion System (TCIS) is a Web portal (http://tropicalcyclone.jpl.nasa.gov) that provides researchers with an extensive set of observed hurricane parameters together with large-scale and convection resolving model outputs. It provides a comprehensive set of high-resolution satellite (see figure), airborne, and in-situ observations in both image and data formats. Large-scale datasets depict the surrounding environmental parameters such as SST (Sea Surface Temperature) and aerosol loading. Model outputs and analysis tools are provided to evaluate model performance and compare observations from different platforms. The system pertains to the thermodynamic and microphysical structure of the storm, the air-sea interaction processes, and the larger-scale environment as depicted by ocean heat content and the aerosol loading of the environment. Currently, the TCIS is populated with satellite observations of all tropical cyclones observed globally during 2005. There is a plan to extend the database both forward in time till present as well as backward to 1998. The portal is powered by a MySQL database and an Apache/Tomcat Web server on a Linux system. The interactive graphic user interface is provided by Google Map.

Li, P. Peggy↗

The Response of Tropospheric Ozone to ENSO in Observations and a Chemistry-Climate Simulation

The El Nino-Southern Oscillation (ENSO) is the dominant mode of tropical variability on interannual time scales. ENSO appears to extend its influence into the chemical composition of the tropical troposphere. Recent results have revealed an ENSO induced wave-l anomaly in observed tropical tropospheric column ozone. This results in a dipole over the western and eastern tropical Pacific, whereby differencing the two regions produces an ozone anomaly with an extremely high correlation to the Nino 3.4 Index. We have successfully reproduced this result using the Goddard Earth Observing System Version 5 (GEOS-5) general circulation model coupled to a comprehensive stratospheric and tropospheric chemical mechanism forced with observed sea surface temperatures over the past 25 years. An examination of the modeled ozone field reveals the vertical contributions of tropospheric ozone to the column over the western and eastern Pacific region. We will show targeted comparisons with observations from NASA's Aura satellite Microwave Limb Sounder (MLS), and the Tropospheric Emissions Spectrometer (TES) to provide insight into the vertical structure of ozone changes. The tropospheric ozone response to ENSO could be a useful chemistry-climate model evaluation tool and should be considered in future modeling assessments.

Oman, L. D.↗

Modeling the Effects of Global Change on Ecosystem Processes in a Tropical Rainforest

Ongoing land-use change and climate change in wet tropical forests can potentially drive shifts in tree species composition, representing a change in individual species within a functional group, tropical evergreen trees. The impacts on the global carbon cycle are potentially large, but unclear. We explored the differential effects of species within this functional group, in comparison with the effects of climate change, using the Century model as a research tool. Simulating effects of individual tree species on biome-level biogeochemical cycles constituted a novel application for Century. Background and Objectives: A unique, long-term, replicated field experiment containing five evergreen tree species in monodominant stands under similar environmental conditions in a Costa Rican wet forest provided data for model evaluation. Our objectives were to gain insights about this forest’s biogeochemical cycles and effects of tree species within this functional group, in comparison with climate change. Materials and Methods: We calibrated Century, using long-term meteorological, soil, and plant data from the field-based experiment. In modeling experiments, we evaluated effects on forest biogeochemistry of eight plant traits that were both observed and modeled. Climate-change simulation experiments represented two climate-change aspects observed in this region. Results: Model calibration revealed that unmodeled soil processes would be required to sustain observed P budgets. In species-traits experiments, three separate plant traits (leaf death rate, leaf C:N, and allocation to fine roots) resulted in modeled biomass C stock changes of >50%, compared with a maximum 21% change in the climate-change experiments. Conclusions: Modeled ecosystem properties and processes in Century were sensitive to changes in plant traits and nutrient limitations to productivity. Realistic model output was attainable for some species, but unusual plant traits thwarted predictions for one species. Including more plant traits and soil processes could increase realism, but less-complex models provide an accessible means for exploring plant-soil-atmosphere interactions.

54 ENVIRONMENTAL SCIENCES↗

Neural Posterior Estimation for Scalable and Accurate Inverse Parameter Inference in Li-Ion Batteries

Diagnosing the internal state of Li-ion batteries is critical for battery research, operation of real-world systems, and prognostic evaluation of remaining lifetime. By using physics-based models to perform probabilistic parameter estimation via Bayesian calibration, diagnostics can account for the uncertainty due to model fitness, data noise, and the observability of any given parameter. However, Bayesian calibration in Li-ion batteries using electrochemical data is computationally intensive even when using a fast surrogate in place of physics-based models, requiring many thousands of model evaluations. A fully amortized alternative is neural posterior estimation (NPE). NPE shifts the computational burden from the parameter estimation step to data generation and model training, reducing the parameter estimation time from minutes to milliseconds, enabling real-time applications. The present work shows that NPE can infer parameters equally or more accurately than Bayesian calibration, even if it leads to higher voltage reconstruction errors. We also demonstrate that the higher computational costs for data generation are tractable even in high-dimensional cases (ranging from 6 to 27 estimated parameters). The NPE method also offers several interpretability advantages over Bayesian calibration, such as local parameter sensitivity to specific regions of the voltage curve. The NPE method is demonstrated using an experimental fast charge dataset, with parameter estimates validated against measurements of loss of lithium inventory and loss of active material. The implementation is made available in a companion repository (https://github.com/NatLabRockies/BatFIT).

25 ENERGY STORAGE↗

MODEL IMPLEMENTATION TO EVALUATE THE COLLECTIVE FUTURE RADIONUCLIDE RELEASES FROM MULTIPLE FACILITIES AT THE SAVANNAH RIVER SITE

A comprehensive Composite Analysis (CA) has been performed considering 152 sources of residual radioactive material at the Savannah River Site (SRS). As part of the CA a model was developed to perform deterministic base case calculations using the commercial GoldSim software. The model treated transport and decay of radionuclides as they are released at the source location and transported through the source region, vadose zone and aquifer to stream outcrops and from there to the Savannah River. A dose to the public was calculated assuming recreational use of stream water and residential use of river water. The specific results from the GoldSim modeling evaluation conducted as part of the CA indicate that the collective maximum dose resulting from the release of radionuclides from all 152 anticipated SRS End State sources of residual radionuclides demonstrate that maximum exposures expected to occur to any offsite MOP will not approach the 300 uSv/yr (30 mrem/yr) dose constraint, and in fact are currently estimated to be only 10% of this. For each of the POA's evaluated, the highest cumulative dose is realized at the Lower Three Runs POA and is calculated to be 29.7 uSv/yr (2.97 mrem/yr). The major dose contributing radionuclide for all of the POA's, with the exception of Upper Three Runs, was {sup 137}Cs in the contaminated streambed sediments. In Upper Three Runs {sup 237}Np from the H-Area Canyon Building was the major dose contributing radionuclide. The major exposure pathway for the SRS streams (where the Recreational Scenario was evaluated) was by the ingestion of fish. In the Savannah River, where the Residential Scenario was evaluated, ingestion of vegetation was the dominant exposure pathway. The uncertainty evaluation lends added assurance to the conclusion that the 30 mrem/yr dose constraint will not be exceeded, in that even at the 95th Percentile, this performance measure is not expected to be exceeded. It must also be added that these conclusions should be regarded as 'preliminary' since the DOE review process of the SRS CA has not yet been completed.

54 ENVIRONMENTAL SCIENCES↗

TESTING MODELS OF INTRINSIC BRIGHTNESS VARIATIONS IN TYPE Ia SUPERNOVAE AND THEIR IMPACT ON MEASURING COSMOLOGICAL PARAMETERS

For spectroscopically confirmed Type Ia supernovae we evaluate models of intrinsic brightness variations with detailed data/Monte Carlo comparisons of the dispersion in the following quantities: Hubble-diagram scatter, color difference (B - V - c) between the true B - V color and the fitted color (c) from the SALT-II light curve model, and photometric redshift residual. The data sample includes 251 ugriz light curves from the three-season Sloan Digital Sky Survey-II and 191 griz light curves from the Supernova Legacy Survey 3 year data release. We find that the simplest model of a wavelength-independent (coherent) scatter is not adequate, and that to describe the data the intrinsic-scatter model must have wavelength-dependent variations resulting in a {approx}0.02 mag scatter in B - V - c. Relatively weak constraints are obtained on the nature of intrinsic scatter because a variety of different models can reasonably describe this photometric data sample. We use Monte Carlo simulations to examine the standard approach of adding a coherent-scatter term in quadrature to the distance-modulus uncertainty in order to bring the reduced {chi}{sup 2} to unity when fitting a Hubble diagram. If the light curve fits include model uncertainties with the correct wavelength dependence of the scatter, we find that this approach is valid and that the bias on the dark energy equation-of-state parameter w is much smaller ({approx}0.001) than current systematic uncertainties. However, incorrect model uncertainties can lead to a significant bias on the distance moduli, with up to {approx}0.05 mag redshift-dependent variation. This bias is roughly reduced in half after applying a Malmquist bias correction. For the recent SNLS3 cosmology results, we estimate that this effect introduces an additional systematic uncertainty on w of {approx}0.02, well below the total uncertainty. This uncertainty depends on the choice of viable scatter models and the choice of supernova (SN) samples, and thus this small w-uncertainty is not guaranteed in future cosmology results. For example, the w-uncertainty for SDSS+SNLS (dropping the nearby SNe) increases to {approx}0.04.

79 ASTRONOMY AND ASTROPHYSICS↗