Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Towards A Flexible Framework for Community-Wide Ensemble Forecasting Tailored for Major Space Environment Impacts

To build continuously improving space weather predictive capabilities based on science and enable assessments and rapid implementations of advances in research into source-to-impact modelling systems we need: to assemble parts of the puzzle by solving problems focused on specific physical domains; to identify essential space environment quantities (ESEQs) passed between domains and linked to impacts; evaluate modeling capabilities for each ESEQ; connect all validated solutions from space weather origins on the sun to impacts on humans and critical infrastructure; to design displays for ensemble predictions tailored for major space weather user groups; to build a collaborative environment for efficient sharing of information and capabilities (models/data/expertise) and collaborative development. The presentation will overview existing community-wide space weather forecasting frameworks and research-to-operations pipelines and discuss opportunities to build a collaborative plug-and-play platform for interconnecting predictive capabilities developed under different space weather programs.

space weather↗

The impact of non-uniform thermal structure on the interpretation of exoplanet emission spectra

The determination of atmospheric structure and molecular abundances of planetary atmospheres via spectroscopy involves direct comparisons between models and data. While varying in sophistication, most model spectra comparisons fundamentally assume one-dimensional (1D) model physics. However, knowledge from general circulation models and of solar system planets suggests that planetary atmospheres are inherently three-dimensional in their structure and composition. We explore the potential biases resulting from standard “1D” assumptions within a Bayesian atmospheric retrieval framework. Specifically, we show how the assumption of a single 1D thermal profile can bias our interpretation of the thermal emission spectrum of a hot Jupiter atmosphere that is composed of two thermal profiles. We retrieve spectra of unresolved model planets as observed with a combination of the Hubble Space Telescope Wide Field Camera 3 (WFC3)+Spitzer Infrared Array Camera (IRAC) as well as the James Webb Space Telescope (JWST) under varying differences in the two thermal profiles. For WFC3+IRAC, there is a significantly biased estimate of CH{sub 4} abundance using a 1D model when the contrast is 80%. For JWST, two thermal profiles are required to adequately interpret the data and estimate the abundances when contrast is greater than 40%. We also apply this preliminary concept to the recent WFC3+IRAC phase curve data of the hot Jupiter WASP-43b. We see similar behavior as present in our simulated data: while the H{sub 2}O abundance determination is robust, CH{sub 4} is artificially well-constrained to incorrect values under the 1D assumption. Our work demonstrates the need to evaluate model assumptions in order to extract meaningful constraints from atmospheric spectra and motivates exploration of optimal observational setups.

79 ASTRONOMY AND ASTROPHYSICS↗

Recreating the California New Year's Flood Event of 1997 in a Regionally Refined Earth System Model

Abstract The 1997 New Year's flood event was the most costly in California's history. This compound extreme event was driven by a category 5 atmospheric river that led to widespread snowmelt. Extreme precipitation, snowmelt, and saturated soils produced heavy runoff causing widespread inundation in the Sacramento Valley. This study recreates the 1997 flood using the Regionally Refined Mesh capabilities of the Energy Exascale Earth System Model (RRM‐E3SM) under prescribed ocean conditions. Understanding the processes causing extreme events informs practical efforts to anticipate and prepare for such events in the future, and also provides a rich context to evaluate model skill in representing extremes. Three California‐focused RRM grids, with horizontal resolution refinement of 14 km down to 3.5 km, and six forecast lead times, 28 December 1996 at 00Z through 30 December 1996 at 12Z, are assessed for their ability to recreate the 1997 flood. Planetary to synoptic scale atmospheric circulations and integrated vapor transport are weakly influenced by horizontal resolution refinement over California. Topography and mesoscale circulations, such as the Sierra barrier jet, are better represented at finer horizontal resolutions resulting in better estimates of storm total precipitation and storm duration snowpack changes. Traditional time‐series and causal analysis frameworks are used to examine runoff sensitivities state‐wide and above major reservoirs. These frameworks show that horizontal resolution plays a more prominent role in shaping reservoir inflows, namely the magnitude and time‐series shape, than forecast lead time, 2‐to‐4 days prior to the 1997 flood onset.

54 ENVIRONMENTAL SCIENCES↗

Investigation of thermal-fluid mechanical characteristics of the capillary pump and the pumped two-phase loop

This first semi-annual report summarized progress made on NASA Goddard Space Flight Center (GSFC) Grant NAG 5-834 during the period September 1, 1986 to February 28, 1987. The goal of the project is to gain a better understanding of the transient behavior of the Capillary Pump Loop (CPL) developed and tested by the GSFC. The investigation is directed toward development of analytical models to represent the transient thermal-fluid mechanic processes occurring in different parts of the CPL engineering model. Evaluation of the available test data has been the starting point for the investigation. Based on results of this evaluation, supplementary tests will be conducted by using a CPL test system already operational in the Heat Transfer laboratory of the university. Of particular interest is the oscillatory behavior of the CPL engineering model exhibited during some of the earlier test runs conducted at NASA-GSFC and Johnson Space Center (JSC).

Kiper, Ali M.↗

Descent strategy comparisons for TNAV-equipped aircraft under airplane-preferred operating conditions

Three 4-D descent strategies were evaluated which were employed by TNAV-equipped aircraft in an advanced metering air traffic control environment. The Flow Management Evaluation Model (FMEM) was used to assess performance using three criteria when traffic enters the simulation under preferred cruise operating conditions (altitude and speed): throughput, fuel usage, and conflict probability. In comparison to an evaluation previously performed under NASA contract, the current analysis indicates that the optimal descent strategy is preferred over the clean-idle and constant descent angle (CFPA) strategies when all three criteria are considered.

Izumi, K. H.↗

Energy deposition and K-shell ionization of supernovae

We present explicit evaluation of K-shell ionization caused by photoelectric absorption, by Compton scattering, and by electron collisions in supernovae envelopes. Each process derives from the radioactivity that dominates the bolometric luminosity of the model supernovae. We include the ionization by bremsstrahlung. We find that electron-collision ionization with decelerating Compton electrons is the dominant process of K-shell ionization for light elements (lighter than Si) whereas photoelectric K-shell absorption of Comptonized gammas is the dominant process of K-shell ionization for heavy elements (like Fe). The relative importance of the ionization processes also depends upon composition and upon time, as well as upon supernova type. For Type Ia all four ionization sources are of importance. We present fitting formulas for the deposition of radioactive power in each class of models studied. The energy deposition of all mechanisms decreases with time, including the rate of K-shell ionizations of all elements throughout the supernovae model evaluated herein. We compare the relative contributions to the energy deposition and confirm with greater numerical detail results already established.

The, Lih-Sin↗

An Update on Global Satellite-Based Precipitation Products and Services at NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is home to major NASA satellite precipitation measurement missions including the Tropical Rainfall Measuring Mission (TRMM) and the Global Precipitation Measurement (GPM) as well as other NASA projects. Accurate and timely available global and regional precipitation products play an important role in research and applications around the world. The GES DISC provides near-real-time, near-global precipitation products (e.g.IMERG) to support a wide variety of interdisciplinary research and operational activities including flood modeling, landslides, crop monitoring and assessment, vector-borne diseases, etc. Climate data record products (e.g.GPCP3) are essential for climate research, assessment, model evaluation and applications. To facilitate data access and exploration, the GES DISC has developed data services such asGiovanni, an online visualization and analysis tool for easy access to over 2000 satellite- and model-based variables. Established in the mid 1980s, the GES DISC also distributes data in other disciplines including hydrology, atmospheric chemistry, atmospheric dynamics, etc. In this presentation, we will present an update on global precipitation products and data services including the new IMERG V06B suite, the latest version of GPCP (Version 3) and value-added data subsetting services (L34RS, L2S).

Liu, Zhong↗

Model of U3Si2 Fuel System using BISON Fuel Code

This research considers the proposed advanced fuel system: U3Si2 combined with an advanced cladding. U3Si2 has a number of advantageous thermophysical properties, which motivate its use as an accident tolerant fuel. This preliminary model evaluates the behavior of U3Si2 using available thermophysical data to predict the cladding-fuel pellet temperature and stress using the fuel performance code: BISON. The preliminary results obtained from the U3Si2 fuel model describe the mechanism of Pellet-Clad Mechanical Interaction for this system while more extensive testing including creep testing of U3Si2 is planned for improved understanding of thermophysical properties for predicting fuel performance.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Machine Learning in Nuclear Thermal Hydraulics, Part 2: Opportunities and Perspectives

This paper summarizes the issues in nuclear thermal hydraulics (NTH), mainly from the three named aspects, and illustrates potential opportunities of machine learning (ML) applications in dealing with these issues. These issues are problems in simultaneously realizing computational efficiency and accuracy of system thermal hydraulic (STH) modeling and simulation, uncertainty in the scaling analysis for the best-estimate calculations of transient and accident analysis, and difficulties in optimal data production and usage for the development and assessment of evaluation models. Due to ML uncertainty, data insufficiency, and lack of cognition about how to efficiently incorporate knowledge and data, challenges of adapting ML techniques still exist. Accordingly, several perspectives are proposed to provide insights for ML applications in solving these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Simulation of Continental Shallow Cumulus Populations Using an Observation-Constrained Cloud-System Resolving Model

Continental shallow cumulus (ShCu) clouds observed on 30 August 2016 during the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign are simulated by using an observation-constrained cloud-system resolving model. On this day, ShCu forms over Oklahoma and southern Kansas and some of these clouds transition to deeper, precipitating convection during the afternoon. We apply a four-dimensional ensemble-variational (4DEnVar) hybrid technique in the Community Gridpoint Statistical Interpolation (GSI) system to assimilate operational data sets and unique boundary layer measurements including a Raman lidar, radar wind profilers, radiosondes, and surface stations collected by the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) atmospheric observatory into the Weather Research and Forecasting (WRF) model to ascertain how improved environmental conditions can influence forecasts of ShCu populations and the transition to deeper convection. Independent observations from aircraft, satellite, as well as ARM's remote sensors are used to evaluate model performance in different aspects. Several model experiments are conducted to identify the impact of data assimilation (DA) on the prediction of clouds evolution. The analyses indicate that ShCu populations are more accurately reproduced after DA in terms of cloud initiation time and cloud base height, which can be attributed to an improved representation of the ambient meteorological conditions and the convective boundary layer. Extending the assimilation to 18 UTC (local noon) also improved the simulation of shallow-to-deep transitions of convective clouds.

54 ENVIRONMENTAL SCIENCES↗

Toward Improved Land Surface Initialization in Support of Regional WRF Forecasts at the Kenya Meteorological Department

Flooding and drought are two key forecasting challenges for the Kenya Meteorological Department (KMD). Atmospheric processes leading to excessive precipitation and/or prolonged drought can be quite sensitive to the state of the land surface, which interacts with the boundary layer of the atmosphere providing a source of heat and moisture. The development and evolution of precipitation systems are affected by heat and moisture fluxes from the land surface within weakly-sheared environments, such as in the tropics and sub-tropics. These heat and moisture fluxes during the day can be strongly influenced by land cover, vegetation, and soil moisture content. Therefore, it is important to represent the land surface state as accurately as possible in numerical weather prediction models. Enhanced regional modeling capabilities have the potential to improve forecast guidance in support of daily operations and high-end events over east Africa. KMD currently runs a configuration of the Weather Research and Forecasting (WRF) model in real time to support its daily forecasting operations, invoking the Nonhydrostatic Mesoscale Model (NMM) dynamical core. They make use of the National Oceanic and Atmospheric Administration / National Weather Service Science and Training Resource Center's Environmental Modeling System (EMS) to manage and produce the WRF-NMM model runs on a 7-km regional grid over eastern Africa. Two organizations at the National Aeronautics and Space Administration Marshall Space Flight Center in Huntsville, AL, SERVIR and the Short-term Prediction Research and Transition (SPoRT) Center, have established a working partnership with KMD for enhancing its regional modeling capabilities. To accomplish this goal, SPoRT and SERVIR will provide experimental land surface initialization datasets and model verification capabilities to KMD. To produce a land-surface initialization more consistent with the resolution of the KMD-WRF runs, the NASA Land Information System (LIS) will be run at a comparable resolution to provide real-time, daily soil initialization data in place of interpolated Global Forecast System soil moisture and temperature data. Additionally, real-time green vegetation fraction data from the Visible Infrared Imaging Radiometer Suite will be incorporated into the KMD-WRF runs, once it becomes publicly available from the National Environmental Satellite Data and Information Service. Finally, model verification capabilities will be transitioned to KMD using the Model Evaluation Tools (MET) package, in order to quantify possible improvements in simulated temperature, moisture and precipitation resulting from the experimental land surface initialization. The transition of these MET tools will enable KMD to monitor model forecast accuracy in near real time. This presentation will highlight preliminary verification results of WRF runs over east Africa using the LIS land surface initialization.

Case. Jonathan↗

A Model-Model and Data-Model Comparison for the Early Eocene Hydrological Cycle

A range of proxy observations have recently provided constraints on how Earth's hydrological cycle responded to early Eocene climatic changes. However, comparisons of proxy data to general circulation model (GCM) simulated hydrology are limited and inter-model variability remains poorly characterised. In this work, we undertake an intercomparison of GCM-derived precipitation and P - E distributions within the extended EoMIP ensemble (Eocene Modelling Intercomparison Project; Lunt et al., 2012), which includes previously published early Eocene simulations performed using five GCMs differing in boundary conditions, model structure, and precipitation-relevant parameterisation schemes. We show that an intensified hydrological cycle, manifested in enhanced global precipitation and evaporation rates, is simulated for all Eocene simulations relative to the preindustrial conditions. This is primarily due to elevated atmospheric paleo-CO2, resulting in elevated temperatures, although the effects of differences in paleogeography and ice sheets are also important in some models. For a given CO2 level, globally averaged precipitation rates vary widely between models, largely arising from different simulated surface air temperatures. Models with a similar global sensitivity of precipitation rate to temperature (dP=dT ) display different regional precipitation responses for a given temperature change. Regions that are particularly sensitive to model choice include the South Pacific, tropical Africa, and the Peri-Tethys, which may represent targets for future proxy acquisition. A comparison of early and middle Eocene leaf-fossil-derived precipitation estimates with the GCM output illustrates that GCMs generally underestimate precipitation rates at high latitudes, although a possible seasonal bias of the proxies cannot be excluded. Models which warm these regions, either via elevated CO2 or by varying poorly constrained model parameter values, are most successful in simulating a match with geologic data. Further data from low-latitude regions and better constraints on early Eocene CO2 are now required to discriminate between these model simulations given the large error bars on paleoprecipitation estimates. Given the clear differences between simulated precipitation distributions within the ensemble, our results suggest that paleohydrological data offer an independent means by which to evaluate model skill for warm climates.

Boundary conditions↗

A fast reduced model for a shell-and-tube based latent heat thermal energy storage heat exchanger and its application for cost optimal design by nonlinear programming

Numerical simulation of latent heat thermal energy storage (LHTES) systems plays a fundamental role in studying the physical process and guiding the engineering design. Discretization of the PDEs describing the nonlinear solidification/melting process of phase change materials (PCMs) leads to a large-scale complex dynamics system, where the system behavior depends on a set of parameters. In a design setting, repeated model evaluations are required over the set of parameters results in significant computational burden. In this paper, an explicit analytic solution was built for the propagation of the solidification front in a cylindrical coordinate. The analytic solution approach is further employed to develop a low computational reduced model (RM) as a module for a shell-and-tube based LHTES heat exchanger. The levelized Cost of Energy (LCOE) is used as a design metric and the RM model is used to apply system-level constraints in the nonlinear programming formulation that facilitates efficient global optimal design of the PCM properties, flow conditions and tube geometries. The use of LCOE as the design metric prevents over design of the heat transfer rate and also establishes a fair ground for evaluation of different thermal storage technologies and their integrated applications with other systems. Optimal results showed that a higher effectiveness results in a higher LCOE; the velocity of the HTF and the length of the channel are highly correlated with each other; both larger PCM latent energy and conductivity result in lower LCOE.

25 ENERGY STORAGE↗

Modeling Organic Aerosols during MILAGRO: Application of the CHIMERE Model and Importance of Biogenic Secondary Organic Aerosols

The meso-scale chemistry-transport model CHIMERE is used to assess our understanding of major sources and formation processes leading to a fairly large amount of organic aerosols [OA, including primary OA (POA) and secondary OA (SOA)] observed in Mexico City during the MILAGRO field project (March 2006). Chemical analyses of submicron aerosols from aerosol mass spectrometers (AMS) indicate that organic particles found in the Mexico City basin have a large fraction of oxygenated organic species (OOA), which have strong correspondence with SOA, and that their production actively continues downwind of the city. The SOA formation is modeled here by the first-generation oxidation of anthropogenic (i.e., aromatics, alkanes) and biogenic (i.e., monoterpenes and isoprene) precursors and their partitioning into both organic and aqueous phases. The near-surface model evaluation shows that predicted OA correlates reasonably well with measurements during the campaign, however it remains a factor of 2 lower than the measured total OA. Fairly good agreement is found between predicted and observed POA within the city suggesting that anthropogenic and biomass burning emissions are reasonably captured. Consistent with previous studies in Mexico City, large discrepancies are encountered for SOA species, with a factor of 5-10 model underestimate. When only anthropogenic SOA precursors were considered, the model was able to reproduce within a factor of two the sharp increase in SOA concentrations during the late morning at both urban and near-urban locations. However, predicted SOA concentrations were unrealistically low when photochemistry was not active, especially overnight. These nighttime discrepancies were not significantly reduced when greatly enhanced partitioning to the aerosol phase was assumed. Model sensitivity results suggest that observed nighttime SOA concentrations are strongly influenced by the regional background (~2µg/m3) from biogenic origin, which is transported from the coastal regions into the Mexico City basin. The relative contribution of biogenic SOA to monthly mean SOA levels is estimated to be more than 30% within the city and up to 65-90% at the regional scale (even in the immediate vicinity of the city), which is consistent with measurements of modern carbon during low biomass burning periods. The anthropogenic emissions of isoprene and its nighttime oxidation by NO3 were also found to enhance the SOA mean concentrations within the city by an additional 15%. Our results confirm the large underestimation of the SOA production by traditional models in polluted regions (estimated to 10-20 Tons within the Mexico City metropolitan area during the daytime), and emphasize for the first time the role of biogenic precursors in this region, indicating that they cannot be neglected in modeling studies.

09 BIOMASS FUELS↗

Evaluation of HEU-Beryllium Benchmark Experiments to Improve Computational Analysis of Space Reactors

An assessment was previously performed to evaluate modeling capabilities and quantify preliminary biases and uncertainties associated with the modeling methods and data utilized in designing a nuclear reactor such as a beryllium-reflected, highly-enriched-uranium (HEU)-O2 fission surface power (FSP) system for space nuclear power. The conclusion of the previous study was that current capabilities could preclude the necessity of a cold critical test of the FSP; however, additional testing would reduce uncertainties in the beryllium and uranium cross-section data and the overall uncertainty in the computational models. A series of critical experiments using HEU metal were performed in the 1960s and 1970s in support of criticality safety operations at the Y-12 Plant. Of the hundreds of experiments, three were identified as fast-fission configurations reflected by beryllium metal. These experiments have been evaluated as benchmarks for inclusion in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). Further evaluation of the benchmark experiments was performed using the sensitivity and uncertainty analysis capabilities of SCALE 6. The data adjustment methods of SCALE 6 have been employed in the validation of an example FSP design model to reduce the uncertainty due to the beryllium cross section data.

Bess, John↗

An Evaluation of Cosmological Models from the Expansion and Growth of Structure Measurements

Here, we compare a large suite of theoretical cosmological models to observational data from the cosmic microwave background, baryon acoustic oscillation measurements of expansion, Type Ia supernova measurements of expansion, redshift space distortion measurements of the growth of structure, and the local Hubble constant. Our theoretical models include parametrizations of dark energy as well as physical models of dark energy and modified gravity. We determine the constraints on the model parameters, incorporating the redshift space distortion data directly in the analysis. To determine whether models can be ruled out, we evaluate the p-value (the probability under the model of obtaining data as bad or worse than the observed data). In our comparison, we find the well-known tension of H 0 with the other data; no model resolves this tension successfully. Among the models we consider, the large-scale growth of structure data does not affect the modified gravity models as a category particularly differently from dark energy models; it matters for some modified gravity models but not others, and the same is true for dark energy models. We compute predicted observables for each model under current observational constraints, and identify models for which future observational constraints will be particularly informative.

79 ASTRONOMY AND ASTROPHYSICS↗

RACORO aerosol data processing

The RACORO aerosol data (cloud condensation nuclei (CCN), condensation nuclei (CN) and aerosol size distributions) need further processing to be useful for model evaluation (e.g., GCM droplet nucleation parameterizations) and other investigations. These tasks include: (1) Identification and flagging of 'splash' contaminated Twin Otter aerosol data. (2) Calculation of actual supersaturation (SS) values in the two CCN columns flown on the Twin Otter. (3) Interpolation of CCN spectra from SGP and Twin Otter to 0.2% SS. (4) Process data for spatial variability studies. (5) Provide calculated light scattering from measured aerosol size distributions. Below we first briefly describe the measurements and then describe the results of several data processing tasks that which have been completed, paving the way for the scientific analyses for which the campaign was designed. The end result of this research will be several aerosol data sets which can be used to achieve some of the goals of the RACORO mission including the enhanced understanding of cloud-aerosol interactions and improved cloud simulations in climate models.

54 ENVIRONMENTAL SCIENCES↗

Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

We present Π4U,{sup 1} an extensible framework, for non-intrusive Bayesian Uncertainty Quantification and Propagation (UQ+P) of complex and computationally demanding physical models, that can exploit massively parallel computer architectures. The framework incorporates Laplace asymptotic approximations as well as stochastic algorithms, along with distributed numerical differentiation and task-based parallelism for heterogeneous clusters. Sampling is based on the Transitional Markov Chain Monte Carlo (TMCMC) algorithm and its variants. The optimization tasks associated with the asymptotic approximations are treated via the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). A modified subset simulation method is used for posterior reliability measurements of rare events. The framework accommodates scheduling of multiple physical model evaluations based on an adaptive load balancing library and shows excellent scalability. In addition to the software framework, we also provide guidelines as to the applicability and efficiency of Bayesian tools when applied to computationally demanding physical models. Theoretical and computational developments are demonstrated with applications drawn from molecular dynamics, structural dynamics and granular flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗