Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Integration of Total-Sky Imager Data with a Physics-Based Smart Persistence Model for Intra-Hour Forecasting of Solar Radiation

Short-term solar forecasting models based solely on global horizontal irradiance (GHI) measurements are often unable to discriminate the forecasting of the factors affecting GHI from those that can be precisely computed by atmospheric models. Our previous study introduced a Physics-based Smart Persistence model for Intra-hour forecasting of solar radiation (PSPI) that decomposed the forecasting of GHI into the computation of extraterrestrial solar radiation and solar zenith angle and the forecasting of cloud albedo and cloud fraction. The extraterrestrial solar radiation and solar zenith angle were accurately computed by the Solar Position Algorithm (SPA) developed at the National Renewable Energy Laboratory (NREL). A cloud retrieval technique was used to estimate cloud albedo and cloud fraction from surface-based observations of GHI. With the assumption of persistent cloud structures, the cloud albedo and cloud fraction were predicted for future time steps using a two-stream approximation and a 5-minute exponential weighted moving average, respectively. The model evaluation indicated the estimation and forecast of cloud fraction mostly contributed to the uncertainty of the PSPI though it overcame the persistence and smart persistence models in all forecast time horizons between 5 and 60 minutes. This study aims to enhance the PSPI by ingesting surface-based observations of cloud fraction from a total sky imager (TSI). The estimation and forecast of cloud albedo is correspondingly improved by utilizing the cloud fraction observations and thus leads to more accurate GHI forecast. Various time-series analysis methods are also investigated on the forecasting of cloud fraction and cloud albedo for further improving the GHI forecast. These improvements are valuable for many applications, such as forecasting energy use for buildings, grid operations, and ultimately bringing down the cost of solar energy.

14 SOLAR ENERGY↗

Monthly Mean In Situ Surface Flux Observations Paired with Satellite-Derived and Reanalysis-Based Flux Data for the Great Lakes Region, 2001–2020

Surface radiative and turbulent heat fluxes over the Great Lakes strongly influence regional hydrological and meteorological processes, and their accurate representation is critical for numerical weather prediction and coupled atmosphere–lake modeling. However, direct flux observations are spatially sparse across the region, so gridded reanalysis and satellite-derived products are often used for climatological analyses and model evaluation despite differences in their flux representations. This dataset provides processed, quality-controlled, monthly mean surface flux observations from the Great Lakes Evaporation Network (GLEN), AmeriFlux, and the National Data Buoy Center, paired with spatiotemporally matched flux estimates from two reanalysis products, the fifth generation European Centre for Medium-Range Weather Forecasts (ECMWF) reanalysis dataset (ERA5) and the Modern Era Reanalysis for Research and Applications, version 2 (MERRA-2), and two satellite-derived products, the Clouds and Earth's Radiant Energy Systems Energy Balanced and Filled (CERES-EBAF) and the Cloud, Albedo and Surface Radiation dataset from AVHRR data - Edition 3 (CLARA-A3). The dataset includes sixteen observational stations with variable temporal coverage within 2001–2020. For each station, a CSV file contains monthly time series of available flux variables, including surface downwelling shortwave radiation (SW), surface downwelling longwave radiation (LW), sensible heat (SH) flux, and latent heat flux (LH), alongside matched gridded product values where available. Columns in the CSV file correspond to different variables sourced from each dataset, with column titles structured as "{dataset}_{variable}". Columns with relevant metadata are also provided in each CSV file, including station latitude and longitude, monthly timestamps, and the name of the sourced observational data. These files are structured for direct use in common analysis tools, including Microsoft Excel, Python pandas, and Python matplotlib. This dataset supports climatological analysis of the Great Lakes regional surface energy budget, evaluation of satellite-derived and reanalysis-based flux products, and development or validation of flux representations in numerical weather prediction and coupled atmosphere–lake models.

Great Lakes↗

Nonlinear Thermal Analyses of a Liquid Hydrogen Tank Wall

A thermal evaluation of a composite tank wall design for a liquid hydrogen tank was performed in the present study. The primary focus of the current effort was to perform one-dimensional, temperature nonlinear, transient thermal analyses to determine the through-the-thickness temperature profiles. These profiles were used to identify critical points within the flight envelope that could have detrimental effects on the adhesive bondlines used in the construction of the tank wall. Additionally, this paper presents the finite element models, analysis strategies, and thermal analysis results that were determined for several vehicle flight conditions. The basic tank wall configuration used to perform the thermal analyses consisted of carbon-epoxy facesheets and a Korex honeycomb core sandwich that was insulated with an Airex cryogenic foam and an Alumina Enhanced Thermal Barrier (AETB-12). Nonlinear, transient thermal analyses were conducted using the ABAQUS finite element code. Tank wall models at a windward side location on the fuel tank were analyzed for three basic flight conditions: cold-soak (ground-hold), ascent, and re-entry. Additionally, three ambient temperature boundary conditions were applied to the tank wall for the cold-soak condition, which simulated the launch pad cooldown process. Time-dependent heating rates were used in the analyses of the ascent and reentry segments of the flight history along with temperature dependent material properties. The steady-state through-the-thickness temperature profile from the cold-soak condition was used as the initial condition for the ascent analyses. Results from the nonlinear thermal analyses demonstrated very good correlation with results from similar models evaluated by Northrop- Grumman using a different analysis tool. Wall through-the-thickness temperature gradients as a function of flight time were obtained for future incorporation into a full-scale thermostructural analysis to evaluate the adhesive bondlines. As a result of the thermal analyses conducted, a sufficient level of confidence was demonstrated in the thermal modeling and analysis capabilities of ABAQUS to warrant future use as a thermo-structural analysis tool to evaluate cryogenic tank wall designs.

Smeltzer, Stanley S., III↗

A simulation study of atmospheric mercury and its deposition in the Great Lakes

The Great Lakes eco-region is one of the largest sources of fresh water in North America; however it is chronically exposed to heavy metal loadings such as mercury. In this study a comprehensive model evaluation was conducted to determine mercury loadings to the Great Lakes. The study also evaluated the relative impact of anthropogenic mercury emissions from China, regional and global sources on deposition to the Great Lakes. For the 2005 study period, CMAQ 4.7.1 model estimated a total of 6.4 ± 0.5 metric tons of mercury deposited in the Great Lakes. The total deposition breakdown showed a net loading for Lake Superior of 1906 ± 246 kg/year which is the highest of all the lakes. Lake Michigan followed with 1645 ± 203 kg/year and 1511 ± 107 kg/year in Lake Huron. The lowest total deposition was seen in Lakes Erie and Ontario amassing annual totals of 837 ± 107 kg and 506 ± 63 kg, respectively. Wet and dry deposition of mercury were both significant pathways and exhibited strong seasonal variability with higher deposition occurring in the warmer months (June–November) and the lowest in winter. Wet deposition of RGM significantly influenced the deposition proportions accounting for roughly 90% of all mercury deposited. Of the three emission sources (global background, integrated planning management (IPM) and Chinese), global background concentrations represented the maximum impact to deposition loading in the Great Lakes, except for Lake Erie and parts of Lake Michigan. There was minimal seasonality for the global background, but differences in percentage contribution between dry (28–97%) and wet deposition (43–98%) was predicted. The contributions were seen mainly in the northern sections of the Great Lakes further away from IPM point sources. These findings suggest strong localized impact of IPM sources on the southernmost lakes. Deposition as a result of emissions from China exhibited seasonality in both wet and dry deposition and showed significant contributions ranging from 0.2 to 9%.

Chinese emissions↗

Comparison of parameter sensitivities between a laboratory and field scale model of uranium transport in a dual domain, distributed-rate reactive system

A laboratory-derived conceptual and numerical model for U(VI) transport at the Hanford 300A site, Washington, USA, was applied to a range of field-scale scenarios of different complexity to systematically evaluate model parameter sensitivities. The model, originally developed from column experiment data, included distributed-rate surface complexation kinetics of U(VI), aqueous speciation, and physical non-equilibrium transport processes. A rigorous parameter sensitivity analysis was carried out with respect to different state variables: concentrations, mass fluxes, total mass and spatial moments of dissolved U(VI) for laboratory systems, and various simulation scenarios that represented the field-scale characteristics at the Hanford 300A site. The field-scenarios accounted for transient groundwater flow and variable geochemical conditions driven by frequent water level changes of the nearby Columbia River. Simulations indicated that the transient conditions significantly affected U(VI) plume migration at the site. The parameter sensitivities were largely similar between the laboratory and field scale systems. Where differences existed, they were shown to result from differing degrees of U(VI) adsorption disequilibrium caused by hydraulic or hydrogeochemical conditions. Adorption disequilibrium was found to differ (i) between short duration peak flow events at the field scale and much longer flow events in the laboratory, (ii) for changing groundwater chemical compositions due to river water intrusion, and (iii) for different sampling locations at the field scale. Parameter sensitivities were also found to vary with respect to the different investigated state variables. An approach is demonstrated that elucidates the most important parameters of a laboratory-scale model that must constrained in both the laboratory and field for meaningful field application.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Increased SOX9 Expression in Premalignant and Malignant Pancreatic Neoplasms

Background: SOX9, a progenitor cell marker, is important for pancreatic ductal development. Our goal was to examine SOX9 expression differences in intraductal papillary mucinous neoplasms (IPMNs) and ductal adenocarcinoma (PDAC) compared with benign pancreatic duct (BP). Methods: SOX9 expression was evaluated by immunohistochemistry performed on 93 specimens: 37 BP, 24 low grade (LG) IPMN, 12 high grade (HG) IPMN, and 20 PDAC. A linear mixed-effects model was used to compare the percentage of cells expressing SOX9 by specimen type. A separate linear mixed-effects model evaluated differences in SOX9 expression by staining intensity in pancreatic epithelial cells. Results: Nuclear SOX9 expression was detected in the epithelial cells of 98% HG IPMN, 93% LG IPMN, 83% PDAC, and 60% BP. Compared with BP, SOX9 was expressed from a significantly greater percentage of cells in LG IMPN, HG IMPN, and PDAC (p < 0.001 for each). BP and PDAC showed greater variability in SOX9 expression in epithelial cells compared with IPMNs which showed strong, homogenous SOX9 expression in almost all cells. Compared with BP, both LG and HG IPMN showed significantly greater SOX9 expression (p < 0.001 for each), but there was no significant difference in SOX9 expression between LG and HG IPMN (p > 0.05). PDAC had significantly higher expression of SOX9 compared with BP but significantly lower SOX9 expression compared with LG or HG IPMN (p < 0.001 for each). Conclusions: IPMNs demonstrated the highest expression levels of SOX9. SOX9 expression in BP and PDAC demonstrated much more heterogeneity compared with the strong, uniform expression in IPMN.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SAM Enhancements and Model Developments for Molten-Salt-Fueled Reactors

To support the development and utilization of the SAM code for molten-salt-fueled reactor (MSR) safety analysis and licensing, an effort was devoted to enhancing code capabilities and developing reference models for the MSR primary loop. A reference standard problem of a prototypical reactor design is foundational to NRC to verify the adequacy of computer codes and evaluation models for a specific reactor type. A thermo-fluid model of the Molten Salt Reactor Experiment (MSRE) has been developed. The MSRE primary loop model consists of a 2-D core region and external core components in 1-D or 0-D. Both the steady-state and a transient scenario are simulated. The porous medium model is utilized for both the molten salt fluid channels and the moderator matrix in the MSRE core. The use of the porous medium model for the MSRE core is verified with the higher-fidelity simulation results using 1-D representations of the fluid channels and 3-D modeling of core structures. To further enhance SAM multi-scale simulation capabilities for MSRs, a mass transport model is developed and implemented in SAM multi-dimension flow module for modeling of species transport such as delayed neutron precursors in MSRs.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models

We present a new atmospheric river (AR) analysis and benchmarking tool, namely Atmospheric River Metrics Package (ARMP). It includes a suite of new AR metrics that are designed for quick analysis of AR characteristics via statistics in gridded climate datasets such as model output and reanalysis. This package can be used for climate model evaluation in comparison with reanalysis and observational products. Integrated metrics such as mean bias and spatial pattern correlation are efficient for diagnosing systematic AR biases in climate models. For example, the package identifies the fact that, in CMIP5 and CMIP6 (Coupled Model Intercomparison Project Phases 5 and 6) models, AR tracks in the South Atlantic are positioned farther poleward compared to ERA5 reanalysis, while in the South Pacific, tracks are generally biased towards the Equator. For the landfalling AR peak season, we find that most climate models simulate a completely opposite seasonal cycle over western Africa. This tool can also be used for identifying and characterizing structural differences among different AR detectors (ARDTs). For example, ARs detected with the Mundhenk algorithm exhibit systematically larger size, width, and length compared to the TempestExtremes (TE) method. The AR metrics developed from this work can be routinely applied for model benchmarking and during the development cycle to trace performance evolution across model versions or generations and set objective targets for the improvement of models. They can also be used by operational centers to perform near-real-time climate and extreme event impact assessments as part of their forecast cycle.

58 GEOSCIENCES↗

Evaluation and prediction of long-term environmental effects on nonmetallic materials

Changes in functional properties of a broad spectrum of nonmetallic materials as a function of environment and exposure time were evaluated. Models for predicting long-term material performance are discussed. A literature search on specific materials in the space and simulated space environment was carried out and evaluated.

Source record↗

Modeling ozone episodes in the Baltimore-Washington region

Surface ozone (O3) concentrations in excess of the National Ambient Air Quality Standard (NAAQS) continue to occur in metropolitan areas in the United States despite efforts to control emissions of O3 precursors. Future O3 control strategies will be based on results from modeling efforts that have just begun in many areas. Two initial questions that arise are model sensitivity to domain-specific conditions and the selection of episodes for model evaluation and control strategy development. For the Baltimore-Washington region (B-W), the presence of the Chesapeake Bay introduces a number of issues relevant to model sensitivity. In this paper, the specific questions of the determination of model volume (mixing height) for the Urban Airshed Model (UAM) is discussed and various alternative methods compared. For the latter question, several analytic approaches, Cluster Analysis and classification and Regression Tree (CART) analysis are undertaken to determine meteorological conditions associated with severe O3 events in the B-W domain.

Ryan, William F.↗

Operational Dust Prediction

Over the last few years, numerical prediction of dust aerosol concentration has become prominent at several research and operational weather centres due to growing interest from diverse stakeholders, such as solar energy plant managers, health professionals, aviation and military authorities and policymakers. Dust prediction in numerical weather prediction-type models faces a number of challenges owing to the complexity of the system. At the centre of the problem is the vast range of scales required to fully account for all of the physical processes related to dust. Another limiting factor is the paucity of suitable dust observations available for model, evaluation and assimilation. This chapter discusses in detail numerical prediction of dust with examples from systems that are currently providing dust forecasts in near real-time or are part of international efforts to establish daily provision of dust forecasts based on multi-model ensembles. The various models are introduced and described along with an overview on the importance of dust prediction activities and a historical perspective. Assimilation and evaluation aspects in dust prediction are also discussed.

assimilation↗

North American Extreme Precipitation Events and Related Large-Scale Meteorological Patterns: a Review of Statistical Methods, Dynamics, Modeling, and Trends

This paper surveys the current state of knowledge regarding Large-Scale Meteorological Patterns (LSMPs) associated with short-duration (less than one week) extreme precipitation events over North America. In contrast to teleconnections, which are typically defined based on the characteristic spatial variations of a meteorological field or on the remote circulation response to a known forcing, LSMPs are defined relative to the occurrence of a specific phenomenon—here, extreme precipitation—and with an emphasis on the synoptic scales that have a primary influence in individual events, have medium-range weather predictability, and are well-resolved in both weather and climate models. For the LSMP relationship with extreme precipitation, we consider the previous literature with respect to definitions and data, dynamical mechanisms, model representation, and climate change trends. There is considerable uncertainty in identifying extremes based on existing observational precipitation data and some limitations in analyzing the associated LSMPs in reanalysis data. Many different definitions of “extreme” are in use, making it difficult to directly compare different studies. Dynamically, several types of meteorological systems—extratropical cyclones, tropical cyclones, mesoscale convective systems, and mesohighs—and several mechanisms—fronts, atmospheric rivers, and orographic ascent—have been shown to be important aspects of extreme precipitation LSMPs. The extreme precipitation is often realized through mesoscale processes organized, enhanced, or triggered by the LSMP. Understanding of model representation, trends, and projections for LSMPs is at an early stage, although some 4 promising analysis techniques have been identified and the LSMP perspective is useful for evaluating model dynamics.

Mathew Barlow↗

Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa

We report the Eastern Africa region experiences frequent extreme precipitation events that can cause destruction of property and environment, and loss of lives. Thus, there is a need to understand how these events may change in the future and how well the global climate models that are used to make projections can simulate precipitation extremes in this region before they can be used in downscaling or flood and drought impact assessment studies. In this work, we evaluated the ability of sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models to simulate present-day precipitation extremes over the Eastern Africa region during the two rainy seasons (March–May and September–November). We used nine extreme precipitation indices (including seven (one) indices of wet (dry) extremes) defined by the Expert Team on Climate Change Detection and Indices. The CMIP6 models were evaluated against two gridded observation datasets: Global Precipitation Climatology Project One-Degree Daily Dataset and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis 3B42. Three model performance metrics (percentage bias, normalized root-mean-square error, and pattern correlation coefficient) were employed to further assess the strengths and weakness of the models. Our results show that the multi-model ensemble mean generally provides a better representation of observed precipitation and related extremes compared to individual models when considering all metrics and seasons. Several consistent biases are evident across CMIP6 models, which tend to overestimate the total-wet day precipitation and consecutive wet days, and underestimate very wet days and maximum 5-day precipitation in both seasons. Furthermore, no single model consistently performs best, model performance varies with the season and index under consideration and is generally independent of horizontal resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Prediction of cloud condensation nuclei activity for organic compounds using functional group contribution methods

A wealth of recent laboratory and field experiments demonstrate that organic aerosol composition evolves with time in the atmosphere, leading to changes in the influence of the organic fraction to cloud condensation nuclei (CCN) spectra. There is a need for tools that can realistically represent the evolution of CCN activity to better predict indirect effects of organic aerosol on clouds and climate. This work describes a model to predict the CCN activity of organic compounds from functional group composition. Following previous methods in the literature, we test the ability of semi-empirical group contribution methods in Köhler theory to predict the effective hygroscopicity parameter, kappa. However, in our approach we also account for liquid–liquid phase boundaries to simulate phase-limited activation behavior. Model evaluation against a selected database of published laboratory measurements demonstrates that kappa can be predicted within a factor of 2. Simulation of homologous series is used to identify the relative effectiveness of different functional groups in increasing the CCN activity of weakly functionalized organic compounds. Hydroxyl, carboxyl, aldehyde, hydroperoxide, carbonyl, and ether moieties promote CCN activity while methylene and nitrate moieties inhibit CCN activity. The model can be incorporated into scale-bridging test beds such as the Generator of Explicit Chemistry and Kinetics of Organics in the Atmosphere (GECKO-A) to evaluate the evolution of kappa for a complex mix of organic compounds and to develop suitable parameterizations of CCN evolution for larger-scale models.

54 ENVIRONMENTAL SCIENCES↗

Quantifying physical parameterization uncertainties associated with land-atmosphere interactions in the WRF model over Amazon

The Weather Research and Forecasting (WRF) model can be used to diagnose regional land-atmosphere (L-A) coupling strength in the absence of sufficient observations but subjected to uncertainties associated with model physical parameterizations. In this study, we propose a framework to quantify and reduce model physical parameterization uncertainties associated with surface fluxes and L-A coupling. An ensemble of WRF simulations with different physical schemes is used to simulate surface fluxes and land-atmosphere coupling strength over the Amazon region. The physical parameterizations investigated include cloud microphysics (MP), land surface processes (LSM), planetary boundary layer (PBL), surface layer (SL), and cumulus (CU). We perform 120 ensemble simulations using the WRF model and different combinations of six MPs, three LSMs, six PBLs and SLs and three CUs. The measurements from the GoAMAZON field campaign and satellite data are used to evaluate model performance. A Multi-way analysis of variance (ANOVA) approach is applied to quantify the relative importance of different physics processes on L-A coupling. The Tukey’s test is used to sort schemes that have no significant differences into one group. The suite of physics that result in the best simulations of the corresponding variables are selected based on the Taylor skill score. Results show that the relative importance of processes and their interaction vary with the variables of interest. For example, CU was the most important process in modulating soil moisture, 2 m-humidity, latent heat, and net radiation. LSM showed dominant effects on 2 m-temperature and also has the largest impact on sensible heat and the lifting condensation level. The best physical parameterization ensembles show much narrower ranges of the variables of interest than the priori ensemble. Results of this study show the roles of different physical processes in modulating L-A interactions, quantify model uncertainties from physical processes, and provide insights for improving the model physics parameterizations.

Wang, Chen↗

SPITZER TRANSITS OF THE SUPER-EARTH GJ1214b AND IMPLICATIONS FOR ITS ATMOSPHERE

We observed the transiting super-Earth exoplanet GJ1214b using warm Spitzer at 4.5 {mu}m wavelength during a 20 day quasi-continuous sequence in 2011 May. The goals of our long observation were to accurately define the infrared transit radius of this nearby super-Earth, to search for the secondary eclipse, and to search for other transiting planets in the habitable zone of GJ1214. We here report results from the transit monitoring of GJ1214b, including a reanalysis of previous transit observations by Desert et al. In total, we analyze 14 transits of GJ1214b at 4.5 {mu}m, 3 transits at 3.6 {mu}m, and 7 new ground-based transits in the I+z band. Our new Spitzer data by themselves eliminate cloudless solar composition atmospheres for GJ1214b, and methane-rich models from Howe and Burrows. Using our new Spitzer measurements to anchor the observed transit radii of GJ1214b at long wavelengths, and adding new measurements in I+z, we evaluate models from Benneke and Seager and Howe and Burrows using a {chi}{sup 2} analysis. We find that the best-fit model exhibits an increase in transit radius at short wavelengths due to Rayleigh scattering. Pure water atmospheres are also possible. However, a flat line (no atmosphere detected) remains among the best of the statistically acceptable models, and better than pure water atmospheres. We explore the effect of systematic differences among results from different observational groups, and we find that the Howe and Burrows tholin-haze model remains the best fit, even when systematic differences among observers are considered.

79 ASTRONOMY AND ASTROPHYSICS↗

Glass formulation and composition optimization with property models: A review

Abstract Glass is a versatile material with a remarkable history and many practical applications. It plays a critical role in our everyday lives, the advancement of science, and the development of many technologies. The Edisonian type trial‐and‐error method was commonly used for conventional design of glass compositions, which was time‐consuming and costly. With the urgent need to develop new glass compositions for technology applications rapidly, it has become necessary to develop precise property models with predictive powers using large databases and efficient formulation approaches. This paper reviews the design of glass compositions using these analytical and numerical models of composition–structure–property relations of glasses, some based on large databases and machine learning approaches. Aspects of data collection, model fitting, feature extraction, model evaluation, and uncertainty quantification will be covered. Furthermore, advances in the glass optimization framework and available tools are summarized with examples. The outlook and perspective for further glass property model development and formulation approaches are discussed.

Lu, Xiaonan↗