Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Critical evaluation and modeling of algal harvesting using dissolved air flotation. DAF Algal Harvesting Modeling

In our study, Chlorella zofingiensis harvesting by dissolved air flotation (DAF) was critically evaluated with regard to algal concentration, culture conditions, type and dosage of coagulants, and recycle ratio. Harvesting efficiency increased with coagulant dosage and leveled off at 81%, 86%, 91%, and 87% when chitosan, Al 3+ , Fe 3+ , and cetyl trimethylammonium bromide (CTAB) were used at dosages of 70, 180, 250, and 500 mg g -1 , respectively. The DAF efficiency-coagulant dosage relationship changed with algal culture conditions. In evaluating the influence of the initial algal concentration and recycle ratio revealed that, under conditions typical for algal harvesting, we found that it is possible that the number of bubbles is insufficient. A DAF algal harvesting model was developed to explain this observation by introducing mass-based floc size distributions and a bubble limitation into the white water blanket model. Moreover, the model revealed the importance of coagulation to increase floc-bubble collision and attachment, and the preferential interaction of bubbles with larger flocs, which limited the availability of bubbles to the smaller sized flocs. The harvesting efficiencies predicted by the model agree reasonably with experimental data obtained at different Al 3+ dosages, algal concentrations, and recycle ratios. Based on this modeling, critical parameters for efficient algal harvesting were identified.

59 BASIC BIOLOGICAL SCIENCES↗

Growth modeling to evaluate alternative cultivation strategies to enhance national microalgal biomass production

In this paper, we present a model-based assessment of alternative cultivation strategies on algal biomass production within the conterminous United States. Our assessment focuses on two basic cultivation strategies: 1) seasonal rotation of three representative freshwater algal strains that are well suited for warm weather, cold weather, and all-season diverse weather conditions, respectively; and 2) variation between three open pond water depths (15cm, 20cm, and 25cm). The enhanced Biomass Assessment Tool (BAT) is applied on a site-specific, hourly basis at 5,832 North American Land Data Assimilation System Phase 2 1/8° meteorological model grid cells over a 30-year period (1980-2009) to evaluate the operational strategies. Recognizing that resource management decisions may also consider scales beyond the individual site, we also conduct a regional assessment of focused on 7 representative climate zones in the conterminous United States. Results demonstrate that the spatial variability of algal productivity is largely affected by the strain-specific growth response to light and temperature that vary significantly by climate zone and latitude. Therefore, with a limited set of alternative cultivation strategies, the BAT identified the best performing combination of cultivation strategies on a site-specific basis that considerably enhances national annual biomass productivity. Specifically, the appropriate choice of seasonal strain rotation is able to significantly dampen climate-driven seasonal and spatial variability.

59 BASIC BIOLOGICAL SCIENCES↗

CFD modeling of turbulent air flow in self-heated gyroid TPMS structures: Thermal-hydraulic performance and validation

The application of mathematically derived geometries, such as triply periodic minimal surface (TPMS) lattices, has garnered significant interest across various fields, including the nuclear sector, due to their superior thermal-hydraulic characteristics for heat transfer compared to traditional plain or finned tubes. Here, this study validates a computational fluid dynamics (CFD) model, evaluates different turbulence models and CFD model settings, and performs uncertainty quantification to provide a comprehensive analysis. Despite extensive research on CFD modeling of TPMS lattices, such as gyroid and diamond geometries, there is a notable lack of publicly available literature providing comprehensive details on numerical analysis aspects, including convergence and methodological best practices. This study embarks on a benchmark analysis of a gyroid geometry to evaluate its thermal-hydraulic performance under turbulent flow conditions and scrutinize various CFD model configurations. The main contributions of this work include validating the CFD model, assessing and comparing different turbulence models, and enhancing pressure drop and temperature prediction capabilities. The results aim to support the development of methodologies needed to benchmark and enhance numerical analysis techniques for TPMS lattices. This work seeks to complement the existing body of knowledge, support the development of TPMS reactor concepts, and improve best practices for CFD modeling of TPMS lattices, ultimately advancing methodologies to support future applications in this domain.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of Modeled Precipitation in Oceanic Extratropical Cyclones Using IMERG

Using a high-spatial- and high-temporal-resolution precipitation dataset, Integrated Multi-satellite Retrievals for GPM (IMERG), extratropical cyclone precipitation is evaluated in two reanalyses and two climate models. Based on cyclone-centered composites, all four models overestimate precipitation in the western subsiding and dry side of the cyclones, and underestimate the precipitation in the eastern ascending and moist side. By decomposing the composites into frequency of occurrence and intensity (mean precipitation rate when precipitating), the analysis reveals a tendency for all four models to overestimate frequency and underestimate intensity, with the former issue dominating in the western half and the latter in the eastern half of the cyclones. Differences in frequency are strongly dependent on cyclone environmental moisture, while the differences in intensity are strongly impacted by the strength of ascent within the cyclone. There are some uncertainties associated with the observations: IMERG might underreport frozen precipitation and possibly exaggerate rates in vigorously ascending regions. Nevertheless, the analysis suggests that all models produce extratropical cyclone precipitation too often and too lightly. These biases have consequences when evaluating the changes in precipitation characteristics with changes in cyclone properties: the models disagree on the magnitude of the change in precipitation intensity with a change in environmental moisture and in precipitation frequency with a change in cyclone strength. This complicates accurate predictions of precipitation changes in a changing climate.

54 ENVIRONMENTAL SCIENCES↗

Semiempirical airframe noise prediction model and evaluation with flight data

A semiempirical maximum overall sound pressure level (OASPL) airframe noise model was derived. Noise radiated from aircraft wings was modeled on the trailing edge diffractes quadrupole sound theory. The acoustic dipole sound theory was used to model noise from the landing gear. The model was correlated with maximum OASPL flyover noise measurements obtained for three jet aircraft. One third octave band sound pressure level flyover data was correlated and interpreted.

Hersh, A. S.↗

A hierarchical evaluation framework for assessing climate simulations relevant to the energy-water-land nexus (Final Report)

The overarching goal was to construct a hierarchy of new and well-tested metrics and analysis tools that support both fundamental and use-inspired research. Motivating this goal was a convergence of needs from climate scientists and stakeholders alike for a systematic, robust framework of model evaluation and diagnosis to provide scientific insights, inform model development, support best practices for the use of climate model outputs, and facilitate communication of climate information in the evolving landscapes of multi-model, multi-resolution, and large ensemble simulations that generate terabytes of data for any single climate run. Steps toward attaining these goals benefited from expertise and established capability of the project team, which included leadership of the North American Regional Climate Change Assessment Program (NARCCAP) and the Coordinated Regional Downscaling Experiment (CORDEX), development of hierarchical model evaluation approaches, and successful research in the analysis and diagnosis of climate model skill, as well as the understanding and modeling of regional climate processes in North America. As part of the overarching goal, the project worked to disseminate a suite of methodologies, algorithms, and software components that the wider community can employ to advance climate science and applications. With rigorous demonstration, the evaluation framework and the mix of standard and high risk / high reward approaches helped form the basis for future development of a computationally enabled user-friendly system for community use.

17 WIND ENERGY↗

Alpha1 LASSO data bundles Lamont, OK

A data bundle is a unified package consisting of LASSO LES input and output, observations, evaluation diagnostics, and model skill scores. LES input includes model configuration information and forcing data. LES output includes profile statistics and full domain fields of cloud and environmental variables. Model evaluation data consists of LES output and ARM observations co-registered on the same grid and sampling frequency. Model performance is quantified by skill scores and diagnostics in terms of cloud and environmental variables.

54 ENVIRONMENTAL SCIENCES↗

LASSO Data Bundles

The Alpha 2 release is the second release from the LASSO Pilot Phase that builds upon the Alpha 1 release. Alpha 2 contains additional diagnostics in the data bundles and focuses on cases from spring-summer 2016. A data bundle is a unified package consisting of LASSO LES input and output, observations, evaluation diagnostics, and model skill scores. LES input include model configuration information and forcing data. LES output includes profile statistics and full domain fields of cloud and environmental variables. Model evaluation data consists of LES output and ARM observations co-registered on the same grid and sampling frequency. Model performance is quantified by skill scores and diagnostics in terms of cloud and environmental variables.

54 ENVIRONMENTAL SCIENCES↗

Investigating Downscaling Methods and Evaluating Climate Models for Use in Estimating Regional Water Resources in Mountainous Regions under Changing Climatic Conditions

The purpose of this three-year study is to develop and evaluate techniques to estimate the range of potential hydrological impacts of climate change in mountainous areas. Three main objectives are set out in the proposal. (1) To develop and evaluate transfer functions to link tropospheric circulation to regional snowfall. (2) To evaluate a suite of General Circulation Models (GCMs) for use in estimating synoptic scale circulation and the resultant regional snowfall. And (3) to estimate the range of potential hydrological impacts of changing climate in the two case study areas: the Upper Colorado River basin, and the Catskill Mountains of southeastern New York State. Both regions provide water to large populations.

Frei, Allan↗

Albedo and Diffuse POA Measurements to Evaluate Transposition Model Uncertainty

Albedo and diffuse plane of array (DPOA) measurements are used in addition to standard global horizontal irradiance (GHI), direct normal irradiance (DNI), diffuse horizontal irradiance (DNI), and plane of array irradiance (POA) measurements to determine the impact of albedo on transposition model performance. Albedo measurements averaged 0.214. Daily albedo values ranged from 0.148 to 0.236 and were found to be correlated to daily relative humidity. DPOA measurements were compared to calculated DPOA values (from POA and DNI), and helped identify a suspected deviation from due south in the azimuth of the POA measurement. Since the measured albedo average was close to the typical fixed $^{albedo = 0.2}$ assumption, little difference was seen between using measured and fixed albedo (~0.15% differences in mean bias difference (MBD) and root mean squared difference (RMSD)). However, evaluation of transposition models at other fixed albedos showed an albedo change of 0.1 is found to increase total modeled insolation by approximately 1%. Thus, for locations with different ground surfaces (e.g., persistent snow cover of black surfaces), the impact of using measured albedo instead of the fixed $^{albedo = 0.2}$ assumption may be greater. Measurement deviations resulted in up to 2% changes in MBD and RIVISD when switching between interrelated measurements (e.g., GHI and DHI as inputs to transposition models versus DNI and DHI as inputs). Variation among transposition models was also up to 2% MBD and RMSD. Thus, for this data set, measurement deviation and transposition model selection are found to have more impact than using measured albedo instead fixed albedo.

42 ENGINEERING↗

Experimental design for three interrelated marine ice sheet and ocean model intercomparison projects: MISMIP v. 3 (MISMIP +), ISOMIP v. 2 (ISOMIP +) and MISOMIP v. 1 (MISOMIP1)

Coupled ice sheet-ocean models capable of simulating moving grounding lines are just becoming available. Such models have a broad range of potential applications in studying the dynamics of marine ice sheets and tidewater glaciers, from process studies to future projections of ice mass loss and sea level rise. The Marine Ice Sheet-Ocean Model Intercomparison Project (MISOMIP) is a community effort aimed at designing and coordinating a series of model intercomparison projects (MIPs) for model evaluation in idealized setups, model verification based on observations, and future projections for key regions of the West Antarctic Ice Sheet (WAIS). Here we describe computational experiments constituting three interrelated MIPs for marine ice sheet models and regional ocean circulation models incorporating ice shelf cavities. These consist of ice sheet experiments under the Marine Ice Sheet MIP third phase (MISMIP+), ocean experiments under the Ice Shelf-Ocean MIP second phase (ISOMIP+) and coupled ice sheet-ocean experiments under the MISOMIP first phase (MISOMIP1). All three MIPs use a shared domain with idealized bedrock topography and forcing, allowing the coupled simulations (MISOMIP1) to be compared directly to the individual component simulations (MISMIP+ and ISOMIP+). The experiments, which have qualitative similarities to Pine Island Glacier Ice Shelf and the adjacent region of the Amundsen Sea, are designed to explore the effects of changes in ocean conditions, specifically the temperature at depth, on basal melting and ice dynamics. In future work, differences between model results will form the basis for the evaluation of the participating models.

58 GEOSCIENCES↗

Experimental Studies and Energy Modeling for Evaluating Performance of Various Deep Wall Retrofits

The Pacific Northwest National Laboratory, Oak Ridge National Laboratory, and the University of Minnesota conducted a three-year, multipart study on residential retrofit wall assemblies. The project, which was funded by the U.S. Department of Energy’s Building Technology Office, aimed to compare a range of residential wall retrofit systems that prioritized affordability, durability, and energy savings potential. The research team identified, constructed, tested, simulated, and analyzed the feasibility and economics of 16 wall retrofit assemblies (14 test configurations and two baseline configurations) that can be applied to the exterior side of existing walls (either with or without the existing cladding). The 16 wall assemblies were installed in an in-situ laboratory environment, to evaluate the ease of construction and study the thermal and hygrothermal performance of the walls. This paper presents the methodology used to evaluate the thermal performance of the walls and discusses the energy modeling results of the study. The results from the experiments were used to calibrate a THERM model of each wall assembly, which was then applied to a whole building using the EnergyPlus 8.6 simulation engine. A residential prototype building was used to extrapolate whole-building energy savings in each U.S. climate zone. To capture the conditions of the largest number of homes in the United States, the most frequent building characteristics (e.g., attic insulation level, window specifications, foundation insulation, etc.) were extracted from ResStock data and applied to the prototype model. Results from the energy modeling showed that the climate zones with the highest potential for retrofit savings are those which are heating-dominated (i.e., Cold and Very Cold climate designations). In these climate zones, heating and cooling energy savings due to the wall retrofits alone ranged from 21.5% to 38.2%.

Nagda, Harshil↗

Energy Model to Evaluate Thermal Energy Storage Integrated with Air Source Heat Pumps: Preprint

Full decarbonization in buildings requires the replacement of combustion appliances with electric ones, and air source heat pumps (ASHP) are a candidate alternative. However, technical limitations, such as the efficiency decrease when operating in cold weather, limit their adoption in the global heating market. Among several options to improve ASHP efficiency operating in colder climates, thermal energy storage (TES) has been considered, as it may provide heating when it is cold and shift ASHP operation to times when the weather is warmer. It may also take advantage of time of use electricity rates and support defrosting when necessary. The evaluation of ASHP-TES systems, however, is still limited because traditional metrics do not capture their full economic and environmental benefits. In this work, a python framework is presented to model the ASHP with and without the presence of TES. Metrics are proposed to analyze the system performance in terms of costs, equivalent CO2 emission, and efficiency metrics to evaluate and compare alternative systems. Model validation against experimental data obtained for a commercial heat pump is provided, as well as an application example using Denver, Colorado, to highlight the model capabilities.

cold climate↗

Evaluation of Model Summertime Boundary Layer Cloud Development over Complex Terrain in New York State

Weather forecasting over complex terrain with diverse land cover is challenging. Utilizing the high-resolution observations from New York State Mesonet (NYSM), we are able to evaluate the surface processes of the Weather Research Forecast (WRF) Model in a detailed, scale-dependent manner. Here, in the study, possible impacts of land–atmosphere interaction on surface meteorology and boundary layer cloud development are investigated with different model resolutions, land surface models (LSMs), and planetary boundary layer (PBL) physical parameterizations. The High-Resolution Rapid Refresh, version 3 (HRRR), forecasting model is used as a reference for the sensitivity evaluation. Results show that over complex terrain, the high-resolution simulations (1 km × 60 vertical levels) generally perform better compared to low-resolution (3 km × 50 levels) in both surface meteorology and cloud fields. LSMs play a more important role in surface meteorology compared to PBL schemes. The NoahMP land surface model exhibits daytime warmer and drier biases compared to the Rapid Update Cycle (RUC) due to better prediction of the Bowen ratio in RUC. The PBL schemes would affect the convective strength in the boundary layer. The Shin–Hong (SH) scale-aware scheme tends to produce the strongest convective strength in the PBL, while the ACM2 PBL scheme rarely resolved convection even at 1-km resolution. By considering the radiation effect of subgrid-scale (SGS) clouds, the Mellor–Yamada–Nakanishi–Niino eddy diffusivity mass flux (MYNN-EDMF) predicted the highest cloud coverage and lowest surface solar radiation bias. The configuration of SGS clouds in MYNN-EDMF would not only significantly reduce shortwave radiation bias, but also affect the convection behaviors through land surface–cloud–radiation interaction.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the CEAS trend and monthly weather data models for soybean yields in Iowa, Illinois, and Indiana

The CEAS models evaluated use historic trend and meteorological and agroclimatic variables to forecast soybean yields in Iowa, Illinois, and Indiana. Indicators of yield reliability and current measures of modeled yield reliability were obtained from bootstrap tests on the end of season models. Indicators of yield reliability show that the state models are consistently better than the crop reporting district (CRD) models. One CRD model is especially poor. At the state level, the bias of each model is less than one half quintal/hectare. The standard deviation is between one and two quintals/hectare. The models are adequate in terms of coverage and are to a certain extent consistent with scientific knowledge. Timely yield estimates can be made during the growing season using truncated models. The models are easy to understand and use and are not costly to operate. Other than the specification of values used to determine evapotranspiration, the models are objective. Because the method of variable selection used in the model development is adequately documented, no evaluation can be made of the objectivity and cost of redevelopment of the model.

French, V.↗

An evaluation of several compressible turbulent boundary-layer models Effects of pressure gradient and Reynolds number

Computations, employing several turbulence models, are compared with a series of attached supersonic turbulent boundary-layer experiments over an extensive range of Reynolds numbers (11.7 x 10 to the 6th to 314 x 10 to the 6th). These experiments included measurements of surface pressure and skin friction for adverse pressure gradients ranging in magnitude from those of previous investigations to an order of magnitude greater. The turbulence models evaluated include algebraic and two-equation eddy-viscosity models and two full Reynolds stress models. In general all the models tested performed well independently of the magnitude of the pressure gradient or Reynolds number and could predict the measured skin friction for most cases with sufficient accuracy for engineering purposes.

Horstman, C. C.↗

Dilated causal convolutional neural networks for forecasting zone airflow to estimate short-term energy consumption

Here this paper investigates the use of dilated causal convolutional neural networks for fine- grained temporal forecasting of building zone states. Specifically, we build and evaluate models using a small set of exogenous features (e.g., external temperature) to autoregressively predict zone airflow setpoints every minute for a 24-hour prediction window. We carefully explore the trade-off between generality and specificity in these models, training and evaluating them based on zone, zone type, month, season, and combinations thereof. When evaluated for a commercial office building in Eastern Washington with 16 zones served by variable air volume air handling units, we find that the highest performance comes from a zone-specific, season-agnostic approach; with it, we obtain an R 2 of 0.704 (averaged over zones) and an average normalized root mean square error (nRMSE) of 0.111. In contrast, the most general model (trained across all zones and seasons) yields an R 2 of only 0.416 and a nRMSE of 0.168, while a baseline zone-specific reduced order model obtains 0.443 R 2 and 0.159 nRMSE. We also report on factors affecting airflow forecasting performance, on the ability of models trained on a specific zone to generalize to other zones, and on the capability of those models trained on a specific month to generalize to other months.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluation of a Multi-Decadal Simulation of Stratospheric Ozone by Comparison with Total Ozone Mapping Spectrometer (TOMS) Observations

One key application of atmospheric chemistry and transport models is prediction of the response of ozone and other constituents to various natural and anthropogenic perturbations. These include changes in composition, such as the previous rise and recent decline in emission of man-made chlorofluorcarbons, changes in aerosol loading due to volcanic eruption, and changes in solar forcing. Comparisons of hindcast model results for the past few decades with observations are a key element of model evaluation and provide a sense of the reliability of model predictions. The 25 year data set from Total Ozone Mapping Spectrometers is a cornerstone of such model evaluation. Here we report evaluation of three-dimensional multi-decadal simulation of stratospheric composition. Meteorological fields for this off-line calculation are taken from a 50 year simulation of a general circulation model. Model fields are compared with observations from TOMS and also with observations from the Stratospheric Aerosol and Gas Experiment (SAGE), Microwave Limb Sounder (MLS), Cryogenic Limb Array Etalon Spectrometer (CLAES), and the Halogen Occultation Experiment (HALOE). This overall evaluation will emphasize the spatial, seasonal, and interannual variability of the simulation compared with observed atmospheric variability.

Douglass, Anne R.↗