Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Groundwater Recharge Estimated by Land Surface Models: An Evaluation in the Conterminous U.S.

Estimating diffuse recharge of precipitation is fundamental to assessing groundwater sustainability. Diffuse recharge is also the process through which climate and climate change directly affect groundwater. In this study, we evaluated diffuse recharge over the conterminous U.S. simulated by a suite of land surface models (LSMs) that were forced using a common set of meteorological input data. Simulated annual recharge exhibited spatial patterns that were similar among the LSMs, with the highest values in the eastern U.S. and Pacific Northwest. However, the magnitudes of annual recharge varied significantly among the models and were associated with differences in simulated ET, runoff and snow. Evaluation against two independent datasets did not answer the question of whether the ensemble mean performs the best, due to inconsistency between those datasets. The amplitude and timing of seasonal maximum recharge differed among the models, influenced strongly by model physics governing deep soil moisture drainage rates and, in cold regions, snowmelt. Evaluation using in situ soil moisture observations suggested that true recharge peaks 1-3 months later than simulated recharge, indicating systematic biases in simulating deep soil moisture. However, recharge from lateral flows and through preferential flows cannot be inferred from soil moisture data, and the seasonal cycle of simulated groundwater storage actually compared well with in situ groundwater observations. Long-term trends in recharge were not consistently correlated with either precipitation trends or temperature trends. This study highlights the need to employ dynamic flow models in LSMs, among other improvements, to enable more accurate simulation of recharge.

snowmelt↗
DOE OSTI2020

A Model for Evaluating the Configuration and Dispatch of PV Plus Battery Power Plants

An open-source model was developed to optimize energy storage operation for photovoltaic- (PV-) plus-battery systems with AC-coupled and DC-coupled configurations. It includes the ability to use forecast energy prices to optimize battery charge and discharge on a rolling time horizon. The model allows for exploration of different configurations, including capital costs, inverter performance, dispatch flexibility, and capturing otherwise clipped energy for the DC-coupled system. The model can run 20 full years of hourly data in approximately two seconds, allowing comparison of a large number of configurations. We applied the model in a test case demonstrating reduced inverter clipping for DC-coupled systems and yielded slightly higher overall value than AC-coupled systems, with an approximately 2 percent increase in internal rate of return or benefit/cost ratio. Our results show that at current estimated prices for lithium-ion battery systems, large-scale PV-plus-battery plants are economically viable under the right conditions, with the configuration playing a role in system flexibility and performance. This model provides the ability for project developers, industry professionals, and researchers to use readily available software to quickly evaluate and design these systems.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2014

Source Term Modeling for Evaluating the Potential Impacts to Groundwater of Fluids Escaping from a Depleted Oil Reservoir Used for Carbon Sequestration

In recent years depleted oil reservoirs have received special interest as carbon storage reservoirs because of their potential to offset costs through collaboration with enhanced oil recovery projects. Modeling is currently being conducted to evaluate potential risks to groundwater associated with leakage of fluids from depleted oil reservoirs used for storage of CO2. Modeling results reported here focused on understanding how toxic organic compounds found in oil will distribute between the various phases within a storage reservoir after introduction of CO2, understanding the migration potential of these compounds, and assessing potential groundwater impacts should leakage occur. Two model scenarios were conducted to evaluate how organic components in oil will distribute among the phases of interest (oil, CO2, and brine). The first case consisted of 50 wt.% oil and 50 wt.% water; the second case was 90 wt.% CO2 and 10 wt.% oil. Several key organic compounds were selected for special attention in this study based upon their occurrence in oil at significant concentrations, relative toxicity, or because they can serve as surrogate compounds for other more highly toxic compounds for which required input data are not available. The organic contaminants of interest (COI) selected for this study were benzene, toluene, naphthalene, phenanthrene, and anthracene. Partitioning of organic compounds between crude oil and supercritical CO2 was modeled using the Peng-Robinson equation of state over temperature and pressure conditions that represent the entire subsurface system (from those relevant to deep geologic carbon storage environments to near surface conditions). Results indicate that for a typical set of oil reservoir conditions (75°C, and 21,520 kPa) negligible amounts of the COI dissolve into the aqueous phase. When CO2 is introduced into the reservoir such that the final composition of the reservoir is 90 wt.% CO2 and 10 wt.% oil, a significant fraction of the oil dissolves into the vapor phase. As the vapor phase moves up through the stratigraphic column, pressures and temperatures decrease, resulting in significant condensation of oil components. The heaviest organic components condense early in this process (at higher pressures and temperatures), while the lighter components tend to remain in the vapor phase until much lower pressures and temperatures are reached. Based on the model assumptions, the final concentrations of COI to reach an aquifer at 1,520 kPa and 25°C were quite significant for benzene and toluene, whereas the concentrations of polynuclear aromatic hydrocarbons that reach the aquifer were very small. This work demonstrates a methodology that can provide COI source term concentrations in CO2 leaking from a reservoir and entering an overlying aquifer for use in risk assessments.

carbon sequestration, scCO2, crude oil, benzene, B↗
DOE OSTI2014

Critical evaluation and modeling of algal harvesting using dissolved air flotation. DAF Algal Harvesting Modeling

In our study, Chlorella zofingiensis harvesting by dissolved air flotation (DAF) was critically evaluated with regard to algal concentration, culture conditions, type and dosage of coagulants, and recycle ratio. Harvesting efficiency increased with coagulant dosage and leveled off at 81%, 86%, 91%, and 87% when chitosan, Al 3+ , Fe 3+ , and cetyl trimethylammonium bromide (CTAB) were used at dosages of 70, 180, 250, and 500 mg g -1 , respectively. The DAF efficiency-coagulant dosage relationship changed with algal culture conditions. In evaluating the influence of the initial algal concentration and recycle ratio revealed that, under conditions typical for algal harvesting, we found that it is possible that the number of bubbles is insufficient. A DAF algal harvesting model was developed to explain this observation by introducing mass-based floc size distributions and a bubble limitation into the white water blanket model. Moreover, the model revealed the importance of coagulation to increase floc-bubble collision and attachment, and the preferential interaction of bubbles with larger flocs, which limited the availability of bubbles to the smaller sized flocs. The harvesting efficiencies predicted by the model agree reasonably with experimental data obtained at different Al 3+ dosages, algal concentrations, and recycle ratios. Based on this modeling, critical parameters for efficient algal harvesting were identified.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Growth modeling to evaluate alternative cultivation strategies to enhance national microalgal biomass production

In this paper, we present a model-based assessment of alternative cultivation strategies on algal biomass production within the conterminous United States. Our assessment focuses on two basic cultivation strategies: 1) seasonal rotation of three representative freshwater algal strains that are well suited for warm weather, cold weather, and all-season diverse weather conditions, respectively; and 2) variation between three open pond water depths (15cm, 20cm, and 25cm). The enhanced Biomass Assessment Tool (BAT) is applied on a site-specific, hourly basis at 5,832 North American Land Data Assimilation System Phase 2 1/8° meteorological model grid cells over a 30-year period (1980-2009) to evaluate the operational strategies. Recognizing that resource management decisions may also consider scales beyond the individual site, we also conduct a regional assessment of focused on 7 representative climate zones in the conterminous United States. Results demonstrate that the spatial variability of algal productivity is largely affected by the strain-specific growth response to light and temperature that vary significantly by climate zone and latitude. Therefore, with a limited set of alternative cultivation strategies, the BAT identified the best performing combination of cultivation strategies on a site-specific basis that considerably enhances national annual biomass productivity. Specifically, the appropriate choice of seasonal strain rotation is able to significantly dampen climate-driven seasonal and spatial variability.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

CFD modeling of turbulent air flow in self-heated gyroid TPMS structures: Thermal-hydraulic performance and validation

The application of mathematically derived geometries, such as triply periodic minimal surface (TPMS) lattices, has garnered significant interest across various fields, including the nuclear sector, due to their superior thermal-hydraulic characteristics for heat transfer compared to traditional plain or finned tubes. Here, this study validates a computational fluid dynamics (CFD) model, evaluates different turbulence models and CFD model settings, and performs uncertainty quantification to provide a comprehensive analysis. Despite extensive research on CFD modeling of TPMS lattices, such as gyroid and diamond geometries, there is a notable lack of publicly available literature providing comprehensive details on numerical analysis aspects, including convergence and methodological best practices. This study embarks on a benchmark analysis of a gyroid geometry to evaluate its thermal-hydraulic performance under turbulent flow conditions and scrutinize various CFD model configurations. The main contributions of this work include validating the CFD model, assessing and comparing different turbulence models, and enhancing pressure drop and temperature prediction capabilities. The results aim to support the development of methodologies needed to benchmark and enhance numerical analysis techniques for TPMS lattices. This work seeks to complement the existing body of knowledge, support the development of TPMS reactor concepts, and improve best practices for CFD modeling of TPMS lattices, ultimately advancing methodologies to support future applications in this domain.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2019

Evaluation of Modeled Precipitation in Oceanic Extratropical Cyclones Using IMERG

Using a high-spatial- and high-temporal-resolution precipitation dataset, Integrated Multi-satellite Retrievals for GPM (IMERG), extratropical cyclone precipitation is evaluated in two reanalyses and two climate models. Based on cyclone-centered composites, all four models overestimate precipitation in the western subsiding and dry side of the cyclones, and underestimate the precipitation in the eastern ascending and moist side. By decomposing the composites into frequency of occurrence and intensity (mean precipitation rate when precipitating), the analysis reveals a tendency for all four models to overestimate frequency and underestimate intensity, with the former issue dominating in the western half and the latter in the eastern half of the cyclones. Differences in frequency are strongly dependent on cyclone environmental moisture, while the differences in intensity are strongly impacted by the strength of ascent within the cyclone. There are some uncertainties associated with the observations: IMERG might underreport frozen precipitation and possibly exaggerate rates in vigorously ascending regions. Nevertheless, the analysis suggests that all models produce extratropical cyclone precipitation too often and too lightly. These biases have consequences when evaluating the changes in precipitation characteristics with changes in cyclone properties: the models disagree on the magnitude of the change in precipitation intensity with a change in environmental moisture and in precipitation frequency with a change in cyclone strength. This complicates accurate predictions of precipitation changes in a changing climate.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1976

Semiempirical airframe noise prediction model and evaluation with flight data

A semiempirical maximum overall sound pressure level (OASPL) airframe noise model was derived. Noise radiated from aircraft wings was modeled on the trailing edge diffractes quadrupole sound theory. The acoustic dipole sound theory was used to model noise from the landing gear. The model was correlated with maximum OASPL flyover noise measurements obtained for three jet aircraft. One third octave band sound pressure level flyover data was correlated and interpreted.

Hersh, A. S.↗
DOE OSTI2021

A hierarchical evaluation framework for assessing climate simulations relevant to the energy-water-land nexus (Final Report)

The overarching goal was to construct a hierarchy of new and well-tested metrics and analysis tools that support both fundamental and use-inspired research. Motivating this goal was a convergence of needs from climate scientists and stakeholders alike for a systematic, robust framework of model evaluation and diagnosis to provide scientific insights, inform model development, support best practices for the use of climate model outputs, and facilitate communication of climate information in the evolving landscapes of multi-model, multi-resolution, and large ensemble simulations that generate terabytes of data for any single climate run. Steps toward attaining these goals benefited from expertise and established capability of the project team, which included leadership of the North American Regional Climate Change Assessment Program (NARCCAP) and the Coordinated Regional Downscaling Experiment (CORDEX), development of hierarchical model evaluation approaches, and successful research in the analysis and diagnosis of climate model skill, as well as the understanding and modeling of regional climate processes in North America. As part of the overarching goal, the project worked to disseminate a suite of methodologies, algorithms, and software components that the wider community can employ to advance climate science and applications. With rigorous demonstration, the evaluation framework and the mix of standard and high risk / high reward approaches helped form the basis for future development of a computationally enabled user-friendly system for community use.

17 WIND ENERGY↗
DOE OSTI2016

Alpha1 LASSO data bundles Lamont, OK

A data bundle is a unified package consisting of LASSO LES input and output, observations, evaluation diagnostics, and model skill scores. LES input includes model configuration information and forcing data. LES output includes profile statistics and full domain fields of cloud and environmental variables. Model evaluation data consists of LES output and ARM observations co-registered on the same grid and sampling frequency. Model performance is quantified by skill scores and diagnostics in terms of cloud and environmental variables.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

LASSO Data Bundles

The Alpha 2 release is the second release from the LASSO Pilot Phase that builds upon the Alpha 1 release. Alpha 2 contains additional diagnostics in the data bundles and focuses on cases from spring-summer 2016. A data bundle is a unified package consisting of LASSO LES input and output, observations, evaluation diagnostics, and model skill scores. LES input include model configuration information and forcing data. LES output includes profile statistics and full domain fields of cloud and environmental variables. Model evaluation data consists of LES output and ARM observations co-registered on the same grid and sampling frequency. Model performance is quantified by skill scores and diagnostics in terms of cloud and environmental variables.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

Investigating Downscaling Methods and Evaluating Climate Models for Use in Estimating Regional Water Resources in Mountainous Regions under Changing Climatic Conditions

The purpose of this three-year study is to develop and evaluate techniques to estimate the range of potential hydrological impacts of climate change in mountainous areas. Three main objectives are set out in the proposal. (1) To develop and evaluate transfer functions to link tropospheric circulation to regional snowfall. (2) To evaluate a suite of General Circulation Models (GCMs) for use in estimating synoptic scale circulation and the resultant regional snowfall. And (3) to estimate the range of potential hydrological impacts of changing climate in the two case study areas: the Upper Colorado River basin, and the Catskill Mountains of southeastern New York State. Both regions provide water to large populations.

Frei, Allan↗
DOE OSTI2015

Albedo and Diffuse POA Measurements to Evaluate Transposition Model Uncertainty

Albedo and diffuse plane of array (DPOA) measurements are used in addition to standard global horizontal irradiance (GHI), direct normal irradiance (DNI), diffuse horizontal irradiance (DNI), and plane of array irradiance (POA) measurements to determine the impact of albedo on transposition model performance. Albedo measurements averaged 0.214. Daily albedo values ranged from 0.148 to 0.236 and were found to be correlated to daily relative humidity. DPOA measurements were compared to calculated DPOA values (from POA and DNI), and helped identify a suspected deviation from due south in the azimuth of the POA measurement. Since the measured albedo average was close to the typical fixed $^{albedo = 0.2}$ assumption, little difference was seen between using measured and fixed albedo (~0.15% differences in mean bias difference (MBD) and root mean squared difference (RMSD)). However, evaluation of transposition models at other fixed albedos showed an albedo change of 0.1 is found to increase total modeled insolation by approximately 1%. Thus, for locations with different ground surfaces (e.g., persistent snow cover of black surfaces), the impact of using measured albedo instead of the fixed $^{albedo = 0.2}$ assumption may be greater. Measurement deviations resulted in up to 2% changes in MBD and RIVISD when switching between interrelated measurements (e.g., GHI and DHI as inputs to transposition models versus DNI and DHI as inputs). Variation among transposition models was also up to 2% MBD and RMSD. Thus, for this data set, measurement deviation and transposition model selection are found to have more impact than using measured albedo instead fixed albedo.

42 ENGINEERING↗
DOE OSTI2016

Experimental design for three interrelated marine ice sheet and ocean model intercomparison projects: MISMIP v. 3 (MISMIP +), ISOMIP v. 2 (ISOMIP +) and MISOMIP v. 1 (MISOMIP1)

Coupled ice sheet-ocean models capable of simulating moving grounding lines are just becoming available. Such models have a broad range of potential applications in studying the dynamics of marine ice sheets and tidewater glaciers, from process studies to future projections of ice mass loss and sea level rise. The Marine Ice Sheet-Ocean Model Intercomparison Project (MISOMIP) is a community effort aimed at designing and coordinating a series of model intercomparison projects (MIPs) for model evaluation in idealized setups, model verification based on observations, and future projections for key regions of the West Antarctic Ice Sheet (WAIS). Here we describe computational experiments constituting three interrelated MIPs for marine ice sheet models and regional ocean circulation models incorporating ice shelf cavities. These consist of ice sheet experiments under the Marine Ice Sheet MIP third phase (MISMIP+), ocean experiments under the Ice Shelf-Ocean MIP second phase (ISOMIP+) and coupled ice sheet-ocean experiments under the MISOMIP first phase (MISOMIP1). All three MIPs use a shared domain with idealized bedrock topography and forcing, allowing the coupled simulations (MISOMIP1) to be compared directly to the individual component simulations (MISMIP+ and ISOMIP+). The experiments, which have qualitative similarities to Pine Island Glacier Ice Shelf and the adjacent region of the Amundsen Sea, are designed to explore the effects of changes in ocean conditions, specifically the temperature at depth, on basal melting and ice dynamics. In future work, differences between model results will form the basis for the evaluation of the participating models.

58 GEOSCIENCES↗
DOE OSTI2022

Experimental Studies and Energy Modeling for Evaluating Performance of Various Deep Wall Retrofits

The Pacific Northwest National Laboratory, Oak Ridge National Laboratory, and the University of Minnesota conducted a three-year, multipart study on residential retrofit wall assemblies. The project, which was funded by the U.S. Department of Energy’s Building Technology Office, aimed to compare a range of residential wall retrofit systems that prioritized affordability, durability, and energy savings potential. The research team identified, constructed, tested, simulated, and analyzed the feasibility and economics of 16 wall retrofit assemblies (14 test configurations and two baseline configurations) that can be applied to the exterior side of existing walls (either with or without the existing cladding). The 16 wall assemblies were installed in an in-situ laboratory environment, to evaluate the ease of construction and study the thermal and hygrothermal performance of the walls. This paper presents the methodology used to evaluate the thermal performance of the walls and discusses the energy modeling results of the study. The results from the experiments were used to calibrate a THERM model of each wall assembly, which was then applied to a whole building using the EnergyPlus 8.6 simulation engine. A residential prototype building was used to extrapolate whole-building energy savings in each U.S. climate zone. To capture the conditions of the largest number of homes in the United States, the most frequent building characteristics (e.g., attic insulation level, window specifications, foundation insulation, etc.) were extracted from ResStock data and applied to the prototype model. Results from the energy modeling showed that the climate zones with the highest potential for retrofit savings are those which are heating-dominated (i.e., Cold and Very Cold climate designations). In these climate zones, heating and cooling energy savings due to the wall retrofits alone ranged from 21.5% to 38.2%.

Nagda, Harshil↗
DOE OSTI2023

Energy Model to Evaluate Thermal Energy Storage Integrated with Air Source Heat Pumps: Preprint

Full decarbonization in buildings requires the replacement of combustion appliances with electric ones, and air source heat pumps (ASHP) are a candidate alternative. However, technical limitations, such as the efficiency decrease when operating in cold weather, limit their adoption in the global heating market. Among several options to improve ASHP efficiency operating in colder climates, thermal energy storage (TES) has been considered, as it may provide heating when it is cold and shift ASHP operation to times when the weather is warmer. It may also take advantage of time of use electricity rates and support defrosting when necessary. The evaluation of ASHP-TES systems, however, is still limited because traditional metrics do not capture their full economic and environmental benefits. In this work, a python framework is presented to model the ASHP with and without the presence of TES. Metrics are proposed to analyze the system performance in terms of costs, equivalent CO2 emission, and efficiency metrics to evaluate and compare alternative systems. Model validation against experimental data obtained for a commercial heat pump is provided, as well as an application example using Denver, Colorado, to highlight the model capabilities.

cold climate↗
DOE OSTI2022

Evaluation of Model Summertime Boundary Layer Cloud Development over Complex Terrain in New York State

Weather forecasting over complex terrain with diverse land cover is challenging. Utilizing the high-resolution observations from New York State Mesonet (NYSM), we are able to evaluate the surface processes of the Weather Research Forecast (WRF) Model in a detailed, scale-dependent manner. Here, in the study, possible impacts of land–atmosphere interaction on surface meteorology and boundary layer cloud development are investigated with different model resolutions, land surface models (LSMs), and planetary boundary layer (PBL) physical parameterizations. The High-Resolution Rapid Refresh, version 3 (HRRR), forecasting model is used as a reference for the sensitivity evaluation. Results show that over complex terrain, the high-resolution simulations (1 km × 60 vertical levels) generally perform better compared to low-resolution (3 km × 50 levels) in both surface meteorology and cloud fields. LSMs play a more important role in surface meteorology compared to PBL schemes. The NoahMP land surface model exhibits daytime warmer and drier biases compared to the Rapid Update Cycle (RUC) due to better prediction of the Bowen ratio in RUC. The PBL schemes would affect the convective strength in the boundary layer. The Shin–Hong (SH) scale-aware scheme tends to produce the strongest convective strength in the PBL, while the ACM2 PBL scheme rarely resolved convection even at 1-km resolution. By considering the radiation effect of subgrid-scale (SGS) clouds, the Mellor–Yamada–Nakanishi–Niino eddy diffusivity mass flux (MYNN-EDMF) predicted the highest cloud coverage and lowest surface solar radiation bias. The configuration of SGS clouds in MYNN-EDMF would not only significantly reduce shortwave radiation bias, but also affect the convection behaviors through land surface–cloud–radiation interaction.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1982

Evaluation of the CEAS trend and monthly weather data models for soybean yields in Iowa, Illinois, and Indiana

The CEAS models evaluated use historic trend and meteorological and agroclimatic variables to forecast soybean yields in Iowa, Illinois, and Indiana. Indicators of yield reliability and current measures of modeled yield reliability were obtained from bootstrap tests on the end of season models. Indicators of yield reliability show that the state models are consistently better than the crop reporting district (CRD) models. One CRD model is especially poor. At the state level, the bias of each model is less than one half quintal/hectare. The standard deviation is between one and two quintals/hectare. The models are adequate in terms of coverage and are to a certain extent consistent with scientific knowledge. Timely yield estimates can be made during the growing season using truncated models. The models are easy to understand and use and are not costly to operate. Other than the specification of values used to determine evapotranspiration, the models are objective. Because the method of variable selection used in the model development is adequately documented, no evaluation can be made of the objectivity and cost of redevelopment of the model.

French, V.↗