Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Evaluation of Model Summertime Boundary Layer Cloud Development over Complex Terrain in New York State

Weather forecasting over complex terrain with diverse land cover is challenging. Utilizing the high-resolution observations from New York State Mesonet (NYSM), we are able to evaluate the surface processes of the Weather Research Forecast (WRF) Model in a detailed, scale-dependent manner. Here, in the study, possible impacts of land–atmosphere interaction on surface meteorology and boundary layer cloud development are investigated with different model resolutions, land surface models (LSMs), and planetary boundary layer (PBL) physical parameterizations. The High-Resolution Rapid Refresh, version 3 (HRRR), forecasting model is used as a reference for the sensitivity evaluation. Results show that over complex terrain, the high-resolution simulations (1 km × 60 vertical levels) generally perform better compared to low-resolution (3 km × 50 levels) in both surface meteorology and cloud fields. LSMs play a more important role in surface meteorology compared to PBL schemes. The NoahMP land surface model exhibits daytime warmer and drier biases compared to the Rapid Update Cycle (RUC) due to better prediction of the Bowen ratio in RUC. The PBL schemes would affect the convective strength in the boundary layer. The Shin–Hong (SH) scale-aware scheme tends to produce the strongest convective strength in the PBL, while the ACM2 PBL scheme rarely resolved convection even at 1-km resolution. By considering the radiation effect of subgrid-scale (SGS) clouds, the Mellor–Yamada–Nakanishi–Niino eddy diffusivity mass flux (MYNN-EDMF) predicted the highest cloud coverage and lowest surface solar radiation bias. The configuration of SGS clouds in MYNN-EDMF would not only significantly reduce shortwave radiation bias, but also affect the convection behaviors through land surface–cloud–radiation interaction.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Fitch Wind-Farm Wake Parameterization with Large-Eddy Simulations of Wakes Using the Weather Research and Forecasting Model

Abstract Wind-farm parameterizations in weather models can be used to predict both the power output and farm effects on the flow; however, their correctness has not been thoroughly assessed. We evaluate the wind-farm parameterization of the Weather Research and Forecasting Model with large-eddy simulations (LES) of the wake performed with the same model. We study the impact on the velocity and turbulence kinetic energy (TKE) of inflow velocity, roughness, resolution, number of turbines (one or two), and inversion height and strength. We compare the mesoscale with the LES by spatially averaging the LES within areas correspondent to the mesoscale horizontal spacing: one covering the turbine area and two downwind. We find an excellent agreement of the velocity within the turbine area between the two types of simulations. However, within the same area, we find the largest TKE discrepancies because in mesoscale simulations, the turbine-added TKE has to be highest at the turbine position to be advected downwind. Within the downwind areas, differences between velocities increase as the wake recovers faster in the LES, whereas for the TKE both types of simulations show similar levels. From the various configurations, the impact of inversion height and strength is small for these heights and inversion levels. The highest impact for the one-turbine simulations appears under the low-speed case due to the higher thrust, whereas the impact of resolution is low for the large-eddy simulations but high for the mesoscale simulations. Our findings demonstrate that higher-fidelity simulations are needed to validate wind-farm parameterizations.

17 WIND ENERGY↗

History Matching and Performance Prediction of a Polymer Flood Pilot in Heavy Oil Reservoir on Alaska North Slope

The first-ever polymer flood pilot to enhance heavy oil recovery on Alaska North Slope (ANS) is ongoing. After more than 2.5 years of polymer injection, significant benefit has been observed from the decrease in water cut from 65% to less than 15% in the project producers. The primary objective of this study is to develop a robust history-matched reservoir simulation model capable of predicting future polymer flood performance. In this work, the reservoir simulation model has been developed based on the geological model and available reservoir and fluid data. In particular, four high transmissibility strips were introduced to connect the injector-producer well pairs, simulating short-circuiting flow behavior that can be explained by viscous fingering and reproducing the water cut history. The strip transmissibilities were manually tuned to improve the history matching results during the waterflooding and polymer flooding periods, respectively. It has been found that higher strip transmissibilities match the sharp water cut increase very well in the waterflooding period. Then the strip transmissibilities need to be reduced with time to match the significant water cut reduction. The viscous fingering effect in the reservoir during waterflooding and the restoration of injection conformance during polymer flooding have been effectively represented. Based on the validated simulation model, numerical simulation tests have been conducted to investigate the oil recovery performance under different development strategies, with consideration for sensitivity to polymer parameter uncertainties. The oil recovery factor with polymer flooding can reach about 39% in 30 years, twice as much as forecasted with continued waterflooding. Besides, the updated reservoir model has been successfully employed to forecast polymer utilization, a valuable parameter to evaluate the pilot test’s economic efficiency. All the investigated development strategies indicate polymer utilization lower than 3.5 lbs/bbl in 30 years, which is economically attractive.

Wang, Xindan↗

The Impact of NASA Scatterometer Data on GEOS-2 Analyses and Forecasts

Experiments with the evolving GEOS-2 data assimilation system (DAS) delineate the impact of NASA scatterometer (NSCAT) data on ocean surface analysis and numerical weather prediction (NWP). Extensions and refinements of the DAS to account for the characteristics of NSCAT data produced better results than were obtained with the GEOS-1 DAS. The two key extensions are to increase the vertical influence of the surface wind data and to take proper account of the time difference between the observation and the analysis. The results of these experiments show that surface wind analyses are improved by NSCAT data. This is seen in subjective evaluation of synoptic cases and in forecast impacts. NSCAT data have a very significant positive impact on the GEOS-2 forecasts in the southern hemisphere (SH). In the northern hemisphere (NH) the overall statistics show a modest positive impact. However, on a case by case basis, in the NH, the impact is generally neutral or significantly positive. The GEOS-2 results are compared to results obtained using the GEOS-1 DAS and using the 1995 National Center for Environmental Prediction (NCEP95) DAS. The GEOS-2 control forecasts are more accurate than those of GEOS-1. All three impact experiments show a large positive impact in the SH. In the NH, both the GEOS-2 and the NCEP95 NSCAT impacts are positive while the GEOS-1 impact is neutral.

Atlas, R.↗

Evaluation of the Impacts of Biomass Burning Aerosols on the NASA GEOS Sub-Seasonal Climate Forecasts

Emission sources of trace gases and aerosol particles in the South American (SA)and African (Af) continents have a strong seasonal and space variability associated with the extensive vegetation fires activities. In both continents, during the austral winter, the fires affect mainly tropical forest and savannah-type biomes and are mostly associated with deforestation and agricultural/pasture land management. Smoke aerosol particles, on average, contribute to at least 90% of the total aerosol optical depth (AOD) in the visible spectrum in the case of the South America regional smoke. Smoke aerosols also act as cloud condensation nuclei affecting cloud microphysics properties and therefore, changing the radiation budget, hydrological cycle and global circulation patterns over disturbed areas (Kaufman, 1995; Rosenfeld, 1999; Andreae,et al., 2004; Koren et al., 2004, Zhang, 2008; Ott et al., 2010; Randles et al., 2013). This study aims to evaluate and quantify the impact of including a comprehensive emission field of biomass burning aerosol on the performance of a seasonal climate forecast system, not only regarding the AOD itself but mainly on the meteorological state variable (e.g., precipitation and temperature). To address the questions put above, we designed two numerical experiments: 1- named"AERO_CTL" which applies the Quick Fire Emissions Dataset (QFED) emissions estimated with intra-diurnal variation (hereafter, BBE), and 2- named "AERO_CLM" where the sourcee mission is based on a climatology of the QFED emissions, with only monthly variation(hereafter, BBCLIM). Hindcast simulations were produced using the Goddard Earth ObservingSystem global circulation model, version 5, sub-seasonal to seasonal (GEOS5-S2S) system with a nominal spatial resolution of 56km (Rienecker et al., 2008). In both experiments, the aerosol feedbacks from cloud developments and radiation interactions were accounted. The two experiments consisted of 4 members each and ran from June to November spanning over the years 2000 to 2015. Model performance was evaluated by calculating statistical metrics on the mean area of SA and Af. Our results demonstrated that the skill model in predicting AOD is significantly improve when BBE source emission is applied over SA, but not over the Afcontinent. Over SA, the correlation between the AERO_CTL model configuration and MERRA-2 is 0.93 (R2= 0.86, RMS=0.02, BIAS=0.01), while the AERO_CLM model presents a value of0.81 (R2= 0.65, RMS=0.04, BIAS=0.06). However, the AERO_CTL experiment better represents the inter-annual variability of the AOS in both regions. The gain of the skill in predicting the AOD by the AERO_CTL experiment is also seen in some meteorological variables. We observed an increase in the model skill in predicting the 2-meter temperature and precipitation of up to 0.3 for the AERO_CTL experiment in comparison to the AERO_CLM. AERO_CLM. According to the analyzed hindcast, we inferred that representing the BBE more realistically implies in a significant gain of skills in the seasonal climate forecasting over SA and Af continents.

Aerosol↗

Evaluating the Contribution of NASA Remotely-Sensed Data Sets on a Convection-Allowing Forecast Model

The Short-term Prediction Research and Transition (SPoRT) Center is a collaborative partnership between NASA and operational forecasting partners, including a number of National Weather Service forecast offices. SPoRT provides real-time NASA products and capabilities to help its partners address specific operational forecast challenges. One challenge that forecasters face is using guidance from local and regional deterministic numerical models configured at convection-allowing resolution to help assess a variety of mesoscale/convective-scale phenomena such as sea-breezes, local wind circulations, and mesoscale convective weather potential on a given day. While guidance from convection-allowing models has proven valuable in many circumstances, the potential exists for model improvements by incorporating more representative land-water surface datasets, and by assimilating retrieved temperature and moisture profiles from hyper-spectral sounders. In order to help increase the accuracy of deterministic convection-allowing models, SPoRT produces real-time, 4-km CONUS forecasts using a configuration of the Weather Research and Forecasting (WRF) model (hereafter SPoRT-WRF) that includes unique NASA products and capabilities including 4-km resolution soil initialization data from the Land Information System (LIS), 2-km resolution SPoRT SST composites over oceans and large water bodies, high-resolution real-time Green Vegetation Fraction (GVF) composites derived from the Moderate-resolution Imaging Spectroradiometer (MODIS) instrument, and retrieved temperature and moisture profiles from the Atmospheric Infrared Sounder (AIRS) and Infrared Atmospheric Sounding Interferometer (IASI). NCAR's Model Evaluation Tools (MET) verification package is used to generate statistics of model performance compared to in situ observations and rainfall analyses for three months during the summer of 2012 (June-August). Detailed analyses of specific severe weather outbreaks during the summer will be presented to assess the potential added-value of the SPoRT datasets and data assimilation methodology compared to a WRF configuration without the unique datasets and data assimilation.

Zavodsky, Bradley T.↗

Real-time streamflow forecasting: AI vs. Hydrologic insights

In this paper, we propose a set of simple benchmarks for the evaluation of data-based models for real-time streamflow forecasting, such as those developed with sophisticated Artificial Intelligence (AI) algorithms. The benchmarks are also data-based and provide context to judge incremental improvements in the performance metrics from the more complicated approaches. The benchmarks include temporal and spatial persistence, persistence corrected for baseflow and streamflow, as well as river distance weighted runoff obtained from space-time distributed rainfall. In the development of the benchmarks, we use basic hydrologic insights such as flow aggregation by the river network, scale-dependence in basin response, streamflow partitioning into quick flow and baseflow, water travel time, and rainfall averaging by the basin width function. The study uses 140 streamflow gauges in Iowa that cover a range of basin scales between 7 and 37,000 km 2 . The data cover 17 years. This work demonstrates that the proposed benchmarks can provide good performance according to several commonly used metrics. For example, streamflow forecasting at half of the test locations across years achieves a Kling-Gupta Efficiency (KGE) score of 0.6 or higher at one-day ahead lead time, and 20% of cases reach the KGE of 0.8 or higher. The proposed benchmarks are easy to implement and should prove useful for developers of data-based as well as physics-based hydrologic models and real-time data assimilation techniques.

54 ENVIRONMENTAL SCIENCES↗

Application of parametric weight and cost estimating relationships to future transport aircraft

A model comprised of system level weight and cost estimating relationships for transport aircraft is presented. In order to determine the production cost of future aircraft its weight is first estimated based on performance parameters, and then the cost is estimated as a function of weight. For initial evaluation CERs were applied to actual system weights of six aircraft (3 military and 3 commercial) with mean empty weights ranging from 30,000 to 300,000 lb. The resulting cost estimates were compared with actual costs. The average absolute error was only 4.3%. Then the model was applied to five aircraft still in the design phase (Boeing 757, 767 and 777, and BAC HS146-100 and HS146-200). While the estimates for the 757 and 767 are within 2 to 3 percent of their assumed break-even costs, it is recognized that these are very sensitive to the validity of the estimated weights, inflation factor, the amount assumed for nonrecurring costs, etc., and it is suggested that the model may be used in conjunction with other information such as RDT&E cost estimates and market forecasts. The model will help NASA evaluate new technologies and production costs of future aircraft.

Beltramo, M. N.↗

An Assessment of the Skill of GEOS-5 Seasonal Forecasts

The seasonal forecast skill of the NASA Global Modeling and Assimilation Office coupled global climate model (CGCM) is evaluated based on an ensemble of 9-month lead forecasts for the period 1993 to 2010. The results from the current version (V2) of the CGCM consisting of the GEOS-5 AGM coupled to the MOM4 ocean model are compared with those from an earlier version (V1) in which the AGCM (the NSIPP model) was coupled to the Poseidon Ocean Model. It was found that the correlation skill of the Sea Surface Temperature (SST) forecasts is generally better in V2, especially over the sub-tropical and tropical central and eastern Pacific, Atlantic, and Indian Ocean. Furthermore, the improvement in skill in V2 mainly comes from better forecasts of the developing phase of ENSO from boreal spring to summer. The skill of ENSO forecasts initiated during the boreal winter season, however, shows no improvement in terms of correlation skill, and is in fact slightly worse in terms of root mean square error (RMSE). The degradation of skill is found to be due to an excessive ENSO amplitude. For V1, the ENSO amplitude is too strong in forecasts starting in boreal spring and summer, which causes large RMSE in the forecast. For V2, the ENSO amplitude is slightly stronger than that in observations and V1 for forecasts starting in boreal winter season. An analysis of the terms in the SST tendency equation, shows that this is mainly due to an excessive zonal advective feedback. In addition, V2 forecasts that are initiated during boreal winter season, exhibit a slower phase transition of El Nino, which is consistent with larger amplitude of ENSO after the ENSO peak season. It is found that this is due to weak discharge of equatorial Warm Water Volume (WWV). In both observations and V1, the discharge of equatorial WWV leads the equatorial geostrophic easterly current so as to damp the El Nino starting in January. This process is delayed by about 2 months in V2 due to the slower phase transition of the equatorial zonal current from westerly to easterly.

GMAO↗

The OSSE Framework at the NASA Global Modeling and Assimilation Office (GMAO)

This abstract summarizes the OSSE framework developed at the Global Modeling and Assimilation Office at the National Aeronautics and Space Administration (NASA/GMAO). Some of the OSSE techniques developed at GMAO including simulation of realistic observations, e.g., adding errors to simulated observations, are now widely used by the community to evaluate the impact of new observations on the weather forecasts. This talk presents some of the recent progresses and challenges in simulating realistic observations, radiative transfer modeling support for the GMAO OSSE activities, assimilation of OSSE observations into data assimilation systems, and evaluating the impact of simulated observations on the forecast skills.

Moradi, Isaac↗

The GMAO Observing System Simulation Experiment (OSSE) Framework

We present the current status of the OSSE system at the Global Modeling and Assimilation Office at the National Aeronautics and Space Administration (NASA/GMAO). Some of the OSSE techniques developed at GMAO including simulation of realistic observations, e.g., adding errors to simulated observations, are now widely used by the community to evaluate the impact of new observations on the weather forecasts. This talk presents some of the recent progresses and challenges in simulating realistic observations, radiative transfer modeling support for the GMAO OSSE activities, assimilation of OSSE observations into data assimilation systems, and evaluating the impact of simulated observations on the forecast skills.

Isaac Moradi↗

Perspectives on flood forecast-based early action and opportunities for Earth observations

This paper seeks to identify opportunities to integrate Earth observations (EO) into flood forecast-based early action and propose future directions for research and collaboration between EO and humanitarian communities. Forecast-based early action (FbA) is an approach to shift disaster response toward anticipation to mitigate impacts to at-risk communities; however, timely and accurate information is needed in the development of data-based triggers and thresholds for action. Therefore, this paper considers the readiness of a wide range of EO for flood monitoring and forecasting in the design, operations, and evaluation phases of FbA. The most significant opportunities for EO to inform FbA efforts lie in the design and evaluation phases, as EO can aid in the development of impact-based triggers. The EO products most readily applicable include precipitation, streamflow estimates, and exposure mapping, and those requiring the greatest amount of further research include vulnerability and impact assessments. This paper identifies collaboration opportunities for the EO and humanitarian communities to create tailored products, such as overlays combining flood extents with exposure maps. Such collaboration opportunities can be fostered by open data sharing, data verification efforts, and incentives for supporting boundary organizations capable of enabling the use of EO for FbA.

disasters↗

A Two-Level Model Predictive Control-Based Approach for Building Energy Management including Photovoltaics, Energy Storage, Solar Forecasting and Building Loads

This paper uses a two-level model predictive control-based approach for the coordinated control and energy management of an integrated system that includes photovoltaic (PV) generation, energy storage, and building loads. Novel features of the proposed local controller include (1) the ability to simultaneously manage building loads and energy storage to achieve different operational objectives such as energy efficiency, economic cost efficiency, demand response and grid optimization through the design of specific power trajectory tracking performance functionals, (2) an energy trim function that minimizes the impact of solar forecasting errors on system performance, and (3) the design of a state of charge controller that uses day-ahead forecast of solar power and building loads to intialize energy storage at the start of each day. The local controller is tested in simulation using an exemplary system with PV generation, energy storage and dispatchable building loads. Two sample days with different PV forecasts and multiple case scenarios are considered, and the performance of the algorithm in managing the real and reactive net building load trajectories and the ramp rate of PV injections into the utility network are evaluated. The simulations are based on actual forecasted and measured PV data, and the results show that the local controller meets the tracking requirements for real and reactive power within the operating constraints of the building.

14 SOLAR ENERGY↗

Assessing the Viability of Using GEOS-Forecast Product for Landslides Forecasting: A Step Toward Early Warning System

Landslides across the globe are mostly triggered by extreme rainfall events affecting infrastructure, transportation and livelihoods. The risks are rarely quantified due to lack of data, analytical skills and limited modeling techniques. Knowledge of local to global scale landslide risks provides communities and national agencies the ability to adapt disaster management practices to mitigate and recover from these hazards. In order to minimize the risks and improve characterization of community resilience to landslides, it is vital to have reliable information about the factors triggering landslides such as rainfall, well ahead in time. Forecasting potential landslide activity and impacts can be achieved through reliable precipitation forecast models. However, it is challenging because of the temporal and spatial variability of precipitation, an important factor in triggering landslides. Evaluation of the precipitation field, associated errors, and sampling uncertainties is integral for development of efficient and reliable landslide forecasting and early warning system. This study develops a methodology to assess the viability of using a precipitation field provided by a global model and its potential integration in the landslide forecasting system. The study focuses on the comparison between the IMERG (Integrated Multi-satellitE Retrievals for Global Precipitation Mission) and GEOS (NASA Goddard Earth Observing System)-Forecast product over contiguous United States (CONUS). GEOS model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The framework is tested on the GEOS-Forecast Model initialized at 00 UTC using daily IMERG early product as reference using both categorical and continuous statistics. The categorical statistics includes the probability of detection (POD), success ratio (SR), critical success index (CSI), and the hit bias. Continuous statistics such as correlation, normalized standard deviation, and root-mean-square error are also evaluated. Overall, GEOS-Forecast precipitation field over the analysis period (~1 year) show underestimation with respect to IMERG early for the daily accumulated rainfall. However, the probability distribution function and cumulative distribution function of both show similar patterns. In terms of correlations, POD, SR, CSI, hit bias, the performance varies with respect to the rainfall threshold used.

Sana Khan↗

Coupling localized Noah-MP-Crop model with the WRF model improved dynamic crop growth simulation across Northeast China

Croplands play a critical role in regulating the energy and moisture exchanges between the land surface and atmosphere. However, the interactions between cropland and climate are usually poorly represented due to a lack of detailed representation in crop types and field management. Here, we coupled the Noah-MP-Crop model with the state-of-the-art Weather Research and Forecasting (WRF) model to explore and evaluate the crop growth dynamics in response to climate variations across Northeast China. The default parameters of the crop model were not exactly suitable for the agricultural ecosystems in Northeast China. The detailed cropland distribution, and crop phenology parameters including growing degree days (GDD) and planting (harvesting) date were first created using multi-source remote sensing products and reanalysis data, and was then successfully used to simulate the growth and yield for corn and soybean and associated energy exchanges. We also optimized and calibrated other crop parameters using the time-series of the Moderate Resolution Imaging Spectroradiometer (MODIS) land surface products. The modified crop model substantially improved the simulation of crop growth, plant physiology, and biomass accumulation for both corn and soybean. Coupling the localized dynamic crop model into the WRF led to considerable decreases in the simulated mean-absolute-errors (MAEs) and biases of the leaf area index, evapotranspiration, and gross primary production compared with the MODIS observed values. Compared with the statistical yield from each province, the modified crop model underestimated the corn yield from 11.1% to 48.6%, whereas overestimated the soybean yield from 16.5% to 162.6%.

54 ENVIRONMENTAL SCIENCES↗

Computational Experiment Design for Operations Model Simulation

Computer simulations that demonstrate the value of novel approaches are crucial to developing more flexible and robust power systems operations with high penetrations of renewable energy at multiple geographic and temporal scales. However, optimization-based simulations that depend on forecast data often face challenges in evaluating performance, reproducing results, and testing under realistic simulation scenarios. In this paper, we develop scientific computing best-practices for the validation and reproduction of power systems operational models. We then employ two case studies to demonstrate the proposed validation and reproduction framework.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗

A review of risk and uncertainty assessment for geologic carbon storage

Carbon capture, utilization, and storage (CCUS) in geological formations play a key role in mitigating anthropogenic CO 2 emissions and achieving the aggressive goal of net-zero greenhouse gas emissions. Risk and uncertainty assessment is crucial for ensuring the safety and reliability of geologic carbon storage (GCS) by evaluating CO 2 migration in subsurface, forecasting potential leakage and induced seismicity risks, and optimizing operational and monitoring plans. In this review, the use and progress of risk assessment for GCS over the last few decades are examined. Here, we use the Southwest Regional Partnership on Carbon Sequestration (SWP), which is one of the seven regional partnerships supported by the United States Department of Energy (U.S. DOE), as an example of large-scale CCUS projects in North America. Additionally, future trends and requirements for risk assessment in GCS are discussed. The information provided in this review can help readers understand the significance of risk and uncertainty assessment and apply it effectively in large-scale GCS projects.

58 GEOSCIENCES↗

A Benchmark to Test Generalization Capabilities of Deep Learning Methods to Classify Severe Convective Storms in a Changing Climate

Abstract This is a test case study assessing the ability of deep learning methods to generalize to a future climate (end of 21st century) when trained to classify thunderstorms in model output representative of the present‐day climate. A convolutional neural network (CNN) was trained to classify strongly rotating thunderstorms from a current climate created using the Weather Research and Forecasting model at high‐resolution, then evaluated against thunderstorms from a future climate and found to perform with skill and comparatively in both climates. Despite training with labels derived from a threshold value of a severe thunderstorm diagnostic (updraft helicity), which was not used as an input attribute, the CNN learned physical characteristics of organized convection and environments that are not captured by the diagnostic heuristic. Physical features were not prescribed but rather learned from the data, such as the importance of dry air at mid‐levels for intense thunderstorm development when low‐level moisture is present (i.e., convective available potential energy). Explanation techniques also revealed that thunderstorms classified as strongly rotating are associated with learned rotation signatures. Results show that the creation of synthetic data with ground truth is a viable alternative to human‐labeled data and that a CNN is able to generalize a target using learned features that would be difficult to encode due to spatial complexity. Most importantly, results from this study show that deep learning is capable of generalizing to future climate extremes and can exhibit out‐of‐sample robustness with hyperparameter tuning in certain applications.

54 ENVIRONMENTAL SCIENCES↗