Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Collaborative Research: Understanding air‐sea feedbacks to the MJO through process evaluation of observations and E3SM experiments (Final Technical Report)

This project explored the role of tropical oceans in regulating cloud populations within the Madden-Julian oscillation (MJO)–a large-scale tropical weather disturbance that influences extreme weather events across the globe by affecting the position of the jet stream and patterns of moisture transport. Our project sought to 1) document ocean feedback strength to the MJO in climate models, 2) understand how air-sea interactions affect the intensity, organization, and propagation of MJO convection, 3) utilize existing observations to identify sources of model bias for tropical air-sea interactions, and 4) better understand the effects of slow and fast ocean variability on MJO cloudiness. We found that transfers of heat and moisture across the air-sea interface (i.e., surface fluxes) in most climate models are over-supportive in maintaining MJO convection and under-supportive in propagating MJO convection. This can lead to misrepresentations in the frequency of extreme weather events across the globe through erroneous MJO feedbacks to jet stream position and moisture transport. Furthermore, using observations collected by ocean moorings across the tropical oceans, we showed that most models greatly overestimate surface evaporation in the subtropics, and that this bias is likely one contributor to a pervasive bias among climate models in their ability to simulate the mean state of rainfall over the tropical oceans (i.e., the “double ITCZ bias”). Replacing the default surface flux algorithm in two climate models with a state-of-the-art surface flux algorithm modestly reduced the double ITCZ bias in those models. Our work produced two model diagnostics packages that are now publicly available through DOE and NOAA model diagnostics archives. The first, the Analysis of Scales of Precipitation (ASoP) diagnoses scales of precipitation variability across space and time, with temporal resolution as fine as the model integration timestep. The second, the air-sea flux diagnostic diagnoses model surface fluxes and allows direct comparison of model fluxes to observations without having to recompute fluxes using model output and a state-of-the-art flux algorithm. These diagnostics, which were developed using climate models, can be readily applied to regional and global forecast model output to improve forecasts for the benefit of society.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Using multiple high-resolution datasets to benchmark the energy exascale earth system model (E3SM) for renewable resource assessment

The United States is accelerating its shift toward a renewable energy system. However, renewable resources, which harness energy from the Earth system, are susceptible to both present-day climate variability and future climate change. For example, variations in regional climate can alter renewable energy production patterns and site viability. The use of high-resolution climate model projections can therefore facilitate and may be critical to long-term planning of renewable energy investments. However, climate models must first be validated for renewable resource assessment. This research employs multiple high-spatiotemporal-resolution datasets to assess the capability of the Department of Energy’s (DOE) Energy Exascale Earth System Model version 2 North American Regionally Refined Model (E3SMv2-NARRM) for predicting multi-year climatological values of solar and wind energy capacity factors in the continental U.S., with a focus on regional and seasonal variability. Present-day E3SMv2-NARRM simulations are compared with reported utility-scale production data obtained from the Energy Information Administration (EIA). In addition, E3SMv2-NARRM data are evaluated against non-climate benchmark models from the National Renewable Energy Laboratory, including the Wind Integration National Dataset Toolkit and the National Solar Radiation Database (NSRDB), as well as three wind energy datasets from PLUSWIND. Our analysis indicates that solar capacity factors from E3SM closely match those from the NSRDB dataset. However, both datasets tend to overestimate values by 10% in comparison to EIA data. Furthermore, biases in wind capacity factors within E3SM are notably pronounced in the West Coast regions, where the seasonal cycle diverges from EIA data.

Energy forecasting, Capacity factor, Renewable ene↗
DOE OSTI2022

OperonSEQer: A set of machine-learning algorithms with threshold voting for detection of operon pairs using short-read RNA-sequencing data

Operon prediction in prokaryotes is critical not only for understanding the regulation of endogenous gene expression, but also for exogenous targeting of genes using newly developed tools such as CRISPR-based gene modulation. A number of methods have used transcriptomics data to predict operons, based on the premise that contiguous genes in an operon will be expressed at similar levels. While promising results have been observed using these methods, most of them do not address uncertainty caused by technical variability between experiments, which is especially relevant when the amount of data available is small. In addition, many existing methods do not provide the flexibility to determine the stringency with which genes should be evaluated for being in an operon pair. We present OperonSEQer, a set of machine learning algorithms that uses the statistic and p-value from a non-parametric analysis of variance test (Kruskal-Wallis) to determine the likelihood that two adjacent genes are expressed from the same RNA molecule. We implement a voting system to allow users to choose the stringency of operon calls depending on whether your priority is high recall or high specificity. In addition, we provide the code so that users can retrain the algorithm and re-establish hyperparameters based on any data they choose, allowing for this method to be expanded as additional data is generated. We show that our approach detects operon pairs that are missed by current methods by comparing our predictions to publicly available long-read sequencing data. OperonSEQer therefore improves on existing methods in terms of accuracy, flexibility, and adaptability.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Urban weather modeling using WRF: linking physical assumptions, code implementation, and observational needs

The Weather Research and Forecasting (WRF) model includes urban schemes that simulate the influence of urban surfaces on the atmosphere using parameterizations for flux, and radiative exchanges. Three core schemes – the Bulk urban parameterization, Single-Layer Urban Canopy Model (SLUCM), and Multi-Layer Urban Canopy Model (MLUCM) – represent increasing levels of complexity. Although the parameterizations within these urban schemes are described in the literature, their specific implementation remains poorly documented, thus slowing down model development efforts. This manuscript provides a roadmap to the three urban schemes in WRF version 4.5.2, presenting equations using the same symbols as in the model code, along with references to code lines, and including graphics and explanations that connect the code to its physical foundations. Our thorough review of the urban parameterizations implemented in WRF version 4.5.2 highlighted a handful of parameters that may introduce discontinuities in simulations: (i) in the SLUCM, a 1 mm h −1 rain rate threshold is employed to switch between two minimum moisture availability parameterizations, thus impacting latent heat flux calculations; (ii) in the SLUCM a threshold is used to partition shortwave radiation into direct and diffuse components; (iii) in all three urban schemes, the bulk Richardson number is employed to select the similarity function, which influences the vertical distribution of heat and momentum. We also identified a highly simplified treatment of the radiative balance on roof surfaces. The implications of these simplifications can be assessed through targeted observations across relevant conditions, including varying precipitation rates, cloud cover, and transitions between stability regimes. Furthermore, the widespread application of the Monin-Obukhov similarity theory in these urban schemes warrants model evaluation under highly stable and unstable conditions and in heterogeneous urban settings with variable land cover and building heights on scales finer than model resolution. To address these challenges, we offer guidance on observational strategies, emphasizing the need for multi-parametric measurements to capture potential compensating biases and multi-height measurements that align with the levels where quantities are diagnostic and prognosed in the model (i.e., the lowest atmospheric level of the WRF model). Finally, our inspection of the code revealed implementation bugs that have now been corrected in WRF versions 4.6.0 and 4.6.1. Sensitivity tests over the Atlanta urban area show that these corrections affect surface temperatures, underscoring the importance of performing rigorous documentation and verification of the implementation of parameterizations in model code.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The wave energy converter control competition (WECCCOMP): Wave energy control algorithms compared in both simulation and tank testing

The wave energy control competition established a benchmark problem which was offered as an open challenge to the wave energy system control community. The competition had two stages: In the first stage, competitors used a standard wave energy simulation platform (WEC-Sim) to evaluate their controllers while, in the second stage, competitors were invited to test their controllers in a real-time implementation on a prototype system in a wave tank. The performance function used was based on converted energy across a range of standard sea states, but also included aspects related to economic performance, such as peak/average power, peak force, etc. This paper compares simulated and experimental results and, in particular, examines if the results obtained in a linear system simulation are borne out in reality. Overall, within the scope of the device tested, the range of sea states employed, and the performance metric used, the conclusion is that high-performance WEC controllers work well in practice, with good carry-over from simulation to experimentation. However, the availability of a good WEC mathematical model is deemed to be crucial.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Examining the Impacts of Great Lakes Temperature Perturbations on Simulated Precipitation in the Northeastern United States

Most inland water bodies are not resolved by general circulation models, requiring that lake surface temperatures be estimated. Given the large spatial and temporal variability of the surface temperatures of the North American Great Lakes, such estimations can introduce errors when used as lower boundary conditions for dynamical downscaling. Lake surface temperatures (LSTs) influence moisture and heat fluxes, thus impacting precipitation within the immediate region and potentially in regions downwind of the lakes. For this study, the Advanced Research version of the Weather Research and Forecasting Model (WRF-ARW) was used to simulate precipitation over the six New England states during a 5-yr historical period. The model simulation was repeated with perturbed LSTs, ranging from 10°C below to 10°C above baseline values obtained from reanalysis data, to determine whether the inclusion of erroneous LST values has an impact on simulated precipitation and synoptic-scale features. Results show that simulated precipitation in New England is statistically correlated with LST perturbations, but this region falls on a wet–dry line of a larger bimodal distribution. Wetter conditions occur to the north and drier conditions occur to the south with increasing LSTs, particularly during the warm season. Additionally, the precipitation differences coincide with large-scale anomalous temperature, pressure, and moisture patterns. Care must therefore be taken to ensure reasonably accurate Great Lakes surface temperatures when simulating precipitation, especially in southeastern Canada, Maine, and the mid-Atlantic region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A Time Series Sustainability Assessment of a Partial Energy Portfolio Transition

Energy portfolios are overwhelmingly dependent on fossil fuel resources that perpetuate the consequences associated with climate change. Therefore, it is imperative to transition to more renewable alternatives to limit further harm to the environment. This study presents a univariate time series prediction model that evaluates sustainability outcomes of partial energy transitions. Future electricity generation at the state-level is predicted using exponential smoothing and autoregressive integrated moving average (ARIMA). The best prediction results are then used as an input for a sustainability assessment of a proposed transition by calculating carbon, water, land, and cost footprints. Missouri, USA was selected as a model testbed due to its dependence on coal. Of the time series methods, ARIMA exhibited the best performance and was used to predict annual electricity generation over a 10-year period. The proposed transition consisted of a one-percent annual decrease of coal’s portfolio share to be replaced with an equal share of solar and wind supply. The sustainability outcomes of the transition demonstrate decreases in carbon and water footprints but increases in land and cost footprints. Decision makers can use the results presented here to better inform strategic provisioning of critical resources in the context of proposed energy transitions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Southwest Pacific tropical cyclone development classification utilizing machine learning and synoptic composites

This study evaluates the ability of machine learning algorithms to classify tropical depressions (TDs) and tropical storms (TSs) in the western region of the southwest Pacific Ocean (SWPO). Decision rules are generated to predict the environment required for a depression to fully develop into a mature storm, and the most influential predictors in the classification decision are ranked. TD and TS are discriminated based on a maximum sustained wind speed threshold (≥17 ms -1 ). Various aerosol, thermodynamic, and dynamic parameters are extracted closest to the initiation point of each non-developing and developing sample. The covariates associated with each labelled sample are used to train a decision tree and random forest model. Results using a testing dataset suggest the random forest approach more accurately distinguishes between non-developing and developing samples. The classification accuracy of the decision tree and random forest are 72% and 91%, respectively. Random forest outperformed the decision tree by providing higher accuracy in test data. The most important variables for binary classification are sea salt aerosol optical depth (AOD), 1,000 mb relative humidity, and sea surface temperature. AOD is a quantitative estimate of the aerosols presents in the air through the extinction of a ray of light as it passes through the atmosphere. Mean composite maps constructed in an unsupervised manner have been created for the most important variables identified by the random forest classifier during TD and TS events to highlight the difference in geophysical and aerosol variables' climatology during the two different classifications. This work will advance the risk management strategies for northeastern Australia and other SWPO basin islands to control their tropical cyclone related losses through prioritizing forecasting variables that are the strongest predictors of the strengthening of tropical depressions into tropical cyclones.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Aridity and forest age mediate landscape scale patterns of tropical forest resistance to cyclonic storms

Abstract Cyclonic storms, or hurricanes, are expected to intensify as ocean heat energy rises due to climate change. Ecological theory suggests that tropical forest resistance to hurricanes should increase with forest age and wood density. However, most data on hurricane effects on tropical forests come from a limited number of well‐studied long‐term monitoring sites, restricting our capacity to evaluate the resistance of tropical forests to hurricanes across broad environmental gradients. In this study, we assessed whether forest age and aridity mediate the effects of hurricanes Irma and Maria in Puerto Rico, Vieques and Culebra islands. We leveraged functional trait data for 410 tree species, remotely sensed measurements of canopy height and cover, along with data on forest stand characteristics of 180 of 338 forest monitoring plots, each covering an area of 0.067 ha. The plots represent a broad mean annual precipitation (MAP) gradient from 701 to 4598 mm and a complex mosaic of forest age from 5 to around 85 years since deforestation. Hurricanes resulted in a 25% increase in basal area mortality rates, a 45% decrease in canopy height and a 21% reduction in canopy cover. These effects intensified with forest age, even after considering proximity to the hurricane path. The links between forest age and hurricane disturbances were likely due the prevalence of tall canopies. Tall forest canopies were strongly linked with low community‐weighted wood density (WD). These characteristics were on average more common in moist and wet forests (MAP >1250 mm). Conversely, dry forests were dominated by short species with high wood density (WD > 0.6 g cm −3 ) and did not show significant increases in basal area mortality rates after the hurricanes. Synthesis . Our findings show that selection towards drought‐tolerant traits across aridity gradients, such as short stature and dense wood, enhances resistance to hurricanes. However, forest age modulated responses to hurricanes, with older forests being less resistant across the islands. This evidence highlights the importance of considering the intricate links between ecological succession and plant function when forecasting tropical forests’ responses to increasingly strong hurricanes.

Vargas G., German↗
DOE OSTI2025

Using ARM Observations to Evaluate Process-Interactions in MCS Simulations Across Scales (Final Progress Report)

This project, funded by DOE Atmospheric System Research (DE-SC0020050), focused on improving the representation of mesoscale convective systems (MCSs) in numerical weather and climate models by leveraging high-resolution observations from the DOE Atmospheric Radiation Measurement (ARM) program. The research aimed to evaluate model sensitivities to grid spacing, microphysics, and planetary boundary layer (PBL) schemes, with a particular emphasis on improving convection parameterization for high-resolution modeling. Findings from this work highlight several key advancements. Model validation against ARM radar wind profiler data from the Southern Great Plains (SGP) and Manaus (MAO) sites revealed systematic biases in simulated convective mass flux profiles, leading to the development of an observationally constrained evaluation framework for diagnosing and improving model performance. Sensitivity analyses demonstrated that the representation of Amazonian MCSs was highly dependent on PBL scheme selection, while mid-latitude MCSs were more strongly influenced by microphysics parameterizations. A series of high-resolution WRF simulations, ranging from 4 km to 125 m grid spacing, provided insight into the behavior of convective drafts across scales. While updraft properties converged at sub-kilometer resolutions, biases in downdraft intensity persisted even at the finest resolution tested, emphasizing the need for further refinements in model physics. Additionally, comparisons of MCS vertical structures between mid-latitude and tropical environments revealed stronger updrafts and larger mass flux in mid-latitude MCSs, providing critical insights for improving climate model representations of storm-scale dynamics. The project’s findings have already contributed to advancing numerical modeling capabilities, particularly in WRF, MPAS, ICON, and DOE’s SCREAM model, by refining how convective processes are represented in high-resolution climate simulations. Results were disseminated through peer-reviewed publications, conference presentations, and ARM/ASR Research Highlights, engaging the broader scientific community. The project also provided valuable training opportunities for two postdoctoral researchers, who played central roles in model development, analysis, and dissemination of results. Their work contributed to several publications and conference presentations, helping prepare them for careers in atmospheric modeling. By improving the simulation of MCSs, this research directly supports the development of next-generation climate models capable of more accurately representing extreme precipitation and convective processes. The insights gained will inform future improvements in convective parameterization and guide the design of high-resolution weather and climate simulations, ultimately enhancing the reliability of climate projections and weather forecasts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Bounding the costs of electric vehicle managed charging—supply curves for scenarios from 2025 to 2050

As electric vehicle (EV) adoption increases, the resulting EV battery charging will increase demand on the electric power grid. Through EV managed charging (EVMC) programs, charging can be shifted in time to support electric grid reliability and reduce electricity costs. EVMC can offer an alternative to additional supply-side generation, but the costs of EVMC implementation must be understood to evaluate the cost-benefits of EVMC. This paper presents bottom-up, forward-looking (from 2025 through 2050) estimates of the incremental costs associated with different EVMC dispatch mechanisms available to electric utilities. The costs of enabling EVMC for a range of customer participation levels are presented in the form of supply curves, which provide per-EV costs for a targeted level of participation. The largest drivers of cost variation are assumptions about future charging flexibility paradigms described in four scenarios. These supply curves can be used to quantify the expected costs of EVMC programs and enable comparison with supply-side or other demand flexibility alternatives.

25 ENERGY STORAGE↗
DOE OSTI2022

Riparian vegetation shade restoration and loss effects on recent and future stream temperatures

River temperatures are expected to increase this century harming species requiring cold-water habitat unless restoration activities protect or improve habitat availability. Local shading by riparian vegetation can cool water temperatures, but uncertainty exists over the scaling of this local effect to larger spatial extents. Here, we evaluate this issue using a regional spatial stream network temperature model with covariates representing shade effects to predict mean August stream temperatures across 78,195 km of tributaries flowing into the Columbia River in the northwestern United States. We evaluate nine scenarios predicting stream temperatures for three riparian shade conditions (current, restored, and no riparian vegetation) within three different climate periods (2000s, 2040s, and 2080s). Results suggest riparian shade restoration (2000s climate) could decrease mean August stream temperatures by 0.62°C across the study network. Under the same restored shade conditions, temperature predictions for tributaries at their confluence with the Columbia River range from 0.02 to 2.08°C cooler than under current shade conditions. The climate warming effect predicted for the 2040s and 2080s, however, is greater than the cooling effect from restoring riparian shade. Streams less than 10-m bankfull width cooled more frequently with riparian shade restoration. In Oregon, the proportion of fish habitat for salmon and trout rearing and migration that meet temperature numeric water quality criteria could be increased by 20% under restored shade conditions although net habitat declines may still occur in the future. We conclude riparian vegetation restoration could partially mitigate future warming and help maintain cold-water habitats that function as thermal refuges if implemented strategically.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Stochastic Analysis for Long Term Capital Structures, Systems, and Components Refurbishment and Replacement

As commercial Nuclear Power Plants (NPPs) pursue extended plant operation in the form of Second License Renewal (SLR), opportunities exist for these plants to provide capital investments to ensure long-term safe and economic performance. At the current time, several utilities have announced an intention to pursue extended operation for one or more of their NPPs via SLR . The goal of this research is to develop a risk-informed approach to evaluate and prioritize plant capital investments made in preparation for, and during the period of, extended plant operations to support decisions for NPP operations. Since the capital investments are influenced by various factors, such as markets, safety and regulatory, the decision-making process of NPP operations should take into account relevant factors for balancing risks, costs and profits. The traditional method of capital budgeting is based on the priority list of candidate projects using economic measures such as benefit-investment ratio, net present value (NPV) and internal rate of return. In the literatures, the problem of capital budgeting or the variant can be represented by an appropriate knapsack problem. The knapsack approach to capital budgeting takes as input as investment, along with the cost and profit of each project. The objective of capital budgeting is to find the combination of the binary decisions for every investment such that the overall profit is as large as possible. The output is a collection of projects to be carried out, and we refer this selected collection of projects as a project portfolio. One limitation of traditional optimization models for capital budgeting is that they do not account for risk/uncertainty in profit and cost streams associated with individual projects, they do not account for risk in resource availability in future years [1,2,3]. Projects can incur cost over-runs, especially when projects are large, performed infrequently, and when there is risk regarding technical viability, external contractors, and/or suppliers of requisite parts and materials. Occasionally, projects are performed ahead of schedule and with cost savings. Planned budgets for capital improvements can be cut and key personnel may be lost. Or, there may be surprise windfalls in budgets for maintenance activities due to decreased costs for “unplanned” maintenance. In these cases, how should we resolve capital budgeting when we have risk forecasts for costs, profits and budgets? One approach we proposed in this summary is to re-solve the optimization models based on assumed statistical distributions of given parameters. If these distributions were not available, a two-stage stochastic optimization approach can be used to provide priority lists to decision-makers to support better risk-informed decisions [4, 5]. In this summary, we will only focus on the first approach.

42 ENGINEERING↗
DOE OSTI2024

When do different scenarios of projected electricity demand start to meaningfully diverge?

Resource adequacy studies look at balancing electricity supply and demand on 10- to 15-year time horizons while asset investment planning typically evaluates returns on 20- to 40-year time horizons. Projections of electricity demand are factored into the decision-making in both cases. Climate, energy policy, and socioeconomic changes are key uncertainties known to influence electricity demands, but their relative importance for demands over the next 10-40 years is unclear. The power sector would benefit from a better understanding of the need to characterize these uncertainties for resource adequacy and investment planning. In this study, we quantify when projected United States (U.S.) electricity demands start to meaningfully diverge in response to a range of climate, energy policy, and socioeconomic drivers. Here we use a wide yet plausible range of 21st century scenarios for the U.S. The projections span two population/economic growth scenarios (Shared Socioeconomic Pathways 3 and 5) and two climate/energy policy scenarios, one including climate mitigation policies and one without (Representative Concentration Pathways 4.5 and 8.5). Each climate/energy policy scenario has two warming levels to reflect a range of climate model uncertainty. We show that the socioeconomic scenario matters almost immediately – within the next 10 years, the climate/policy scenario matters within 25-30 years, and the climate model uncertainty matters only after 50+ years. This work can inform the power sector working to integrate climate change uncertainties into their decision-making.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Calibration and Uncertainty Estimation Using the Ensemble Kalman Filter with a Large Subsurface Flow and Transport Model - 20321

At routinely monitored groundwater contamination sites, periodically measured environmental conditions such as groundwater levels and contaminant concentrations are used to inform and confirm a conceptual site model (CSM) and guide the development and calibration of a numerical groundwater flow and transport model. The calibration of groundwater flow and transport models after each measurement (sampling) event can illuminate deficiencies in a CSM, identify areas where additional monitoring is warranted, and predict the behavior of the system to guide decision making. However, manual and automated (e.g. PEST) model calibration tools can be time-consuming and computationally expensive to implement after each sampling event. Perhaps as a result, such calibration tools generally utilize all available monitoring data simultaneously rather than sequentially assimilating monitoring data one sampling event at a time as the results from sampling become available. A more real-time data assimilation approach may reduce parameter uncertainty, quantify the value of additional monitoring data, and produce a usable model more quickly and with less effort. To mitigate the potential time-consuming aspects of manual and widely applied automated calibration techniques, a data assimilation algorithm called the ensemble Kalman filter (EnKF) was evaluated as a relatively efficient method of model calibration and uncertainty assessment via the sequential integration of monitoring data into a model. The EnKF was able to successfully and efficiently assimilate monitoring and modeling data to calibrate a complex flow and transport model at a real-world site with significant subsurface heterogeneity, uncertainty, and 12 years of monitoring data (over 4,000 individual measurements of groundwater levels and over 2,500 measurements of contaminant concentrations). Starting with an uncalibrated model data from annual sampling events were sequentially assimilated, and the resultant predication errors and estimated parameter uncertainties were tracked. After all monitoring data were assimilated, both flow and transport residuals at the end of the EnKF process were comparable to those produced via a concurrent PEST calibration effort but required fewer model simulations. Both uncertainty and prediction errors decreased over time. In a real-time application, the adequacy of the model could be assessed after each sampling event. The benefits of such a real-time approach to utilizing monitoring data include reduced costs (in the form of model updates or site characterization efforts), early flagging of possible errors in the CSM, and a reduced risk of overfitting and corresponding increased confidence in model predictions. This tool may be particularly useful compared to other calibration techniques (e.g. manual, PEST) when model runtimes are long, calibration parameters are many, or parameter uncertainty is large. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Classification Analysis of Southwest Pacific Tropical Cyclone Intensity Changes Prior to Landfall

This study evaluates the ability of a random forest classifier to identify tropical cyclone (TC) intensification or weakening prior to landfall over the western region of the Southwest Pacific Ocean (SWPO) basin. For both Australia mainland and SWPO island cases, when a TC first crosses land after spending ≥24 h over the ocean, the closest hour prior to the intersection is considered as the landfall hour. If the maximum wind speed (V max ) at the landfall hour increased or remained the same from the 24-h mark prior to landfall, the TC is labeled as intensifying and if the V max at the landfall hour decreases, the TC is labeled as weakening. Geophysical and aerosol variables closest to the 24 h before landfall hour were collected for each sample. The random forest model with leave-one-out cross validation and the random oversampling example technique was identified as the best-performing classifier for both mainland and island cases. The model identified longitude, initial intensity, and sea skin temperature as the most important variables for the mainland and island landfall classification decisions. Incorrectly classified cases from the test data were analyzed by sorting the cases by their initial intensity hour, landfall hour, monthly distribution, and 24-h intensity changes. TC intensity changes near land strongly impact coastal preparations such as wind damage and flood damage mitigations; hence, this study will contribute to improve identifying and prioritizing prediction of important variables contributing to TC intensity change before landfall.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A Guide for Improved Resource Adequacy Assessments in Evolving Power Systems: Institutional and Technical Dimensions

This paper identifies and evaluates issues in traditional resource adequacy (RA) assessment practices, and how adjusting these practices may affect and depend on existing institutional arrangements for planning and procurement. The paper proposes a technical-institutional roadmap that would allow regulators in vertically-integrated jurisdictions and system planners and operators in restructured jurisdictions to revise RA practices across a range of components. First, we compile a critical review of current RA assessment practices based on (1) interviews with RA practitioners and (2) a review of recent technical literature. We find that (i) RA may need to expand beyond capacity adequacy to ensure energy adequacy – relevant for energy-limited resources such as storage – and potentially some form of ancillary service adequacy (e.g. enough ramping-up and ramping-down capability in the system); (ii) chronological hourly simulations for all hours in the year are the current best practice; (iii) metrics and models used do not reflect economic criteria in system operation and loss of load; and (iv) there is a need to improve representation of weather dependencies and weather data. Second, we review planning and RA reports for several private and public entities that plan generation and/or transmission infrastructure in the continental U.S. to look for existing practices involving resilience assessments. We find no systematic treatment of the costs of extreme weather and other hazards, the benefits of resilience, and resilience metrics in planning analyses and no systematic treatment of resilience metrics, methods, and outcomes for resource adequacy purposes. Third, we create a technical framework for probabilistic RA assessment and use it to study how key choices about how to model power system operations affect the values that are obtained for RA metrics. We find that (i) non-economic dispatch schemes that ignore economic objectives can lead to accurate RA assessments when coordinated with detailed operational strategies; (ii) multi-year data is critical to capture a wide variety of system conditions; (iii) not incorporating transmission limits into RA assessment could lead to substantial underestimation of traditional “expected value” RA metrics; and (iv) new RA metrics that capture event-specific shortfall characteristics should be used as supplements to traditional metrics. Finally, we examine RA assessments and use this information to propose a guide of evolving industry standards for resource adequacy assessments in resource planning and transmission planning. We report minimum, best, and frontier practices for temporal resolution of assessments, metrics and targets, weather data, load forecasting, characterization of variable renewable resources, characterization of transmission and market transactions, RA modeling and integration with planning processes, and capacity accreditation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Connecting the Radiative Influences of Aerosol upon the Mass Flux Profiles of Shallow Cumuli across the Southeast Atlantic Ocean Basin and its Boundaries (Final Report)

The Atlantic Ocean covers approximately 25% of Earth’s surface and the atmosphere above it is home to a complex array of clouds and aerosols that have important influences on regional and global weather and climate. These influences must be accurately depicted in short range, medium range, seasonal, and climate forecast models. Conditions over the tropical Atlantic are particularly complex due to continental scale plumes of dust from the Sahara Desert and smoke from agricultural burning in Africa that drift across the Atlantic Ocean basin toward the Americas. These plumes are often found meandering in the lower atmosphere above shallow tropical clouds that form above the ocean surface, presumably mingling with these clouds on occasion due to convective mixing processes. Elevated dust and smoke particles absorb incoming sunlight and substantially warm the marine atmosphere in the layer in which they are present. This warming may alter the thermal stability of the marine atmosphere and may throttle or enhance the development of clouds, change their internal structure and the rate at which they precipitate. Alternatively, it may isolate the lower atmosphere from drier layers above enabling water vapor to accumulate near the ocean surface potentially leading to the development of deeper convection. Our study was organized around the principal concept of determining the impact of African smoke and dust plumes upon cloud development at ASI and understanding how a popular shallow convection parameterization used in models responds to the presence of this aerosol. We analyzed observations collected during the US Department of Energy (DOE) Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign using the Atmospheric Radiation Measurement Program’s Mobile Facility #1 (AMF-1), which was deployed to Ascension Island (ASI) in Southeastern Atlantic for a one-year period. Ascension Island is immediately downwind from an African source of these plumes, but far enough removed to enable the lower atmosphere to have reacted to their presence. A main goal of our study was to compute radiative heating rate profiles over Ascension Island and along the trajectory from the biomass burning regions along coastal Africa to Ascension Island. To compute the radiative heating rate due to aerosols and clouds, we employed observed profiles of temperature, humidity, and clouds from LASIC alongside aerosol optical properties from the Modern-era Retrospective analysis for Research and Applications Version 2 (MERRA-2), as input for the Rapid Radiation Transfer Model (RRTM). Radiative heating was also assessed across the southeast Atlantic Ocean using an ensemble of back trajectories from the Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT) model. We were successful in this effort and the resulting publication is already being cited despite its relatively short lifetime in the literature. The second part of our study involved the process-level representation of the clouds observed over the Southeastern Atlantic in models. Our initial task, upon which the balance of this portion of the study depended, was to evaluate the representativeness of the clouds observed by AMF-1. What orographic influence did Ascension Island have on the measured cloud structure? We set out to answer this question by trying to separate observations that were clearly indicative of orographic forcing from those that were representative of open ocean. The siting of AMF-1, which was 340-m above sea-level on the slope of a steep escarpment, proved demonstrably problematic for cloud process measurements. Despite considerable effort using multiple approaches including artificial intelligence (AI), we were unable to successfully compensate for the orographic forcing present at the AMF-1 site on ASI and, hence, produce process-level summaries of the convective mass flux representative of open ocean over the Southeastern Atlantic. Even though the project has officially ended, we are making a final attempt using two new types of clustering algorithm (i.e., AI) on the recommendation of a former student, who is an expert in this area. Since we have only recently begun to test these new AI schemes, the recommendations from the second part of our project outlined below are based on our experience at the time of this report.

54 ENVIRONMENTAL SCIENCES↗