Search NASA⌕ Search

SEARCH · Search NASA

Results for “complex ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Ensemble modeling of global lake evaporation under climate change

Global projections of lake evaporation are typically based on simulations using single mechanistic models. However, because of its complex interactions with various lake physical properties, environmental and anthropogenic drivers, lake evaporation is highly variable and sensitive to the choice of model used. In this study, we present a multi-model analysis to investigate differences across global simulations of lake evaporation during the warm-season using three different lake models driven by outputs from four general circulation models (GCM) (i.e. 12 model combinations in total) for historic and future scenarios. Our results suggest substantial differences among lake-climate model simulations of lake evaporation. These differences varied throughout the 20th and 21st century, with model driver data explaining 74% of the variance in future projections of warm- season lake evaporation. Our projections indicate that, by the end of the 21st century (2070–2099), global annual lake evaporation rates will increase by 10–27% under Representative Concentration Pathways (RCPs) 2.6–8.5. Finally, we highlight the importance of using a multi-model approach for the prediction of future global lake evaporation responses to climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

STITCHES: a Python package to amalgamate existing Earth system model output into new scenario realizations

Understanding the interaction between humans and the Earth system is a computationally daunting task, with many possible approaches depending on resources available and questions of interest. For example, state-of-the-art impact models require decade-long time series of relatively high frequency, spatially resolved and often multiple variables representing climatic impact-drivers (Ruane et al., 2022). Most commonly these are derived from the outputs of detailed, computationally expensive Earth System Models (ESMs) run according to a standard, limited set of future scenarios, the latest being the SSP-RCPs run under CMIP6/ScenarioMIP (Eyring et al., 2016; O’Neill et al., 2016). At the time of writing, O’Neill et al. (2016) has been cited more than 1750 times and Eyring et al. (2016) more than 5000 times, highlighting the broad, general applications of this data. Often, however, impact modeling seeks to explore new scenarios that were not part of the ScenarioMIP protocol, and/or needs a larger set of initial condition ensemble members than are typically available to quantify the effects of ESM internal variability. In addition, the recognition that the human and Earth systems are fundamentally intertwined, and may feature potentially significant feedback loops, is making integrated, simultaneous modeling of the coupled human-Earth system increasingly necessary, if computationally challenging with most existing tools (Thornton et al., 2017). For impact modelers, climate model emulators can be the answer to meet both the needs of: 1) creating realizations for novel scenarios and 2) achieving a simplified, computationally tractable representation of ESM behavior in a coupled human-Earth system modeling framework. We proposed a new, comprehensive approach to such emulation of gridded, multivariate ESM outputs for novel scenarios without the computational cost of a full ESM, STITCHES (Tebaldi et al., 2022). The approach outlined in Tebaldi et al. (2022) should be extensible to future CMIP eras, although the STITCHES software at present is strictly focused on CMIP6/ScenarioMIP data hosted on Pangeo (https://gallery.pangeo.io/repos/pangeo-gallery/cmip6/). The corresponding STITCHES Python package uses existing archives of ESMs’ scenario experiments from CMIP6/ScenarioMIP to construct gridded, multivariate realizations of new scenarios provided by reduced complexity climate models (Hartin et al., 2015; Meinshausen et al., 2011; Smith et al., 2018), or to enrich existing initial condition ensembles. Its output provides the same characteristics as the emulated ESM output: multivariate (spanning potentially all variables that the ESM has saved), spatially resolved (down to the native grid of the ESM), and preserving the same high frequency as the original data. A new realization of multiple variables can be generated on the order of minutes with STITCHES, rather than the hours or sometimes days that ESMs require.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Colloidal State Machines as Smart Tracers for Chemical Reactor Analysis

A widely utilized tool in reactor analysis is passive tracers that report the residence time distribution, allowing estimation of the conversion and other properties of the system. Recently, advances in microrobotics have introduced powered and functional entities with sizes comparable to some traditional tracers. This has motivated the concept of Smart Tracers that could record the local chemical concentrations, temperature, or other conditions as they progress through reactors. Herein, the design constraints and advantages of Smart Tracers by simulating their operation in a laminar flow reactor model conducting chemical reactions of various orders are analyzed. It is noted that far fewer particles are necessary to completely map even the most complex concentration gradients compared with their conventional counterparts. Design criteria explored herein include sampling frequency, memory storage capacity, and ensemble number necessary to achieve the required accuracy to inform a reactor model. Cases of severe particle diffusion and sensor noise appear to bind the functional upper limit of such probes and require consideration for future design. The results of the study provide a starting framework for applying the new technology of microrobotics to the broad and impactful set of problems classified as chemical reactor analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

RNA target highlights in CASP15 : Evaluation of predicted models by structure providers

Abstract The first RNA category of the Critical Assessment of Techniques for Structure Prediction competition was only made possible because of the scientists who provided experimental structures to challenge the predictors. In this article, these scientists offer a unique and valuable analysis of both the successes and areas for improvement in the predicted models. All 10 RNA‐only targets yielded predictions topologically similar to experimentally determined structures. For one target, experimentalists were able to phase their x‐ray diffraction data by molecular replacement, showing a potential application of structure predictions for RNA structural biologists. Recommended areas for improvement include: enhancing the accuracy in local interaction predictions and increased consideration of the experimental conditions such as multimerization, structure determination method, and time along folding pathways. The prediction of RNA–protein complexes remains the most significant challenge. Finally, given the intrinsic flexibility of many RNAs, we propose the consideration of ensemble models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Using Convolutional Neural Network to Emulate Seasonal Tropical Cyclone Activity

Abstract It has been widely recognized that tropical cyclone (TC) genesis requires favorable large‐scale environmental conditions. Based on these linkages, numerous efforts have been made to establish an empirical relationship between seasonal TC activities and large‐scale environmental favorability in a quantitative way, which lead to conceptual functions such as the TC genesis index. However, due to the limited amount of reliable TC observations and complexity of the climate system, a simple analytic function may not be an accurate portrait of the empirical relationship between TCs and their ambiences. In this research, we use convolution neural networks (CNNs) to disentangle this complex relationship. To circumvent the limited amount of seasonal TC observation records, we implement transfer‐learning technique to train ensemble of CNNs first on suites of high‐resolution climate model simulations with realistic seasonal TC activities and large‐scale environmental conditions, and then on a state‐of‐the‐art reanalysis from 1950 to 2019. The trained CNNs can well reproduce the historical TC records and yields significant seasonal prediction skills when the large‐scale environmental inputs are provided by operational climate forecasts. Furthermore, by inputting the ensemble CNNs with 20th century reanalysis products and Phase 6 of the Coupled Model Intercomparison Project (CMIP6) simulations, we investigated TC variability and its changes in the past and future climates. Specifically, our ensemble CNNs project a decreasing trend of global mean TC activity in the future warming scenario, which is consistent with our future projections using high‐resolution climate model.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

In situ amplification of spin echoes within a kinetic inductance parametric amplifier

The use of superconducting microresonators together with quantum-limited Josephson parametric amplifiers has enhanced the sensitivity of pulsed electron spin resonance (ESR) measurements by more than four orders of magnitude. So far, the microwave resonators and amplifiers have been designed as separate components due to the incompatibility of Josephson junction–based devices with magnetic fields. This has produced complex spectrometers and raised technical barriers toward adoption of the technique. Here, we circumvent this issue by coupling an ensemble of spins directly to a weakly nonlinear and magnetic field–resilient superconducting microwave resonator. We perform pulsed ESR measurements with a 1-pL mode volume containing 6 × 10 7 spins and amplify the resulting signals within the device. When considering only those spins that contribute to the detected signals, we find a sensitivity of 2.8 x 10 3 spins / $\sqrt{Hz}$ for a Hahn echo sequence at a temperature of 400 mK. In situ amplification is demonstrated at fields up to 254 mT, highlighting the technique’s potential for application under conventional ESR operating conditions.

42 ENGINEERING↗
DOE OSTI2024

OpenFacadeControl: enabling integration of automated facades with other building systems

Automated facades are, for the most part, still considered as separate from other building systems throughout the design, installation, commissioning, operation, and maintenance cycle. This takes place despite the fact that their energy and comfort performance are deeply interlinked with the operation of lighting and HVAC systems. Over the last two decades, research has shown that there are significant advantages from operating facades as an integrated system with the rest of the building. Nevertheless, significant barriers prevent this type of integration becoming more common. One of them is the lack of a platform that is inexpensive to implement and that easily allows the practical implementation of integrated control algorithms across fenestration and other building systems, using a variety of communications protocols. This is particularly challenging when automated facades are installed in existing buildings, where interaction with legacy building systems that were installed over the past lifetime of the building can require a high degree of interoperability. OpenFacadeControl (OFC) is an open-source controls framework aimed at unified control of facades and other building systems, including the sharing of third-party sensor information. Through leveraging the Volttron controls platform, it allows the integration of systems and sensors that are manufactured by different companies and that use different communications protocols into an ensemble that functions as a single system. OFC is designed to enable integrated control algorithms of varying degrees of complexity, ranging from simple, heuristic controls to more sophisticated approaches like model-predictive control. Use of a research version to test advanced lighting and shading strategies in a full-scale experimental testbed has demonstrated the ease of deploying advanced control solutions using OpenFacadeControl. This paper presents the structure of OpenFacadeControl and a demonstration case showing the use of OFC in laboratory tests of advanced lighting and fenestration controls that coordinated motorized shades communicating via the BACnet building communications standard and lights communicating via internet-protocol-based application programming interface (API), based on the readings of a shared light level sensor communicating via a different API.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Pseudorandomness from Subset States

We show it is possible to obtain quantum pseudorandomness and pseudoentanglement from random subset states -- i.e. quantum states which are equal superpositions over (pseudo)random subsets of strings. This answers an open question of Aaronson et al. [arXiv:2211.00747], who devised a similar construction augmented by pseudorandom phases. Our result follows from a direct calculation of the trace distance between t copies of random subset states and the Haar measure, via the representation theory of the symmetric group. We show that the trace distance is negligibly small, as long as the subsets are of an appropriate size which is neither too big nor too small. In particular, we analyze the action of basis permutations on the symmetric subspace, and show that the largest component is described by the Johnson scheme: the double-cosets of the symmetric group S N by the subgroup S t x S N-t . The Gelfand pair property of this setting implies that the matrix eigenbasis coincides with the symmetric group irreducible blocks, with the largest eigenblock asymptotically approaching the Haar average. An immediate corollary of our result is that quantum pseudorandom and pseudoentangled state ensembles do not require relative phases.

Computational Complexity (cs.CC)↗
DOE OSTI2021

Artificial intelligence techniques for integrative structural biology of intrinsically disordered proteins

Here, we outline recent developments in artificial intelligence (AI) and machine learning (ML) techniques for integrative structural biology of intrinsically disordered proteins (IDP) ensembles. IDPs challenge the traditional protein structure-function paradigm by adapting their conformations in response to specific binding partners leading them to mediate diverse, and often complex cellular functions such as biological signaling, self-organization and compartmentalization. Obtaining mechanistic insights into their function can therefore be challenging for traditional structural determination techniques. Often, scientists have to rely on piecemeal evidence drawn from diverse experimental techniques to characterize their functional mechanisms. Multiscale simulations can help bridge critical knowledge gaps about IDP structure-function relationships - however, these techniques also face challenges in resolving emergent phenomena within IDP conformational ensembles. We posit that scalable statistical inference techniques can effectively integrate information gleaned from multiple experimental techniques as well as from simulations, thus providing access to atomistic details of these emergent phenomena.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Defect Thermodynamics and Transport Properties of Proton Conducting Oxide BaZr 1–x Y x O 3–δ (x ≤ 0.1) Guided by Density Functional Theory Modeling

Density functional theory-based thermodynamic modeling was performed to determine the effect of humidity and H 2 /O 2 gas pressure on the defect chemistry and transport properties of proton conducting oxide BaZr 1-x Y x O 3-δ (x ≤ 0.1) in the temperature range of 800–1200K, relevant for solid oxide fuel/electrolysis cell applications. The first-principles charge defect analysis was carried out to obtain the defect energetic ensembles as a function of Fermi level as well as the dependence of the hydration and oxidation reaction energies on complex defect-dopant configurations. It is shown that oxygen vacancies introduced to compensate for the extra Ba vacancies may cause a slight increase in the concentration of hydroxyl and proton species upon hydration of Ba deficient BaZr 1-x Y x O 3-δ , while the overall proton diffusivity is predicted to decrease with increased proton hopping barriers upon trapping near the Ba vacancies. The developed defect model is further demonstrated to be able to describe the bulk defect chemistry and transport properties of BaZr 0.9 Y 0.1 O 3-δ under the solid oxide cell operating conditions. Finally, the theoretical framework developed in this work further allows the inclusion of configurational, energetic and electronic characteristics of the defects that can be used as a complementary tool to experimental measurements for testing various mechanistic pathways or to provide essential mechanistic data.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Forced Patterns of Sea Level Rise in the Community Earth System Model Large Ensemble From 1920 to 2100

To provide context for observed sea level rise, the forced response (FR) in dynamic sea level (DSL) during the 20th and 21st centuries is examined in the Community Earth System Model Large Ensemble (LE). After accounting for simulation drift, which in the LE is sizable, the DSL FR is found to be complex, both in space and time. Its evolving character is suggested to arise from both the diversity and transient evolution of climate forcing agents and the slow adjustment timescales of the intermediate and deep oceans. Nonetheless, various intervals of spatially coherent change simulated for the recent past and near future are identified, and their characteristics and associated driving mechanisms are identified and discussed. The mid- to late-20th century DSL FR is characterized by an hemispherically asymmetric pattern of change, with depressed rates of rise in the northern oceans. There is also a dipole of change in the Southern Ocean caused by changes in near-surface zonal winds. Through the late 20th and early 21st centuries, a different pattern of rise emerges with elevated rates in the tropics and depressed rates at high latitudes. Zonal and interbasin variations characterize both intervals and involve the pattern and depth of anomalous ocean heat content storage and spatial contrasts in the expansion coefficient tied mainly to base state temperature, with greater rates of rise in warm regions per unit warming. Finally, the relative roles of surface flux and ocean convergence anomalies are examined.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Cryptate binding energies towards high throughput chelator design: metadynamics ensembles with cluster–continuum solvation

A tiered forcefield/semiempirical/meta-GGA pipeline together with a thermodynamic scheme designed with error cancellation in mind was developed to calculate binding energies of [2.2.2] cryptate complexes of mono- and divalent cations. Stable complexes of Na, K, Rb, Ca, Zn and Pb were generated, revealing consistent cation–N lengths but highly variable cation–O lengths and an amine stacking mechanism potentially augmenting the cation size selectivity. Metadynamics, used for searching the high-dimensional potential energy surface, together with a cluster–continuum model for affordable – yet accurate – solvation modeling, enabled the discovery of more stable geometries than those previously reported. Similar solvation energy curve shapes for lone vs. coordinated ions enabled rapid solvation convergence via the cancellation of errors stemming from finite cluster sizes. In conclusion, an R 2 of 0.850 vs. experimental aqueous binding energies was obtained, validating this scheme as the backbone of a high-throughput workflow for chelator design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

An Ensemble Approach to Computationally Efficient Radiological Anomaly Detection and Isotope Identification

Radiological source search is a challenging task involving detection and identification of weak sources in a constantly changing radiological background. As of now, many radiological source detection algorithms have been proposed; however, their computational complexity, and hence reliance on power intensive processing units inhibit low-power applications of radiological source search systems. In this work, we introduce the anomaly filter (AF) algorithm; a computationally light, yet effective time-series source detection algorithm based on exponential weighted moving average (EWMA) and Poisson deviance statistics. Then, we demonstrate that the proposed algorithm can be used in ensemble with other more computationally intensive source detection and identification algorithms to achieve both increased detection performance and reduced power consumption. The proposed AF algorithm and the ensemble algorithms were thoroughly benchmarked against several existing source detection and identification algorithms. The results show that the AF algorithm outperforms existing conventional source detection algorithms, and the ensemble approach improves the overall performance of existing source detection and isotope identification algorithms. Furthermore, the AF algorithm and the Non-negative Matrix Factorization approach based source identification (NMF-ID) algorithm were combined and implemented on a singleboard microcontroller and the power consumption was measured. This ensemble algorithm reduced the power consumption of the NMF-ID algorithm almost by a factor of 100, while improving the detection performance of the overall system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Multi-model Hydroclimate Projections for the Alabama-Coosa-Tallapoosa River Basin in the Southeastern United States

Abstract This study uses a high-resolution, process-based modeling framework to assess the impacts of changing climate on water resources for the Alabama-Coosa-Tallapoosa River Basin in the southeastern United States. A 33-member ensemble of hydrologic projections was generated using 3 distributed hydrologic models (Precipitation-Runoff Modeling System, Variable Infiltration Capacity, and Distributed Hydrology Soil Vegetation Model) of different complexity. These hydrologic models were driven by dynamically downscaled and bias-corrected future climate simulations from 11 Coupled Model Intercomparison Project Phase 5 global climate models under Representative Concentration Pathway 8.5 emission scenario, with 40 years each in baseline (1966–2005) and future (2011–2050) periods. The hydroclimate response, in general, projects an increase in mean seasonal precipitation, runoff, and streamflow. The high and low flows are projected to increase and decrease, respectively, in general, suggesting increased likelihood of extreme rainfall events and intensification of the hydrologic cycle. The uncertainty associated with the ensemble hydroclimate response, analyzed through an analysis of variance technique, suggests that the choice of climate model is more critical than the choice of hydrologic model for the studied region. This study provides in-depth insights of hydroclimate response and associated uncertainties to support informed decisions by water resource managers.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Capturing multireference excited states by constrained-density-functional theory

The computation of excited electronic states with commonly employed (approximate) methods is challenging, typically yielding states of lower quality than the corresponding ground state for a higher computational cost. In this work, we present a mean-field method that extends the previously proposed excited constrained-density-functional theory (XCDFT) from single Slater determinants to ensemble one-body reduced density matrices for computing low-lying excited states. The method still retains an associated computational complexity comparable to a semilocal density functional theory (DFT) calculation while at the same time it is capable of approaching states with multireference character. Further, we benchmark the quality of this method on well-established test sets, finding good descriptions of the electronic structure of multireference states and maintaining an overall accuracy for the predicted excitation energies comparable to semilocal time-dependent DFT.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

HIGH-FIDELITY SIMULATION OF SOOT FORMATION AND THERMAL RADIATION IN A LABORATORY-SCALE RICH-QUENCH-LEAN BURNER

High-fidelity simulations of a swirl-stabilized turbulent spray flame in a laboratory-scale aero-combustor have been performed to evaluate the predictability of state-of-the-art models in capturing soot formation. The simulations employ a complex chemical mechanism developed for Jet-A with PAH chemistry, coupled with the Hybrid Method of Moments (HMOM) soot model, and a Lagrangian dilute spray model for the fuel injection. Two simulations are performed to compare the results when thermal radiation is neglected or included in the solution with a mean spectral model. Modeling closures for the soot differential diffusion effects in mixture fraction space, as well as turbulence-radiation interaction are also evaluated using the data generated by the simulations. Given the degree of complexity of the simulation, the results showed good agreement with experimental measurements of the spatial distribution of the soot volume fraction ensemble average. A closer agreement with the experiment is observed when thermal radiation is included in the solution. Thermal radiation is observed to reduce the flame temperature and increase the flame intermittency, denoted by the increase in the temperature standard deviation in mixture fraction space. The reduction in temperature also leads to a reduction in PAH production and soot volume fraction. Turbulence is observed to have different effects on radiative emission depending on the mixture fraction. Turbulent scalar fluctuations significantly enhance radiative emission in fuel lean mixtures and can also play a role for fuel rich conditions. The statistical description of the turbulence-radiation interaction, previously proposed in the literature, was observed to correctly reproduce the high-fidelity results. Model coefficients were provided for swirl-stabilized flames. The soot differential diffusion model, previously proposed in the literature, based on the residual between the exact term and its model approximation, was also evaluated. The residual correction term further improved the agreement with exact differential diffusion term evaluated with the high-fidelity simulation data in mixture fraction space. The results suggest that the effective turbulent Lewis number can be equal to unity in simulations of turbulent non-premixed recirculating flames.

Soriano, Bruno [Sandia National Laboratories (SNL)↗
DOE OSTI2024

Ensemble Manufacturing Techniques for Steam Turbine Components Across Length Scales

Faster design to manufacturing requirements were sought for steam turbine components to meet the changing demands of today’s power grid of improved efficiency through operating temperature increases and enhanced operational flexibility from baseload to cyclic operations. Advances in multiple advanced manufacturing (AM) process enabled redesign of turbine components for extreme environments with the potential to reduce cost. AM is of particular interest to improve component functionality, higher temperature capability, and superior durability in large scale steam turbine applications. AM methods have an immense potential to open-up the design space by working directly with the 3D model to produce near-net shapes, enable fast design-manufacturing iterations, thereby significantly reducing product cost and lead-time up to 25 % from current baseline. However, these benefits cannot be fully realized due to the potential for unknown AM processing defects and their resultant effect upon component performance in service. Siemens is partnering with Oak Ridge National Laboratory (ORNL), Electric Power Research Institute (EPRI), and Connecticut Center for Advanced Technology (CCAT) to advance the knowledge of complex process-material interactions for desired microstructures and properties that are closely interlinked to component geometries across different length scales. The proposed program utilized an ensemble of multidisciplinary technologies to accelerate the development of materials, high-throughput experiments for their qualification, and design flexibility/topology optimization for repair/redesign of components to address critical failure mechanisms for improved performance and increased reliability of existing power plant components. The proposed activities, if successfully demonstrated for identified components, will enable paradigm shift in customized manufacturing and accelerated qualification/certification towards increased steam turbine component durability, increased turbine efficiency, and reduced CO 2 emissions in load-following environments compared to today’s technology. Technology maturation is built into the project as successful research will include customized process-component down-selection enabling AM methodologies to be incorporated directly into the existing supply chain. The specific activities of the proposed effort are: 1. Topology optimization of down-selected steam turbine parts that are amenable to additive and hybrid manufacturing for cost/performance improvement. 2. Process-structure-property relationships for five AM processes for steam turbine materials of interest to compare with conventional materials. 3. Perform part/assembly build process using advanced additive/hybrid machine tools followed by quality inspection of the built components for insight into qualification for production scale-up. Steam turbine rig testing of printed components under targeted, well monitored and characterized environmental conditions of for performance comparison of baseline and redesigned components.

36 MATERIALS SCIENCE↗
DOE OSTI2022

The effects of bias, drift, and trends in calculating anomalies for evaluating skill of seasonal-to-decadal initialized climate predictions

In initialized seasonal to decadal (S2D) predictions, model hindcasts rapidly drift away from the initial observed state and converge toward a preferred state characterized by systematic error, or bias. Bias and drift are among the greatest challenges facing initialized prediction today. Differences in trends between initial states and drifted states, combined with bias and drift, introduce complexities in calculating anomalies to assess skill of initialized predictions. We examine several methods of calculating anomalies using the Decadal Prediction Large Ensemble (DPLE) using the Community Earth System Model (CESM) initialized hindcasts and focus on Pacific and Atlantic SSTs to illustrate issues with anomaly calculations. Three methods of computing anomalies, one as differences from a long term model climatology, another as bias-adjusted differences from the previous 15 year average from observations, and a third as differences from the previous 15 year average from the model, are contrasted and each is shown to have limitations. For the first, trends in bias and drift introduce higher skill estimates earlier and later in the hindcast period due to the trends that contribute to skill. For the second, higher skill can be introduced in situations where low frequency variability in the observations is large compared to the hindcasts on timescales greater than 15 years, while lower skill can result if the predicted signal is small and the bias-correction itself produces a transition of SST anomalies to the opposite sign of those that are observed. The third method has somewhat lower skill compared to each of the others, but has less difficulties with not only the long term trends in the model climatology, but also with the unrealistic situational skill from using observations as a reference. However, the first 15 years of the hindcast period cannot be evaluated due to having to wait to accumulate the previous 15 year model climatology before the method can be applied. Here, the IPO transition in the 2014–2016 time frame from negative to positive (predicted by Meehl et al. in in Nat Commun, 10.1038/NCOMMS11718, 2016) did indeed verify using all three methods, though each provides somewhat different skill values as a result of the respective limitations. There is no clear best method, as all are roughly comparable, and each has its own set of limitations and caveats. However, all three methods show generally higher overall skill in the AMO region compared to the IPO region.

54 ENVIRONMENTAL SCIENCES↗