Search NASA⌕ Search

SEARCH · Search NASA

Results for “complex ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗
NASA NTRSDate not supplied

Multiclass Flight Anomaly Detection Using Sensor Fusion Based on Dempster-Shafer Theory

As aviation systems in commercial operations continue to grow in complexity, the anomalies exhibited by these systems become more elaborate and difficult to detect. To address the challenge of detecting these complex anomalies, deep learning models have been used extensively in aviation anomaly detection studies, at the expense of end-user interpretability. Aiming to maintain the same level of interpretability as traditional threshold-exceedance methods, we continue our development of prediction models using ordinal patterns and their distributions throughout the flight. Specifically, this study extends our work into multiclass anomaly detection using sensor fusion based on Dempster-Shafer theory (DST), a second-order probability theory used to combine information from different sources of evidence. Our approach uses DST to reduce the uncertainty in the class predictions of an ensemble of classifiers. These classifiers rely on the similarity between flight data and class templates to make a prediction of the state of the aircraft. Our approach aims to take advantage of simple models trained on interpretable features (ordinal patterns) to correctly predict an anomaly and identify the flight dynamics linked to the anomaly. Our results show an improvement when using DST-based sensor fusion over simple majority voting. Additionally, our results provide insight into aircraft states linked to rare high-risk anomalies.

Risk detection↗
DOE OSTI2023

Analysis of Narrow Bipolar Events Using Mode Decomposition Methods

Multi-resolution analysis methods can reveal the underlying physical dynamics of nonstationary signals, such as those from lightning. In this paper we demonstrate the application of two multi-resolution analysis methods: Ensemble Empirical Mode Decomposition (EEMD) and Variational Mode Decomposition (VMD) in a comparative way in the analysis of electric field change waveforms from lightning. EEMD and VMD decompose signals into a set of Intrinsic Mode Functions (IMFs). The IMFs can be combined using distance and divergence metrics to obtain noise reduction or to obtain new waveforms that isolate the physical processes of interest while removing irrelevant components of the original signal. We apply the EEMD and VMD methods to the observations of three close Narrow Bipolar Events (NBEs) that were reported by Rison et al. The ΔE observations reveal the occurrence of complex oscillatory processes after the main NBE sferic. We show that both EEMD and VMD are able to isolate the oscillations from the main NBE, with VMD being more effective of the two methods since it requires the least user supervision. The oscillations are found to begin at the end of the NBEs' downward fast positive breakdown and appear to be produced by a half-wavelength standing wave within a weakly-conducting resonant ionization cavity left behind in the wake of the streamer-based NBE event. In conclusion, additional analysis shows that one of the NBEs was likely initiated by an energetic cosmic ray shower, and also corrects a misinterpretation in the literature that fast breakdown is an artifact of NBE-like events in interferometer observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Coarse-grain cluster analysis of tensors with application to climate biome identification

A tensor provides a concise way to codify the interdependence of complex data. Treating a tensor as a d-way array, each entry records the interaction between the different indices. Clustering provides a way to parse the complexity of the data into more readily understandable information. Clustering methods are heavily dependent on the algorithm of choice, as well as the chosen hyperparameters of the algorithm. However, their sensitivity to data scales is largely unknown. In this work, we apply the discrete wavelet transform to analyze the effects of coarse-graining on clustering tensor data. We are particularly interested in understanding how scale affects clustering of the Earth's climate system. The discrete wavelet transform allows classification of the Earth's climate across a multitude of spatial-temporal scales. The discrete wavelet transform is used to produce an ensemble of classification estimates, as opposed to a single classification. Each element of the ensemble is a clustering at a different spatial-temporal scale. Information theoretic approaches are used to identify important scale lengths in clustering the L15 Climate Datset. We also discover a sub-collection of the ensemble that spans the majority of the variance observed, allowing for efficient consensus clustering techniques that can be used to identify climate biomes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2019

Solar Activity Modeling: From Subgranular Dynamical Scales to the Solar Cycles

Dynamical effects of solar magnetoconvection span a wide range spatial and temporal scales that extends from the interior to the corona and from fast turbulent motions to the global-Sun magnetic activity. To study the solar activity on short temporal scales (from minutes to hours), we use 3D radiative MHD simulations that allow us to investigate complex turbulent interactions that drive various phenomena, such as plasma eruptions, spontaneous formation of magnetic structures, funnel-like structures and magnetic loops in the corona, and others. In particular, we focus on multi-scale processes of energy exchange across the different layers, which contribute to the corona heating and eruptive dynamics, as well as interlinks between different layers of the solar interior and atmosphere. For modeling the global-scale activity we use the data assimilation approach that has demonstrated great potential for building reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to the Parker-Kleeorin-Ruzmakin dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of observational limitation on the prediction accuracy. We present the EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields, and discuss the uncertainties and potential of the data assimilation approach for modeling and forecasting the solar activity.

Kitiashvili, I. N.↗
DOE OSTI2020

LDRD Macromolcule Radiolysis Poster

Moving toward a circular carbon economy depends on enabling reuse of carbon-based macromolecules and increased recycling of waste products into higher value products. Macromolecules are challenging to valorize into products easily converted into liquid fuel or chemical feedstocks, due to their large and sometimes heterogeneous network of polymeric bonds. The novel aspect of this project is to show a proof of principle that radiolysis of macromolecules using “waste” radiation from energy production in the presence of radical capping donors presents an attractive opportunity to break down complex macromolecules into smaller molecules while controlling re-polymerization. This approach offers a new, cost-efficient way to utilize “waste” radiation and heat byproducts of nuclear energy production to convert a simple mixture of complex molecules into a complex mixture of small molecules, to be utilized as an energy source by the fuel industry, or to create value-added feedstocks for new polymers or commodity chemicals. Ionizing radiation can be harnessed to convert energy to molecules, adding value to low-value macromolecules as they are broken down into smaller, more easily separated feedstocks or fuels to be converted to a value-added product. This project will test 2 hypotheses. Hypothesis 1: Macromolecular materials that comprise biomass and coal or other macromolecules can be infused with radical capping donors (RCDs), and gamma irradiation of the resulting mixtures will produce ensembles of lower-molecular weight chemicals that can be more easily separated. If this expectation is realized, the conversion chemistry can be optimized by adjusting the feedstock composition, irradiation time, and choice of RCD.

02 - PETROLEUM↗
DOE OSTI2020

Steering Molecular Dynamics Simulations of Membrane-Associated Proteins with Neutron Reflection Results

Herein, we present a novel method to incorporate structural results from surface-sensitive scattering, such as X-ray or neutron reflectometry, into molecular dynamics simulations. While reflectometry techniques generally provide a means to determine the molecular-scale structures of organized interfacial films, they were recently shown to offer the capability to characterize the structures of protein-membrane complexes supported by a solid substrate. One-dimensional information inherent in the experimental results is used in the form of component volume occupancy (CVO) profiles, which describe the distribution of molecular components within an interfacial architecture, to construct real-space constraints in the form of a biasing potential for the simulation that vanishes when the simulated and experimental profiles agree. This approach improves the correspondence between simulation and experiment, as shown in the re-evaluation of an neutron-reflection-derived structure which was approximated by an independent molecular dynamics simulation in earlier work, and it also leads to faster equilibration of ensemble structures. We further show that time averaging the CVO profile that develops in the simulation while biasing with this approach permits fluctuations about the average that are necessary for conformational exploration of the system. This method is particularly valuable for studies of proteins at interfaces that contain disordered regions since the conformation of such regions is difficult to judge from the analysis of one-dimensional experimental profiles and may take prohibitively long to equilibrate in simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Tailoring Spin-Wave Channels in a Reconfigurable Artificial Spin Ice

Artificial spin ices are ensembles of geometrically arranged interacting nanomagnets that have shown promising potential for the realization of reconfigurable magnonic crystals. Such systems allow for the manipulation of spin waves on the nanoscale and their potential use as information carriers. However, there are presently two general obstacles to the realization of artificial spin-ice-based magnonic crystals: the magnetic state of artificial spin ices is difficult to reconfigure and the magnetostatic interactions between the nanoislands are often weak, preventing mode coupling. We demonstrate, using micromagnetic modeling, that coupling a reconfigurable artificial spin-ice geometry made of weakly interacting nanomagnets to a soft magnetic underlayer creates a complex system exhibiting dynamically coupled modes. These give rise to spin-wave channels in the underlayer at well-defined frequencies, based on the artificial spin-ice magnetic state, which can be reconfigured. Finally, these findings open the door to the realization of reconfigurable magnonic crystals with potential applications for data transport and processing in magnonic-based logic architectures.

25 ENERGY STORAGE↗
DOE OSTI2025

A structured framework for predicting sustainable aviation fuel properties using liquid-phase FTIR and machine learning

Sustainable aviation fuels have the potential to improve efficiency, reduce emissions, and enhance energy security. To help identify viable sustainable aviation fuels and accelerate research, machine learning models have been developed to predict relevant physicochemical properties. However, many models have limited applicability, leverage data from complex analytical techniques with confined spectral ranges, or use feature decomposition methods that offer limited interpretability. Using liquid-phase Fourier Transform Infrared (FTIR) spectra, this study presents a structured method for creating accurate and interpretable property prediction models for neat molecules, aviation fuels, and blends. Liquid FTIR spectra can be collected quickly and consistently, offering high reliability, sensitivity, and component specificity using less than 2 ml of sample. The method first decomposes FTIR spectra into fundamental building blocks using non-negative matrix factorization (NMF) to enable scientific analysis of FTIR spectra attributes and fuel properties. The NMF features are then used to create five ensemble models for predicting final boiling point, flash point, freezing point, density at 15°C, and kinematic viscosity at -20°C. All models were trained using experimental property data from neat molecules, aviation fuels, and blends. The models accurately predict key properties across a broad range of neat molecules and representative fuels and blends, while enabling interpretation of relationships between compositional elements, such as functional groups or chemical classes, and their resulting properties. This demonstrates strong potential to support sustainable aviation fuel research and development. The models and data are available on an interactive web tool.

Fourier transform infrared spectroscopy↗
DOE OSTI2026

Landau–Zener Transition Enhanced Quantum Sensing in Spin Defects of Hexagonal Boron Nitride

Negatively charged boron vacancies (V $^{–}_{B}$ ) in hexagonal boron nitride (hBN) comprise a promising quantum sensing platform, optically addressable at room temperature and transferable onto samples. However, broad hyperfine-split spin transitions of the ensemble pose challenges for quantum sensing with conventional resonant excitation due to limited spectral coverage. While V $^{–}_{B}$ in isotopically enriched hBN using 10 B and 15 N isotopes (h 10 B 15 N) exhibits sharper spectral features, significant inhomogeneous broadening persists. We show that, implemented via frequency modulation on an FPGA, a frequency-ramped microwave pulse achieves around 4-fold greater |0⟩→|−1⟩ spin-state population transfer and thus contrast than resonant microwave excitation and thus 16-fold shorter measurement time for spin relaxation-based quantum sensing. Quantum dynamics simulations reveal that an effective two-state Landau–Zener model captures the complex relationship between population inversion and pulse length with relaxations incorporated. Our approach is robust and valuable for quantum relaxometry with spin defects in hBN, especially in noisy environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Climatological sensitivities of shallow-cumulus bulk entrainment in continental and oceanic locations

Cumulus entrainment is a complex process that has long challenged conceptual understanding and atmospheric prediction. To investigate this process observationally, two retrievals are used to generate multi-year climatologies of shallow-cumulus bulk entrainment ( ϵ ) at two Atmospheric Radiation Measurement cloud observatories, one in the US southern Great Plains (SGP) and the other in the Azores archipelago in the eastern North Atlantic (ENA). The statistical distributions of ϵ thus obtained, as well as certain environmental and cloud-related sensitivities of ϵ , are consistent with previous findings from large-eddy simulations. The retrieved ϵ robustly increases with cloudlayer relative humidity and decreases in wider clouds and cloud ensembles with larger cloud-base mass fluxes. While ϵ also correlates negatively with measures of cloud-layer vigor (e.g., maximum in-cloud vertical velocity and cloud depth), the extent to which these metrics actually regulate ϵ (or vice-versa) is unclear. Novel sensitivities of ϵ include a robust decrease of ϵ with increasing subcloud wind speed in oceanic flows, as well as a decrease of ϵ with increasing cloud-base mass flux in individual cumuli. A strong land–ocean contrast in ϵ is also found, with median values of 0.5-0.6 km -1 at the continental SGP site and and 1.0-1.1 km -1 at the oceanic ENA site. This trend is associated with drier and deeper cloud layers, along with larger cloud-base mass fluxes, at SGP, all of which favor reduced ϵ . The flow-dependence of retrieved ϵ implies that its various sensitivities should be accounted for in cumulus parameterization schemes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Sentinel

Network intrusion detection systems (NIDS) are commonplace in network security but they frequently employ algorithms that are computational demanding requiring hardware and software with significant power requirements. Two examples of such resource-intensive algorithms used for network security are regular expression matching and broader signature pattern matching which are commonly used in deep packet inspection (DPI). Network security algorithms that have large power requirements may be a challenge for low-power internet-of-things (IoT) environments, which generally lack the power resources to implement complex security measures like computationally expensive DPI at the edge. Furthermore, IoT environments incorporating 5G standalone networks have network latency constraints beyond just power that make DPI at the edge even more difficult. Programmable logic is ideally suited for machine learning inference for DPI because of its deep instruction level parallelism and single-cycle memory access. Machine learning approaches for DPI have been explored before using the programmable logic of field programmable gate arrays (FPGA) as a potential solution for NIDS approaches that would be power-suitable for IoT. However, those previous programmable logic NIDS approaches utilize either a supervised or unsupervised learning model. Sentinel utilizes the ensemble of these two machine learning approaches known as a semi-supervised approach which has shown promise in NIDS implementations. Sentinel provides a programmable logic implementation of a semi-supervised approach for DPI which operates at much lower power and latency than a GPU implementation with negligible loss of accuracy due to quantization through a logistic regressor.

Anderson, MatthewW [Idaho National Laboratory (INL↗
NASA NTRSDate not supplied

Rational Design of Nanoplasmonic Array Geometries for Biosensing

Background: Molecular diagnostics provide early and accurate diagnosis, which is essential for the prevention and treatment of infectious as well as chronic diseases. These tests are designed to detect disease-specific bioanalytes such as nucleic acid (DNA or RNA) or protein (antigens, antibodies) biomarkers. In the context of infectious disease diagnosis, nucleic acid-based detection methods are known to provide more specific and sensitive results. Here, the presence of a unique sequence belonging to the pathogenic genomic material is targeted to identify species, organism, genera and/or antimicrobial resistant gene markers. The majority of the common nucleic acid based diagnostic techniques require amplification (polymerase chain reaction, isothermal amplification etc.) of the pathogenic genetic material prior to detection impacting diagnostic speed, complexity, and cost thereby limiting ease of use. Thus, the development of simplified nucleic acid-based diagnostics that can be even used in resource-poor settings may hugely benefit patients across the globe. Nanopath is a molecular diagnostics company utilizing a solid-state nanosensor to enable sequence-specific detection of target nucleic acids without the need of amplification. These nanostructures enable ultra-sensitive biomarker detection using geometric, feature-dependent properties highly dependent on the local dielectric environment, allowing them to be sensitive to low concentration binding events. This paper describes an application of this approach to provide highly relevant clinical information within a single doctor’s office visit. Intro: The Nanopath team is in collaboration with NASA (National Aeronautics and Space Administration) and NIST (National Institute of Standards and Technology) to push the bounds of the fundamental physics associated with their biosensing platform. The ability of metals to support electromagnetic surface waves gives rise to surface plasmons when optically illuminated. This property, and its strong sensitivity to changes in the local refractive index, allows for the use of metal nanoparticles as ultra-sensitive transducers. In prior work by members of this team, ensembles of randomly oriented nanoparticles (i.e., colloidal nanorods dispersed on chip) were employed for sequence-specific nucleic acid sensing (1-3). While these particle sensors have the advantage of rapid fabrication, they suffer from low sensitivity and quality factor due to the random particle dispersity. In contrast, in this study we employ ordered array nanoparticle ensembles which can be used to improve sensor sensitivity and figure-of-merit. Study Methods Overview: In this talk, we detail the results of sensing experiments and computational simulations to outline a rational design of the structure of these plasmonic nanoparticle arrays for biomolecular sensing. Through simulation and experiment, we iteratively tailor nanostructure dimension to provide high quality signal and large resonance shifts upon modeled nucleic acid binding. In particular, full-wave electromagnetic simulations were conducted using Lumerical photonic simulation software in which periodic boundary conditions were applied in the x- and y- dimensions for each of the nanoplasmonic sensor geometries. To simulate the resonance response to changes in the bulk solution in contact with the sensor surface, the refractive index of the surrounding media was changed appropriately. Nucleic acid hybridization events were modeled using either using spherical structures approximating the relevant radius of genomic material as estimated by polymer models, or as conformal layers with the known refractive indices for nucleic acids. On the basis of initial simulations, nanosensors were fabricated using traditional electron-beam lithography protocols at NIST. To evaluate consensus between simulations and experiments, bulk sensing experiments were carried out in which the resonance peaks were obtained by submerging the sensors in refractive index standards. Key nanosensor characteristics including resonance peak locations, resonance peak shifts as a function of refractive index, and figure of merit (FOM) of extinction curves were examined between the experimental and simulation results prior to proceeding with simulations on additional geometries and more complex solution conditions, and further device fabrication. This iterative process is repeated toward a rational design of nanoplasmonic array geometries for biosensing optimizing response for targeted disease detection. In summary, this study puts forth a methodology for rational design and characterization of regularly spaced nanoparticle arrays for optics-based biosensing. The results of this study will allow for more informed design of nanostructure geometries towards sequence-specific nucleic acid detection. These improved designs have the potential to improve clinical sensitivity and limit-of-detection across disease indication.

sensor↗
DOE OSTI2020

Sequential ensemble transform for Bayesian inverse problems

In this work, we present the Sequential Ensemble Transform (SET) method, an approach for generating approximate samples from a Bayesian posterior distribution. The method explores the posterior distribution by solving a sequence of discrete optimal transport problems to produce a series of transport plans which map prior samples to posterior samples. We prove that the sequence of Dirac mixture distributions produced by the SET method converges weakly to the true posterior as the sample size approaches infinity. Furthermore, our numerical results indicate that, when compared to standard Sequential Monte Carlo (SMC) methods, the SET approach is more robust to the choice of Markov mutation kernels and requires less computational efforts to reach a similar accuracy when used to explore complex posterior distributions. Finally, we describe adaptive schemes that allow to completely automate the use of the SET method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Derivation of A Representative Elementary Volume (REV) for Upscaled Two-Phase Flow in Porous Media

Relative permeability plays an important role in the upscaling of multiphase flow in porous media from the pore scale to the Darcy scale. The entire concept of relative permeability is contingent on the existence of a representative elementary volume (REV). As we move to smaller samples to measure relative permeability, such as with digital core analysis, the concept of a classical REV has become increasingly unlikely when using the conventional approach to defining a representative volume. The “‘conventional”’ understanding of an REV is that a large enough volume must be considered such that spatial variability averages out. In digital rock methods, such as pore-scale simulations based on micro-computed tomography (CT) images, the domain size is typically 2 to 4 mm. This is approximately the length scale of a single-phase flow REV using the classic REV approach. However, the single-phase perspective does not consider the complex dynamics and fluctuations often observed in multiphase flow systems, even at centimeter-scale experiments and/or simulations. A fundamental question is, therefore, whether the domain size commonly used in digital rock simulations can provide a consistent energy budget such that the concept of relative permeability exists. Based on first principles, relative permeability accounts for the rate of energy dissipated in a stationary process. If the dynamics are fluctuating, the energy dissipated can vary but will average out over a long enough timescale. The key to determining the validity of the relative permeability is the timescale of the measurement, not the spatial scale. The conventional REV theory assumes that spatial, temporal, and ensemble averages are equivalent in an ergodic system, but it does not provide a way to test this assumption. We provide a formal way to identify the timescale where the relative permeability accurately captures energy dissipation as a way to validate relative permeability measurements and quantitatively assess their accuracy. This result will be tested for a practical SCAL test, determining how long a flow experiment needs to be run to accurately characterize the rate of energy dissipation by the flow. The outcome will be a best practice guide for the determination of relative permeability from core-scale experiments and/or digital core simulations that ensure the energy budget is fully accounted for in the relative permeability coefficient.

Mcclure, James [Virginia Tech, Blacksburg]↗
DOE OSTI2025

A Parametric, Data-Driven, Non-Intrusive Reduced-Order Model Framework for Crystal Plasticity Simulations of Voids

The influence of the internal structure at micrometer length scales on the deformation of polycrystalline materials can be effectively captured using crystal plasticity finite element methods (CPFEM). However, the complexity and nonlinearity of the deformation equations CPFEM solves demand significant computational power and resources to achieve accurate predictions, limiting its broader application. To address this challenge, we have identified a reduced-order representation of the complex data in order to establish a computationally efficient reduced-order models (ROM) and drastically reduce the computational expense of CPFEM. Specifically, in this work, we developed a parametric, data-driven, and non-intrusive ROM framework for CPFEM using proper orthogonal decomposition (POD) and sparse variational Gaussian process (SVGP) regression for single-crystal microstructures under tensile loading conditions. The developed protocol enables one to compress field into a latent/low-dimensional space described by principal component analysis (PCA) via the singular value decomposition (SVD) algorithm. As a result, the high-dimensional data are reduced to a significantly smaller amount of dimensions with POD bases and POD coefficients. Furthermore, we deployed an ensemble of SVGPs—extended from the classical Gaussian process (GP) regression for scalability and handling big data—in a massively parallel manner to train and predict latent POD coefficients using known POD bases from a set of previously obtained simulations results. Lastly, using the predicted POD coefficients, we reconstructed the full-field results and showed reasonable agreement compared with the true values obtained from running CPFEM. The developed framework is validated with a set of CPFEM simulations of a single embedded void in single-crystal aluminum alloy. While the framework is broadly applicable, this work specifically focuses on single-crystal microstructures, a single load case (e.g., tensile), and a specific void geometry (spherical).

Anisotropy↗
DOE OSTI2023

Comparing emulation methods for a high‐resolution storm surge model

Abstract Realistic simulations of complex systems are fundamental for climate and environmental studies. Large computer systems are often not sufficient to run sophisticated computational models for large numbers of different input settings. Statistical surrogate models, or emulators, are key tools enabling fast exploration of the simulator input space. Gaussian processes have become standard for computer simulator emulation. However, they require careful implementation to scale appropriately, motivating alternative methods more recently introduced. We present a comparison study of surrogates of the Sea, Lake, and Overland Surges from Hurricanes (SLOSH) simulator—the simulator of choice for government agencies—using four emulation approaches: BASS; BART; SEPIA; and RobustGaSP. SEPIA and RobustGaSP use Gaussian processes, BASS implements adaptive splines, and BART is based on ensembles of regression trees. We describe the four models and compare them in terms of computation time and predictive metrics. These surrogates use proven and distinct methodologies, are available through accessible software, and quantify prediction uncertainty. Our data cover millions of response values. We find that SEPIA and RobustGaSP provide exceptional predictive power, but cannot scale to emulate experiments as large as the one considered in this paper as effectively as BASS and BART.

Hutchings, Grant↗