Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble computing.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Project Title: Adaptive Vertical Grid Enhancement for E3SM (Final Technical Report)

During the first phase of the project (2018/05-2021/05), we proved the hypothesis that, without tuning, high vertical resolution improves the representation of unresolved, parameterized low altitude clouds such as stratocumulus clouds in global climate models. We evaluated the effectiveness of the newly developed computational framework, Framework for Improvement by Vertical Enhancement (FIVE) by implementing it into E3SM. FIVE aims to improve representation of the target cloud, low level cloud for this project, with use of a locally high vertical resolution for computation of selected processes. FIVE was assessed via direct comparison among E3SM, E3SM-FIVE, and satellite data as well as a newly developed ensemble artificial neural network methodology. We demonstrated that E3SM-FIVE remarkably improves marine stratocumulus representation. To advance the FIVE methodology, we took a first step toward the adaptive vertical grid in the FIVE method by modifying the E3SM single column model. For future application of FIVE to the global storm resolving model with a few km horizontal grid resolution, we developed the vertical-meridional two-dimensional (2D) Hadley circulation model, which allows one to run simulations with much higher vertical resolution and significantly longer duration than current three-dimensional global storm resolving model. During the second phase of the project (2021/05-2023/11; period for this technical report), we sought a way to appropriately transform FIVE to a regionalized version of FIVE, which allows one to select locations with/without FIVE. In parallel, we demonstrated that E3SM-FIVE with a 25-km mesh significantly reduced the bias associated with coastal stratocumulus. Furthermore, we showed that the same improvement was able to be obtained with the use of both the Regional Refined Model (RRM) targeted to one of the stratocumulus regions with 25-km resolution and FIVE. We explored a new implementation strategy of FIVE with our 2D Hadley circulation model. In parallel we applied the 2D Hadley circulation model to study the double intertropical convergence zone bias with storm resolving model resolution and aerosol-cloud interactions within the Hadley circulation with near large eddy simulation resolution. Last, we have been investigating Arctic mixed-phase stratocumulus clouds with large eddy simulations in order to improve their representation in global models. During the course of the entire project, 6 journal articles were published, and 3 manuscripts are currently in preparation. We gave a total of 30 presentations at various domestic and international conferences. In addition we gave 6 seminar talks at universities and a national laboratory. E3SM- FIVE is available as a branch of E3SM.

54 ENVIRONMENTAL SCIENCES↗

Ensemble Learning Based Convex Approximation of Three-Phase Power Flow

Though the convex optimization has been widely used in power systems, it still cannot guarantee to yield a tight (accurate) solution to some problems. To mitigate this issue, this paper proposes an ensemble learning based convex approximation for alternating current (AC) power flow equations that differs from the existing convex relaxations. The proposed approach is based on three-phase quadratic power flow equations in rectangular coordinates. To develop this data-driven convex approximation of power flows, the polynomial regression (PR) is first deployed as a basic learner to fit convex relationships between the independent and dependent variables. Then, ensemble learning algorithms such as gradient boosting (GB) and bagging are introduced to combine learners to boost model performance. Based on the learned convex approximation of power flow, optimal power flow (OPF) is formulated as a convex quadratic programming problem. The simulation results on IEEE standard cases of both balanced and unbalanced systems show that, in the context of solving OPF, the proposed data-driven convex approximation outperforms the conventional semi-definite programming (SDP) relaxation in both accuracy and computational efficiency, especially in the cases that the conventional SDP relaxation fails

Convex approximation↗

Applicability of aquifer impact models to support decisions at CO 2 sequestration sites

The National Risk Assessment Partnership has developed a suite of tools to assess and manage risk at CO 2 sequestration sites. This capability includes polynomial or look-up table based reduced-order models (ROMs) that predict the impact of CO 2 and brine leaks on overlying aquifers. The development of these computationally-efficient models and the underlying reactive transport simulations they emulate has been documented elsewhere (Carroll et al., 2014a; Carroll et al., 2014b; Dai et al., 2014 ; Keating et al., 2016). Here in this paper, we seek to demonstrate applicability of ROM-based analysis by considering what types of decisions and aquifer types would benefit from the ROM analysis. We present four hypothetical examples where applying ROMs, in ensemble mode, could support decisions during a geologic CO 2 sequestration project. These decisions pertain to site selection, site characterization, monitoring network evaluation, and health impacts. In all cases, we consider potential brine/CO 2 leak rates at the base of the aquifer to be uncertain. We show that derived probabilities provide information relevant to the decision at hand. Although the ROMs were developed using site-specific data from two aquifers (High Plains and Edwards), the models accept aquifer characteristics as variable inputs and so they may have more broad applicability. We conclude that pH and TDS predictions are the most transferable to other aquifers based on the analysis of the nine water quality metrics (pH, TDS, 4 trace metals, 3 organic compounds). Guidelines are presented for determining the aquifer types for which the ROMs should be applicable.

54 ENVIRONMENTAL SCIENCES↗

Distilling Knowledge from Ensembles of Cluster-Constrained-Attention Multiple-Instance Learners for Whole Slide Image Classification

The peculiar nature of whole slide imaging (WSI), digitizing conventional glass slides to obtain multiple high resolution images which capture microscopic details of a patient’s histopathological features, has garnered increased interest from the computer vision research community over the last two decades. Given the unique computational space and time complexity inherent to gigapixel-size whole slide image data, researchers have proposed novel machine learning algorithms to aid in the performance of diagnostic tasks in clinical pathology. One effective algorithm represents a Whole slide image as a bag of smaller image patches, which can be represented as low-dimension image patch embeddings. Weakly supervised deep-learning methods, such as cluster-constrained-attention multiple instance learning (CLAM), have shown promising results when combined with image patch embeddings. While traditional ensemble classifiers yield improved task performance, such methods come with a steep cost in model complexity. Through knowledge distillation, it is possible to retain some performance improvements from an ensemble, while minimizing costs to model complexity. In this work, we implement a weakly supervised ensemble using clustering-constrained-attention multiple-instance learners (CLAM), which uses attention and instance-level clustering to identify task salient regions and feature extraction in whole slides. By applying logit-based and attention-based knowledge distillation, we show it is possible to retain some performance improvements resulting from the ensemble at zero cost to model complexity.

Alamudun, Folami↗

Single-site Lennard-Jones models via polynomial chaos surrogates of Monte Carlo molecular simulation

In this work, two Polynomial Chaos (PC) surrogates were generated to reproduce Monte Carlo (MC) molecular simulation results of the canonical (single-phase) and the NVT-Gibbs (two-phase) ensembles for a system of normalized structureless Lennard-Jones (LJ) particles. The main advantage of such surrogates, once generated, is the capability of accurately computing the needed thermodynamic quantities in a few seconds, thus efficiently replacing the computationally expensive MC molecular simulations. Benefiting from the tremendous computational time reduction, the PC surrogates were used to conduct large-scale optimization in order to propose single-site LJ models for several simple molecules. Experimental data, a set of supercritical isotherms, and part of the two-phase envelope, of several pure components were used for tuning the LJ parameters (ε, σ). Based on the conducted optimization, excellent fit was obtained for different noble gases (Ar, Kr, and Xe) and other small molecules (CH{sub 4}, N{sub 2}, and CO). On the other hand, due to the simplicity of the LJ model used, dramatic deviations between simulation and experimental data were observed, especially in the two-phase region, for more complex molecules such as CO{sub 2} and C{sub 2} H{sub 6}.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Form factors for Lambda_b to Lambda transitions from lattice QCD

The rare baryonic decays Lb !Lm+m? and Lb !Lg can complement rare B meson decays in constraining models of new physics. In this work, we calculate the relevant Lb ! L transition form factors at leading order in heavy-quark effective theory using lattice QCD. Our analysis is based on RBC/UKQCD gauge field ensembles with 2+1 flavors of domain-wall fermions, and with lattice spacings of a?0:11 fm and a?0:08 fm. We compute appropriate ratios of three-point and two-point correlation functions for a wide range of source-sink separations, and extrapolate to infinite separation in order to eliminate excited-state contamination. We then extrapolate the form factors to the continuum limit and to the physical values of the light-quark masses.

Meinel, Stefan↗

Toward a resolution of the NN controversy

Lattice QCD calculations of two-nucleon interactions have been underway for about a decade, but still haven't reached the pion mass regime necessary for matching onto effective field theories and extrapolating to the physical point. Furthermore, results from different methods, including the use of the Lüscher formalism with different types of operators, as well as the HALQCD potential method, do not agree even qualitatively at very heavy pion mass. We investigate the role that different operators employed in the literature may play on the extraction of spectra for use within the Lüscher method. We first explore expectations from Effective Field Theory solved within a finite volume, for which the exact spectrum may be computed given different physical scenarios. We then present preliminary lattice QCD results for two-nucleon spectra calculated using different operators on a common lattice ensemble.

Nicholson, A↗

Combining Three-Dimensional Modeling with Artificial Intelligence to Increase Specificity and Precision in Peptide–MHC Binding Predictions

The reliable prediction of the affinity of candidate peptides for the MHC is important for predicting their potential antigenicity and thus influences medical applications, such as decisions on their inclusion in T cell–based vaccines. In this study, we present a rapid, predictive computational approach that combines a popular, sequence-based artificial neural network method, NetMHCpan 4.0, with three-dimensional structural modeling. We find that the ensembles of bound peptide conformations generated by the programs MODELLER and Rosetta FlexPepDock are less variable in geometry for strong binders than for low-affinity peptides. In tests on 1271 peptide sequences for which the experimental dissociation constants of binding to the well-characterized murine MHC allele H-2D b are known, by applying thresholds for geometric fluctuations the structure-based approach in a standalone manner drastically improves the statistical specificity, reducing the number of false positives. Furthermore, filtering candidates generated with NetMHCpan 4.0 with the structure-based predictor led to an increase in the positive predictive value (PPV) of the peptides correctly predicted to bind very strongly (i.e., Kd < 100 nM) from 40 to 52% (p = 0.027). The combined method also significantly improved the PPV when tested on five human alleles, including some with limited data for training. Overall, an average increase of 10% in the PPV was found over the standalone sequence-based method. The combined method should be useful in the rapid design of effective T cell–based vaccines.

60 APPLIED LIFE SCIENCES↗

EnZymClass: Substrate specificity prediction tool of plant acyl-ACP thioesterases based on ensemble learning

Characterizing the functional properties of plant acyl-ACP thioesterases (TEs), a key enzyme class used in the production of renewable oleochemicals in microbial hosts, experimentally, can be an expensive and time consuming process since it requires manual screening of thousands of candidates in a database. Using amino acid sequence to computationally predict an enzyme’s function might accelerate this process; however obtaining the necessary amount of information on previously characterized enzymes and their respective sequences required by standard Machine Learning (ML) based approaches to accurately infer sequence-function relationships can be prohibitive, especially with a low-throughput testing cycle. Experimental noise, unbalanced dataset where high sequence similarity does not always imply identical functional properties will further prevent robust prediction performance. Herein we present a ML method, Ensemble method for enZyme Classification (EnZymClass), that is specifically designed to address these issues. We used EnZymClass to classify TEs into short, long and mixed free fatty acid substrate specificity categories. While general guidelines for inferring substrate specificity have been proposed before, prediction of chain-length preference from primary sequence has remained elusive for plant acyl-ACP TEs. By applying EnZymClass to a subset of TEs in the ThYme database, we identified two medium chain TEs, ClFatB3 and CwFatB2, with previously uncharacterized activity in E. coli fatty acid production hosts.

59 BASIC BIOLOGICAL SCIENCES↗

Ensemble-type numerical uncertainty information from single model integrations

We suggest an algorithm that quantifies the discretization error of time-dependent physical quantities of interest (goals) for numerical models of geophysical fluid dynamics. The goal discretization error is estimated using a sum of weighted local discretization errors. The key feature of our algorithm is that these local discretization errors are interpreted as realizations of a random process. The random process is determined by the model and the flow state. From a class of local error random processes we select a suitable specific random process by integrating the model over a short time interval at different resolutions. The weights of the influences of the local discretization errors on the goal are modeled as goal sensitivities, which are calculated via automatic differentiation. The integration of the weighted realizations of local error random processes yields a posterior ensemble of goal approximations from a single run of the numerical model. From the posterior ensemble we derive the uncertainty information of the goal discretization error. This algorithm bypasses the requirement of detailed knowledge about the models discretization to generate numerical error estimates. The algorithm is evaluated for the spherical shallow-water equations. For two standard test cases we successfully estimate the error of regional potential energy, track its evolution, and compare it to standard ensemble techniques. The posterior ensemble shares linear-error-growth properties with ensembles of multiple model integrations when comparably perturbed. The posterior ensemble numerical error estimates are of comparable size as those of a stochastic physics ensemble.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Coarse-grained molecular simulations of allosteric cooperativity

Interactions between a protein and a ligand are often accompanied by a redistribution of the population of thermally accessible conformations. This dynamic response of the protein’s functional energy landscape enables a protein to modulate binding affinities and control binding sensitivity to ligand concentration. In this paper, we investigate the structural origins of binding affinity and allosteric cooperativity of binding two Ca{sup 2+} ions to each domain of Calmodulin (CaM) through simulations of a simple coarse-grained model. In this model, the protein’s conformational transitions between open and closed conformational ensembles are simulated explicitly and ligand binding and unbinding are treated implicitly within the grand canonical ensemble. Ligand binding is cooperative because the binding sites are coupled through a shift in the dominant conformational ensemble upon binding. The classic Monod-Wyman-Changeux model of allostery with appropriate binding free energies to the open and closed ensembles accurately describes the simulated binding thermodynamics. The simulations predict that the two domains of CaM have distinct binding affinity and cooperativity. In particular, the C-terminal domain binds Ca{sup 2+} with higher affinity and greater cooperativity than the N-terminal domain. From a structural point of view, the affinity of an individual binding loop depends sensitively on the loop’s structural compatibility with the ligand in the bound ensemble, as well as the conformational flexibility of the binding site in the unbound ensemble.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multinomial diffusion equation

We describe a new, microscopic model for diffusion that captures diffusion induced uctuations at scales where the concept of concentration gives way to discrete par- ticles. We show that in the limit as the number of particles N ! 1, our model is equivalent to the classical stochastic diffusion equation (SDE). We test our new model and the SDE against Langevin dynamics in numerical simulations, and show that our model successfully reproduces the correct ensemble statistics, while the classical model fails.

Environmental Molecular Sciences Laboratory↗

SU-E-T-56: A Novel Approach to Computing Expected Value and Variance of Point Dose From Non-Gated Radiotherapy Delivery

Purpose: Randomness in patient internal organ motion phase at the beginning of non-gated radiotherapy delivery may introduce uncertainty to dose received by the patient. Concerns of this dose deviation from the planned one has motivated many researchers to study this phenomenon although unified theoretical framework for computing it is still missing. This study was conducted to develop such framework for analyzing the effect. Methods: Two reasonable assumptions were made: a) patient internal organ motion is stationary and periodic; b) no special arrangement is made to start a non -gated radiotherapy delivery at any specific phase of patient internal organ motion. A statistical ensemble was formed consisting of patient’s non-gated radiotherapy deliveries at all equally possible initial organ motion phases. To characterize the patient received dose, statistical ensemble average method is employed to derive formulae for two variables: expected value and variance of dose received by a patient internal point from a non-gated radiotherapy delivery. Fourier Series was utilized to facilitate our analysis. Results: According to our formulae, the two variables can be computed from non-gated radiotherapy generated dose rate time sequences at the point’s corresponding locations on fixed phase 3D CT images sampled evenly in time over one patient internal organ motion period. The expected value of point dose is simply the average of the doses to the point’s corresponding locations on the fixed phase CT images. The variance can be determined by time integration in terms of Fourier Series coefficients of the dose rate time sequences on the same fixed phase 3D CT images. Conclusion: Given a non-gated radiotherapy delivery plan and patient’s 4D CT study, our novel approach can predict the expected value and variance of patient radiation dose. We expect it to play a significant role in determining both quality and robustness of patient non-gated radiotherapy plan.

60 APPLIED LIFE SCIENCES↗

Investigation of boundary-layer wind predictions during nocturnal low-level jet events using the Weather Research and Forecasting model

Simulations of two periods featuring three consecutive low level jet (LLJ) events in the US Upper Great Plains during the autumn of 2011 were conducted to explore the impacts of various setup configurations and physical process models on simulated flow parameters within the lowest 200 m above the surface, using the Weather Research and Forecasting (WRF) model. Sensitivities of simulated flow parameters to the horizontal and vertical grid spacing, planetary boundary layer (PBL) and land surface model (LSM) physics options, were assessed. Data from a Light Detection and Ranging (lidar) system, deployed to the Weather Forecast Improvement Project (WFIP; Finley et al. 2013) were used to evaluate the accuracy of simulated wind speed and direction at 80 m above the surface, as well as their vertical distributions between 120 and 40 m, covering the typical span of contemporary tall wind turbines. All of the simulations qualitatively captured the overall diurnal cycle of wind speed and stratification, producing LLJs during each overnight period, however large discrepancies occurred at certain times for each simulation in relation to the observations. 54-member ensembles encompassing changes of the above discussed configuration parameters displayed a wide range of simulated vertical distributions of wind speed and direction, and potential temperature, reflecting highly variable representations of stratification during the weakly stable overnight conditions. Root mean square error (RMSE) statistics show that different ensemble members performed better and worse in various simulated parameters at different times, with no clearly superior configuration . Simulations using a PBL parameterization designed specifically for the stable conditions investigated herein provided superior overall simulations of wind speed at 80 m, demonstrating the efficacy of targeting improvements of physical process models in areas of known deficiencies. However, the considerable magnitudes of the RMSE values of even the best performing simulations indicate ample opportunities for further improvements.

Mirocha, Jeff D.↗

An evaluation of the consistency of extremes in gridded precipitation data sets

Noting a strong imperative to understand precipitation extremes, and that considerable uncertainty affects observational data sets, this paper compares the representation of extremes in a number of widely used daily gridded products, derived from rain gauge data, satellite retrieval and reanalysis for the conterminous United States. Analysis is based upon the concept of “tail dependence” arising in multivariate extreme value theory, and we infer the level of temporal dependence in the joint tail of the precipitation probability distribution for pairwise comparisons of products. In this way, we consider the range of products more like an ensemble and examine the relationships between members, and do not attempt to define, or compare products to, some ground truth. Linear correlation between products is also computed. Considerable discrepancy between groups of products, both annually and seasonally, is linked to source data and complex terrain. In particular, products based on rain gauge data showed remarkable similarity, but differed considerably, showing almost total loss of extremal dependence during DJF in mountainous regions, when compared with satellite products. Additionally, simulated re-forecasts revealed reasonable temporal agreement with large scale generated extremes. The diversity and extent of discrepancies identified across all products raises important questions about their use, and we urge caution, particularly for products derived from satellite data.

54 ENVIRONMENTAL SCIENCES↗

Protocol for applying a network-enabled gene discovery pipeline to non-model plant species

Identifying upstream regulators of key genes is essential for understanding gene regulatory mechanisms and translating these insights into functional targets. Here, we present a protocol for applying the network-enabled gene discovery pipeline (NEEDLE) to non-model plant species. We describe steps for environment setup, data preparation, computational analysis, expected outputs, and parameter considerations. NEEDLE integrates RNA sequencing (RNA-seq) processing, weighted gene co-expression analysis (WGCNA), Gene Network Inference with Ensemble of trees (GENIE3), and promoter conservation analysis to prioritize candidate transcriptional regulators.

Plant Sciences↗