Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Prediction of the development of islet autoantibodies through integration of environmental, genetic, and metabolic markers

The Environmental Determinants of the Diabetes in the Young (TEDDY) study has prospectively followed, from birth, children at increased genetic risk of type 1 diabetes. We evaluated the potential of machine learning to identify new biomarkers that predict imminent (within 6 months) development of persistent islet autoantibodies to insulin, GAD or IA-2 in TEDDY participants through integration of time-invariant risk factors with time-varying metabolomics. The predictive modeling was initiated with over 220 potential biomarkers; through ensemble-based feature evaluation, the optimal model included 42 biomarkers, returning a cross-validated receiver operating characteristic area under the curve of 0.74. The model identified a principal set of 20 time-invariant markers, including 16 single nucleotide polymorphisms and two HLA-DR genotypes, gestational age, and exposure to a prebiotic formula. Integration of the metabolome identified 22 high-priority metabolites and lipids, including adipic acid and ceramide d42:0, that predicted development of islet autoantibodies, dependent upon the time horizon. The majority (86%) of metabolites that predicted development of islet autoantibodies belonged to 3 pathways: lipid oxidation, phospholipase A2 signaling, and pentose phosphate pathway. TEDDY data suggest that these metabolic processes may play a role in triggering islet autoimmunity.

59 BASIC BIOLOGICAL SCIENCES↗

Bioactive scaffolds with enhanced supramolecular motion promote recovery from spinal cord injury

The signaling of cells by scaffolds of synthetic molecules that mimic proteins is known to be effective in the regeneration of tissues. Here, we describe peptide amphiphile supramolecular polymers containing two distinct signals and test them in a mouse model of severe spinal cord injury. One signal activates the transmembrane receptor β1-integrin and a second one activates the basic fibroblast growth factor 2 receptor. By mutating the peptide sequence of the amphiphilic monomers in nonbioactive domains, we intensified the motions of molecules within scaffold fibrils. This resulted in notable differences in vascular growth, axonal regeneration, myelination, survival of motor neurons, reduced gliosis, and functional recovery. Here, we hypothesize that the signaling of cells by ensembles of molecules could be optimized by tuning their internal motions.

36 MATERIALS SCIENCE↗

Optimizing multiple reliable forward contracts for reservoir allocation using multitime scale streamflow forecasts

Streamflow forecasts at multiple time scales provide a new opportunity for reservoir management to address competing objectives. Market instruments such as forward contracts with specified reliability are considered as a tool that may help address the perceived risk associated with the use of such forecasts in lieu of traditional operation and allocation strategies. A water allocation process that enables multiple contracts for water supply and hydropower production with different durations, while maintaining a prescribed level of flood risk reduction, is presented. The allocation process is supported by an optimization model that considers multitime scale ensemble forecasts of monthly streamflow and flood volume over the upcoming season and year, the desired reliability and pricing of proposed contracts for hydropower and water supply. It solves for the size of contracts at each reliability level that can be allocated for each future period, while meeting target end of period reservoir storage with a prescribed reliability. The contracts may be insurable, given that their reliability is verified through retrospective modeling. The process can allow reservoir operators to overcome their concerns as to the appropriate skill of probabilistic forecasts, while providing water users with short–term and long–term guarantees as to how much water or energy they may be allocated. An application of the optimization model to the Bhakra Dam, India, provides an illustration of the process. In conclusion, the issues of forecast skill and contract performance are examined. A field engagement of the idea is useful to develop a real–world perspective and needs a suitable institutional environment.

54 ENVIRONMENTAL SCIENCES↗

Lung Cancer Survival Prediction using Ensemble Data Mining on Seer Data

We analyze the lung cancer data available from the SEER program with the aim of developing accurate survival prediction models for lung cancer. Carefully designed preprocessing steps resulted in removal/modification/splitting of several attributes, and 2 of the 11 derived attributes were found to have significant predictive power. Several supervised classification methods were used on the preprocessed data along with various data mining optimizations and validations. In our experiments, ensemble voting of five decision tree based classifiers and meta-classifiers was found to result in the best prediction performance in terms of accuracy and area under the ROC curve. We have developed an on-line lung cancer outcome calculator for estimating the risk of mortality after 6 months, 9 months, 1 year, 2 year and 5 years of diagnosis, for which a smaller non-redundant subset of 13 attributes was carefully selected using attribute selection techniques, while trying to retain the predictive power of the original set of attributes. Further, ensemble voting models were also created for predicting conditional survival outcome for lung cancer (estimating risk of mortality after 5 years of diagnosis, given that the patient has already survived for a period of time), and included in the calculator. The on-line lung cancer outcome calculator developed as a result of this study is available at http://info.eecs.northwestern.edu:8080/LungCancerOutcomeCalculator/.

Agrawal, Ankit↗

Spectral proper orthogonal decomposition and its relationship to dynamic mode decomposition and resolvent analysis

We consider the frequency domain form of proper orthogonal decomposition (POD), called spectral proper orthogonal decomposition (SPOD). Spectral POD is derived from a space–time POD problem for statistically stationary flows and leads to modes that each oscillate at a single frequency. This form of POD goes back to the original work of Lumley ( Stochastic Tools in Turbulence , Academic Press, 1970), but has been overshadowed by a space-only form of POD since the 1990s. We clarify the relationship between these two forms of POD and show that SPOD modes represent structures that evolve coherently in space and time, while space-only POD modes in general do not. We also establish a relationship between SPOD and dynamic mode decomposition (DMD); we show that SPOD modes are in fact optimally averaged DMD modes obtained from an ensemble DMD problem for stationary flows. Accordingly, SPOD modes represent structures that are dynamic in the same sense as DMD modes but also optimally account for the statistical variability of turbulent flows. Finally, we establish a connection between SPOD and resolvent analysis. The key observation is that the resolvent-mode expansion coefficients must be regarded as statistical quantities to ensure convergent approximations of the flow statistics. When the expansion coefficients are uncorrelated, we show that SPOD and resolvent modes are identical. Our theoretical results and the overall utility of SPOD are demonstrated using two example problems: the complex Ginzburg–Landau equation and a turbulent jet.

Mechanics↗

Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale

A strict throughput requirement has placed a cap on the degree to which we can depend on the execution of single, long, fine spatial grid simulations to explore global atmospheric climate behavior. Alternatively, running an ensemble of short simulations is computationally more efficient. We test the null hypothesis that the climate statistics of a full-complexity atmospheric model derived from an ensemble of independent short simulation is equivalent to that from an equilibrated long simulation. The climate of short simulation ensembles is statistically distinguishable from that of a long simulation in terms of the distribution of global annual means, largely due to the presence of low-frequency atmospheric intrinsic variability in the long simulation. We also find that model climate statistics of the simulation ensemble are sensitive to the choice of compiler optimizations. While some answer-changing optimization choices do not effect the climate state in terms of mean, variability and extremes, aggressive optimizations can result in significantly different climate states.

54 ENVIRONMENTAL SCIENCES↗

Sensitivity Study for Forecasting Variables of WRF-Solar Using a Tangent Linear Approach

Integrating solar generation in recent years has highlighted the need for improved accuracy in predicting solar power. Confidence in solar power forecasting can be achieved by designing an ensemble that provides reliable probabilistic information for solar radiation with reduced uncertainty and error. Ideally, ensemble members are created through the optimized perturbation of the initial conditions in numerical weather prediction (NWP) models. Tangent linear models are capable of efficiently investigating the sensitivity of solar radiation to model input parameters because they do not require individual perturbation of each variable. This sensitivity study using tangent linear models provide us the capability to identify the right variables to perturb in an ensemble prediction system. In this study, we developed tangent linear models for WRF-Solar modules that directly impact the computation of solar radiation and the simulation of cloud formation and dissipation including the Fast All-sky Model for Solar Applications (FARMS), the Noah land surface model (LSM), the Thompson microphysics, the Mello-Yamada-Nakanishi-Niino (MYNN) boundary layer parameterization, and the Deng scheme for a shallow-convection parameterization. A sensitivity analysis was conducted under various scenarios based on satellite observations and model simulations from the National Solar Radiation Data Base (NSRDB) and WRF-Solar, respectively. Critical forecasting variables that are highly sensitive to the forecasting of global horizontal irradiance (GHI), direct normal irradiance (DNI), cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes were determined using the relevant WRF-Solar module. This study will be used as a guidance on future research leading to high-quality probabilistic solar forecasting. In this presentation, we discuss the validation of tangent linear approach for WRF-Solar modules and illustrate how the sensitivity results are valuable in the improvement of probabilistic solar prediction.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Systems and methods for modeling water quality

A system, method, device and computer-readable medium for creating an ensemble model of water quality. The ensemble model is generated by determining a set of optimal component models for spectral regions of a body of water, and combining the optimal models. The optimal models can be based on remote sensing data, including satellite imagery. A K-fold partition approach or a global approach can be used to determine the optimal component models, and the optimal component models can be combined through spectral space partition rules to generate an ensemble model of water quality. The ensemble model not only has improved water quality prediction ability, but also has strong spatial and temporal extensibility. The spatial and temporal extensibility of the ensemble model is fundamentally important and desirable for long-term and large-scale remote sensing monitoring and assessment of water quality.

Liu, Hongxing↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

A novel machine learning-based optimization algorithm (ActivO) for accelerating simulation-driven engine design

A novel design optimization approach (ActivO) that employs an ensemble of machine learning algorithms is presented. The proposed approach is a surrogate-based scheme, where the predictions of a weak leaner and a strong learner are utilized within an active learning loop. The weak learner is used to identify promising regions within the design space to explore, while the strong learner is used to determine the exact location of the optimum within promising regions. For each design iteration, exploration is done by randomly selecting evaluation points within regions where the weak learner-predicted fitness is high. The global optimum obtained by using the strong learner as a surrogate is also evaluated to enable rapid convergence once the most promising region has been identified. First, the performance of ActivO was compared against five other optimizers on a cosine mixture function with 25 local optima and one global optimum. In the second problem, the objective was to minimize indicated specific fuel consumption of a compression-ignition internal combustion (IC) engine while adhering to desired constraints associated with in-cylinder pressure and emissions. In this work, the efficacy of the proposed approach is compared to that of a genetic algorithm, which is widely used within the internal combustion engine community for engine optimization, showing that ActivO reduces the number of function evaluations needed to reach the global optimum, and thereby time-to-design by 80%. Furthermore, the optimization of engine design parameters leads to savings of around 1.9% in energy consumption, while maintaining operability and acceptable pollutant emissions.

97 MATHEMATICS AND COMPUTING↗

Pitch-angle scattering of energetic charged particles in nearly constant magnitude magnetic turbulence

We use a method developed by Roberts that optimizes the phase angles of an ensemble of plane waves with amplitudes determined from a Kolmogorov-like power spectrum, to construct magnetic field vector fluctuations having nearly constant magnitude and large variances in its components. This is a representation of the turbulent magnetic field consistent with that observed in the solar wind. Charged-particle pitch-angle diffusion coefficients are determined by integrating the equations of motion for a large number of charged particles moving under the influence of forces from our predefined magnetic field. We tested different cases by varying the kinetic energy of the particles (E {sub p}) and the turbulent magnetic field variance (σ{sub B}{sup 2}). For each combination of E {sub p} and σ{sub B}{sup 2}, we tested three different models: (1) the so-called “slab” model, where the turbulent magnetic field depends on only one spatial coordinate and has significant fluctuations in its magnitude (b=√(δB{sub x}{sup 2}(z)+δB{sub y}{sup 2}(z)+B{sub 0}{sup 2})); (2) the slab model optimized with nearly constant magnitude b; and (3) the slab model turbulent magnetic field with nearly constant magnitude plus a “variance-conserving” adjustment. In the last case, this model attempts to conserve the variance of the turbulent components (σ{sub Bx}{sup 2}+σ{sub By}{sup 2}), which is found to decrease during the optimization with nearly constant magnitude. We found that there is little or no effect on the pitch-angle diffusion coefficient D{sub μμ} between models 1 and 2. However, the result from model 3 is significantly different. We also introduce a new method to accurately determine the pitch-angle diffusion coefficients as a function of μ.

79 ASTRONOMY AND ASTROPHYSICS↗

Efficient multimode quantum memory based on photon echo in an optimal QED cavity

Effective multimode photon echo quantum memory on multiatomic ensemble in the QED cavity is proposed. We obtain the analytical solution for the quantum memory efficiency that can be equal to unity when optimal conditions for the cavity and atomic parameters are held. Detailed analysis of the optimal conditions is performed. Numerical estimation for realistic atomic and cavity parameters demonstrates the high efficiency of the quantum memory for an optically thin resonant atomic system that opens a door for real applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in A Mach 4.5 Boundary Layer

We use deep learning, an ensemble variationaltechnique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (Deep-ONets), which have the known ability to learn com-plex nonlinear operators within dynamical systems,are used for machine learning. For the baseline config-uration of a smooth flat plate, the second-mode wavesat the DNS inflow cause a quick nonlinear breakdownof the high-speed boundary layer within the computa-tional domain. Results reported in the present studyvalidate the ability of DeepONets to model the tran-sition delay via a given topography of the roughnesselement. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substan-tially lowered by the DeepONets-based reduced-ordermodel. In comparison to the baseline method of EnVaroptimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition pastthe outflow boundary of the computational domainwhile utilizing almost 5–6 times fewer DNS.

Machine Learning↗

Ground-state cooling enabled by critical coupling and dark entangled states

Here, we analyze the cooling of a mechanical resonator coupled to an ensemble of interacting two-level systems via an open quantum systems method. Using an exact analytical result, we find optimal cooling occurs when the phonon mode is critically coupled (γ ~ g) to the two-level system ensemble. Typical systems operate in suboptimal cooling regimes due to the intrinsic parameter mismatch (γ $\gg$ g) between the dissipative decay rate γ and the coupling factor g . To overcome this obstacle, we show that carefully engineering the coupling parameters through the strain profile of the mechanical resonator allows phonon cooling to proceed through the dark (subradiant) entangled states of an interacting ensemble, thereby resulting in optimal phonon cooling. Our findings provide an avenue for ground-state cooling and should be accessible for experimental demonstrations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

CeO2 Nanoparticle Doping as a Probe of Active Site Speciation in the Catalytic Hydrolysis of Organophosphates

Organophosphate hydrolysis is important for degrading environmentally harmful compounds and recovering phosphate ions in biological molecules. CeO2 nanocrystals have been well-studied for dephosphorylation via hydrolysis owing to the accessible and tunable distribution of Ce3+ and Ce4+ ions. However, there remains uncertainty in the literature regarding which surface defect properties direct catalytic activity, such as the Ce3+/Ce4+ distribution, oxygen vacancies, faceting, and dopants, and to what degree they contribute to efficient hydrolysis. Trivalent (M3+) dopants serve as a tool for manipulating defects, including the concentration of Ce3+ and oxygen vacancies, thereby influencing the hydrolytic activity of CeO2. Herein, trivalent metal ions (M = Y3+, Cr3+, In3+, and Gd3+) were employed to modulate the active sites on the CeO2 nanocrystal surface, and the effects of each metal dopant on the cerium oxide active sites for organophosphate hydrolysis were investigated. M-doped CeO2 nanoparticles were synthesized via hydrothermal methods, followed by annealing to remove ligands and prime the nanocrystal surface for catalysis. Catalytic performance was evaluated using dimethyl-p¬-nitrophenyl phosphate (DMNP) as a model organophosphate substrate, with degradation monitored over time using UV-visible absorption spectroscopy. Powder X-ray diffraction (PXRD), X-ray photoelectron spectroscopy (XPS), and Raman spectroscopy revealed successful doping of CeO2 in all cases, albeit with distinctive characteristics demonstrating how M3+ dopants affect catalysis. We show that CeO2 exhibits high sensitivity to dopants that generate lattice strain, Ce3+ ions, and oxygen vacancy defects. Consequently, achieving high catalytic efficiency within CeO2 requires a balanced active site ensemble, wherein defects are maintained at optimal concentrations and distributions on the nanocrystal surface.

Miura-Stempel, Emily L.↗

Off-Equilibrium Reactivity of Boron-Enriched Metal Diboride Surfaces in Electroreduction Conditions

Boron-based materials, featuring B-dependent reactivity and diverse phases, are emerging as promising catalyst systems. However, the catalytic mechanism on many borides remains poorly understood due to complex surface reconstructions under reaction conditions. Here, we investigate the MoB 2 surface in conditions of hydrogen evolution reaction in acidic media, using grand canonical global optimization, grand canonical density functional theory, ab initio molecular dynamics, free energy surface sampling, and an analytical model for electrochemical barrier evaluation. We propose a boron-enrichment strategy to tune the surface reactivity of the hexagonal face of MoB 2 . We reveal the dynamic nature of the B-enriched surface under H coverage and kinetic trapping of the system in the metastable regime with an extensive examination of the deactivation pathways. The metastable center B site on B-enriched surfaces, featuring buckled-up configuration and a usual relaxation effect, is found to be highly active toward HER via the Volmer–Heyrovsky mechanism. In conclusion, this work demonstrates how off-equilibrium behaviors can arise from the interplay between adsorbate coverage and surface reconstruction on a seemingly simple surface, and we present a theoretical framework and computational workflows to address these behaviors, along with other realistic complexities, in kinetics simulations.

Adsorption↗

Enhancing the activity of Pd ensembles on graphene by manipulating coordination environment

Atomic dispersion of metal catalysts on a substrate accounts for the increased atomic efficiency of single-atom catalysts (SACs) in various catalytic schemes compared to the nanoparticle counterparts. However, lacking neighboring metal sites has been shown to deteriorate the catalytic performance of SACs in a few industrially important reactions, such as dehalogenation, CO oxidation, and hydrogenation. Metal ensemble catalysts (M n ), an extended concept to SACs, have emerged as a promising alternative to overcome such limitation. Inspired by the fact that the performance of fully isolated SACs can be enhanced by tailoring their coordination environment (CE), we here evaluate whether the CE of M n can also be manipulated in order to enhance their catalytic activity. We synthesized a set of Pd ensembles (Pd n ) on doped graphene supports (Pd n /X-graphene where X = O, S, B, and N). We found that introducing S and N onto oxidized graphene modifies the first shell of Pd n converting Pd–O to Pd–S and Pd–N, respectively. Also, we further found that the B dopant significantly affected the electronic structure of Pd n by serving as an electron donor in the second shell. We examined the performance of Pd n /X-graphene toward selective reductive catalysis, such as bromate reduction, brominated organic hydrogenation, and aqueous-phase CO 2 reduction. We observed that Pd n /N-graphene exhibited superior performance by lowering the activation energy of the rate-limiting step, i.e., H 2 dissociation into atomic hydrogen. The results collectively suggest controlling the CE of SACs in an ensemble configuration is a viable strategy to optimize and enhance their catalytic performance.

36 MATERIALS SCIENCE↗

Optimizers for stabilizing likelihood-free inference

A growing number of applications in particle physics and beyond use neural networks as unbinned likelihood ratio estimators applied to real or simulated data. Precision requirements on the inference tasks demand a high-level of stability from these networks, which are affected by the stochastic nature of training. We show how physics concepts can be used to stabilize network training through a physics-inspired optimizer. In particular, the energy conserving descent (ECD) optimization framework uses classical Hamiltonian dynamics on the space of network parameters to reduce the dependence on the initial conditions while also stabilizing the result near the minimum of the loss function. We develop a version of this optimizer known as , which has few free hyperparameters with limited ranges guided by physical reasoning. We apply to representative likelihood-ratio estimation tasks in particle physics and find on average that it out-performs the widely used Adam optimizer. We expect that ECD will be a useful tool for wide array of data-limited problems, where it is computationally expensive to exhaustively optimize hyperparameters and mitigate fluctuations with ensembling.

Monte Carlo methods↗