Search NASA⌕ Search

SEARCH · Search NASA

Results for “active subspace”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Materials Design using an Active Subspace-based Batch Bayesian Optimization Approach

Integrated computational materials engineering (ICME) calls for integrating simulation tools and/or experiments to develop new materials and materials systems. However, implementation of ICME approaches is challenging mainly due to the considerable computational expense of such frameworks and large dimensionality of the design space. Addressing these challenges is thus critical to the success of ICME initiatives. We present here a specific Bayesian optimization framework designed to address these two challenges. In particular, we propose an active subspace batch Bayesian optimization framework. The framework makes use of dimension reduction via the active subspace method and makes use of the ability to query in parallel via the batch Bayesian optimization approach. Here, the integration of these techniques leads to significant efficiency improvements while maintaining accuracy.

36 MATERIALS SCIENCE↗

A near-stationary subspace for ridge approximation

Response surfaces are common surrogates for expensive computer simulations in engineering analysis. However, the cost of fitting an accurate response surface increases exponentially as the number of model inputs increases, which leaves response surface construction intractable for high-dimensional, nonlinear models. Here we describe ridge approximation for fitting response surfaces in several variables. A ridge function is constant along several directions in its domain, so fitting occurs on the coordinates of a low-dimensional subspace of the input space. We review essential theory for ridge approximation – e.g., the best mean-squared approximation and an optimal low-dimensional subspace – and we prove that the gradient-based active subspace is near-stationary for the least-squares problem that defines an optimal subspace. Motivated by the theory, we propose a computational heuristic that uses an estimated active subspace as an initial guess for a ridge approximation fitting problem. We show a simple example where the heuristic fails, which reveals a type of function for which the proposed approach is inappropriate. We then propose a simple alternating heuristic for fitting a ridge function, and we demonstrate the effectiveness of the active subspace initial guess applied to an airfoil model of drag as a function of its 18 shape parameters.

42 ENGINEERING↗

Concordance

Dimension reduction techniques have long been an important topic in statistics, and active subspaces (AS) have received much attention this past decade in the computer experiments literature. The most common approach towards estimating the AS is to use Monte Carlo with numerical gradient evaluation. This software takes a new approach towards estimating the active subspace, in which Multivariate Adaptive Regression Splines (MARS) is used as a surrogate model, and relevant calculation are obtained analytically. Using a MARS surrogate has many advantages including improved scaling, better estimation of active subspaces in high dimensions and the ability to handle a large number of prior distributions in closed form. This software is also capable of conducting a so-called "concordance analysis", using a generalization of ASs which we refer to as "Co-Active" subspaces.

Rumsey, Kelin↗

Exact-to-precision generalized perturbation for neutron transport calculation

This manuscript extends the exact-to-precision generalized perturbation theory (E{sub P}GPT), introduced previously, to neutron transport calculation whereby previous developments focused on neutron diffusion calculation only. The E{sub P}GPT collectively denotes new developments in generalized perturbation theory (GPT) that place premium on computational efficiency and defendable accuracy in order to render GPT a standard analysis tool in routine design and safety reactor calculations. EPGPT constructs a surrogate model with quantifiable accuracy which can replace the original neutron transport model for subsequent engineering analysis, e.g. functionalization of the homogenized few-group cross sections in terms of various core conditions, sensitivity analysis and uncertainty quantification. This is achieved by reducing the effective dimensionality of the state variable (i.e. neutron angular flux) by projection onto an active subspace. Confining the state variations to the active subspace allows one to construct a small number of what is referred to as the 'active' responses which are solely dependent on the physics model rather than on the responses of interest, the number of input parameters, or the number of points in the state phase space. (authors)

97 MATHEMATICS AND COMPUTING↗

Factorized visual representations in the primate visual system and deep neural networks

Object classification has been proposed as a principal objective of the primate ventral visual stream and has been used as an optimization target for deep neural network models (DNNs) of the visual system. However, visual brain areas represent many different types of information, and optimizing for classification of object identity alone does not constrain how other information may be encoded in visual representations. Information about different scene parameters may be discarded altogether (‘invariance’), represented in non-interfering subspaces of population activity (‘factorization’) or encoded in an entangled fashion. In this work, we provide evidence that factorization is a normative principle of biological visual representations. In the monkey ventral visual hierarchy, we found that factorization of object pose and background information from object identity increased in higher-level regions and strongly contributed to improving object identity decoding performance. We then conducted a large-scale analysis of factorization of individual scene parameters – lighting, background, camera viewpoint, and object pose – in a diverse library of DNN models of the visual system. Models which best matched neural, fMRI, and behavioral data from both monkeys and humans across 12 datasets tended to be those which factorized scene parameters most strongly. Notably, invariance to these parameters was not as consistently associated with matches to neural and behavioral data, suggesting that maintaining non-class information in factorized activity subspaces is often preferred to dropping it altogether. Thus, we propose that factorization of visual scene information is a widely used strategy in brains and DNN models thereof.

59 BASIC BIOLOGICAL SCIENCES↗

Domain Knowledge Guided Bayesian Optimization For Autonomous Alignment Of Complex Scientific Instruments

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where rewards are sparse. In such needle-in-a-haystack scenarios, even advanced methods like trust-region BO (TurBO) often lead to unsatisfactory results. We propose a domain knowledge guided Bayesian Optimization approach, which leverages physical insight to fundamentally simplify the search problem by transforming coordinates to decouple input features and align the active subspaces with the primary search axes. We demonstrate this approach's efficacy on a challenging 12-dimensional, 6-crystal Split-and-Delay optical system, where conventional approaches, including standard BO, TuRBO and multi-objective BO, consistently led to unsatisfactory results. When combined with an reverse annealing exploration strategy, this approach reliably converges to the global optimum. The coordinate transformation itself is the key to this success, significantly accelerating the search by aligning input co-ordinate axes with the problem's active subspaces. As increasingly complex scientific instruments, from large telescopes to new spectrometers at X-ray Free Electron Lasers are deployed, the demand for robust high-dimensional optimization grows. Our results demonstrate a generalizable paradigm: leveraging physical insight to transform high-dimensional, coupled optimization problems into simpler representations can enable rapid and robust automated tuning for consistent high performance while still retaining current optimization algorithms.

FOS: Computer and information sciences↗

Improved multifidelity Monte Carlo estimators based on normalizing flows and dimensionality reduction techniques

Here, we study the problem of multifidelity uncertainty propagation for computationally expensive models. In particular, we consider the general setting where the high-fidelity and low-fidelity models have a dissimilar parameterization both in terms of number of random inputs and their probability distributions, which can be either known in closed form or provided through samples. We derive novel multifidelity Monte Carlo estimators which rely on a shared subspace between the high-fidelity and low-fidelity models where the parameters follow the same probability distribution, i.e., a standard Gaussian. We build the shared space employing normalizing flows to map different probability distributions into a common one, together with linear and nonlinear dimensionality reduction techniques, active subspaces and autoencoders, respectively, which capture the subspaces where the models vary the most. We then compose the existing low-fidelity model with these transformations and construct modified models with an increased correlation with the high-fidelity model, which therefore yield multifidelity estimators with reduced variance. A series of numerical experiments illustrate the properties and advantages of our approaches.

97 MATHEMATICS AND COMPUTING↗

Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they often suffer from overfitting due to their large number of parameters. Kolmogorov-Arnold networks (KANs) offer an alternative solution with fewer parameters. However, gradient-based inference methods, such as Hamiltonian Monte Carlo (HMC), may result in computational inefficiency when applied to KANs, especially for large-scale datasets, due to the high cost of back-propagation. To address these challenges, we propose a novel approach, combining the dropout Tikhonov ensemble Kalman inversion (DTEKI) with Chebyshev KANs. This gradient-free method effectively mitigates overfitting and enhances numerical stability. In addition, we incorporate the active subspace method to reduce the parameter-space dimensionality, allowing us to improve the accuracy of predictions and obtain more reliable uncertainty estimates. Extensive experiments demonstrate the efficacy of our approach in various test cases, including scenarios with large datasets and high noise levels. Our results show that the new method achieves comparable or better accuracy, much higher efficiency as well as stability compared to HMC, in addition to scalability. Moreover, by leveraging the low-dimensional parameter subspace, our method preserves prediction accuracy while substantially reducing further the computational cost.

97 MATHEMATICS AND COMPUTING↗

Field Sensitivity Analysis of Turbulence Model Parameters for Flow Over a Wing

Reynolds-averaged-Navier-Stokes (RANS) turbulence models are a critical tool in computational-fluid-dynamics simulations of aerodynamic systems, but simulation results can be highly sensitive to RANS-model parameter choices. Sensitivity analysis can be used to quantify these impacts, and the objective of this study is to demonstrate field sensitivity analysis with respect to ten parameters in the 2003 Menter shear-stress-transport (SST) turbulence model. Here, the analysis is demonstrated for an application relevant to wind energy, namely, flow over a NACA 0015 wing at 12 degree angle of attack and a Reynolds number of 1.5 x 10 6 . We quantify sensitivity using Sobol indices and the mean-squared gradient, which are estimated using polynomial chaos and active subspace models, respectively. Our results indicate that there are substantial spatial variations in parameter sensitivities, with different sets of most-sensitive parameters near the wing, as well as in the downstream wake, consistent with the physical interpretations of the turbulence model inputs. We show that, for this particular turbulence model and flow, simultaneous dimension reduction is possible across all quantities of interest, enabling efficient exploration of model outcomes. Ultimately, this analysis provides new insights into turbulence model parameter sensitivities in incompressible flows, and also demonstrates the implementation of field sensitivity analysis for applications relevant to aerodynamics simulations.

17 WIND ENERGY↗

Further Investigation of Employing Binomial Small-Sample Estimator in M-LROM

Reduced Order Modeling (ROM) is essential to enable the identification of the so-called active parameter subspace for high-fidelity models that are employed in computationally intensive analyses such as uncertainty characterization and data assimilation. Given the complexity of models for real-world application, brute force methods to identify the active subspace may not be computationally efficient to realize the value of reduction, since in realistic problems, the full scale model must be executed few hundred times, which may be computationally taxing. Earlier work has introduced a new approach, which represents a further development of our previous work on ROM, referred to as multi-level ROM (M-LROM). In M-LROM, approximate models are employed to identify the active subspace instead of the full scale model. In this summary, we present our recent results on M-LROM, specifically in regard to the construction of reliable error metrics that can bound the errors resulting from the reduction. The idea is to employ a lower fidelity model, i.e., an approximation of the full scale or high fidelity model, to build the active subspace, and via the proposed error bound, the quality of the active subspace can be determined by calculating an upper bound on the errors resulting from the reduction. For this approach to be practical, the error bound must be realistic, implying that it should be close to the actual errors expected, and not much higher. Therefore, an important goal of this summary is to compare different error bounds in terms of the relation between their estimated bounds to the actual errors. In particular, we compare the proposed error bound which numerically construct an estimator using binomial distribution to the widely used small-sample norm estimators. Unlike most probabilistic error estimation methods, the proposed bound employs a binomial distribution to construct the estimator whereas in other conventional methods, the distribution employed is typically the standard Gaussian, normalized over a unit hypersphere as initially proposed by the seminal paper of J. Dixon on random matrix theory. Previous publications provided evidence that the binomial distribution calculates more realistic bounds as compared to the Gaussian distribution, which tends to be conservative, implying that the bound is much bigger than the actual errors, which diminishes the value of the reduction, as now must increase the size of the active subspace to reach the desired upper bound on the reduction errors. This work has provided a rigorous approach by which error bounds on the reduction errors can be established without having to execute the high fidelity model during the construction of the active subspace. The high fidelity model is only need to test the error bound using small number of executions. This methodology paves the way for a more efficient application of ROM to complex engineering models, where standard ROM techniques may be too taxing to optimally realize their value in practical situations. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Optimal control of a Cope rearrangement by coupling the reaction path to a dissipative bath or a second active mode

We compare the strategy found by the optimal control theory in a complex molecular system according to the active subspace coupled to the field. The model is the isomerization during a Cope rearrangement of Thiele’s ester that is the most stable dimer obtained by the dimerization of methyl-cyclopentadienenylcarboxylate. The crudest partitioning consists in retaining in the active space only the reaction coordinate, coupled to a dissipative bath of harmonic oscillators which are not coupled to the field. The control then fights against dissipation by accelerating the passage across the transition region which is very wide and flat in a Cope reaction. This mechanism has been observed in our previous simulations [Chenel et al., J. Phys. Chem. A 116, 11273 (2012)]. We compare here, the response of the control field when the reaction path is coupled to a second active mode. Constraints on the integrated intensity and on the maximum amplitude of the fields are imposed limiting the control landscape. Then, optimum field from one-dimensional simulation cannot provide a very high yield. Better guess fields based on the two-dimensional model allow the control to exploit different mechanisms providing a high control yield. By coupling the reaction surface to a bath, we confirm the link between the robustness of the field against dissipation and the time spent in the delocalized states above the transition barrier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploring the Sensitivity of Photosynthesis and Stomatal Resistance Parameters in a Land Surface Model

Abstract Land surface models, like the Common Land Model component of the ParFlow integrated hydrologic model (PF-CLM), are used to estimate transpiration from vegetated surfaces. Transpiration rates quantify how much water moves from the subsurface through the plant and into the atmosphere. This rate is controlled by the stomatal resistance term in land surface models. The Ball–Berry stomatal resistance parameterization relies, in part, on the rate of photosynthesis, and together these equations require the specification of 20 input parameters. Here, the active subspace method is applied to 2100 year-long PF-CLM simulations, forced by atmospheric data from California, Colorado, and Oklahoma, to identify which input parameters are important and how they relate to three quantities of interest: transpiration, stomatal resistance from the sunlit portion of the canopy, and stomatal resistance from the shaded portion. The slope (mp) and intercept (bp) parameters associated with the Ball–Berry parameterization are consistently important for all locations, along with five parameters associated with ribulose bisphosphate carboxylase/oxygenase (RuBisCO)- and light-limited rates of photosynthesis [CO2 Michaelis–Menten constant at 25°C (kc25), maximum ratio of oxygenation to carboxylation (ocr), quantum efficiency at 25°C (qe25), maximum rate of carboxylation at 25°C (vcmx25), and multiplier in the denominator of the equation used to compute the light-limited rate of photosynthesis (wj1)]. The importance of these input parameters, quantified by the active variable weight, and the relationship between the input parameters and quantities of interest vary seasonally and diurnally. Input parameter values influence transpiration rates most during midday, summertime hours when fluxes are large. This research informs model users about which photosynthesis and stomatal resistance parameters should be more carefully selected. Quantifying sensitivities associated with the stomatal resistance term is necessary to better understand transpiration estimates from land surface models.

54 ENVIRONMENTAL SCIENCES↗