Physics-informed machine learning with conditional Karhunen-Loève expansions
Not Available
Tartakovsky, A. M. (ORCID:000000032375318X)↗
SEARCH · Search NASA
Results for “state space model”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Dynamic Phasor Modeling of Various Multipulse Rectifiers and a VSI Fed by 18-Pulse Asymmetrical Autotransformer Rectifier Unit for Fast Transient Analysis
To study the fast modelling of dynamic characteristics caused by power electronic switching, the dynamic phasor (DP) theory based on the time-varying Fourier decomposition and frequency shifting is firstly applied to the modelling of various multipulse rectifiers. The DP model for symmetrical 12-pulse phase-shifting reactor rectifier unit (PSR-RU) is derived with model order reduction, relations between ac and dc terminals, and Taylor series expansion. The DP model of asymmetrical 18-pulse autotransformer rectifier unit (AT-RU) is proposed based on the switching functions expressed in the DP domain. Meanwhile, the DP model of voltage source inverter (VSI) fed by asymmetrical 18-pulse AT-RU is built with the harmonic state-space (HSS) equations. Under both balanced and unbalanced conditions, the good calculation accuracy and rapid simulation speed of the developed DP models are validated by the detailed time-domain (TD) simulation.
42 ENGINEERING↗
Inference offers a metric to constrain dynamical models of neutrino flavor transformation
The multimessenger astrophysics of compact objects presents a vast range of environments where neutrino flavor transformation may occur and may be important for nucleosynthesis, dynamics, and a detected neutrino signal. Development of efficient techniques for surveying flavor evolution solution spaces in these diverse environments, which augment and complement existing sophisticated computational tools, could leverage progress in this field. To this end we continue our exploration of statistical data assimilation (SDA) to identify solutions to a small-scale model of neutrino flavor transformation. SDA is a machine learning formula wherein a dynamical model is assumed to generate any measured quantities. Specifically, we use an optimization formulation of SDA wherein a cost function is extremized via the variational method. Regions of state space in which the extremization identifies the global minimum of the cost function will correspond to parameter regimes in which a model solution can exist. Our example study seeks to infer the flavor transformation histories of two monoenergetic neutrino beams coherently interacting with each other and with a matter background. We require that the solution be consistent with measured neutrino flavor fluxes at the point of detection, and with constraints placed upon the flavor content at various locations along their trajectories, such as the point of emission, and the locations of the Mikheyev-Smirnov-Wolfenstein resonances. We show how the procedure efficiently identifies solution regimes and rules out regimes where solutions are infeasible. Overall, results in this work intimate the promise of this “variational annealing” methodology to efficiently probe an array of fundamental questions that traditional numerical simulation codes render difficult to access.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Bayesian reduced-order deep learning surrogate model for dynamic systems described by partial differential equations
We propose a reduced-order deep-learning surrogate model for dynamic systems described by time-dependent partial differential equations. This method employs space–time Karhunen–Loève expansions (KLEs) of the state variables and space-dependent KLEs of space-varying parameters to identify the reduced (latent) dimensions. Subsequently, a deep neural network (DNN) is used to map the parameter latent space to the state variable latent space. An approximate Bayesian method is developed for uncertainty quantification (UQ) in the proposed KL-DNN surrogate model. The KL-DNN method is tested for the linear advection–diffusion and nonlinear diffusion equations, and the Bayesian approach for UQ is compared with the deep ensembling (DE) approach, commonly used for quantifying uncertainty in DNN models. It was found that the approximate Bayesian method provides a more informative distribution of the PDE solutions in terms of the coverage of the reference PDE solutions (the percentage of nodes where the reference solution is within the confidence interval predicted by the UQ methods) and log predictive probability. The DE method is found to underestimate uncertainty and introduce bias. For the nonlinear diffusion equation, we compare the KL-DNN method with the Fourier Neural Operator (FNO) method and find that KL-DNN is 10% more accurate and needs less training time than the FNO method.
97 MATHEMATICS AND COMPUTING↗
Navigating Transition-Metal Chemical Space: Artificial Intelligence for First-Principles Design
Conspectus The variability of chemical bonding in open-shell transition-metal complexes not only motivates their study as functional materials and catalysts but also challenges conventional computational modeling tools. Here, tailoring ligand chemistry can alter preferred spin or oxidation states as well as electronic structure properties and reactivity, creating vast regions of chemical space to explore when designing new materials atom by atom. Although first-principles density functional theory (DFT) remains the workhorse of computational chemistry in mechanism deduction and property prediction, it is of limited use here. DFT is both far too computationally costly for widespread exploration of transition-metal chemical space and also prone to inaccuracies that limit its predictive performance for localized d electrons in transition-metal complexes. These challenges starkly contrast with the well-trodden regions of small-organic-molecule chemical space, where the analytical forms of molecular mechanics force fields and semiempirical theories have for decades accelerated the discovery of new molecules, accurate DFT functional performance has been demonstrated, and gold-standard methods from correlated wavefunction theory can predict experimental results to chemical accuracy. The combined promise of transition-metal chemical space exploration and lack of established tools has mandated a distinct approach. In this Account, we outline the path we charted in exploration of transition-metal chemical space starting from the first machine learning (ML) models (i.e., artificial neural network and kernel ridge regression) and representations for the prediction of open-shell transition-metal complex properties. The distinct importance of the immediate coordination environment of the metal center as well as the lack of low-level methods to accurately predict structural properties in this coordination environment first motivated and then benefited from these ML models and representations. Once developed, the recipe for prediction of geometric, spin state, and redox potential properties was straightforwardly extended to a diverse range of other properties, including in catalysis, computational “feasibility”, and the gas separation properties of periodic metal–organic frameworks. Interpretation of selected features most important for model prediction revealed new ways to encapsulate design rules and confirmed that models were robustly mapping essential structure–property relationships. Encountering the special challenge of ensuring that good model performance could generalize to new discovery targets motivated investigation of how to best carry out model uncertainty quantification. Distance-based approaches, whether in model latent space or in carefully engineered feature space, provided intuitive measures of the domain of applicability. With all of these pieces together, ML can be harnessed as an engine to tackle the large-scale exploration of transition-metal chemical space needed to satisfy multiple objectives using efficient global optimization methods. In practical terms, bringing these artificial intelligence tools to bear on the problems of transition-metal chemical space exploration has resulted in ML-model assessments of large, multimillion compound spaces in minutes and validated new design leads in weeks instead of decades.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Microscopic constraints for the equation of state and structure of neutron stars: A Bayesian model mixing framework
Bayesian model mixing (BMM) is a statistical technique that can combine constraints from different regions of an input space in a principled way. Here we extend our BMM framework for the equation of state (EOS) of strongly interacting matter from symmetric nuclear matter to asymmetric matter, specifically focusing on zero-temperature, charge-neutral, 𝛽-equilibrated matter. We use Gaussian processes (GPs) to infer constraints on the neutron-star matter EOS at intermediate densities from two different microscopic theories: chiral effective-field theory (𝜒EFT) at baryon densities around nuclear saturation, 𝑛 𝐵 ∼ 𝑛 0 , and perturbative QCD at asymptotically high baryon densities, 𝑛 𝐵 ⩾ 20𝑛 0 . The uncertainties of the 𝜒EFT and pQCD EOSs are obtained using the BUQEYE truncation error model. We demonstrate the flexibility of our framework through the use of two categories of GP kernels: conventional stationary kernels and a nonstationary changepoint kernel. We use the latter to explore potential constraints on the dense matter EOS by including exogenous data representing theory predictions and heavy-ion collision measurements at densities ⩾ 2𝑛 0 . We also use our EOSs to obtain neutron-star mass-radius relations and their uncertainties. Finally, our framework, whose implementation will be available through a GitHub repository, provides a prior distribution for the EOS that can be used in large-scale neutron-star inference frameworks.
Bayesian methods↗
Reduced Models for Chemical Kinetics derived from Parallel Ensemble Simulations of Stirred Reactors
Detailed chemical kinetic models are essential to improve the predictive capability of computational fluid dynamics (CFD) simulations and to impact the development of next generation combustion technologies. However, such detailed kinetic models are beyond the reach of CFD codes due to the computational cost of transporting additional chemical degrees of freedom. Reduced order models for combustion kinetics exploit the presence of lower dimensional manifolds in the state space and require far fewer number of scalars to be transported as part of CFD simulations. In this paper, we describe the software infrastructure developed to allow large ensembles of stirred reactor configurations with detailed chemical kinetics. The canonical reactor simulations are incorporated in a workflow with sparse grid and data reduction methodologies aimed at development of reduced order models. We present results from analyzing the results of the stirred reactor calculations for syngas mixture using principal component analysis (PCA) and neural network methodologies. The results show that nonlinear autoencoder model can surpass PCA in representing the original dataset with far fewer degrees of freedom.
Zhang, Pei↗
Assessment of the burning-plasma operational space in ITER by using a control-oriented core-SOL-divertor model
In future tokamaks, the control of burning plasmas will require careful regulation of the plasma density and temperature. Along with the design of effective burn-control systems, understanding how the fusion power varies in the density-temperature space is vital for the operation of fusion power plants. Here in this work, the steady-state operational space of ITER is studied using a control-oriented core-plasma model coupled to a two-point model of the scrape-off-layer (SOL) and divertor regions. The two models are coupled through the exchange of input-output parameters. The deuterium and tritium recycling from the wall are output parameters of the SOL-divertor model that are used as input parameters in the core-plasma density balance. Furthermore, the separatrix temperature, which is an output parameter of the SOL-divertor model, is incorporated into the radial core-plasma temperature profiles. Therefore, the temperature-dependent power balance of the plasma core is intimately linked to the SOL-divertor model. Both the power entering the SOL from the core, as determined by the core-plasma power balance, and the separatrix density, as dictated by the core-plasma density balance, are input parameters to the SOL-divertor model. They are control knobs in the SOL-divertor model that can be regulated using the core-plasma actuators: auxiliary power and pellet injection. There are various operational limitations, such as the saturation of the aforementioned actuators, that will prevent ITER from accessing certain high-fusion plasma regimes. The achievable tritium concentration in the fueling lines and the maximum sustainable heat load on the divertor will impose further restrictions. By accounting for these limitations, the ITER operational space is computed based on the coupled core-SOL-divertor model and visualized using Plasma Operation Contour (POPCON) plots that map performance metrics, such as the fusion to auxiliary power ratio, over the density-temperature space. Comparisons are drawn between plasmas with different recycling, confinement, and SOL-divertor conditions.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
The shock physics of giant impacts: Key requirements for the equations of state
We discuss major challenges in modeling giant impacts between planetary bodies, focusing on the equations of state (EOS). During the giant impact stage of planet formation, rocky planets are melted and partially vaporized. However, most EOS models fail to reproduce experimental constraints on the thermodynamic properties of the major minerals over the required phase space. Here, we present an updated version of the widely-used ANEOS model that includes a user-defined heat capacity limit in the thermal free energy term. Our revised model for forsterite (Mg 2 SiO 4 ), a common proxy for the mantles of rocky planets, provides a better fit to material data over most of the phase space of giant impacts. We discuss the limitations of this model and the Tillotson equation of state, a commonly used alternative model.
79 ASTRONOMY AND ASTROPHYSICS↗
Muon capture on deuteron using local chiral potentials
The muon capture reaction μ – + d → n + n + ν μ in the doublet hyperfine state is studied using nuclear potentials and consistent currents derived in the chiral effective field theory, which are local and expressed in coordinate space (the so-called Norfolk models). Only the largest contribution due to the 1 S 0 nn scattering state is considered. Particular attention is given to the estimate of theoretical uncertainty, for which four sources have been identified: 1) the model dependence, 2) the chiral-order convergence for the weak nuclear current, 3) the uncertainty in the single-nucleon axial form factor, and 4) the numerical technique adopted to solve the bound and scattering A = 2 systems. This last source of uncertainty has turned out to be essentially negligible. For the 1 S 0 doublet muon capture rate Γ D ( 1 S 0 ), we obtain Γ D ( 1 S 0 ) = 255.8(0.6) (4.4)(2.9) s –1 , where the three errors come from the first three sources of uncertainty. The value for Γ D ( 1 S 0 ) obtained within this local chiral framework is compared with previous calculations and found in very good agreement.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Parton distribution functions from scalar light-front parton gas model
Here, we propose an application of a microcanonical ensemble with light-front kinematics to model the phase-space distribution of relativistic constituents of a bound state. These constituents denoted by partons are treated as classical spin-zero particles confined inside the bound state with inter-parton collisions as their only interaction. The microcanonical molecular dynamics ensemble is applied to obtain the phase-space distribution of such a thermodynamic system. We sample this phase-space distribution using Monte Carlo algorithms to obtain the parton distribution functions (PDFs) in scenarios with 3, 4, and 5 identical partons. In addition PDFs when a selected number of massless partons are mixed with 3 massive partons are also presented.
Microcanonical ensemble↗
Quantum Criticality in the 2D Quasiperiodic Potts Model
Quantum critical points in quasiperiodic magnets can realize new universality classes, with critical properties distinct from those of clean or disordered systems. Here, we study quantum phase transitions separating ferromagnetic and paramagnetic phases in the quasiperiodic q-state Potts model in 2+1D. Using a controlled real-space renormalization group approach, we find that the critical behavior is largely independent of q, and is controlled by an infinite-quasiperiodicity fixed point. In conclusion, the correlation length exponent is found to be ν = 1, saturating a modified version of the Harris-Luck criterion.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Pareto Optimization of Analog Circuits Using Reinforcement Learning
Analog circuit optimization and design presents a unique set of challenges in the IC design process. Many applications require the designer to optimize for multiple competing objectives, which poses a crucial challenge. Motivated by these practical aspects, we propose a novel method to tackle multi-objective optimization for analog circuit design in continuous action spaces. In particular, we propose to (i) extrapolate current techniques in Multi-Objective Reinforcement Learning to continuous state and action spaces and (ii) provide for a dynamically tunable trained model to query user defined preferences in multi-objective optimization in the analog circuit design context.
99 GENERAL AND MISCELLANEOUS↗
Quantifying Uncertainty in All-to-All Estimates of Space Object Conjunction Probabilities using U-Statistics
Predicting space object conjunctions is inherently probabilistic due to initial state and orbit model uncertainty. A commonly considered Monte Carlo estimator of the conjunction probability is the ’all-to-all’ estimator. Given independent random samples of the trajectories of both objects, the estimator is the percentage of all pairs of trajectories that result in a conjunction. Intuitively, the all-to-all estimator is the best possible estimator of the conjunction probability since it considers all pairs of Monte Carlo samples. However, its distribution is not available in closed-form, which limits its use in practice and makes this intuition difficult to make rigorous. In this paper, the all-to-all estimator is identified as a U-statistic, which implies that it has several favorable properties. Specifically, the estimator is the minimum variance unbiased estimator of the conjunction probability and is asymptotically Gaussian distributed. An approximate confidence interval for the conjunction probability is obtained from an estimate of the asymptotic Gaussian distribution. We show how to efficiently compute the confidence interval and demonstrate that the interval has the nominal coverage level. The confidence intervals are also seen to be narrower than those based on the commonly-used each-to-each estimator. Furthermore, the all-to-all estimator is shown to allow different Monte Carlo sample sizes, whereas the each-to-each estimator requires equal sample sizes.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Tools for unbinned unfolding
Machine learning has enabled differential cross section measurements that are not discretized. Going beyond the traditional histogram-based paradigm, these unbinned unfolding methods are rapidly being integrated into experimental workflows. Here, in order to enable widespread adaptation and standardization, we develop methods, benchmarks, and software for unbinned unfolding. For methodology, we demonstrate the utility of boosted decision trees for unfolding with a relatively small number of high-level features. This complements state-of-the-art deep learning models capable of unfolding the full phase space. To benchmark unbinned unfolding methods, we develop an extension of existing dataset to include acceptance effects, a necessary challenge for real measurements. Additionally, we directly compare binned and unbinned methods using discretized inputs for the latter in order to control for the binning itself. Lastly, we have assembled two software packages for the OmniFold unbinned unfolding method that should serve as the starting point for any future analyses using this technique. One package is based on the widely-used RooUnfold framework and the other is a standalone package available through the Python Package Index (PyPI).
47 OTHER INSTRUMENTATION↗
Link Scheduling in Satellite Networks via Machine Learning Over Riemannian Manifolds
Low Earth Orbit (LEO) satellites play a crucial role in enhancing global connectivity, serving a complementary solution to existing terrestrial systems. In wireless networks, scheduling is a vital process that allocates time-frequency resources to users for interference management. However, LEO satellite networks face significant challenges in scheduling their links towards ground users due to the satellites’ mobility and overlapping coverage. This paper addresses the dynamic link scheduling problem in LEO satellite networks by considering spatio-temporal correlations introduced by the satellites’ movements. The first step in the proposed solution involves modeling the network over Riemannian manifolds, thanks to their representation as symmetric positive definite matrices. We introduce two machine learning (ML)-based link scheduling techniques that model the dynamic evolution of satellite positions and link conditions over time and space. To accurately predict satellite link states, we present a recurrent neural network (RNN) over Riemannian manifolds, which captures spatio-temporal characteristics over time. Furthermore, we introduce a separate model, the convolutional neural network (CNN) over Riemannian manifolds, which captures geometric relationships between satellites and users by extracting spatial features from the network topology across all links. Simulation results demonstrate that both RNN and CNN over Riemannian manifolds deliver comparable performance to the fractional programming-based link scheduling (FPLinQ) benchmark. Remarkably, unlike other ML-based models that require extensive training data, both models only need 30 training samples to achieve over 99% of the sum rate while maintaining similar computational complexity relative to the benchmark.
42 ENGINEERING↗
Designing a Framework for Solving Multiobjective Simulation Optimization Problems
Multiobjective simulation optimization (MOSO) problems are optimization problems with multiple conflicting objectives, where evaluation of at least one of the objectives depends on a black-box numerical code or real-world experiment, which we refer to as a simulation. Whereas an extensive body of research is dedicated to developing new algorithms and methods for solving these and related problems, it is challenging and time-consuming to integrate these techniques into real-world production-ready solvers. This is partly because of the diversity and complexity of modern state-of-the-art MOSO algorithms and methods and partly because of the complexity and specificity of many real-world problems and their corresponding computing environments. The complexity of this problem is only compounded when introducing potentially complex and/or domain-specific surrogate-modeling techniques, problem formulations, design spaces, and data acquisition functions. Here, this paper carefully surveys the current state of the art in MOSO algorithms, techniques, and solvers, as well as problem types and computational environments where MOSO is commonly applied. We then present several key challenges in the design of a parallel multiobjective simulation optimization framework (ParMOO) and how they have been addressed. Finally, we provide two case studies demonstrating how customized ParMOO solvers can be quickly built and deployed to solve real-world MOSO problems.
engineering design optimization↗