Search NASA⌕ Search

SEARCH · Search NASA

Results for “generalized gradient approximations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

ABINIT: Overview and focus on selected capabilities

ABINIT is probably the first electronic-structure package to have been released under an open-source license about 20 years ago. It implements density functional theory, density-functional perturbation theory (DFPT), many-body perturbation theory (GW approximation and Bethe–Salpeter equation), and more specific or advanced formalisms, such as dynamical mean-field theory (DMFT) and the “temperature-dependent effective potential” approach for anharmonic effects. Relying on planewaves for the representation of wavefunctions, density, and other space-dependent quantities, with pseudopotentials or projector-augmented waves (PAWs), it is well suited for the study of periodic materials, although nanostructures and molecules can be treated with the supercell technique. The present article starts with a brief description of the project, a summary of the theories upon which ABINIT relies, and a list of the associated capabilities. It then focuses on selected capabilities that might not be present in the majority of electronic structure packages either among planewave codes or, in general, treatment of strongly correlated materials using DMFT; materials under finite electric fields; properties at nuclei (electric field gradient, Mössbauer shifts, and orbital magnetization); positron annihilation; Raman intensities and electro-optic effect; and DFPT calculations of response to strain perturbation (elastic constants and piezoelectricity), spatial dispersion (flexoelectricity), electronic mobility, temperature dependence of the gap, and spin-magnetic-field perturbation. The ABINIT DFPT implementation is very general, including systems with van der Waals interaction or with noncollinear magnetism. Community projects are also described: generation of pseudopotential and PAW datasets, high-throughput calculations (databases of phonon band structure, second-harmonic generation, and GW computations of bandgaps), and the library libpaw. ABINIT has strong links with many other software projects that are briefly mentioned.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The radial phase variation of reversed-shear and toroidicity-induced Alfvén eigenmodes in DIII-D

The eigenfunction of an instability contains information about energy flow in the wave. Here, the amplitude and phase of electron cyclotron emission radiometer data from hundreds of DIII-D reversed shear Alfvén eigenmodes (RSAE) and toroidicity-induced Alfvén eigenmodes (TAE) are analyzed along the outboard horizontal midplane. The radial phase profile can be flat, linearly rising or falling, convex or concave; in other words, a wide variety of shapes is observed. For a particular mode, often the radial phase profile remains approximately constant as the mode evolves in time but sometimes it changes rapidly. Many TAEs and some RSAEs have phase profiles that are rather flat where the mode amplitude is largest but rise steadily by ~2π at large major radius. Rapid phase changes are observed when the frequencies of an RSAE and TAE overlap and the modes couple. The phase profile depends weakly on the fast-ion gradient that would appear in the absence of wave-induced transport. Linear and quadratic fits to the phase profiles, together with many plasma parameters, are assembled into RSAE and TAE databases. In both cases, large variability is observed. For RSAEs, the strongest phase dependencies are on electron temperature T e , RSAE mode frequency, and the density of carbon impurities. For TAEs, the strongest dependencies are on beam power and major radius of the mode. In general, the average RSAE radial phase profile is essentially flat but the TAE profile has non-zero slope and curvature.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Machine learning-enabled discovery of ionic liquid–solvent electrolytes exhibiting high ionic conductivity

Ionic liquids (ILs), which are a class of materials with versatile nature and growing popularity, are facing impediments toward widespread usage as electrolytes due to various factors such as low ionic conductivity, high viscosity, high market price etc. One of the ways these limitations can be addressed is by mixing ILs with a molecular solvent. In a combinatorial sense, there exists an immense number of specific IL–solvent combinations. An exhaustive experimental or even simulation-based investigation of the chemical space spanned by such combinations can be extremely time-consuming, expensive, and nearly impossible. An alternative approach is to employ machine learning-based models developed from available databases. Although there exists prior literature that integrates machine learning to investigate mixtures of specific solvents with ILs, these models lack generalization necessitating development of a large number of ML models to handle various solvents. To remedy this shortcoming, as a part of designing green electrolytes with high ionic conductivity that can have potential applications in next-generation batteries and solar cells, this work aims to develop a unified machine learning model to predict ionic conductivity of any IL–solvent mixture system. In this regard, three models, namely, Random Forest, extreme gradient boosting (XGBoost), and artificial neural network (ANN) were formulated using the NIST ILThermo database. The dataset contained 549 unique ionic liquids from 16 cation families and 81 unique solvents, representing a total of 23 712 datapoints. SHAPLEY additive explanation (SHAP) method was used to assess the impact of various features on model prediction and their significance was compared with literature to gain physical insight about the model behavior. Finally, using the developed models, approximately 2.5 million IL–solvent mixtures at five different compositions were screened at room temperature. The high-throughput screening yielded nearly 19 000 IL–solvent mixtures for which ionic conductivity was found to exceed the ionic conductivity of conventional Li-ion battery electrolyte.

25 ENERGY STORAGE↗

Leveraging operator learning to accelerate convergence of the preconditioned conjugate gradient method

We propose a new deflation strategy to accelerate the convergence of the preconditioned conjugate gradient (PCG) method for solving parametric large-scale linear systems of equations. Unlike traditional deflation techniques that rely on eigenvector approximations or recycled Krylov subspaces, we generate the deflation subspaces using operator learning, specifically the Deep Operator Network (DeepONet). To this aim, we introduce two complementary approaches for assembling the deflation operators. The first approach approximates near-null space vectors of the discrete PDE operator using the basis functions learned by the DeepONet. The second approach directly leverages solutions predicted by the DeepONet. To further enhance convergence, we also propose several strategies for prescribing the sparsity pattern of the deflation operator. Here, a comprehensive set of numerical experiments encompassing steady-state, time-dependent, scalar, and vector-valued problems posed on both structured and unstructured geometries is presented and demonstrates the effectiveness of the proposed DeepONet-based deflated PCG method, as well as its generalization across a wide range of model parameters and problem resolutions.

Deflation↗

Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions

Here we propose a new type of neural networks, Kronecker neural networks (KNNs), that form a general framework for neural networks with adaptive activation functions. KNNs employ the Kronecker product, which provides an efficient way of constructing a very wide network while keeping the number of parameters low. Our theoretical analysis reveals that under suitable conditions, KNNs induce a faster decay of the loss than that by the feed-forward networks. This is also empirically verified through a set of computational examples. Furthermore, under certain technical assumptions, we establish global convergence of gradient descent for KNNs. As a specific case, we propose the Rowdy activation function that is designed to get rid of any saturation region by injecting sinusoidal fluctuations, which include trainable parameters. The proposed Rowdy activation function can be employed in any neural network architecture like feed-forward neural networks, Recurrent neural networks, Convolutional neural networks etc. The effectiveness of KNNs with Rowdy activation is demonstrated through various computational experiments including function approximation using feed-forward neural networks, solution inference of partial differential equations using the physics-informed neural networks, and standard deep learning benchmark problems using convolutional and fully-connected neural networks.

97 MATHEMATICS AND COMPUTING↗

Techno-economic feasibility of geothermal energy production using inactive oil and gas wells for district heating and cooling systems in Tuttle, Oklahoma

Oil and gas wells have been drilled in the United States and often encounter hot co-produced water possibly suitable for geothermal direct-use applications. Here this study evaluated geothermal resources, heating and cooling demand, and techno-economic potential of four oil and gas wells repurposed for geothermal energy production to serve two public schools and 250 nearby houses in Tuttle, Oklahoma, USA. Subsurface geology in the study area primarily consists of Permian to Mississippian sandstone and limestone formations approximately from 2 km to 3.5 km depth. With a geothermal gradient of 25.3 °C/km, the temperature of geothermal energy production was estimated as 68.2 °C at 2.1 km. The potential of calcite scaling within boreholes and pipes was minimal. Using the characterized reservoir properties, techno-economic analyses were conducted for evaluating levelized costs of geothermal energy production for direct-use heating and cooling and district heating systems with five different production scenarios. Heating and cooling demand in two schools and 250 houses and additional 0.3 MW and 0.6 MW base heating loads for potential geothermal direct-use applications in the study area were also incorporated in the modeling. Results indicated that the levelized cost of heating of geothermal district heating systems utilizing existing wells were significantly lower than those of conventional geothermal energy systems that include well drillings. The geothermal energy production with doublet and quartet configurations was generally sufficient to supply total annual heating demand in the district, while a peaking boiler was used to supply peak loads. Doublet configurations showed higher production temperature with a lower thermal drawdown than the quartet configurations. The doublet system at 2.1 km production depth with 9.3 kg/s flow rate represented the optimal levelized cost of $71/MWh and 91.2% utilization factor. These results imply that the Tuttle geothermal district heating system is techno-economically feasible and comparable to geothermal district heating systems in the United States and the regional natural gas rate for residentials by recycling inactive oil and gas wells with no drillings.

15 GEOTHERMAL ENERGY↗

Fully variational incremental CASSCF

We report the complete-active-space self-consistent field (CASSCF) method is a canonical electronic structure theory that holds a central place in conceptualizing and practicing first principles simulations. For application to realistic molecules, however, the CASSCF must be approximated to circumvent its exponentially scaling computational costs. Applying the many-body expansion - also known as the method of increments - to CASSCF (iCASSCF) has been shown to produce a polynomially scaling method that retains much of the accuracy of the parent theory and is capable of treating full valence active spaces. Due to an approximation made in the orbital gradient, the orbital parameters of the original iCASSCF formulation could not be variationally optimized, which limited the accuracy of its nuclear gradient. Herein, a variational iCASSCF is introduced and implemented, where all parameters are fully optimized during energy minimization. This method is able to recover electronic correlations from the full valence space in large systems, produce accurate gradients, and optimize stable geometries as well as transition states. Demonstrations on challenging test cases, such as the oxoMn(salen)Cl complex with 84 electrons in 84 orbitals and the automerization of cyclobutadiene, show that the fully variational iCASSCF is a powerful tool for describing challenging molecular chemistries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

Rain-Induced Stratification of the Equatorial Indian Ocean and Its Potential Feedback to the Atmosphere

Surface freshening through precipitation can act to stably stratify the upper ocean, forming a rain layer (RL). RLs inhibit subsurface vertical mixing, isolating deeper ocean layers from the atmosphere. This process has been studied using observations and idealized simulations. The present ocean modeling study builds upon this body of work by incorporating spatially resolved and realistic atmospheric forcing. Fine-scale observations of the upper ocean collected during the Dynamics of the Madden-Julian Oscillation field campaign are used to verify the General Ocean Turbulence Model (GOTM). Spatiotemporal characteristics of equatorial Indian Ocean RLs are then investigated by forcing a 2D array of GOTM columns with realistic and well-resolved output from an existing regional atmospheric simulation. RL influence on the ocean-atmosphere system is evaluated through analysis of RL-induced modification to surface fluxes and sea surface temperature (SST). This analysis demonstrates that RLs cool the ocean surface on time scales longer than the associated precipitation event. A second simulation with identical atmospheric forcing to that in the first, but with rainfall set to zero, is performed to investigate the role of rain temperature and salinity stratification in maintaining cold SST anomalies within RLs. Approximately one third, or 0.1°C, of the SST reduction within RLs can be attributed to rain effects, while the remainder is attributed to changes in atmospheric temperature and humidity. The prolonged RL-induced SST anomalies enhance SST gradients that have been shown to favor the initiation of atmospheric convection. These findings encourage continued research of RL feedbacks to the atmosphere.

54 ENVIRONMENTAL SCIENCES↗

Impacts of Varying Concentrations of Cloud Condensation Nuclei on Deep Convective Cloud Updrafts—A Multimodel Assessment

Abstract This study presents results from a model intercomparison project, focusing on the range of responses in deep convective cloud updrafts to varying cloud condensation nuclei (CCN) concentrations among seven state-of-the-art cloud-resolving models. Simulations of scattered convective clouds near Houston, Texas, are conducted, after being initialized with both relatively low and high CCN concentrations. Deep convective updrafts are identified, and trends in the updraft intensity and frequency are assessed. The factors contributing to the vertical velocity tendencies are examined to identify the physical processes associated with the CCN-induced updraft changes. The models show several consistent trends. In general, the changes between the High-CCN and Low-CCN simulations in updraft magnitudes throughout the depth of the troposphere are within 15% for all of the models. All models produce stronger (~+5%–15%) mean updrafts from ~4–7 km above ground level (AGL) in the High-CCN simulations, followed by a waning response up to ~8 km AGL in most of the models. Thermal buoyancy was more sensitive than condensate loading to varying CCN concentrations in most of the models and more impactful in the mean updraft responses. However, there are also differences between the models. The change in the amount of deep convective updrafts varies significantly. Furthermore, approximately half the models demonstrate neutral-to-weaker (~−5% to 0%) updrafts above ~8 km AGL, while the other models show stronger (~+10%) updrafts in the High-CCN simulations. The combination of the CCN-induced impacts on the buoyancy and vertical perturbation pressure gradient terms better explains these middle- and upper-tropospheric updraft trends than the buoyancy terms alone.

54 ENVIRONMENTAL SCIENCES↗

A machine learning approach for efficient multi-dimensional integration

Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Global stochastic optimization of stellarator coil configurations

In the construction of a stellarator, the manufacturing and assembling of the coil system is a dominant cost. These coils need to satisfy strict engineering tolerances, and if those are not met the project could be cancelled as in the case of the National Compact Stellarator Experiment (NCSX) project. Therefore, our goal is to find coil configurations that increase construction tolerances without compromising the performance of the magnetic field. In this paper, we develop a gradient-based stochastic optimization model which seeks robust stellarator coil configurations in high dimensions. In particular, we design a two-step method: first, we perform an approximate global search by a sample efficient trust-region Bayesian optimization; second, we refine the minima found in step one with a stochastic local optimizer. To this end, we introduce two stochastic local optimizers: BFGS applied to the sample average approximation; and Adam, equipped with a control variate for variance reduction. Numerical simulations performed on a W7-X-like coil configuration demonstrate that our global optimization approach finds a variety of promising local solutions at less than 0.1% of the cost of previous work, which considered solely local stochastic optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Coupled physics simulation of fracture in nuclear fuel pellets induced by resistive heating

While it is well known that the UO 2 fuel used in light-water reactors cracks early in its life in the reactor, it is very difficult to collect in-reactor data regarding fuel cracking initiation and propagation to validate fracture models in fuel performance codes. Most fracture data comes from the post-irradiation examination of fuel that has been subjected to long and complex power histories. Replicating the thermal gradients experienced in this fuel to study crack initiation and propagation in a laboratory environment is challenging. This is primarily because the fuel is heated volumetrically by fission, which is difficult to replicate. One way to approximate this volumetric heating out of the reactor is to use electrical resistance (or Joule heating). An electrical conductivity model has been developed and coupled with the existing thermomechanical modeling capability in the BISON nuclear fuel performance code. This will permit simulation of experiments that use resistive heating for the purpose of validating fracture models in BISON. The modeling approach developed here is applied to simulate both historical and current resistive heating experiments on ceramic nuclear fuel.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Optimization using pathwise algorithmic derivatives of electromagnetic shower simulations

Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Computing them via algorithmic differentiation typically does not require major manual analysis and rewriting of the code, even for very complex programs like simulations of particle-detector interactions in high-energy physics. However, the pathwise derivative estimator can be biased if there are discontinuities in the program, which may diminish its value for applications. This work integrates algorithmic differentiation into the electromagnetic shower simulation code HepEmShow based on G4HepEm, allowing us to study how well pathwise derivatives approximate derivatives of energy depositions in a sampling calorimeter with respect to parameters of the beam and geometry. We found that when multiple scattering is disabled in the simulation, means of pathwise derivatives converge quickly to their expected values, and these are close to the actual derivatives of the energy deposition. Additionally, we demonstrate the applicability of this novel gradient estimator for stochastic gradient-based optimization in a model example.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accurate prediction of core-level spectra of radicals at density functional theory cost via square gradient minimization and recoupling of mixed configurations

State-specific orbital optimized approaches are more accurate at predicting core-level spectra than traditional linear-response protocols, but their utility had been restricted due to the risk of "variational collapse" down to the ground state. We employ the recently developed square gradient minimization algorithm to reliably avoid variational collapse and study the effectiveness of orbital optimized density functional theory (DFT) at predicting second period element 1s core-level spectra of open-shell systems. Several density functionals (including SCAN, B3LYP, and ωB97X-D3) are found to predict excitation energies from the core to singly occupied levels with high accuracy (≤0.3 eV RMS error) against available experimental data. Higher excited states are, however, more challenging by virtue of being intrinsically multiconfigurational. We thus present a configuration interaction inspired route to self-consistently recouple single determinant mixed configurations obtained from DFT, in order to obtain approximate doublet states. This recoupling scheme is used to predict the C K-edge spectra of the allyl radical, the O K-edge spectra of CO + , and the N K-edge of NO 2 with high accuracy relative to experiment, indicating substantial promise in using this approach for the computation of core-level spectra for doublet species [vs more traditional time dependent DFT, equation of motion coupled cluster singles and doubles (EOM-CCSD), or using unrecoupled mixed configurations]. Finally, we also present general guidelines for computing core-excited states from orbital optimized DFT.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Persistent compositions of non-stoichiometric compounds with low bulk diffusivity: A theory and application to Nb3Sn superconductors

Non-stoichiometric compounds may develop a composition gradient when they are formed by reactive diffusional processes. This paper reports an interesting phenomenon that in compounds with low bulk diffusivities, which rely mainly on grain boundary diffusion for their growth, the final bulk compositions may be far from equilibrium, with a very low bulk diffusivity leading to fixed (persistent) compositions – one such example is Nb 3 Sn, a superconductor. We investigated the microchemistry at the reactive interface using atom probe tomography to clarify the diffusion reaction mechanism for this low-bulk-diffusivity case and thus propose a theory for what determines the compound composition, using Nb 3 Sn as an example for concreteness. Using certain approximations, we derive an explicit analytical equation that illustrates what factors determine its composition profile. We compare our model with the known facts of Nb 3 Sn and see good agreement. In particular, this model predicts that internal oxidation may lead to higher Sn contents than conventional, non-oxidized Nb 3 Sn. Our measurements show that this is indeed true, and that the internally-oxidized Nb 3 Sn also has higher upper critical fields, achieving up to 28.2 T at 4.2 K. We discuss the general applicability of this model to non-stoichiometric compounds with low bulk diffusivity, and propose it as a tool to help in the design and processing of such materials for compositional control.

36 MATERIALS SCIENCE↗

Nonlinear sparse Bayesian learning for physics-based models

This paper addresses the issue of overfitting while calibrating unknown parameters of over-parameterized physics-based models with noisy and incomplete observations. Here, a semi-analytical Bayesian framework of nonlinear sparse Bayesian learning (NSBL) is proposed to identify sparsity among model parameters during Bayesian inversion. NSBL offers significant advantages over machine learning algorithm of sparse Bayesian learning (SBL) for physics-based models, such as 1) the likelihood function or the posterior parameter distribution is not required to be Gaussian, and 2) prior parameter knowledge is incorporated into sparse learning (i.e. not all parameters are treated as questionable). NSBL employs the concept of automatic relevance determination (ARD) to facilitate sparsity among questionable parameters through parameterized prior distributions. The analytical tractability of NSBL is enabled by employing Gaussian ARD priors and by building a Gaussian mixture-model approximation of the posterior parameter distribution that excludes the contribution of ARD priors. Subsequently, type-II maximum likelihood is executed using Newton's method whereby the evidence and its gradient and Hessian information are computed in a semi-analytical fashion. We show numerically and analytically that SBL is a special case of NSBL for linear regression models. Subsequently, a linear regression example involving multimodality in both parameter posterior pdf and model evidence is considered to demonstrate the performance of NSBL in cases where SBL is inapplicable. Next, NSBL is applied to identify sparsity among the damping coefficients of a mass-spring-damper model of a shear building frame. These numerical studies demonstrate the robustness and efficiency of NSBL in alleviating overfitting during Bayesian inversion of nonlinear physics-based models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An extended variational method for the resistive wall mode in toroidal plasma confinement devices

The external-kink stability of a toroidal plasma surrounded by a rigid resistive wall is investigated. The well-known analysis of Haney and Freidberg is rigorously extended to allow for a wall that is sufficiently thick that the thin-shell approximation does not necessarily hold. A generalized Haney–Freidberg formula for the growth-rate of the resistive wall mode is obtained. Thick-wall effects do not change the marginal stability point of the mode but introduce an interesting asymmetry between growing and decaying modes. Growing modes have growth-rates that exceed those predicted by the original Haney–Freidberg formula. On the other hand, decaying modes have decay-rates that are less than those predicted by the original formula. The well-known Hu–Betti formula for the rotational stabilization of the resistive wall mode is also generalized to take thick-wall effects into account. Increasing wall thickness facilitates the rotational stabilization of the mode, because it decreases the critical toroidal electromagnetic torque that the wall must exert on the plasma. On the other hand, the real frequency of the mode at the marginal stability point increases with increasing wall thickness.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗