Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient based optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Optimized Machine Learning Model for Predicting Groundwater Contamination

The use of physical models to predict groundwater contaminant movement remains technically challenging due to the complexity of the phenomena, the heterogeneity of key parameters in nature, and the presence of poorly defined interactive and feedback processes. New approaches to address these challenges are needed. In this study, we evaluate various Artificial Intelligence (AI)-based approaches to understand a hexavalent chromium (Cr(VI)) plumes located on the U.S. Department of Energy’s (DOE) Hanford Site in Richland, WA. The groundwater monitoring dataset used in this study included data from the 100 Area along the Columbia River and included data collected between 2010 to 2019. This study investigates the most prominent contaminant, Cr(VI), with the Extreme Gradient Boosting (XGBoost) machine learning model. The XGBoost models were compared with optimized versions using an Empirical Bayes Search Cross-Validation technique for better prediction. The optimized XGBoost model yielded an R^2 value of 0.99 on the training set and 0.85 on the testing set, whereas XGBoost without optimization yielded a value of 0.83 on the training set and 0.85 on the testing set. This paper provides an overview of a computational method for groundwater contamination modeling that shows promise for improving current remediation efforts.

Mazumdar, Hirak↗
DOE OSTI2026

Multinuclear Solid-State NMR and NMR Crystallography of Solid Forms of Creatine and Creatinine

Creatine is a performance-enhancing supplement with two widely available commercial solid forms, namely, creatine monohydrate (creatine·H 2 O) and creatine HCl, the latter of which does not have a reported crystal structure. Moreover, commercial formulations of creatine may contain creatinine, an undesired impurity phase resulting from the self-cyclization of creatine during manufacturing. Therefore, reliable methods for characterizing the different solid forms of creatine and detecting the presence of creatinine are essential. Herein, we address these challenges using 13 C, 15 N, and 35 Cl solid-state NMR (SSNMR) spectroscopy to obtain distinct spectral fingerprints for creatine·H 2 O and creatine HCl, along with creatinine and creatinine HCl. The acquisition of these SSNMR spectra offers a robust approach for both the rapid characterization of each solid form and the detection of the impurity phases. Additionally, quadrupolar NMR crystallography-guided crystal structure prediction (QNMRX-CSP) was applied for the de novo crystal structure determination of creatine HCl, which was validated by the subsequently determined single-crystal X-ray diffraction (SCXRD) structure. Finally, to investigate the relationship between NMR parameters and structural features, 13 C and 15 N chemical shifts and 35 Cl electric field gradient (EFG) tensors were computed from geometry-optimized structures of the four solid forms by using dispersion-corrected DFT-D2* methods. Finally, this integrative approach offers a powerful framework for advancing the structural understanding and quality control of creatine-based supplements and next-generation formulations, as well as a wide range of other solid pharmaceuticals and nutraceuticals.

NMR↗
DOE OSTI2021

Reduced scaling formulation of CASPT2 analytical gradients using the supporting subspace method

We present a reduced scaling and exact reformulation of state specific complete active space second-order perturbation (CASPT2) analytical gradients in terms of the MP2 and Fock derivatives using the supporting subspace method. This work follows naturally from the supporting subspace formulation of the CASPT2 energy in terms of the MP2 energy using dressed orbitals and Fock builds. For a given active space configuration, the terms corresponding to the MP2-gradient can be evaluated with O(N5) operations, while the rest of the calculations can be computed with O(N3) operations using Fock builds, Fock gradients, and linear algebra. When tensor-hyper-contraction is applied simultaneously, the computational cost can be further reduced to O(N4) for a fixed active space size. The new formulation enables efficient implementation of CASPT2 analytical gradients by leveraging the existing graphical processing unit (GPU)-based MP2 and Fock routines. We present benchmark results that demonstrate the accuracy and performance of the new method. Example applications of the new method in ab initio molecular dynamics simulation and constrained geometry optimization are given.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1982

Nonlinear optimization with linear constraints using a projection method

Nonlinear optimization problems that are encountered in science and industry are examined. A method of projecting the gradient vector onto a set of linear contraints is developed, and a program that uses this method is presented. The algorithm that generates this projection matrix is based on the Gram-Schmidt method and overcomes some of the objections to the Rosen projection method.

Fox, T.↗
NASA NTRS2015

Strategic Planning of Efficient Oceanic Flights

The efficiency of oceanic flights is low due to limited navigational and communication equipment, congestion and airspace restrictions. The availability of Automated Dependent Surveillance-Broadcast (ADS-B) and other improvements provides opportunity for better strategic planning of trajectories. Transatlantic flights between US and Europe constitute one of the busiest oceanic airspace regions in the world. This paper examines the benefits of a wind-optimal trajectory concept with a strategic de-confliction component compared to the current flight planning using the North Atlantic Tracks. The methodology generates a wind-optimal route for each aircraft and a strategic reduction in the potential conflicts between aircraft by a combination of small adjustments to departure times and rerouting. The de-confliction is achieved by optimization techniques involving simulated annealing with local gradient searching. The fuel burn for the tracks in today's Organized Track System are compared with the corresponding quantities for the wind-optimized routes to evaluate the potential benefits of flying wind-optimal routes in North Atlantic Airspace. The analysis is based on air traffic between US and Europe during July 2012. The potential fuel savings depend on existing inefficiencies in current flight plans, atmospheric conditions and location of the city-pairs. The paper provides both aggregate results and detailed examination of some of the most popular city-pairs. Results show that strategic planning can improve the efficiency of flight trajectories by 3 to 5 depending on city-pairs and aircraft type. This translates into a potential fuel savings in the range of (420-970) kg per flight for a Boeing 767-300, the most widely used aircraft between the city-pairs in this study.

oceanic operations↗
NASA NTRS2003

Processing and Properties of HfB2 Based Materials

Contents include the following: Modified hot pressing schedule has significantly improved UHTC billet processing: density and microstructure uniformity have improved. 2 in. dia. x 2 in. tall UHTC billets have been successfully hot pressed: scaled up billets have slightly higher density gradients axially than 1 in. billets. Hot press schedule has not been optimized for scaled up billets. Strengths and strength distributions are improving with experience: need to evaluate strength uniformity in the center of the billets. CTE or ARC materials compares favorably with heritage materials. Thermal conductivity of ARC materials considerably different than that of heritage materials.

Johnson, Sylvia M.↗
DOE OSTI2025

Learning with Adaptive Conservativeness for Distributionally Robust Optimization: Incentive Design for Voltage Regulation

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg game-theoretic framework, where the DSO seeks to overcome the information asymmetry and refine its incentive strategies by learning from DERA behavior over multiple iterations. We introduce a model-based online learning algorithm for the DSO, aimed at inferring the relationship between incentives and DERA responses. Given the uncertain nature of these responses, we also propose a distributionally robust incentive design model to control the probability of voltage regulation failure and then reformulate it into a convex problem. This model allows the DSO to periodically revise distribution assumptions on uncertain parameters in the decision model of the DERA. Finally, we present a gradient-based method that permits the DSO to adaptively modify its conservativeness level, measured by the size of a Wasserstein metric-based ambiguity set, according to historical voltage regulation performance. The effectiveness of our proposed method is demonstrated through numerical experiments.

adaptation models↗
DOE OSTI2023

Partial Least Squares, Experimental Design, and Near-Infrared Spectrophotometry for the Remote Quantification of Nitric Acid Concentration and Temperature

Near-infrared spectrophotometry and partial least squares regression (PLSR) were evaluated to create a pleasantly simple yet effective approach for measuring HNO3 concentration with varying temperature levels. A training set, which covered HNO3 concentrations (0.1–8 M) and temperature (10–40 °C), was selected using a D-optimal design to minimize the number of samples required in the calibration set for PLSR analysis. The top D-optimal-selected PLSR models had root mean squared error of prediction values of 1.4% for HNO 3 and 4.0% for temperature. The PLSR models built from spectra collected on static samples were validated against flow tests including HNO 3 concentration and temperature gradients to test abnormal conditions (e.g., bubbles) and the model performance between sample points in the factor space. Based on cross-validation and prediction modeling statistics, the designed near-infrared absorption approach can provide remote, quantitative analysis of HNO 3 concentration and temperature for production-oriented applications in facilities where laser safety challenges would inhibit the implementation of other optical techniques (e.g., Raman spectroscopy) and in which space, time, and/or resources are constrained. The experimental design approach effectively minimized the number of samples in the training set and maintained or improved PLSR model performance, which makes the described chemometric approach more amenable to nuclear field applications.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRS2014

Human Outer Solar System Exploration via Q-Thruster Technology

Propulsion technology development efforts at the NASA Johnson Space Center continue to advance the understanding of the quantum vacuum plasma thruster (QThruster), a form of electric propulsion. Through the use of electric and magnetic fields, a Q-thruster pushes quantum particles (electrons/positrons) in one direction, while the Qthruster recoils to conserve momentum. This principle is similar to how a submarine uses its propeller to push water in one direction, while the submarine recoils to conserve momentum. Based on laboratory results, it appears that continuous specific thrust levels of 0.4 - 4.0 N/kWe are achievable with essentially no onboard propellant consumption. To evaluate the potential of this technology, a mission analysis tool was developed utilizing the Generalized Reduced Gradient non-linear parameter optimization engine contained in the Microsoft Excel® platform. This tool allowed very rapid assessments of "Q-Ship" minimum time transfers from earth to the outer planets and back utilizing parametric variations in thrust acceleration while enforcing constraints on planetary phase angles and minimum heliocentric distances. A conservative Q-Thruster specific thrust assumption (0.4 N/kWe) combined with "moderate" levels of space nuclear power (1 - 2 MWe) and vehicle specific mass (45 - 55 kg/kWe) results in continuous milli-g thrust acceleration, opening up realms of human spaceflight performance completely unattainable by any current systems or near-term proposed technologies. Minimum flight times to Mars are predicted to be as low as 75 days, but perhaps more importantly new "retro-phase" and "gravity-augmented" trajectory shaping techniques were revealed which overcome adverse planetary phasing and allow virtually unrestricted departure and return opportunities. Even more impressively, the Jovian and Saturnian systems would be opened up to human exploration with round-trip times of 21 and 32 months respectively including 6 to 12 months of exploration at the destinations. Finally, interstellar trip times are assessed at milli-g acceleration levels.

Joosten, B. Kent↗
NASA NTRS2004

Using the GeoFEST Faulted Region Simulation System

GeoFEST (the Geophysical Finite Element Simulation Tool) simulates stress evolution, fault slip and plastic/elastic processes in realistic materials, and so is suitable for earthquake cycle studies in regions such as Southern California. Many new capabilities and means of access for GeoFEST are now supported. New abilities include MPI-based cluster parallel computing using automatic PYRAMID/Parmetis-based mesh partitioning, automatic mesh generation for layered media with rectangular faults, and results visualization that is integrated with remote sensing data. The parallel GeoFEST application has been successfully run on over a half-dozen computers, including Intel Xeon clusters, Itanium II and Altix machines, and the Apple G5 cluster. It is not separately optimized for different machines, but relies on good domain partitioning for load-balance and low communication, and careful writing of the parallel diagonally preconditioned conjugate gradient solver to keep communication overhead low. Demonstrated thousand-step solutions for over a million finite elements on 64 processors require under three hours, and scaling tests show high efficiency when using more than (order of) 4000 elements per processor. The source code and documentation for GeoFEST is available at no cost from Open Channel Foundation. In addition GeoFEST may be used through a browser-based portal environment available to approved users. That environment includes semi-automated geometry creation and mesh generation tools, GeoFEST, and RIVA-based visualization tools that include the ability to generate a flyover animation showing deformations and topography. Work is in progress to support simulation of a region with several faults using 16 million elements, using a strain energy metric to adapt the mesh to faithfully represent the solution in a region of widely varying strain.

Geophyical Finite Element Simulation Tool (GeoFEST↗
DOE OSTI2022

Scalable and accurate multi-GPU-based image reconstruction of large-scale ptychography data

Abstract While the advances in synchrotron light sources, together with the development of focusing optics and detectors, allow nanoscale ptychographic imaging of materials and biological specimens, the corresponding experiments can yield terabyte-scale volumes of data that can impose a heavy burden on the computing platform. Although graphics processing units (GPUs) provide high performance for such large-scale ptychography datasets, a single GPU is typically insufficient for analysis and reconstruction. Several works have considered leveraging multiple GPUs to accelerate the ptychographic reconstruction. However, most of these works utilize only the Message Passing Interface to handle the communications between GPUs. This approach poses inefficiency for a hardware configuration that has multiple GPUs in a single node, especially while reconstructing a single large projection, since it provides no optimizations to handle the heterogeneous GPU interconnections containing both low-speed (e.g., PCIe) and high-speed links (e.g., NVLink). In this paper, we provide an optimized intranode multi-GPU implementation that can efficiently solve large-scale ptychographic reconstruction problems. We focus on the maximum likelihood reconstruction problem using a conjugate gradient (CG) method for the solution and propose a novel hybrid parallelization model to address the performance bottlenecks in the CG solver. Accordingly, we have developed a tool, called PtyGer ( Pty chographic G PU(multipl e )-based r econstruction), implementing our hybrid parallelization model design. A comprehensive evaluation verifies that PtyGer can fully preserve the original algorithm’s accuracy while achieving outstanding intranode GPU scalability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optimal Control of SOEC-Based Hydrogen Production Systems for Demand Response Using Deep Reinforcement Learning in Smart Grids

Solid oxide electrolysis cell (SOEC) hydrogen production technology can range in size from small, appliance-size equipment to large-scale, central production facilities that can be tied directly to renewable or non-greenhouse-gas-emitting forms of electricity production, making it an ideal resource for demand response (DR). The SOEC hydrogen production system is a complex integrated system that encompasses fluid dynamics, electrical dynamics, and electrochemical and thermal dynamics, all of which involve non-linearity and non-convexity. Proper control of the SOEC hydrogen production system is crucial to enable its participation in the DR program. Here, to overcome the difficulty of designing an explicit control law for such nonlinear systems with nonconvex optimization features in DR applications, deep reinforcement learning (DRL) is explored to achieve the optimal control of the SOEC system for DR participation. Specifically, a twin delayed deterministic policy gradient (TD3) control framework is applied to achieve optimal response performance during DR events by considering power tracking error and hydrogen production efficiency with a suitable reward function. Two case studies with grid connections for tracking different DR commands were investigated. The first case study involved operating conditions reaching the boundaries, while the second involved operating conditions within the boundaries. The results showed that the proposed DRL-based control for SOEC can track the DR signal in a timely manner while maintaining high energy efficiency.

08 HYDROGEN↗
NASA NTRS2002

Particle Segregation in a Flowing Suspension Subject to High-Gradient Strong Electric Fields

The widespread use of electro-hydrodynamic devices and processes emphasizes a critical need for developing a comprehensive predictive theory capable of improving our fundamental understanding of the behavior of a suspension subject to an AC electric field and shear, and of facilitating the design and optimization of such devices. The currently favored approach to the qualitative interpretation of the AC field driven manipulation of suspensions is based on a model which considers only the force exerted on a single particle by an external field and neglects the field-induced and hydrodynamic interparticle interactions both being inversely proportional to the interparticle distance raised to the power three. On the other hand, the purpose of the field-induced separation is to concentrate particles in certain regions of a device. This clearly raises the fundamental question regarding the extent to which we can neglect these slow decaying electrical and hydrodynamic collective interactions and rely on the predictions of a single-particle model. Another important issue that still remains open is how to characterize the polarization of a particle exposed to a strong electric field. The presentation will address both these questions. Experiments were conducted in a parallel-plate channel in which a 10(exp -3) (v/v) suspension of heavy, positively polarized Al2O3 spheres was exposed to an AC field under conditions such that the field lines were arranged in the channel cross-section perpendicular to the streamlines of the main flow. To reduce the effects of the gravitational settling of the particles, the channel was slowly rotated (4 rpm) around a horizontal axis. Following the application of a high-gradient strong AC field (approx. kV/mm), the particles were found to move towards both the high-voltage (HV) and grounded (GR) electrodes and to form 'bristles' along their edges.

Acrivos, Andreas↗
NASA NTRS1986

Guidance strategies for near-optimum take-off performance in a windshear

This paper is concerned with guidance strategies for near-optimum performance in a windshear. This is a wind characterized by sharp change in intensity and direction over a relatively small region of space. The take-off problem is considered with reference to flight in a vertical plane. First, trajectories for optimum performance in a windshear are determined for different windshear models and different windshear intensities. Use is made of the methods of optimal control theory in conjunction with the dual sequential gradient-restoration algorithm (DSGRA) for optimal control problems. In this approach, global information on the wind flow field is needed. Then, guidance strategies for near-optimum performance in a windshear are developed, starting from the optimal trajectories. Specifically, three guidance schemes are presented: (1) gamma guidance, based on the relative path inclination; (2) theta guidance, based on the pitch attitude angle; and (3) acceleration guidance, based on the relative acceleration. In this approach, local information on the wind flow field is needed.

Miele, A.↗
DOE OSTI2025

Criticality analysis of nuclear binding energy neural networks

Machine learning methods, in particular deep learning methods such as artificial neural networks (ANNs) with many layers, have become widespread and useful tools in nuclear physics. However, these ANNs are typically treated as ‘black boxes’, with their architecture (width, depth, and weight/bias initialization) and the training algorithm and parameters chosen empirically by optimizing learning based on limited exploration. We test a non-empirical approach to understanding and optimizing nuclear physics ANNs by adapting a criticality analysis based on renormalization group flows in terms of the hyperparameters for weight/bias initialization, training rates, and the ratio of depth to width. This treatment utilizes the statistical properties of neural network initialization to find a generating functional for network outputs at any layer, allowing for a path integral formulation of the ANN outputs as a Euclidean statistical field theory. We use a prototypical example to test the applicability of this approach: a simple ANN for nuclear binding energies. We find that with training using a stochastic gradient descent optimizer, the predicted criticality behavior is realized, and optimal performance is found with critical tuning. However, the use of an adaptive learning algorithm leads to somewhat superior results without concern for tuning and thus obscures the analysis. Nevertheless, the criticality analysis offers a way to look within the black box of ANNs, which is a first step towards potential improvements in network performance beyond using adaptive optimizers.

artificial neural network↗
DOE OSTI2024

Stochastic average model methods

We consider the solution of finite-sum minimization problems, such as those appearing in nonlinear least-squares or general empirical risk minimization problems. We are motivated by problems in which the summand functions are computationally expensive and evaluating all summands on every iteration of an optimization method may be undesirable. Here we present the idea of stochastic average model (SAM) methods, inspired by stochastic average gradient methods. SAM methods sample component functions on each iteration of a trust-region method according to a discrete probability distribution on component functions; the distribution is designed to minimize an upper bound on the variance of the resulting stochastic model. We present promising numerical results concerning an implemented variant extending the derivative-free model-based trust-region solver POUNDERS, which we name SAM-POUNDERS.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Performance and Energy Study of GPU-Resident Preconditioners for Conjugate Gradient Solvers: In the Context of Existing and Novel Approaches

Optimizing a particular subprogram out of the set of Basic (sparse) Linear Algebra Subprograms (BLAS) for a given architecture is a common topic of research. In applications, however, these BLAS functions rarely appear in isolation; usually, many of them are used together, in various combinations and with varying inputs. As the need to solve a large, sparse linear system is ubiquitous throughout HPC applications, linear solvers constitute a realistic, sufficiently complex and well-defined representative use case for composite BLAS routines. To this end, based on a representative set of matrices drawn from a diverse set of fields, we present a framework to study, from the performance and energy perspective, the efficacy of GPU- resident parallel Conjugate Gradient (CG) linear solver with different preconditioner options, including Gauss-Seidel, Jacobi, and incomplete Cholesky. We also propose a novel GPU-based preconditioner, in which the triangular solves are approximated by an iterative process. The development of this preconditioner was motivated by solving large graph Laplacian linear systems, for which the existing preconditioners either perform slow on GPU-based platforms or are not applicable. We compare the performance of these preconditioners on different hardware accelerator architectures, i.e., AMD MI250X, MI100, Nvidia A100, V100, and Jetson. Our experiments reveal performance trade-offs and provide information on how to select the best strategy for the given linear system, dictated by its properties, and the platform of interest. We demonstrate the application of our novel preconditioner for solving CG and graph Laplacian systems. Overall, the framework can be utilized as a benchmark to guide informed decisions in choosing a specific preconditioner, i.e., whether it is better to rely on the performance of a triangular solver or on the performance of sparse matrix-vector product. Finally, by considering power consumption to solve the linear systems, we report the energy footprint for the solvers.

Preconditioned Conjugate Gradient, GPUs, iterative↗
DOE OSTI2021

Nonlinear Matrix Approximation with Radial Basis Function Components

We introduce and investigate matrix approximation by decomposition into a sum of radial basis function (RBF) components. An RBF component is a generalization of the outer product between a pair of vectors, where an RBF function replaces the scalar multiplication between individual vector elements. Even though the RBF functions are positive definite, the summation across components is not restricted to convex combinations and allows us to compute the decomposition for any real matrix that is not necessarily symmetric or positive definite. We formulate the problem of seeking such a decomposition as an optimization problem with a nonlinear and non-convex loss function. Several modern versions of the gradient descent method, including their scalable stochastic counterparts, are used to solve this problem. We provide extensive empirical evidence of the effectiveness of the RBF decomposition and that of the gradient-based fitting algorithm. While being conceptually motivated by singular value decomposition (SVD), our proposed nonlinear counterpart outperforms SVD by drastically reducing the memory required to approximate a data matrix with the same L2 error for a wide range of matrix types. For example, it leads to 2 to 6 times memory save for Gaussian noise, graph adjacency matrices, and kernel matrices. Moreover, this proximity-based decomposition can offer additional interpretability in applications that involve, e.g., capturing the inner low-dimensional structure of the data, retaining graph connectivity structure, and preserving the acutance of images.

Rebrova, Elizaveta↗