SEARCH · Search NASA

Results for “gradient based optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Macroscale property assessment and indentation characteristics of thick section friction stir welded AA 5083

The spatial gradients in microstructure have been proven to be effective in optimizing the performance of components, and several techniques have been developed to achieve this microstructure. Nevertheless, the local microstructural modification methods inevitably result in the formation of gradient microstructure leading to a variation in the property. Herein this work systematically investigates the effect of gradient microstructure formed during thick section friction stir weld Al5083 alloy on its mechanical properties. A novel macro-indentation technique, profilometer-based indentation plastometry (PIP), is utilized to capture the variation in the mechanical properties in the feedstock (rolled plate) and weld region. The feedstock exhibited a gradient microstructure owing to different stress states during rolling. Additionally, the stirring of the tool resulted in a complex material flow pattern producing a microstructure gradient in the weld region. The aspect ratio of the grains was identified as the primary factor causing variation in indentation response in the feedstock. In contrast, variation in the grain size in the weld region resulted in property variation. Overall, the stir zone has a lower yield strength (158±4MPa) than the base material (173±3MPa). In addition, microstructure heterogeneity in the stir zone resulted in lower elongation than the base material.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Deep Reinforcement Learning Based Control of Wind Turbines for Fast Frequency Response

In order to fulfill vital auxiliary grid services, such as load regulation, spin and non-spin reserve provision, and frequency support during emergencies, there is often a requirement for certain wind farms to operate in de-loaded modes. Leveraging the swift response capabilities of wind farms, this study demonstrates that reserving power in de-loaded modes can significantly enhance power grid stability and reliability during system contingencies. Controlling wind farms optimally for frequency support is intricate due to the nonlinearity of models and controllers and the complexity of wind farm interactions with power systems. Here, to address this challenge, this paper introduces a novel approach that integrates wind turbines into reinforcement learning-based solutions for frequency response. This innovative methodology utilizes the state-of-the-art reinforcement learning algorithm known as the surrogate-gradient-based evolutionary strategy. The proposed learning-based algorithm provides continuous control of wind farm output to rapidly stabilize system frequency and prevent unnecessary trips of under-frequency load shedding relays. To facilitate efficient training, parallel computing techniques are employed. The proposed methodology is evaluated on a modified IEEE-39 bus system, and simulation results reveal its efficacy in reliably supporting power system frequency and preventing the need for unnecessary load shedding.

Gao, Wei [Argonne National Laboratory (ANL), Argon↗

DOE OSTI2026

Controlling homogenization length scales and microstructure in additively manufactured Ti-Ta functionally graded materials

Materials with smooth compositional gradients or functionally grade materials (FGMs) produced via additive manufacturing (AM), enables joining dissimilar materials and optimizing multiple properties in advanced engineering applications. However, as-printed AM microstructures exhibit micro-segregation and solidification defects which, when combined with controlling macroscale gradient properties, complicates necessary post-processing. Here, we use CALPHAD-informed diffusion modelling to design post-processing heat treatments for lightweight to refractory FGMs. Ti-Ta (0 to 85 at. % Ta) FGMs were fabricated using laser-based directed energy deposition AM. Post-processing heat treatments at 1000° C and 1500° C were designed to promote homogenization across specific length scales and experimentally validated. Investigation of chemical segregation and microstructures demonstrated that the length scale of homogenization is controlled as a function of time, temperature, and local composition. Ta-rich regions exhibited incomplete homogenization compared to Ti-rich layers. Unmelted Ta particles were found to completely dissolve at 1500 °C. By controlling cooling rate (200 °C/min), martensitic structures were produced between 14–36 at. % Ta, consistent with martensite-start temperatures calculations, while furnace cooling (2 °C/min) produced α+β morphologies. This work establishes a validated predictive framework for designing post-processing to tailor microstructure and chemical architecture in AM FGMs, facilitating their deployment in demanding environments.

Materials science↗

NASA NTRS1999

Nanoporous Silica Thermal Insulation for Space Shuttle Cryogenic Tanks: A Case Study

Nanoporous silica (with typical 10-50 nm porous radii) has been benchmarked for thermal insulators capable of maintaining a 150 K/cm temperature gradient. For cryogenic use in aerospace applications, the combined features for low-density, high thermal insulation factors, and low temperature compatibility are demonstrated in a prototype sandwich structure between two propulsion tanks. Theoretical modelling based on a nanoscale fractal structure suggest that the thermal conductivity scales proportionally (exponent, 1.7) with the material density-lower density increases the thermal insulation rating. Computer simulations, however, support the optimization tradeoff between material strength (Young moduli, proportional to density with exponent, 3.7), the characteristic (colloidal silica, less than 5 nm) particle size, and the thermal rating. The results of these simulations indicate that as nanosized particles are incorporated into the silica backbone, the resulting physical properties will be tailored by the smallest characteristic length and their fractal interconnections (dimension and fractal size). The application specifies a prototype panel which takes advantage of the processing flexibility inherent in sol-gel chemistry.

Noever, David A.↗

NASA NTRS1994

Optimal active control for Burgers equations

A method for active fluid flow control based on control theory is discussed. Dynamic programming and fixed point successive approximations are used to accommodate the nonlinear control problem. The long-term goal of this project is to establish an effective method applicable to complex flows such as turbulence and jets. However, in this report, the method is applied to stochastic Burgers equation as an intermediate step towards this goal. Numerical results are compared with those obtained by gradient search methods.

Ikeda, Yutaka↗

DOE OSTI2024

A Hierarchical OPF Algorithm with Improved Gradient Evaluation in Three-Phase Networks

Linear approximation commonly used in solving alternating-current optimal power flow (AC-OPF) simplifies the system models but incurs accumulated voltage errors in large power networks. Such errors will make the primal-dual type gradient algorithms converge to solutions with voltage violation. In this paper, we improve a recent hierarchical OPF algorithm that rested on primal-dual gradients evaluated with a linearized distribution power flow model. Specifically, we propose a more accurate gradient evaluation method based on an unbalanced three-phase nonlinear distribution power flow model to mitigate the errors arising from linearization. The resultant gradients feature a blocked structure that enables our development of an improved hierarchical primal-dual algorithm to solve the OPF problem. Numerical results on the IEEE 123-bus test feeder and a 4,518-node test feeder show that the proposed method can enhance voltage safety at comparable computational efficiency with the linearized algorithm.

approximation algorithms↗

NASA NTRS2017

Composite Reflective Absorptive IR-Blocking Filters Embedded in Metamaterial Antireflection Coated Silicon

Infrared (IR)-blocking filters are crucial for controlling the radiative loading on cryogenic systems and for optimizing the sensitivity of bolometric detectors in the far-IR. We present a new IR filter approach based on a combination of patterned frequency-selective structures on silicon and a thin (2575 micron thick) absorptive composite based on powdered reststrahlen absorbing materials. For a 300 K blackbody, this combination reflects approximately 50% of the incoming light and blocks greater than.99.8% of the total power with negligible thermal gradients and excellent low-frequency transmission. This allows a reduction in the IR thermal loading to negligible levels in a single cold filter. These composite filters are fabricated on silicon substrates, which provide excellent thermal transport laterally through the filter and ensure that the entire area of the absorptive filter stays near the bath temperature. A metamaterial antireflection coating cut into these substrates reduces in-band reflections to below 1%, and the in-band absorption of the powder mix is below 1% for signal bands below 750 GHz. This type of filter can be directly incorporated into silicon refractive optical elements.

Munson, C. D.↗

DOE OSTI2024

Self‐Consistent Convolutional Density Functional Approximations: Application to Adsorption at Metal Surfaces

The exchange-correlation (XC) functional in density functional theory is used to approximate multi-electron interactions. A plethora of different functionals are available, but nearly all are based on the hierarchy of inputs commonly referred to as “Jacob's ladder.” This paper introduces an approach to construct XC functionals with inputs from convolutions of arbitrary kernels with the electron density, providing a route to move beyond Jacob's ladder. We derive the variational derivative of these functionals, showing consistency with the generalized gradient approximation (GGA), and provide equations for variational derivatives based on multipole features from convolutional kernels. A proof-of-concept functional, PBEq, which generalizes the PBEα framework with mathematical equation being a spatially-resolved function of the monopole of the electron density, is presented and implemented. It allows a single functional to use different GGAs at different spatial points in a system, while obeying PBE constraints. Analysis of the results underlines the importance of error cancellation and the XC potential in data-driven functional design. After testing on small molecules, bulk metals, and surface catalysts, the results indicate that this approach is a promising route to simultaneously optimize multiple properties of interest.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2004

Advanced SiC/SiC Ceramic Composites For Gas-Turbine Engine Components

NASA Glenn Research Center (GRC) is developing a variety of advanced SiC/SiC ceramic composite (ASC) systems that allow these materials to operate for hundreds of hours under stress in air at temperatures approaching 2700 F. These SiC/SiC composite systems are lightweight (approximately 30% metal density) and, in comparison to monolithic ceramics and carbon fiber-reinforced ceramic composites, are able to reliably retain their structural properties for long times under aggressive gas-turbine engine environments. The key for the ASC systems is related first to the NASA development of the Sylramic-iBN Sic fiber, which displays higher thermal stability than any other SiC- based ceramic fibers and possesses an in-situ grown BN surface layer for higher environmental durability. This fiber is simply derived from Sylramic Sic fiber type that is currently produced at ATK COI Ceramics (COIC). Further capability is then derived by using chemical vapor infiltration (CVI) and/or polymer infiltration and pyrolysis (PIP) to form a Sic-based matrix with high creep and rupture resistance as well as high thermal conductivity. The objectives of this study were (1) to optimize the constituents and processing parameters for a Sylramic-iBN fiber reinforced ceramic composite system in which the Sic-based matrix is formed at COIC almost entirely by PIP (full PIP approach), (2) to evaluate the properties of this system in comparison to other 2700 F Sylramic-iBN systems in which the matrix is formed by full CVI and CVI + PIP, and (3) to examine the pros and cons of the full PIP approach for fabricating hot-section engine components. A key goal is the development of a composite system with low porosity, thereby providing high modulus, high matrix cracking strength, high interlaminar strength, and high thermal conductivity, a major property requirement for engine components that will experience high thermal gradients during service. Other key composite property goals are demonstration at high temperatures of high environmental resistance and high creep resistance, which in turn will result in long component life. Data are presented from a variety of laboratory tests on simple two-dimensional panels that examine these properties and compare the performance of the optimized full PIP system with those of the full CVI and CVI + PIP hybrid systems. Underlying mechanisms for performance differences in the various systems are discussed. Remaining issues for further property enhancement and for application of the full PIP approach for engine components are also discussed, as well as on-going approaches at NASA to solve these issues.

H. M. Yun↗

NASA NTRS2011

Improvement of OMI Ozone Profile Retrievals in the Troposphere and Lower Troposphere by the Use of the Tropopause-Based Ozone Profile Climatology

An advance algorithm based on the optimal estimation technique has beeen developed to derive ozone profile from GOME UV radiances and have adapted it to OMI UV radiances. OMI vertical resolution : 7-11 km in the troposphere and 10-14 km in the stratosphere. Satellite ultraviolet measurements (GOME, OMI) contain little vertical information for the small scale of ozone, especially in the upper troposphere (UT) and lower stratosphere (LS) where the sharp O3 gradient across the tropopause and large ozone variability are observed. Therefore, retrievals depend greatly on the a-priori knowledge in the UTLS

Bak, Juseon↗

DOE OSTI2025

Modeling and design of compact, permanent-magnet transport systems for highly divergent, broad energy spread laser-driven proton beams

Laser-driven (LD) ion acceleration has been explored in a newly constructed short focal length laser beamline at the BELLA petawatt facility (interaction point 2, iP2). For applications utilizing such LD ion beams, a beam transport system is required, which for reasons of compactness be ideally contained within 3 m. While they are generated from a micron-scale source, large divergence and energy spread of LD ion beams present a unique challenge to transporting them compared to beams from conventional accelerators. This study gives an overview of proposed compact transport designs using permanent magnets satisfying different requirements depending on the application for the iP2 laser beamline such as radiation biology, material science, and high-energy density science. These designs are optimized for different parameters such as energy spread and peak proton density according to the application’s need. The various designs consist solely of permanent magnet elements, which can provide high magnetic field gradients on a small footprint. While the field strengths are fixed, we have shown that the beam size is able to be tuned effectively by varying the placement of the magnets. The performance of each design was evaluated based on high-order particle tracking simulations of typical LD proton beams. We also examine the ability of certain configurations to tune and select beam energies, critical for specific applications. A more detailed investigation was carried out for a design to deliver 10 MeV LD accelerated ions for radiation biology applications. With these transport system designs, the iP2 laser beamline is ready to house various application experiments.

43 PARTICLE ACCELERATORS↗

NASA NTRS2006

Adjoint Sensitivity Computations for an Embedded-Boundary Cartesian Mesh Method and CAD Geometry

Cartesian-mesh methods are perhaps the most promising approach for addressing the issues of flow solution automation for aerodynamic design problems. In these methods, the discretization of the wetted surface is decoupled from that of the volume mesh. This not only enables fast and robust mesh generation for geometry of arbitrary complexity, but also facilitates access to geometry modeling and manipulation using parametric Computer-Aided Design (CAD) tools. Our goal is to combine the automation capabilities of Cartesian methods with an eficient computation of design sensitivities. We address this issue using the adjoint method, where the computational cost of the design sensitivities, or objective function gradients, is esseutially indepeudent of the number of design variables. In previous work, we presented an accurate and efficient algorithm for the solution of the adjoint Euler equations discretized on Cartesian meshes with embedded, cut-cell boundaries. Novel aspects of the algorithm included the computation of surface shape sensitivities for triangulations based on parametric-CAD models and the linearization of the coupling between the surface triangulation and the cut-cells. The objective of the present work is to extend our adjoint formulation to problems involving general shape changes. Central to this development is the computation of volume-mesh sensitivities to obtain a reliable approximation of the objective finction gradient. Motivated by the success of mesh-perturbation schemes commonly used in body-fitted unstructured formulations, we propose an approach based on a local linearization of a mesh-perturbation scheme similar to the spring analogy. This approach circumvents most of the difficulties that arise due to non-smooth changes in the cut-cell layer as the boundary shape evolves and provides a consistent approximation tot he exact gradient of the discretized abjective function. A detailed gradient accurace study is presented to verify our approach. Thereafter, we focus on a shape optimization problem for an Apollo-like reentry capsule. The optimization seeks to enhance the lift-to-drag ratio of the capsule by modifyjing the shape of its heat-shield in conjunction with a center-of-gravity (c.g.) offset. This multipoint and multi-objective optimization problem is used to demonstrate the overall effectiveness of the Cartesian adjoint method for addressing the issues of complex aerodynamic design. This abstract presents only a brief outline of the numerical method and results; full details will be given in the final paper.

Nemec, Marian↗

DOE OSTI2026

Towards gradient multimaterial toolpath generation for direct ink writing with connected fermat spirals

This work describes advances towards a reproducible, parametrically defined algorithm for generating graded multimaterial toolpaths for direct ink writing. Expanding on the existing Fermat space-filling algorithm and coupling with image-driven processing techniques, we demonstrate the fabrication of multimaterial structures. Here, material composition is encoded within toolpaths by parsing hue values from a multi-colored image. By performing dynamic velocity compensation based on local curvature and Euclidean distance filtering, internal voids are mitigated while optimizing print fidelity. Here, the work opens new avenues for designing complex toolpaths with locally programmable composition.

3D Printing↗

DOE OSTI2023

AlignOT: An Optimal Transport Based Algorithm for Fast 3D Alignment With Applications to Cryogenic Electron Microscopy Density Maps

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being potentially stuck in local minima, we propose here a new procedure, called AlignOT, which relies on the use of computational optimal transport (OT) to align EM maps in 3D space. By embedding a fast estimation of OT maps within a stochastic gradient descent algorithm, our method searches for a rotation that minimizes the Wasserstein distance between two maps, represented as point clouds. Here, we quantify the impact of various parameters on the precision and accuracy of the alignment, and show that AlignOT can outperform the standard local alignment methods, with an increased range of rotation angles leading to proper alignment. We further benchmark AlignOT on various pairs of experimental maps, which account for different types of conformational heterogeneities and geometric properties. As our experiments show good performance, we anticipate that our method can be broadly applied to align 3D EM maps.

3D alignment↗

DOE OSTI2022

Optimizing process-based models to predict current and future soil organic carbon stocks at high-resolution

From hillslope to small catchment scales (< 50 km 2 ), soil carbon management and mitigation policies rely on estimates and projections of soil organic carbon (SOC) stocks. Here we apply a process-based modeling approach that parameterizes the MIcrobial-MIneral Carbon Stabilization (MIMICS) model with SOC measurements and remotely sensed environmental data from the Reynolds Creek Experimental Watershed in SW Idaho, USA. Calibrating model parameters reduced error between simulated and observed SOC stocks by 25%, relative to the initial parameter estimates and better captured local gradients in climate and productivity. The calibrated parameter ensemble was used to produce spatially continuous, high-resolution (10 m 2 ) estimates of stocks and associated uncertainties of litter, microbial biomass, particulate, and protected SOC pools across the complex landscape. Here, subsequent projections of SOC response to idealized environmental disturbances illustrate the spatial complexity of potential SOC vulnerabilities across the watershed. Parametric uncertainty generated physicochemically protected soil C stocks that varied by a mean factor of 4.4 × across individual locations in the watershed and a – 14.9 to + 20.4% range in potential SOC stock response to idealized disturbances, illustrating the need for additional measurements of soil carbon fractions and their turnover time to improve confidence in the MIMICS simulations of SOC dynamics.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Building thermal load prediction through shallow machine learning and deep learning

Building thermal load prediction informs the optimization of cooling plant and thermal energy storage. Physics-based prediction models of building thermal load are constrained by the model and input complexity. In this study, we developed 12 data-driven models (7 shallow learning, 2 deep learning, and 3 heuristic methods) to predict building thermal load and compared shallow machine learning and deep learning. The 12 prediction models were compared with the measured cooling demand. It was found XGBoost (Extreme Gradient Boost) and LSTM (Long Short Term Memory) provided the most accurate load prediction in the shallow and deep learning category, and both outperformed the best baseline model, which uses the previous day's data for prediction. Then, we discussed how the prediction horizon and input uncertainty would influence the load prediction accuracy. Major conclusions are twofold: first, LSTM performs well in short-term prediction (1 h ahead) but not in long term prediction (24 h ahead), because the sequential information becomes less relevant and accordingly not so useful when the prediction horizon is long. Second, the presence of weather forecast uncertainty deteriorates XGBoost's accuracy and favors LSTM, because the sequential information makes the model more robust to input uncertainty. Training the model with the uncertain rather than accurate weather data could enhance the model's robustness. Finally, our findings have two implications for practice. First, LSTM is recommended for short-term load prediction given that weather forecast uncertainty is unavoidable. Second, XGBoost is recommended for long term prediction, and the model should be trained with the presence of input uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

torch-einshard v1.0

torch-einshard is a Python library for describing local and distributed PyTorch tensor computations with compact, einsum-like notation. Its expressions name logical axes, specify how they are sharded across a PyTorch DeviceMesh, and represent partial reductions. The library automatically performs contractions, permutations, reshaping, splitting, gathering, reduction, reduce-scatter, and repartitioning while preserving autograd. Additional features include sharding-aware FFTs, tensor rolls, halo exchange, sliding windows, 1D–3D convolutions, uneven-shard handling, parameter initialization and gradient management, and cost-based execution planning. It is designed for scientific machine learning and large-model workloads, including tensor-, sequence-, and spatial-parallel MLPs, attention, convolutions, and spectral operations. Compared with manually combining torch.einsum and distributed collectives, torch-einshard expresses both the mathematical operation and data placement in one readable formula. This reduces boilerplate and synchronization errors, keeps forward and backward communication consistent, and allows the library to select optimized collective strategies without changing model code.

Morozov, Dmitriy [Lawrence Berkeley National Labor↗