Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

STEMDL

The code "STEMDL" provides highly-optimized multi-gpu implementations of DL models of applicability in electron microscopy via the use of mixed-precision arithmetic, native graph construction and evaluation in Tensorflow, and adaptive scaling of learning parameters to avoid numerical instabilities due to reduced precision. STEMDL also uses low-level methods from the Horovod library for gradient communication and reduction and adds an additional optimization by allowing the user to scheduling the gradient reduction operations based on their position within the layers of a neural net. STEMDL provides optimized I/O routines for data staging and data reading/writing in both Tensorflow and Pytorch using multi-processing and asynchronous transfer between host and device. .

Laanait, Nouamane↗

Stochastic minibatch approach to the ptychographic iterative engine

The ptychographic iterative engine (PIE) is a widely used algorithm that enables phase retrieval at nanometer-scale resolution over a wide range of imaging experiment configurations. By analyzing diffraction intensities from multiple scanning locations where a probing wavefield interacts with a sample, the algorithm solves a difficult optimization problem with constraints derived from the experimental geometry as well as sample properties. The effectiveness at which this optimization problem is solved is highly dependent on the ordering in which we use the measured diffraction intensities in the algorithm, and random ordering is widely used due to the limited ability to escape from stagnation in poor-quality local solutions. In this study, we introduce an extension to the PIE algorithm that uses ideas popularized in recent machine learning training methods, in this case minibatch stochastic gradient descent. Our results demonstrate that these new techniques significantly improve the convergence properties of the PIE numerical optimization problem.

47 OTHER INSTRUMENTATION↗

Scalable Second Order Optimization for Machine Learning

Many machine learning (ML) training tasks are essentially optimization processes that would at first glance appear eminently parallelizable and scalable. However, effective acceleration of these tasks with scalable parallel hardware has proven to be elusive. While standard methods for machine learning, e.g., stochastic gradient descent (SGD) for DNNs, tend to be resource efficient, they appear to be fundamentally sequential in nature.

97 MATHEMATICS AND COMPUTING↗

Beyond Magic Barrels: Digital manufacturing for crystallization, process development and optimization of explosive materials: Part II Resveratrol Exemplar

This SAND report summarizes work supported by an Engineering Sciences Research Foundation (ESRF) Lab Directed Research and Development (LDRD) project entitled “Beyond Magic Barrels: Digital manufacturing for crystallization, process development and optimization of explosive materials.” This SAND report is written in two parts with Part 1 discusses recrystallization of our explosive exemplar and Part 2 summarizing our work with recrystallization of resveratrol. We have studied resveratrol recrystallization with a multiscale approach combining experiments, modeling and simulation. At the single crystal scale, microscopy experiments illuminate crystal time-dependent growth rates using advanced image analysis. Bench scale experiments were carried out to look at growth of multiple particles in a small reactor creating thousands of particles and analyzing the results with microscopy and μCT. For the modeling we combine kinetic Monte Carlo (kMC) models with subscale information from density functional theory (DFT) or molecular dynamics. This work is discussed in Part 1 and can also be found in a paper from the project discussing a coarse-grained kMC model specifically developed for resveratrol. For well-mixed systems, we have population balance equations (PBE) linked with species mass conservation forming a set of ordinary differential equations that can be solved quickly. For more complicated geometries, such as the vat crystallization used throughout the complex, a coupled computational fluid dynamic (CFD)/PBE method was developed to account for gradients in temperature and concentration and differences in crystallization rates throughout the domain. These simulations are more complex and require high performance computing. We present results for two cases: 5% seed fast cool with parameters fit to the well-mixed case and 5% seed slow cool using the same parameters. We show reasonable agreement with experiments though are particles are significantly larger than the experiments.

36 MATERIALS SCIENCE↗

ISOTHERMAL AIR INGRESS VALIDATION EXPERIMENTS AT IDAHO NATIONAL LABORATORY: DESCRIPTION AND SUMMARY OF DATA

Idaho National Laboratory performed air ingress experiments as part of validating computational fluid dynamics code (CFD). An isothermal stratified flow experiment was designed and set to understand stratified flow phenomena in the very high temperature gas cooled reactor (VHTR) and to provide experimental data for validating computer codes. The isothermal experiment focused on three flow characteristics unique in the VHTR air-ingress accident: stratified flow in the horizontal pipe, stratified flow expansion at the pipe and vessel junction, and stratified flow around supporting structures. Brine and sucrose were used as heavy fluids and water was used as light fluids. The density ratios were changed between 0.87 and 0.98. This experiment clearly showed that a stratified flow between heavy and light fluids is generated even for very small density differences. The code was validated by conducting blind CFD simulations and comparing the results to the experimental data. A grid sensitivity study was also performed based on the Richardson extrapolation and the grid convergence index method for modeling confidence. As a result, the calculated current speed showed very good agreement with the experimental data, indicating that the current CFD methods are suitable for predicting density gradient stratified flow phenomena in the air-ingress accident.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Prairie Strips and Lower Land Use Intensity Increase Biodiversity and Ecosystem Services

Agricultural landscapes can be managed to protect biodiversity and maintain ecosystem services. One approach to achieve this is to restore native perennial vegetation within croplands. Where rowcrops have displaced prairie, as in the US Midwest, restoration of native perennial vegetation can align with crops in so called “prairie strips.” We tested the effect of prairie strips in addition to other management practices on a variety of taxa and on a suite of ecosystem services. To do so, we worked within a 33-year-old experiment that included treatments that varied methods of agricultural management across a gradient of land use intensity. In the two lowest intensity crop management treatments, we introduced prairie strips that occupied 5% of crop area. We addressed three questions: (1) What are the effects of newly established prairie strips on the spillover of biodiversity and ecosystem services into cropland? (2) How does time since prairie strip establishment affect biodiversity and ecosystem services? (3) What are the tradeoffs and synergies among biodiversity conservation, non-provisioning ecosystem services, and provisioning ecosystem services (crop yield) across a land use intensity gradient (which includes prairie strips)? Within prairie strip treatments, where sampling effort occurred within and at increasing distance from strips, dung beetle abundance, spider abundance and richness, active carbon, decomposition, and pollination decreased with distance from prairie strips, and this effect increased between the first and second year. Across the entire land use intensity gradient, treatments with prairie strips and reduced chemical inputs had higher butterfly abundance, spider abundance, and pollination services. In addition, soil organic carbon, butterfly richness, and spider richness increased with a decrease in land use intensity. Crop yield in one treatment with prairie strips was equal to that of the highest intensity management, even while including the area taken out of production. We found no effects of strips on ant biodiversity and greenhouse gas emissions (N 2 O and CH 4 ). Our results show that, even in early establishment, prairie strips and lower land use intensity can contribute to the conservation of biodiversity and ecosystem services without a disproportionate loss of crop yield.

54 ENVIRONMENTAL SCIENCES↗

kemmerl4/LTER_prairie_strip_2019-2020: Data for: Prairie strips and lower land use intensity increase biodiversity and ecosystem services

Agricultural landscapes can be managed to protect biodiversity and maintain ecosystem services. One approach to achieve this is to restore native perennial vegetation within croplands. Where rowcrops have displaced prairie, as in the US Midwest, restoration of native perennial vegetation can align with crops in so called “prairie strips.” We tested the effect of prairie strips in addition to other management practices on a variety of taxa and on a suite of ecosystem services. To do so, we worked within a 33-year-old experiment that included treatments that varied methods of agricultural management across a gradient of land use intensity. In the two lowest intensity crop management treatments, we introduced prairie strips that occupied 5% of crop area. We addressed three questions: (1) What are the effects of newly established prairie strips on the spillover of biodiversity and ecosystem services into cropland? (2) How does time since prairie strip establishment affect biodiversity and ecosystem services? (3) What are the tradeoffs and synergies among biodiversity conservation, non-provisioning ecosystem services, and provisioning ecosystem services (crop yield) across a land use intensity gradient (which includes prairie strips)? Within prairie strip treatments, where sampling effort occurred within and at increasing distance from strips, dung beetle abundance, spider abundance and richness, active carbon, decomposition, and pollination decreased with distance from prairie strips, and this effect increased between the first and second year. Across the entire land use intensity gradient, treatments with prairie strips and reduced chemical inputs had higher butterfly abundance, spider abundance, and pollination services. In addition, soil organic carbon, butterfly richness, and spider richness increased with a decrease in land use intensity. Crop yield in one treatment with prairie strips was equal to that of the highest intensity management, even while including the area taken out of production. We found no effects of strips on ant biodiversity and greenhouse gas emissions (N 2 O and CH 4 ). Our results show that, even in early establishment, prairie strips and lower land use intensity can contribute to the conservation of biodiversity and ecosystem services without a disproportionate loss of crop yield.

54 ENVIRONMENTAL SCIENCES↗

Heat flow and geothermal potential of the East Mesa KGRA, Imperial Valley, California

The East Mesa KGRA (Known Geothermal Resource Area) is located in the southeast part of the Imperial Valley, California, and is roughly 150 kilometers square in areal extent. A new heat flow technique which utilizes temperature gradient measurements across best clays is presented and shown to be as accurate as conventional methods for the present study area. Utilizing the best clay gradient technique, over 70 heat flow determinations have been completed within and around the East Mesa KGRA. Background heat flow values range from 1.4 to 2.4 hfu (1 hfu = .000001 cal. per square centimeter-second) and are typical of those throughout the Basin and Range province. Heat flow values for the northwest lobe of the KGRA (Mesa anomaly) are as high as 7.9 hfu, with the highest values located near gravity and seismic noise maxima and electrical resistivity minima. An excellent correlation exists between heat flow contours and faults defined by remote sensing and microearthquake monitoring.

Swanberg, C. A.↗

Numerical computation of viscous flows on the lee side of blunt shapes flying at supersonic speeds

A numerical method for solving the parabolic approximation to the steady-state compressible Navier-Stokes equations is examined. The approximation neglects only the streamwise gradients of shear stress. An implicit finite difference method is used which advances the solution downstream from an initial data surface and determines the complete viscous-inviscid flow between the body and bow shock wave. It is necessary that the inviscid portion of the flow field be supersonic. Crossflow separation is determined as part of the solution. The method is applied to a 15 deg sphere-cone at 15 deg angle of attack, and the results are compared with an inviscid method-of-characteristics calculation.

Rakich, J. V.↗

Mixed solar wind originating from coronal regions of different temperatures

Ionization states of elements in the solar wind are often used to determine thermal gradients in the lower corona. This method is based on the assumption, that in the beginning, solar wind material has a homogeneous temperature determining the original charge state of elements. Features in M/Q-spectra which might appear if the above assumption is violated are investigated and compared with observational evidence.

Bochsler, P.↗

Simulated flight through JAWS wind shear - In-depth analysis results

The Joint Airport Weather Studies (JAWS) field experiment was carried out in 1982 near Denver. An analysis is presented of aircraft performance in the three-dimensional wind fields. The fourth dimension, time, is not considered. The analysis seeks to prepare computer models of microburst wind shear from the JAWS data sets for input to flight simulators and for research and development of aircraft control systems and operational procedures. A description is given of the data set and the method of interpolating velocities and velocity gradients for input to the six-degrees-of-freedom equations governing the motion of the aircraft. The results of the aircraft performance analysis are then presented, and the interpretation classifies the regions of shear as severe, moderate, or weak. Paths through the severe microburst of August 5, 1982, are then recommended for training and operational applications. Selected subregions of the flow field defined in terms of planar sections through the wind field are presented for application to simulators with limited computer storage capacity, that is, for computers incapable of storing the entire array of variables needed if the complete wind field is programmed.

Frost, W.↗

Transient natural convection heat and mass transfer in a rectangular enclosure - A numerical analysis

A numerical analysis of transient heat and solute transport across a rectangular cavity with combined horizontal temperature and concentration gradients is performed by a numerical method based on the SIMPLE. Numerical results show that the average Nusselt and Sherwood numbers both decrease markedly when the solutal and thermal buoyancy forces act in the opposite directions. When the solutal and thermal buoyancy forces act in the same directions, however, the average Sherwood number increases significantly and yet the average Nusselt number decreases slightly.

Han, Samuel S.↗

Identification of atmospheric fronts over the ocean with microwave measurements of water vapor and rain

This paper describes some basic research techniques and algorithms developed to diagnose fronts in cyclonic storms over the ocean with data from satellite-borne microwave radiometers. Methods are developed for flagging strong gradients in integrated atmospheric water vapor and the presence of rain by using data from the SSMR on board the polar orbiting Seasat and Nimbus-7 satellites. Examination of 65 frontal systems showed that the water vapor gradient flag correctly identified 86 percent of the fronts, while the precipitation flagged 91 percent. The two types of flags emphasize different portions of the cyclone and are therefore complementary. Ultimately, these techniques are intended for operational use with data from the Special Sensor Microwave Imager which was launched in June 1987 on a satellite in the Defense Meteorological Satellite Program (DMSP).

Katsaros, Kristina B.↗

Constrained trajectory optimization for kinematically redundant arms

Two velocity optimization schemes for resolving redundant joint configurations are compared. The Extended Moore-Penrose Technique minimizes the joint velocities and avoids obstacles indirectly by adjoining a cost gradient to the solution. A new method can incorporate inequality constraints directly to avoid obstacles and singularities in the workspace. A four-link arm example is used to illustrate singularity avoidance while tracking desired end-effector paths.

Carignan, Craig R.↗

Validation of parameterization scheme for eddy diffusion from satellite data

The eddy diffusion coefficient K(yy) has been calculated usign LIMS for the months of December 1978 and January and February 1979. Two methods have been used. The first implements the suggestion made by Tung (1987) to parameterize the eddy transport as a diffusive process along isentropes. The second method integrates the equation relating the parcel displacements to the eddy velocity fields. The latter method uses a filtering on both space and time domains to isolate transients and is referred to as the 'spectral method'. Results from the first method are shown to be reliable only for quiescent periods, breaking down when the meridional gradient of potential vorticity is negligible. Results from the two methods are in agreement only for very disturbed conditions, when transience is readily isolated. It is concluded that the parameterizations suggested for eddy transport and calculated in this paper may be meaningful for quiet periods, but are not reliable for unsteady and very large amplitude disturbances.

Sassi, F.↗

A deterministic particle method for one-dimensional reaction-diffusion equations

We derive a deterministic particle method for the solution of nonlinear reaction-diffusion equations in one spatial dimension. This deterministic method is an analog of a Monte Carlo method for the solution of these problems that has been previously investigated by the author. The deterministic method leads to the consideration of a system of ordinary differential equations for the positions of suitably defined particles. We then consider the time explicit and implicit methods for this system of ordinary differential equations and we study a Picard and Newton iteration for the solution of the implicit system. Next we solve numerically this system and study the discretization error both analytically and numerically. Numerical computation shows that this deterministic method is automatically adaptive to large gradients in the solution.

Mascagni, Michael↗

Global Design Optimization for Aerodynamics and Rocket Propulsion Components

Modern computational and experimental tools for aerodynamics and propulsion applications have matured to a stage where they can provide substantial insight into engineering processes involving fluid flows, and can be fruitfully utilized to help improve the design of practical devices. In particular, rapid and continuous development in aerospace engineering demands that new design concepts be regularly proposed to meet goals for increased performance, robustness and safety while concurrently decreasing cost. To date, the majority of the effort in design optimization of fluid dynamics has relied on gradient-based search algorithms. Global optimization methods can utilize the information collected from various sources and by different tools. These methods offer multi-criterion optimization, handle the existence of multiple design points and trade-offs via insight into the entire design space, can easily perform tasks in parallel, and are often effective in filtering the noise intrinsic to numerical and experimental data. However, a successful application of the global optimization method needs to address issues related to data requirements with an increase in the number of design variables, and methods for predicting the model performance. In this article, we review recent progress made in establishing suitable global optimization techniques employing neural network and polynomial-based response surface methodologies. Issues addressed include techniques for construction of the response surface, design of experiment techniques for supplying information in an economical manner, optimization procedures and multi-level techniques, and assessment of relative performance between polynomials and neural networks. Examples drawn from wing aerodynamics, turbulent diffuser flows, gas-gas injectors, and supersonic turbines are employed to help demonstrate the issues involved in an engineering design context. Both the usefulness of the existing knowledge to aid current design practices and the need for future research are identified.

Shyy, Wei↗