Search NASA⌕ Search

SEARCH · Search NASA

Results for “Memory effect”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

Post-training model compression can reduce the inference costs of deep neural networks, but uncompressed training still consumes enormous hardware resources and energy. To enable low-energy training on edge devices, it is highly desirable to directly train a compact neural network from scratch with a low memory cost. Low-rank tensor decomposition is an effective approach to reduce the memory and computing costs of large neural networks. However, directly training low-rank tensorized neural networks is a very challenging task because it is hard to determine a proper tensor rank a priori, and the tensor rank controls both model complexity and accuracy. Here, this paper presents a novel end-to-end framework for low-rank tensorized training. We first develop a Bayesian model that supports various low-rank tensor formats (e.g., CANDECOMP/PARAFAC, Tucker, tensor-train, and tensor-train matrix) and reduces neural network parameters with automatic rank determination during training. Then we develop a customized Bayesian solver to train large-scale tensorized neural networks. Our training methods shows orders-of-magnitude parameter reduction and little accuracy loss (or even better accuracy) in the experiments. On a very large deep learning recommendation system with over 4.2 ×10 9 model parameters, our method can reduce the parameter number to 1.6 ×10 5 automatically in the training process (i.e., by 2.6 ×10 4 times) while achieving almost the same accuracy. Code is available at https://github.com/colehawkins/bayesian-tensor-rank-determination.

compact neural networks↗

Automatic Generation of Directive-Based Parallel Programs for Shared Memory Parallel Systems

The shared-memory programming model is a very effective way to achieve parallelism on shared memory parallel computers. As great progress was made in hardware and software technologies, performance of parallel programs with compiler directives has demonstrated large improvement. The introduction of OpenMP directives, the industrial standard for shared-memory programming, has minimized the issue of portability. Due to its ease of programming and its good performance, the technique has become very popular. In this study, we have extended CAPTools, a computer-aided parallelization toolkit, to automatically generate directive-based, OpenMP, parallel programs. We outline techniques used in the implementation of the tool and present test results on the NAS parallel benchmarks and ARC3D, a CFD application. This work demonstrates the great potential of using computer-aided tools to quickly port parallel programs and also achieve good performance.

Jin, Hao-Qiang↗

Automatic Generation of OpenMP Directives and Its Application to Computational Fluid Dynamics Codes

The shared-memory programming model is a very effective way to achieve parallelism on shared memory parallel computers. As great progress was made in hardware and software technologies, performance of parallel programs with compiler directives has demonstrated large improvement. The introduction of OpenMP directives, the industrial standard for shared-memory programming, has minimized the issue of portability. In this study, we have extended CAPTools, a computer-aided parallelization toolkit, to automatically generate OpenMP-based parallel programs with nominal user assistance. We outline techniques used in the implementation of the tool and discuss the application of this tool on the NAS Parallel Benchmarks and several computational fluid dynamics codes. This work demonstrates the great potential of using the tool to quickly port parallel programs and also achieve good performance that exceeds some of the commercial tools.

Yan, Jerry↗

The Automatic Parallelisation of Scientific Application Codes Using a Computer Aided Parallelisation Toolkit

The shared-memory programming model is a very effective way to achieve parallelism on shared memory parallel computers. Historically, the lack of a programming standard for using directives and the rather limited performance due to scalability have affected the take-up of this programming model approach. Significant progress has been made in hardware and software technologies, as a result the performance of parallel programs with compiler directives has also made improvements. The introduction of an industrial standard for shared-memory programming with directives, OpenMP, has also addressed the issue of portability. In this study, we have extended the computer aided parallelization toolkit (developed at the University of Greenwich), to automatically generate OpenMP based parallel programs with nominal user assistance. We outline the way in which loop types are categorized and how efficient OpenMP directives can be defined and placed using the in-depth interprocedural analysis that is carried out by the toolkit. We also discuss the application of the toolkit on the NAS Parallel Benchmarks and a number of real-world application codes. This work not only demonstrates the great potential of using the toolkit to quickly parallelize serial programs but also the good performance achievable on up to 300 processors for hybrid message passing and directive-based parallelizations.

Ierotheou, C.↗

Caloric Effects Induced by Uniform and Non-uniform Stress in Shape-Memory Materials

A Ginzburg–Landau model is developed that is adequate to describe a square-to-rectangle martensitic transition with associated shape-memory and superelastic properties. Using this model we study caloric effects in the vicinity of the martensitic transition induced by stress and we compare the case of a uniform uniaxial stress and the case of a non-uniform continuous distribution of stresses that produce bending of the material. The former case corresponds to an elastocaloric effect and the latter corresponds to a flexocaloric effect. The aim of the work is to quantitatively compare both cases, which we show must be accomplished in terms of equal amounts of exchanged mechanical work. It is then obtained that the flexocaloric effect is more efficient for low exchanged work but less efficient for large exchanged work.

36 MATERIALS SCIENCE↗

Effects of ongoing task context and target typicality on prospective memory performance: the importance of associative cueing

Two experiments examined whether prospective memory performance is influenced by contextual cues. In our automatic activation model, any information available at encoding and retrieval should aid recall of the prospective task. The first experiment demonstrated an effect of the ongoing task context; performance was better when information about the ongoing task present at retrieval was available at encoding. Performance was also improved by a strong association between the prospective memory target as it was presented at retrieval and the intention as it was encoded. Experiment 2 demonstrated boundary conditions of the ongoing task context effect, which implicate the association between the ongoing and prospective tasks formed at encoding as the source of the context effect. The results of this study are consistent with predictions based on automatic activation of intentions.

Cues↗

Memory Optimizations for Sparse Linear Algebra on GPU Hardware

An effort to maximize memory bandwidth utilization for a sparse linear algebra kernel executing on NVIDIA® Tesla V100 and A100 Graphics Processing Units (GPUs) is described. The kernel consists of a block-sparse matrix-vector product and a series of forward/backward triangular solves. The computation is memory-bound and exhibits low arithmetic intensity. Along with a relatively small block size, the data layout poses a challenge to effectively utilize the available memory bandwidth on common GPU architectures. An earlier implementation using a warp to process a single row of the matrix was found to yield good memory performance on the V100 architecture. However, anew approach, which assigns a warp to six rows of the matrix, is proposed for the A100. In addition, two new features offered by the A100 architecture are explored.L2residency control enables a portion of theL2cache to be used for persistent data access, and the asynchronous copy instruction allows data to be loaded directly from main memory into shared memory. Demonstrations show that the new implementation improves memory bandwidth utilization from 71.5% to 81.2% of the peak available on theA100 architecture.

GPU↗

Influence of Thin-Film Adhesives in Pullout Tests Between Nickel-Titanium Shape Memory Alloy and Carbon Fiber-Reinforced Polymer Matrix Composites

Strips of nickel-titanium (NiTi) shape memory alloy (SMA) and carbon fiber-reinforced polymer matrix composite (PMC) were bonded together using multiple thin film adhesives and their mechanical strengths were evaluated under pullout test configuration. Tensile and lap shear tests were conducted to confirm the deformation of SMAs at room temperature and to evaluate the adhesive strength between the NiTi strips and the PMC. Optical and scanning electron microscopy techniques were used to examine the interfacial bonding after failure. Simple equations on composite tensile elongation were used to fit the experimental data on tensile properties. ABAQUS models were generated to show the effects of enhanced bond strength and the distribution of stress in SMA and PMC. The results revealed that the addition of thin film adhesives increased the average adhesive strength between SMA and PMC while halting the room temperature shape memory effect within the pullout specimen.

Polymer Matrix Composites↗

Soil Moisture Memory in Climate Models

Water balance considerations at the soil surface lead to an equation that relates the autocorrelation of soil moisture in climate models to (1) seasonality in the statistics of the atmospheric forcing, (2) the variation of evaporation with soil moisture, (3) the variation of runoff with soil moisture, and (4) persistence in the atmospheric forcing, as perhaps induced by land atmosphere feedback. Geographical variations in the relative strengths of these factors, which can be established through analysis of model diagnostics and which can be validated to a certain extent against observations, lead to geographical variations in simulated soil moisture memory and thus, in effect, to geographical variations in seasonal precipitation predictability associated with soil moisture. The use of the equation to characterize controls on soil moisture memory is demonstrated with data from the modeling system of the NASA Seasonal-to-Interannual Prediction Project.

Koster, Randal D.↗

Effect of Melt-Spinning Parameters on the Structure and Properties of Ni 55.5 Mn 18.8 Ga 24 Si 1.7 Heusler Alloy Ribbons

Ni–Mn-based Heusler alloys are known to demonstrate magnetic shape memory and giant magnetocaloric effect (MCE). These effects depend on the phases, crystallographic and magnetic phase transitions, and the crystallographic texture characteristics. These structural characteristics, in turn, are a function of the processing parameters. In the current work, Ni 55.5 Mn 18.8 Ga 24 Si 1.7 Heusler alloy was processed by melt-spinning under a helium atmosphere. This process results in a fine microstructure. The ribbon that was produced with a narrower nozzle width, faster wheel speed, and higher cast temperature, indicating a faster cooling rate, had double the magnetic entropy change close to room temperature. However, the other ribbon demonstrated a large entropy change over a broader temperature range, extending its usability. The effect of the melt-spinning process parameters on the developing microstructure, crystallographic structure and texture, transformation temperatures, and the magnetic entropy change were studied to explain the difference in magnetocaloric behavior.

36 MATERIALS SCIENCE↗

Learning the Temporal Effect in Infrared Thermal Videos With Long Short-Term Memory for Quality Prediction in Resistance Spot Welding

With the advances of sensing technology, in-situ infrared thermal videos can be collected from Resistance Spot Welding (RSW) processes. Each video records the formulation process of a weld nugget. The nugget evolution creates a “temporal effect” across the frames, which can be leveraged for real-time, nondestructive evaluation (NDE) of the weld quality. Currently, quality prediction with imaging data mainly focuses on optical feature extraction with Convolutional Neural Network (CNN) but does not make the most of such temporal effect. In this study, pixels corresponding to critical locations on the weld nugget surface are extracted from a video to form multivariate time series (MTS). Multivariate Adaptive Regression Splines (MARS) is used in MTS processing to remove noisy signals related to uninformative frames. A Stacked Long Short-Term Memory (LSTM) model is developed to learn from the processed MTS and then predicts weld nugget size and thickness in real-time NDE. Results from a case study on RSW of Boron steel demonstrates the improvement in prediction accuracy and computational time with the proposed method, as compared to CNN-based weld quality prediction.

Guo, Shenghan↗

Implementing Directive-Based Deferred Execution for Effective Network Aggregation

Remote direct memory access technology provides an efficient mechanism for one-sided communication that can be leveraged to implement a distributed shared memory programming model. However, when applications generate large numbers of small, irregular messages, network congestion often arises. Existing solutions address this small message problem by facilitating message aggregation but typically require disruptive code transformations that detract from the algorithmic intent of applications, or can be limited by dependent operations on aggregated data between synchronisation points. A solution is to use a directive-assisted approach that enables compilers to transform code dependent on aggregated communication for deferred execution. This paper presents an algorithm that a compiler can use to implement and optimise deferred execution for code dependent on aggregated data, based on an "aggregation context" extension for the OpenSHMEM partitioned global address space library. This new capability addresses a key challenge of message aggregation, allowing its full potential to reduce network congestion and enhance programmability to be realised.

Welch, Aaron [ORNL]↗