SEARCH · Search NASA

Results for “Emerging memory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Design-Technology Co-Optimization for NVM-based Neuromorphic Processing Elements

An emerging use-case of machine learning (ML) is to train a model on a high-performance system and deploy the trained model on energy-constrained embedded systems. Neuromorphic hardware platforms, which operate on principles of the biological brain, can significantly lower the energy overhead of a machine learning inference task, making these platforms an attractive solution for embedded ML systems. In this paper, we present a design-technology tradeoff analysis to implement such inference tasks on the processing elements (PEs) of a Non-Volatile Memory (NVM)-based neuromorphic hardware. Through detailed circuit-level simulations at scaled process technology nodes, we show the negative impact of technology scaling on the information-processing latency, which impacts the quality-of-service (QoS) of an embedded ML system. At a finer granularity, the latency inside a PE depends on 1) the delay introduced by parasitic components on its current paths, and 2) the varying delay to sense different resistance states of its NVM cells. Based on these two observations, we make the following three contributions. First, on the technology front, we propose an optimization scheme where the NVM resistance state that takes the longest time to sense is set on current paths having the least delay, and vice versa, reducing the average PE latency, which improves the QoS. Second, on the architecture front, we introduce isolation transistors within each PE to partition it into regions that can be individually power-gated, reducing both latency and energy. Finally, on the system-software front, we propose a mechanism to leverage the proposed technological and architectural enhancements when implementing a machine-learning inference task on neuromorphic PEs of the hardware. Evaluations with a recent neuromorphic hardware architecture show that our proposed design-technology co-optimization approach improves both performance and energy efficiency of machine-learning inference tasks without incurring high cost-per-bit.

42 ENGINEERING↗

DOE OSTI2025

Navigating the Noise: Bringing Clarity to ML Parameterization Design With O $\boldsymbol{\mathcal{O}}$(100) Ensembles

Abstract Machine‐learning (ML) parameterizations of subgrid processes (here of turbulence, convection, and radiation) may one day replace conventional parameterizations by emulating high‐resolution physics without the cost of explicit simulation. However, uncertainty about the relationship between offline and online performance (i.e., when integrated with a large‐scale general circulation model) hinders their development. Much of this uncertainty stems from limited sampling of the noisy, emergent effects of upstream ML design decisions on downstream online hybrid simulation. Our work rectifies the sampling issue via the construction of a semi‐automated, end‐to‐end pipeline for size ensembles of hybrid simulations, revealing important nuances in how systematic reductions in offline error manifest in changes to online error and online stability. For example, removing dropout and switching from a Mean Squared Error to a Mean Absolute Error loss both reduce offline error, but they have opposite effects on online error and online stability. Other design decisions, like incorporating memory, converting moisture input from specific humidity to relative humidity, using batch normalization, and training on multiple climates do not come with any such compromises. Finally, we show that ensemble sizes of may be necessary to reliably detect causally relevant differences online. By enabling rapid online experimentation at scale, we can empirically settle debates regarding subgrid ML parameterization design that would have otherwise remained unresolved in the noise.

Lin, Jerry [Department of Earth System Sciences Un↗

DOE OSTI2020

Profiles of upcoming HPC Applications and their Impact on Reservation Strategies

With the expected convergence between HPC, BigData and AI, new applications with different profiles are coming to HPC infrastructures. Here, we aim at better understanding the features and needs of these applications in order to be able to run them efficiently on HPC platforms. The approach followed is bottom-up: we study thoroughly an emerging application from the neuroscience community (SLANT) to understand its behavior. Based on these observations, we derive a generic, yet simple, application model (namely, a linear sequence of stochastic jobs). We expect this model to be representative for a large set of upcoming applications that require the computational power of HPC clusters without fitting the typical behavior of large-scale traditional applications. In a second step, we show how one can manipulate this generic model in a scheduling framework. Specifically we consider the problem of making reservations (both time and memory) for an execution on an HPC platform. We derive solutions using the model of the first step of this work. We experimentally show the robustness of the model, even with very few data or with another application, to generate the model, and provide performance gains with regards to standard and more recent approaches used in the neuroscience community.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Bridging the Gap Between LLMs and LNS with Dynamic Data Format and Architecture Codesign

Deep neural networks (DNNs) have achieved tremendous success in the past few years. However, their training and inference demand exceptional computational and memory resources. Quantization has been shown as an effective approach to mitigate the cost, with the mainstream data types reduced from FP32 to FP16/BF16 and recently FP8 in the latest NVIDIA H100 GPUs. With increasingly aggressive quantization, however, the conventional floating-point formats suffer from limited precision in representing numbers around zero. Recently, NVIDIA demonstrated the potential of using a Logarithmic Number System (LNS) for the next generation of tensor cores. While LNS mitigates the hurdles in representing small numbers, in this work we observed a mismatch between LNS and the emerging Large Language Models (LLM), where LLM exhibits significant outliers when directly adopting the LNS format. In this paper, we present a data-format/architecture codesign to bright this gap. On the format side, we propose a dynamic LNS format to flexibly represent outliers at a higher precision, by exploiting asymmetry in the LNS representation and identifying outliers through a per-vector basis. On the architecture side, for demonstration, we realize the dynamic LNS format in a systolic array, which can handle the irregularity of the outliers at runtime. We implement our approach on an Alveo U280 FPGA as a prototype. Experimental results show that our design can effectively handle the outliers and resolve the mismatch between LNS and LLM, contributing to an accuracy improvement of 15.4% and 16% over the floating-point and the original LNS baselines, using four state-of-the-art LLM models. Our observation and design lay a solid foundation for the large-scale adoption of the LNS format in the next-generation deep learning hardware.

Haghi, Pouya↗

DOE OSTI2020

Quantum Dynamics at Scale: Ultrafast Control of Emergent Functional Materials

Confluence of extreme-scale quantum dynamics simulations (i.e. quantum@scale) and cutting-edge x-ray free-electron laser experiments are revolutionizing materials science. An archetypal example is the exciting concept of using picosecond light pulses to control emergent material properties on demand in atomically-thin layered materials. This paper describes efforts to scale our quantum molecular dynamics engine toward the United States' first exaflop/s computer, under an Aurora Early Science Program project named "Metascalable layered material genome". Key algorithmic and computing techniques incorporated are: (1) globally-scalable and locally-fast solvers within a linear-scaling divide-conquer-recombine algorithmic framework; (2) algebraic `BLASification' of computational kernels; and (3) data alignment and loop restructuring, along with register and cache blocking, for enhanced vectorization and efficient memory access. The resulting weak-scaling parallel efficiency was 0.93 on 131,072 Intel Xeon Phi cores for a 56.6 million atom (or 169 million valence-electron) system, whereas the various code transformations achieved 5-fold speedup. The optimized simulation engine allowed us for the first time to establish a significant effect of substrate on the dynamics of layered material upon electronic excitation.

Algebraic BLASification↗

DOE OSTI2025

A hybrid neural architecture: Online attosecond x-ray characterization

The emergence of high-repetition-rate x-ray free-electron lasers (XFELs), such as SLAC’s LCLS-II, serves as our canonical example for autonomous controls that necessitate high-throughput diagnostics paired with streaming computational pipelines capable of single-shot analysis with extremely low latency. We present the deterministic characterization with an integrated parallelizable hybrid resolver architecture, a hybrid machine learning framework designed for fast, accurate analysis of XFEL diagnostics using angular streaking-based sinogram images. This architecture integrates convolutional neural networks and bidirectional long short-term memory models to denoise input, identify x-ray sub-spike features, and extract sub-spike relative delays with sub-30 attosecond temporal resolution. Deployed on low-latency hardware, it achieves over 10 kHz throughput with 168.3 μs inference latency, indicating scalability to 14 kHz with field-programmable gate array integration. By transforming regression tasks into classification problems and leveraging optimized error encoding, we achieve high precision with low-latency performance that is critical for real-time streaming event selection and experimental control feedback signals. This represents a key development in real-time control pipelines for next-generation autonomous science, generally, and high repetition-rate x-ray experiments in particular.

Accelerator Physics (physics.acc-ph)↗

DOE OSTI2024

Enabling HPC Scientific Workflows for Serverless

The convergence of edge computing, big data analytics, and AI with traditional scientific calculations is increasingly being adopted in HPC workflows. Workflow management systems are crucial for managing and orchestrating these complex computational tasks. However, it is difficult to identify patterns within the growing population of HPC workflows. Serverless has emerged as a novel computing paradigm, offering dynamic resource allocation, quick response time, fine-grained resource management and auto-scaling. In this paper, we propose a framework to enable HPC scientific workflows on serverless. Our approach integrates a widely used traditional HPC workflow generator with an HPC serverless workflow management system to create benchmark suites of scientific workflows with diverse characteristics. These workflows can be executed on different serverless platforms. We comprehensively compare executing workflows on traditional local containers and serverless computing platforms. Our results show that serverless can reduce CPU and memory usage respectively by 78.11% and 73.92% without compromising performance.

Andrei da silva, Anderson↗

DOE OSTI2024

A deep learning-based Bayesian framework for high-resolution calibration of building energy models

Calibrating building energy models (BEMs), i.e., closing discrepancy between modeling and field measurements, is of significance to support its applications in building sustainability and resilience analysis. However, as being widely used in practice, current Bayesian calibration is mostly performed in low-resolution (annual or monthly), instead of high-resolution (hourly or sub-hourly), which is crucial to support emerging BEM applications, such as building-renewable energy integration (demand response) and smart control. This is attributable to the gaps in current Bayesian calibration process, including (1) difficulty in supporting reliable high-resolution calibration with over-parameterization and multi-solution issues, (2) inadequacy of meta-model to capture temporal building dynamics in high-resolution, and (3) excessive computational burdens of covariance matrix calculation in Bayesian inference. Therefore, to close these gaps, this research proposes a novel deep learning-based Bayesian calibration framework, involving pre-calibration mechanism, Long Short-Term Memory as surrogate models, and simplified covariance matrix calculation, to calibrate BEMs in high temporal resolution (i.e., hourly) with enhanced accuracy and computational efficiency. Finally, the case study demonstrates its effectiveness to match modeling outcomes with measurements and realize CV-RMSE of < 30 % and NMBE of < 6 % in hourly resolution, as well as a significant reduction of calibration time (by > 99 %, from > 600 h to ~ 1.5 h).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Quantum criticality and topology in non-equilibrium systems

A key goal of condensed matter physics research is to identify new phases of matter, and to understand the universal features of the phase transitions between them. In the past decade, physicists have uncovered a wealth of new phases with interesting surface properties, exemplified by the theoretical prediction and subsequent experimental discovery of topological insulators and superconductors. Traditional condensed matter systems are usually in a thermal equilibrium state and typically at very low temperature. Very recently, experimental advances have sparked interest in the non-equilibrium setting. Non-equilibrium systems can host new phases and phenomena with no equilibrium counterpart, and could also enable robust ways to build quantum memory devices to store and manipulate quantum information in a coherent manner. These phases and phenomena are inherently “dynamical”: they are described not by changes in the arrangement or structure of the constituent particles, but instead marked by sharp distinctions in how the particles move and exchange energy or quantum information. The discovery of robust non-equilibrium phases raises many fundamental questions: Can we develop a systematic theory of states of matter and of dynamical transitions between such states? How can such states be realized and probed experimentally? The main goal of this project was to explore the emergence of topological phases and quantum criticality (two cornerstones of modern condensed matter physics in equilibrium) in such non-equilibrium quantum systems. Specific goals included (1) using tensor networks to efficiently represent non-equilibrium states of matter and their phase transitions; (2) studying and designing new probes for periodically driven systems; and (3) developing analytic and numerical tools to analyze non-equilibrium topological phase transitions. Advances in these directions were achieved using novel techniques appropriate to study the non-equilibrium dynamics in many-body quantum systems combining strong interactions and randomness. Taken together, these results provide a new conceptual framework for understanding the emergence of quantum critical and topological properties in quantum systems far from thermal equilibrium.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2025

Prospects of Nanoscience with Nanocrystals: 2025 Edition

Abstract Nanocrystals (NCs) of various compositions have made important contributions to science and technology, with their impact recognized by the 2023 Nobel Prize in Chemistry for the discovery and synthesis of semiconductor quantum dots (QDs). Over four decades of research into NCs has led to numerous advancements in diverse fields, such as optoelectronics, catalysis, energy, medicine, and recently, quantum information and computing. The last 10 years since the predecessor perspective “Prospect of Nanoscience with Nanocrystals” was published in ACS Nano have seen NC research continuously evolve, yielding critical advances in fundamental understanding and practical applications. Mechanistic insights into NC formation have translated into precision control over NC size, shape, and composition. Emerging synthesis techniques have broadened the landscape of compounds obtainable in colloidal NC form. Sophistication in surface chemistry, jointly bolstered by theoretical models and experimental findings, has facilitated refined control over NC properties and represents a trusted gateway to enhanced NC stability and processability. The assembly of NCs into superlattices, along with two-dimensional (2D) photolithography and three-dimensional (3D) printing, has expanded their utility in creating materials with tailored properties. Applications of NCs are also flourishing, consolidating progress in fields targeted early on, such as optoelectronics and catalysis, and extending into areas ranging from quantum technology to phase-change memories. In this perspective, we review the extensive progress in research on NCs over the past decade and highlight key areas where future research may bring further breakthroughs.

Chemistry↗

DOE OSTI2023

Exploring temporal community evolution: algorithmic approaches and parallel optimization for dynamic community detection

Abstract Dynamic (temporal) graphs are a convenient mathematical abstraction for many practical complex systems including social contacts, business transactions, and computer communications. Community discovery is an extensively used graph analysis kernel with rich literature for static graphs. However, community discovery in a dynamic setting is challenging for two specific reasons. Firstly, the notion of temporal community lacks a widely accepted formalization, and only limited work exists on understanding how communities emerge over time. Secondly, the added temporal dimension along with the sheer size of modern graph data necessitates new scalable algorithms. In this paper, we investigate how communities evolve over time based on several graph metrics under a temporal formalization. We compare six different algorithmic approaches for dynamic community detection for their quality and runtime. We identify that a vertex-centric (local) optimization method works as efficiently as the classical modularity-based methods. To its advantage, such local computation allows for the efficient design of parallel algorithms without incurring a significant parallel overhead. Based on this insight, we design a shared-memory parallel algorithm DyComPar , which demonstrates between 4 and 18 fold speed-up on a multi-core machine with 20 threads, for several real-world and synthetic graphs from different domains.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Proximity Ferroelectricity in Compositionally Graded Structures

Proximity ferroelectricity is a novel paradigm for inducing ferroelectricity in a non-ferroelectric polar material, such as AlN or ZnO that are typically unswitchable with an external field below their dielectric breakdown field. When placed in direct contact with a thin switchable ferroelectric layer (such as Al 1-x Sc x N or Zn 1-x Mg x O), they become a practically switchable ferroelectric. Using the thermodynamic Landau-Ginzburg-Devonshire theory, in this work, we perform the finite element modeling of the polarization switching in the compositionally graded AlN-Al 1-x Sc x N, ZnO-Zn 1-x Mg x O, and MgO-Zn 1-x Mg x O structures sandwiched in both a parallel-plate capacitor geometry as well as in a sharp probe-planar electrode geometry. We reveal that the compositionally graded structure allows the simultaneous switching of spontaneous polarization in the whole system by a coercive field significantly lower than the electric breakdown field of unswitchable polar materials. The physical mechanism is the depolarization electric field determined by the gradient of chemical composition “x”. The field lowers the steepness of the switching barrier in the otherwise unswitchable parts of the compositionally graded AlN-Al 1-x Sc x N and ZnO-Zn 1-x Mg x O structures. In the MgO-like regions of the compositionally graded MgO-Zn 1-x Mg x O structure, a shallow double-well free energy potential emerges. Proximity ferroelectric switching of the compositionally graded structures placed in the probe-electrode geometry occurs due to nanodomain formation under the tip. We predict that a gradient of chemical composition “x” significantly lowers effective coercive fields of the compositionally graded AlN-Al 1-x Sc x N and ZnO-Zn 1-x Mg x O structures compared to the coercive fields of the corresponding multilayers with a uniform chemical composition in each layer. A tip-induced switching further lowers the coercive field, enabling control of ferroelectric domains in otherwise unswitchable compositionally graded structures, which can provide nanoscale domain control for memory, actuation, sensing, and optical applications.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Thermodynamic Theory of Proximity Ferroelectricity

Proximity ferroelectricity has recently been reported as a new design paradigm for inducing ferroelectricity, where a nonferroelectric polar material becomes a ferroelectric one by interfacing with a thin ferroelectric layer. Strongly polar materials, such as AlN and ZnO, which were previously unswitchable with an external field below their dielectric breakdown fields, can now be switched with practical coercive fields when they are in intimate proximity to a switchable ferroelectric. Here, we develop a general Landau-Ginzburg theory of proximity ferroelectricity in multilayers of nonferroelectrics and ferroelectrics to analyze their switchability and coercive fields. The theory predicts regimes of both “proximity switching,” where the multilayers collectively switch, and “proximity suppression,” where they collectively do not switch. The mechanism of the proximity ferroelectricity is an internal electric field determined by the polarization of the layers and their relative thickness in a self-consistent manner that renormalizes the double-well ferroelectric potential to lower the steepness of the switching barrier. Further reduction in the coercive field emerges from charged defects in the bulk that act as nucleation centers. The application of the theory to proximity ferroelectricity in Al x−1⁢ Sc x ⁢N/AlN and Zn 1−x ⁢Mg x ⁢O/ZnO bilayers is demonstrated. The theory further predicts that dielectric-ferroelectric and paraelectric-ferroelectric multilayers can potentially lead to induced ferroelectricity in the dielectric or paraelectric layers, resulting in the entire stack being switched, an exciting avenue for new discoveries. This thawing of “frozen ferroelectrics,” paraelectrics, and potentially dielectrics with high dielectric constants promises a large class of new ferroelectrics with exciting prospects for previously unrealizable domain-patterned optoelectronic and memory technologies.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Emergent ferromagnetism and unusual irreversible magnetoresistance in an intercalated van der Waals antiferromagnet

Orthorhombic air-stable two-dimensional (2D) antiferromagnet (AFM) CrSBr has attracted much research interest lately thanks to its rich magnetic behaviors together with its remarkable electronic, excitonic, and polaritonic properties. Here, we report a reliable electrochemical intercalation method by inserting large tetrabutylammonium (TBA + ) ions into CrSBr layers. Magnetically, such intercalation efficiently suppresses the interlayer AFM and induces a ferromagnetic (FM) order with a much-enhanced transition temperature up to 200 K, nearly 70 K higher than the AFM onset of 132 K in pristine CrSBr. Electronically, the TBA + intercalation not only increases the electric conductivity of CrSBr, which is further enhanced by magnetic fields, but also introduces a giant negative irreversible magnetoresistance. This work demonstrates the tunable magnetic and electronic properties of CrSBr as well as their interplay, paving the way for advanced spintronic and magnetic memory devices.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Vertex Reordering for Real-world Graphs and Applications: An Empirical Evaluation

Vertex reordering is a way to improve locality in graph computations. Given an input (or ``natural'') order, reordering aims to compute an alternate permutation of the vertices that is aimed at maximizing a locality-based objective. Given decades of research on this topic, there are tens of graph reordering schemes, and there are also several linear arrangement ``gap'' measures for treatment as objectives. However, a comprehensive empirical analysis of the efficacy of the ordering schemes against the different gap measures, and against real-world applications is currently lacking. In this study, we present an extensive empirical evaluation of up to 11 ordering schemes, taken from different classes of approaches, on a set of 34 real-world graphs emerging from different application domains. Our study is presented in two parts: a) a thorough comparative evaluation of the different ordering schemes on their effectiveness to optimize different linear arrangement gap measures, relevant to preserving locality; and b) extensive evaluation of the impact of the ordering schemes on two real-world, parallel graph applications, namely, community detection and influence maximization. Our studies show a significant divergence among the ordering schemes (up to $40\times$ between the best and the poor) in their effectiveness to reduce the gap measures; and a wide ranging impact of the ordering schemes on various aspects including application runtime (up to $4\times$), memory and cache use, load balancing, and parallel work and efficiency. The comparative study also help reveal the nuances of a parallel environment (compared to serial) on the ordering schemes and their role in optimizing applications.

Barik, Reet↗

DOE OSTI2021

A Graphics Processing Unit–Based, Industrial Grade Compositional Reservoir Simulator

Summary Recently, graphics processing units (GPUs) have been demonstrated to provide a significant performance benefit for black-oil reservoir simulation, as well as flash calculations that serve an important role in compositional simulation. A comprehensive approach to compositional simulation based on GPUs has yet to emerge, and the question remains as to whether the benefits observed in black-oil simulation persist with a more complex fluid description. We present a positive answer to this question through the extension of a commercial GPU-based black-oil simulator to include a compositional description based on standard cubic equations of state (EOSs). We describe the motivations for the selected nonlinear formulation, including the choice of primary variables and iteration scheme, and support for both fully implicit methods (FIMs) and adaptive implicit methods (AIMs). We then present performance results on an example sector model and simplified synthetic case designed to allow a detailed examination of runtime and memory scaling with respect to the number of hydrocarbon components and model size, as well as the number of processors. We finally show results from two complex asset models (synthetic and real) and examine performance scaling with respect to GPU generation, demonstrating that performance correlates strongly with GPU memory bandwidth. NOTE: This paper is also published as part of the 2021 SPE Reservoir Simulation Conference Special Issue.

Engineering↗

DOE OSTI2025

Large enhancement of ferroelectric properties of perovskite oxides via nitrogen incorporation

Perovskite oxides have a wide variety of physical properties that make them promising candidates for versatile technological applications including nonvolatile memory and logic devices. Chemical tuning of those properties has been achieved, to the greatest extent, by cation-site substitution, while anion substitution is much less explored due to the difficulty in synthesizing high-quality, mixed-anion compounds. Here, nitrogen-incorporated BaTiO3 thin films have been synthesized by reactive pulsed-laser deposition in a nitrogen growth atmosphere. The enhanced hybridization between titanium and nitrogen induces a large ferroelectric polarization of 70 μC/cm2 and high Curie temperature of ~1213 K, which are ~2.8 times larger and ~810 K higher than in bulk BaTiO3, respectively. These results suggest great potential for anion-substituted perovskite oxides in producing emergent functionalities and device applications.

Wang, Tao↗

DOE OSTI2024

Adaptive nonequilibrium design of actin-based metamaterials: Fundamental and practical limits of control

The adaptive and surprising emergent properties of biological materials self-assembled in far-from-equilibrium environments serve as an inspiration for efforts to design nanomaterials. In particular, controlling the conditions of self-assembly can modulate material properties, but there is no systematic understanding of either how to parameterize external control or how controllable a given material can be. Here, we demonstrate that branched actin networks can be encoded with metamaterial properties by dynamically controlling the applied force under which they grow and that the protocols can be selected using multi-task reinforcement learning. These actin networks have tunable responses over a large dynamic range depending on the chosen external protocol, providing a pathway to encoding “memory” within these structures. Interestingly, we obtain a bound that relates the dissipation rate and the rate of “encoding” that gives insight into the constraints on control—both physical and information theoretical. Taken together, these results emphasize the utility and necessity of nonequilibrium control for designing self-assembled nanostructures.

59 BASIC BIOLOGICAL SCIENCES↗