Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Terminals”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Visible-Light Photoinitiation of (Meth)acrylate Polymerization with Autonomous Post-Conversion

Conversion plateaus rapidly in radical photopolymerizations (RPPs) following discontinuation of irradiation due to rapid termination of reactive radicals, which restricts the wider use of RPPs in applications that involve nonuniform light access including those with attenuated light transmission or irregular surfaces. Based on our recent report of a radical dark-curing photoinitiator (DCPI) that continues polymerization beyond the cessation of irradiation by enabling latent redox initiation with photo-released amine in the presence of a suitable oxidant, we developed a new DCPI with an absorption spectrum that extends well into the visible range. Our design process involved a series of computational investigations of candidate molecules, including a systematic study of substituents and their position-dependent effects on absorption characteristics, electronic transitions, and the photochemical mechanism and its associated energetics. Our quantum chemical computations identified the target compound 5,7-dimethoxy-6-bromo-3-aroylcoumarin-DMPT/BPh4 and predicted that it would facilitate the dark-curing mechanism by concurrent photo-radical generation and photo-induced release of an efficient redox reductant under visible irradiation. This reductant-tethered chromophore was then synthesized and optically characterized with UV–vis spectroscopy that revealed its strong visible-light absorption with a molar absorptivity of 5710 M–1 cm–1 at 405 nm and 50 M–1 cm–1 at 455 nm. We then demonstrated extensive dark-curing of >35% additional conversion over 25 min following brief activation of the shelf-stable one-part system by irradiation with a 455 nm LED that was ceased at 20% conversion. In contrast, shuttering irradiation of the control formulation at that same point resulted in immediate cessation of conversion, which plateaued at 20%. We determined a remarkable initiator efficiency of 2.82 that results from the additional redox-generated radicals with a 77% photo-reductant generation quantum yield. The combination of superior photo- and dark-curing efficiencies of this new visible DCPI is expected to open new application opportunities in RPP, especially those involving resins that are highly light attenuating, surfaces that possess irregular features that produce uneven irradiance, and production lines where continued dark-curing downstream of the light activation step enhances line efficiencies.

absorption spectrum↗

Machine Learning-Accelerated First-Principles Molecular Dynamics Reveals C–C Coupling Mechanisms toward Ethylene on Cu(100)

Here, the Cu(100) termination has been identified as the most effective facet for converting CO and CO 2 into ethylene. To enhance both the activity and selectivity of ethylene production, we perform machine-learning-accelerated, first-principles molecular dynamics simulations at 298 K in an explicit solvent at pH 7 to elucidate the C–C coupling mechanism─the critical reaction step in forming C 2+ products. Among the six potential C–C coupling pathways, the most feasible are CO* dimerization and CO – CHO* and CHO* – CHO* couplings. Using the computational hydrogen electrode method, we demonstrate that all three pathways are equally accessible at −0.6 V vs RHE. At a potential below −1.0 V vs RHE, the thermodynamic barriers for the CO – CHO* and CHO* – CHO* pathways become negligible. Our computational findings explain the experimental observations, particularly the absence of C 2+ products above −0.4 V vs RHE and the peaks in ethylene production near −0.6 and −1.0 V vs RHE. Since CHO* acts as a key intermediate common to both C–C coupling and CH 4 formation, we propose that suppressing CHO* hydrogenation would inhibit CH 4 pathways, thereby maximizing ethylene selectivity.

CO2 reduction↗

A Reversed Impedance-Based Stability Criterion for IBR Grids: Preprint

The existing impedance-based stability criterion is effective for analyzing local control interactions; however, it is difficult to scale the existing criterion to analyze wide-area control interactions among numerous IBRs through a complex power system network. The scaled version of the existing criterion requires the impedance response of each IBR in the system as well as of the network looking from all the IBRs. It is quite challenging to obtain all these impedance responses because of the computational effort and the requirement of separately scanning the impedance of the network and the IBRs. We propose a reversed criterion for the impedance-based stability analysis to address these problems. In contrast to the existing criterion, the reversed criterion analyzes the stability of a power system when an IBR is disconnected from the system. The reversed criterion estimates the impact of an IBR on the frequency and damping of power system oscillation modes using the impedance scans of only the IBR and the grid at its terminal. It can be sequentially applied at different IBRs to evaluate their impact on the power system stability. In addition to scalability, the reversed criterion gives flexibility to focus only on a few selected IBRs, depending on their rating, the magnitude of oscillations observed at their terminals, and the vendor support available for implementing stabilizing control system updates. The reversed criterion is demonstrated on a 14-bus power system with 100% IBRs.

control interactions↗

Tad and toxin-coregulated pilus structures reveal unexpected diversity in bacterial type IV pili

<Type IV pili (T4P) are ubiquitous in both bacteria and archaea. They are polymers of the major pilin protein, which has an extended and protruding N-terminal helix, α1, and a globular C-terminal domain. Cryo-EM structures have revealed key differences between the bacterial and archaeal T4P in their C-terminal domain structure and in the packing and continuity of α1. This segment forms a continuous α-helix in archaeal T4P but is partially melted in all published bacterial T4P structures due to a conserved helix breaking proline at position 22. The tad (tight adhesion) T4P are found in both bacteria and archaea and are thought to have been acquired by bacteria through horizontal transfer from archaea. Tad pilins are unique among the T4 pilins, being only 40 to 60 residues in length and entirely lacking a C-terminal domain. They also lack the Pro22 found in all high-resolution bacterial T4P structures. We show using cryo-EM that the bacterial tad pilus from Caulobacter crescentus is composed of continuous helical subunits that, like the archaeal pilins, lack the melted portion seen in other bacterial T4P and share the packing arrangement of the archaeal T4P. We further show that a bacterial T4P, the Vibrio cholerae toxin coregulated pilus, which lacks Pro22 but is not in the tad family, has a continuous N-terminal α-helix, yet its α1 s are arranged similar to those in other bacterial T4P. Our results highlight the role of Pro22 in helix melting and support an evolutionary relationship between tad and archaeal T4P.

59 BASIC BIOLOGICAL SCIENCES↗

Optimizing Rate of Penetration and Tripping Decision-Making using Real-Time Bit Wear Monitoring While Drilling Geothermal Wells

Understanding bit wear while drilling is critical to minimizing non-productive time (NPT) and optimizing rate of penetration (ROP). Lengthening drilling runs with damaged bits does not only lower the ROP, but also elevates the risk of inducing severe bit damage, which could potentially lead to time-consuming fishing operations. When drillers believe the bit has worn off substantially, the bit is tripped out to be replaced. On geothermal wells, tripping can take up to 20% of the overall well construction time, and this is generally acknowledged as an opportunity for improvement. Ideally, a bit run should be terminated before the bit is damaged beyond repair. At the same time, premature bit pulls are to be avoided as well. This study aims to leverage bit and tooth wear metrics that can be obtained in real time to characterize bit condition in order to optimize ROP and determine the optimal time to pull the bit. Two metrics were explored in this study: a bit wear metric that incorporated depth-of-cut, and a tooth wear metric developed by Bourgoyne & Young characterizing the state of bit teeth dull. Both metrics were computed using recorded data from 12¼ inches roller cone insert bit runs in five geothermal wells targeting a granodiorite formation in the western United States. Together with the actual dull grades, determined after the bits were pulled to surface, the metric trends were interpreted to characterize the downhole bit condition and identify the point at which the bit should have optimally been tripped out. The insights from studying the actual dull grades and how they relate to the two metrics were used to establish a reliable bit pull criterion. The bit wear metric trend correctly showed a noticeable departure from baseline for bits experiencing major dulling behavior. Additionally, the tooth wear model predicted the cutter dull within two dull grades for most runs, with better performance in predicting the inner teeth dull. Moreover, the combination of the bit wear and tooth wear metrics was effective in revealing the cause of the bit performance impairment. Proactive tracking of these two metrics in real-time can facilitate geothermal drilling ROP optimization and better-informed tripping decision-making, thereby avoiding wasted time and cost.

Ashari, Rahmat↗

Data transmission by quantum matter wave modulation

Abstract Classical communication schemes exploiting wave modulation are the basis of our information era. Quantum information techniques with photons enable future secure data transfer in the dawn of decoding quantum computers. Here we demonstrate that also matter waves can be applied for secure data transfer. Our technique allows the transmission of a message by a quantum modulation of coherent electrons in a biprism interferometer. The data is encoded in the superposition state by a Wien filter introducing a longitudinal shift between separated matter wave packets. The transmission receiver is a delay line detector performing a dynamic contrast analysis of the fringe pattern. Our method relies on the Aharonov–Bohm effect but does not shift the phase. It is demonstrated that an eavesdropping attack will terminate the data transfer by disturbing the quantum state and introducing decoherence. Furthermore, we discuss the security limitations of the scheme due to the multi-particle aspect and propose the implementation of a key distribution protocol that can prevent active eavesdropping.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Orientation-dependent etching of silicon by fluorine molecules: A quantum chemistry computational study

Anisotropic etching is a widely used process in semiconductor manufacturing, in particular, for micro- and nanoscale texturing of silicon surfaces for black silicon production. The typical process of plasma-assisted etching uses energetic ions to remove materials in the vertical direction, creating anisotropic etch profiles. Plasmaless anisotropic etching, considered here, is a less common process that does not use ions and plasma. The anisotropy is caused by the unequal etching rates of different crystal planes; the etching process, thus, proceeds in a preferred direction. In this paper, we have performed quantum chemistry modeling of gas-surface reactions involved in the etching of silicon surfaces by molecular fluorine. The results confirm that orientation-dependent etch rates are the reason for anisotropy. The modeling of F 2 dissociative chemisorption on F-terminated silicon surfaces shows that Si–Si bond breaking is slow for the Si(111) surface, while it is fast for Si(100) and Si(110) surfaces. Both Si(100) and Si(110) surfaces incorporate a larger number of fluorine atoms resulting in Si–Si bonds having a larger amount of positive charge, which lowers the reaction barrier of F 2 dissociative chemisorption, yielding a higher etch rate for Si(100) and Si(110) surfaces compared to Si(111) surfaces. Molecular dynamics modeling of the same reactions has shown that the chosen reactive bond order potential does not accurately reproduce the lower reaction barriers for F 2 dissociative chemisorption on Si(100) and Si(100) surfaces. Furthermore, reparameterization is necessary to model the anisotropic etching process that occurs at lower temperatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Field–potential finite-difference time-domain (FiPo FDTD) technique for computational electromagnetics

Modeling light–matter interactions at the nanoscale requires accurate handling of coupled quantum and electromagnetic systems. This coupling requires information about the electric scalar potential Φ and the magnetic vector potential A, which are not typically calculated in standard computational electromagnetics implementations. To that end, we have developed a field–potential finite-difference time-domain (FiPo FDTD) algorithm, which solves a set of first-order equations for Φ and A alongside equations for the electric and magnetic fields E and H. The FiPo Basic code is essentially conventional FDTD, but with an added module that calculates the potentials. The FiPo Hybrid code self-consistently calculates both fields and potentials and is particularly suitable for coupling with quantum electronic transport solvers because it can be sourced by the potentials themselves. To terminate the domain and mimic infinite space, we have derived and implemented a convolutional perfectly matched layer (CPML) absorbing boundary condition for FiPo FDTD whose performance is on par with state-of-the-art CPMLs for standard FDTD. We present FiPo simulation results on several example systems.

Avazpour, L. [University of Wisconsin-Madison, WI ↗

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗

Scalable branching on dual decomposition of stochastic mixed-integer programming problems

In this work, we present a scalable branching method for the dual decomposition of stochastic mixed-integer programming. Our new branching method is based on the branching method proposed by Caroe and Schultz that creates branching disjunctions on first-stage variables only. We propose improvements to the process for creating branching disjunctions, including (1) branching on the optimal solutions of the Dantzig-Wolfe reformulation of the restricted master problem and (2) using a more comprehensive (yet simple) measure for the dispersions associated with subproblem solution infeasibility. We prove that the proposed branching process leads to an algorithm that terminates finitely, and we provide conditions under which globally optimal solutions can be identified after termination. We have implemented our new branching method, as well as the Caroe-Schultz method and a branch-and-price method, in the open-source software package DSP. Using SIPLIB test instances, we present extensive numerical results to demonstrate that the proposed branching method significantly reduces the number of node subproblems and solution times.

97 MATHEMATICS AND COMPUTING↗

A combined experimental and computational study on the reaction dynamics of the 1-propynyl (CH 3 CC, X 2 A 1 ) – propylene (CH 3 CHCH 2 , X 1 A') system: formation of 1,3-dimethylvinylacetylene (CH 3 CCCHCHCH 3 , X 1 A') under single collision conditions

The reaction of the 1-propynyl radical (CH 3 CC; X 2 A 1 ) with propylene (CH 3 CHCH 2 ; X 1 A') was studied in a crossed molecular beam machine at a collision energy of 37 ± 1 kJ mol –1 . Experimental data combined with high-level electronic structure (CCSD(T)-F12/cc-pVTZ-F12//ωB97X-D/6-311G(d,p)) and RRKM calculations reveal the reaction mechanism. Here, the overall barrierless and exoergic reaction involves indirect reaction dynamics and commences preferentially with addition of 1-propynyl with its radical centre to the carbon–carbon double bond at the terminal carbon atom of propylene. This work focuses on molecular mass growth process (hydrogen loss channels) although theory suggests methyl loss as a prevalent channel. In these processes, the C6H9 collision complexes either emit atomic hydrogen or undergo isomerisation followed by atomic hydrogen loss to preferentially yield the cis/trans isomers of 1,3-dimethylvinylacetylene (2-hexen-4-yne) as the primary product. Analysis of reaction dynamics of 1-propynyl and ethynyl radicals with propylene along with their fractional abundance in deep space suggests formation of methyl- and dimethyl derivatives of vinylacetylene in cold molecular clouds. Once formed they may engage in fundamental molecular mass growth processes via the barrierless Hydrogen Abstraction Vinylacetylene Addition mechanism that leads to the formation of methyl- and dimethylnaphthalenes thus providing a versatile route to methyl-substituted PAHs in interstellar medium.

1-propynyl↗

Towards an all-orders calculation of the electroweak bubble wall velocity

We analyze Higgs condensate bubble expansion during a first-order electroweak phase transition in the early Universe. The interaction of particles with the bubble wall can be accompanied by the emission of multiple soft gauge bosons. When computed at fixed order in perturbation theory, this process exhibits large logarithmic enhancements which must be resummed to all orders when the wall velocity is large. We perform this resummation both analytically and numerically at leading logarithmic accuracy. The numerical simulation is achieved by means of a particle shower in the broken phase of the electroweak theory. The two approaches agree to the 10$\%$ level. For fast-moving walls, we find the scaling of the thermal pressure exerted against the wall to be $P\sim \gamma^2T^4$, independent of the particle masses, implying a significantly slower terminal velocity than previously suggested.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Theory of the phase transition in random unitary circuits with measurements

Here, we present a theory of the entanglement transition tuned by measurement strength in qudit chains evolved by random unitary circuits and subject to either weak or random projective measurements. The transition can be understood as a nonanalytic change in the amount of information extracted by the measurements about the initial state of the system, quantified by the Fisher information. To compute the von Neumann entanglement entropy $\textit{S}$ and the Fisher information $\mathcal{F}$, we apply a replica method based on a sequence of quantities $\tilde{S}^{(n)}$ and $\mathcal{F}^{(n)}$ that depend on the $\textit{n}$th moments of density matrices and reduce to $\textit{S}$ and $\mathcal{F}$ in the limit $\textit{n}$ → 1. These quantities with $\textit{n}$ ≥ 2 are mapped to free energies of a classical spin model with $\textit{n}$! internal states in two dimensions with specific boundary conditions. In particular, $\tilde{S}^{(n)}$ is the excess free energy of a domain wall terminating on the top boundary, and $\mathcal{F}^{(n)}$ is related to the magnetization on the bottom boundary. Phase transitions occur as the spin models undergo ordering transitions in the bulk. Taking the limit of large local Hilbert space dimension $\textit{q}$ followed by the replica limit $\textit{n}$ → 1, we obtain the critical measurement probability $p_c$ = 1/2 and identify the transition as a bond percolation in the 2D square lattice in this limit. Finally, we show there is no phase transition if the measurements are allowed in an arbitrary nonlocal basis, thereby highlighting the relation between the phase transition and information scrambling. We establish an explicit connection between the entanglement phase transition and the purification dynamics of a mixed state evolution and discuss implications of our results to experimental observations of the transition and simulability of quantum dynamics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

From Vehicles to Systems: Understanding Freight Transportation as a Connected Energy, Infrastructure, and Operations System

The U.S. freight system may need to handle 50% more cargo by 2050. Upgrading our freight system requires modernizing capital-intensive, long-lived assets including freight trains, ports, and terminal infrastructure. NLR is advancing freight system solutions spanning ALTRIOS, the first digital twin for the full freight rail system; ALTRIOS-LIFTS, which can create digital twins of freight terminals; INFORMES, the first national model of the intermodal freight system; MARINESim, used to simulate and optimize ocean-going vessel operations; and more. These modeling and simulation tools enable data-driven decision-making across freight modes and systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Exploring mechanistic routes for light alkane oxidation with an iron–triazolate metal–organic framework

In this work, we computationally explore the formation and subsequent reactivity of various iron-oxo species in the iron–triazolate framework Fe 2 (m-OH) 2 (bbta) (H2bbta = 1H,5H-benzo(1,2-d:4,5- d0)bistriazole) for the catalytic activation of strong C–H bonds. With the direct conversion of methane to methanol as the probe reaction of interest, we use density functional theory (DFT) calculations to evaluate multiple mechanistic pathways in the presence of either N 2 O or H 2 O 2 oxidants. These calculations reveal that a wide range of transition metal-oxo sites – both terminal and bridging – are plausible in this family of metal–organic frameworks, making it a unique platform for comparing the electronic structure and reactivity of different proposed active site motifs. Based on the DFT calculations, we predict that Fe 2 (m-OH)2(bbta) would exhibit a relatively low barrier for N 2 O activation and energetically favorable formation of an [Fe(O)] 2+ species that is capable of oxidizing C–H bonds. In contrast, the use of H 2 O 2 as the oxidant is predicted to yield an assortment of bridging iron-oxo sites that are less reactive. We also find that abstracting oxo ligands can exhibit a complex mixture of both positive and negative spin density, which may have broader implications for relating the degree of radical character to catalytic activity. In general, we consider the coordinatively unsaturated iron sites to be promising for oxidation catalysis, and we provide several recommendations on how to further tune the catalytic properties of this family of metal–triazolate frameworks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Gradient-based surface nuclear magnetic resonance for groundwater investigation

In medical magnetic resonance imaging, spatial localization (imaging) is based upon the application of controlled magnetic field gradients on top of the main magnetic field to spatially modulate the frequency and/or phase of the nuclear magnetic resonance (NMR) signal across the volume of investigation. In this work, we have applied similar physical principles to produce controlled magnetic field gradients during surface NMR-based groundwater investigations. In this approach, a gradient pulse of variable amplitude or duration is applied immediately after the excitation pulse to cause predictable phase encoding of the NMR signal as a function of depth. This approach is also applicable to emerging surface NMR detection methods that use a prepolarization field with fast nonadiabatic turn-off to generate detectable NMR signals from the shallow subsurface. In this case, the gradient pulse is applied after terminating the prepolarization field and provides a heretofore unavailable means of localizing the NMR response as a function of depth. The application of gradients can also be combined with tip-angle-based modulation to yield higher imaging resolution than can be achieved through either gradient- or tip-angle-based imaging alone. We implemented this new gradient-based capability into a surface NMR gradient generation accessory that is compatible with the GMR-Flex instrument and developed surface NMR-specific forward modeling and linear inverse models. We validated the accuracy of this novel gradient-based sNMR technology using computer simulations, experiments using a small pool filled with a discrete layer of bulk water, and field experiments at well-characterized groundwater test sites along Ebey Island, WA, and Larned, KS. The gradient-based sNMR imaging observations were compared with high-resolution direct push NMR results observed at these sites. The results of computer simulations and field experiments indicate improvements in both the detection (signal-to-noise ratio) and spatial resolution of shallow subsurface water content using gradient-based surface NMR, compared with traditional surface NMR imaging methods.

Geochemistry & Geophysics↗

Characterizing Structure-Dependent TiS 2 /Water Interfaces Using Deep-Neural-Network-Assisted Molecular Dynamics

As a promising layered electrode material, TiS 2 -based capacitive deionization (CDI) devices for water desalination have attracted significant attention. However, TiS 2 /H 2 O interfacial features, potentially important for device optimization, remain unidentified. Using Deep Potential Molecular Dynamics (DPMD), we characterized distinct aqueous interfaces introduced by four TiS 2 terminations expected to be present as water intercalates into TiS 2 , namely, Armchair, Zigzag, Zigzag-L, and Zigzag-R. First, we assessed important representative physical properties of the system to validate the deep potentials (DPs). DPMD simulations agree well with experiments and first-principles simulations, suggesting the DPs are accurate and reliable. Subsequent simulations of these TiS 2 /water interfaces revealed how TiS 2 surface termination influences the structure of interfacial water. This effect is most evident in the first and second water layers close to the TiS 2 surface, and more pronounced when spontaneous dissociative adsorption of water occurs. The extent of water dissociation on each surface was evaluated using enhanced sampling. Zigzag-L is the only interface where proton transfer from adsorbed water to TiS 2 surface S atoms is thermodynamically and kinetically favored. The coexistence of surface four-fold-coordinated Ti (Ti 4c ) and one-fold-coordinated S (S 1c ) is found to be essential to making proton transfer feasible on the Zigzag-L surface. Furthermore, remaining unprotonated S 1c atoms can act as good proton acceptors after water dissociation. Thus, TiS 2 with Zigzag-L termination may be a surface to avoid in CDI device construction, given that pH fluctuations adversely affect performance. Furthermore, this work provides new understanding of TiS 2 /H 2 O interfacial features that could aid future design and optimization of TiS 2 -based CDI devices for water desalination.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Towards Low-Overhead Resilience for Data Parallel Deep Learning

Data parallel techniques have been widely adopted both in academia and industry as a tool to enable scalable training of deep learning models. At scale, DL training jobs can fail due to software or hardware bugs, may need to be preempted or terminated due to unexpected events, or may perform suboptimally because they were misconfigured. Under such circumstances, there is a need to recover and/or reconfigure data-parallel DL training jobs on-the-fly, while minimizing the impact on the accuracy of the DNN model and the runtime overhead. In this regard, state-of-art techniques adopted by the HPC community mostly rely on checkpoint-restart, which inevitably leads to loss of progress, thus increasing the runtime overhead. In this paper we explore alternative techniques that exploit the properties of modern deep learning frameworks (overlapping of gradient averaging and weight updates with local gradient computations through pipeline parallelism) to reduce the overhead of resilience/elasticity. To this end we introduce a failure simulation framework and two resilience strategies (immediate mini-batch rollback and lossy forward recovery), which we study compared with checkpoint-restart approaches in a variety of settings in order to understand the trade-offs between the accuracy loss of the DNN model and the runtime overhead.

data-parallel training↗