Search NASA⌕ Search

SEARCH · Search NASA

Results for “Adaptive”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

The Benefits of Incorporating Shipping Containers into the Climate Change Adaption Plans at NASA Wallops Flight Facility

The National Aeronautics and Space Administration has several centers and facilities located near the coast that are undoubtedly susceptible to climate change. One of those facilities is Wallops Flight Facility on the Eastern Shore of Virginia which is separated into three areas: Main Base, Mainland, and the Island. Wallops Island has numerous buildings and assets that are vulnerable to flood inundation, intense storms, and storm surge. The shoreline of Wallops Island is prone to beach erosion and is slated for another beach replenishment project in 2019. In addition, current climate projections for NASAs centers and facilities, conducted by the Climate Adaptation Science Investigators, warn of inevitable increases in annual temperature, precipitation, sea level rise, and extreme events such as heat waves. The aforementioned vulnerabilities Wallops Island faces in addition to the projections of future climate change reveal an urgency for NASA to adjust how new buildings at its centers and facilities near the coast are built to adapt to the inevitable effects of climate change. Although the agency has made strides to mitigate the effects of climate change by incorporating L.E.E.D. into new buildings that produce less greenhouse gas, the strides for the agency to institute clear climate adaptation policies for the buildings at its centers and facilities near the coast seem to lag behind. As NASA continues to formulate formidable climate change adaptation plans for its centers and facilities, an architectural trend that should be examined for its potential to replace several old buildings at Wallops Island is shipping containers buildings. Shipping containers or Intermodal Steel Building Units offer an array of benefits such as strength, durability, versatility, modular, and since they can be upcycled, they are also eco-friendly. Some disadvantages of shipping containers are they contain harmful chemicals, insulation must be added, fossil fuels must be used to transport them to the site, and multiple ISBUs are needed. However, the benefits of shipping container buildings could be utilized at NASA centers or facilities near the coast such as Wallops Island on new buildings that are designed to adapt to the impending effects of climate change. Thus, this Masters Research Project will explore how those benefits can be incorporated into the climate change adaptation plans at Wallops Island and make recommendations for policy guidelines and shipping container buildings specific to Wallops Island.

Sustainable Design↗
NASA NTRSDate not supplied

Neo – Mars Adaptive Training Integrative Knowledge System (MATRIKS) to Improve Operational Performance and its Neural Basis for Spaceflight

With prolonged mission durations, spaceflight crews will become increasingly dependent on onboard technologies for knowledge acquisition and maintenance. It is expected that not all skills and knowledge required for these missions can be retained and retrieved based on pre-mission training alone. Limited and delayed communication will significantly constrain support from Mission Control and crews will increasingly rely on autonomous onboard technologies to successfully perform post-landing operations. With the present project we will target NASA’s particular interest in developing and assessing an adaptive, just-in-time countermeasure that will consolidate and improve skills that are most relevant to space flight operations. To achieve this aim, NASA established a Virtual NASA Specialized Center of Research (VNSCOR)referred to as “Mars Adaptive Training Integrative Knowledge System (MATRIKS)”, comprising the following three projects: (1) “Trinity–Multi-Environment Virtual Training for Long Duration Exploration Missions”, PI: A. Anderson (UC Boulder); (2) “Morpheus–A Haptic Sensory Supplement to Optimize In-Flight Adaptive Training for Human Control of Spacecraft Robotic Arms”, PI: S. Robinson, UC Davis); and the present project “Neo–Adaptive Training integrative knowledge System to Improve Operational Performance and its Neural Basis for Spaceflight” (UPenn, PI: A.C. Stahn). Neo leverages a validated workstation called 6DF that simulates a rendezvous and docking maneuver using real spacecraft flight dynamics. It is designed to (1) train and improve sensorimotor skills relevant for inflight and post-landing operational tasks; (2) feature an autonomous and adaptive training approach that does not rely on feedback from flight operations on the ground; (3) maximize the transfer of mission-relevant motor skills; (4) allow the assessment of the neural circuitry underlying the task; and (5) deliver the training in a motivating and meaningful way to astronauts. Neocomprises two overarching aims: First, we will identify the neural circuitry underlying spaceflight relevant tasks by performing a subset of the 6DFtaskduring functional magnetic resonance imaging (MRI)in a total of up to N=30 subjects with varying levels of 6DF training experience. Second, as part of the above-mentioned VNSCOR MATRIKS the proposed 6DF autonomous intelligent tutor system will be integrated in an additive manner with a haptic feedback intervention (Morpheus), and a multi-environment virtual trainer(Trinity).It is expected that Neo, Morpheus and Trinity mutually complement each other to facilitate an effective countermeasure tool to acquire and retain operational skills that are critical for exploration class missions. To assess the efficacy of this combined effort, the VNSCOR MATRIKS will collect data inN=16 crew members in one HERA campaign of 45 days duration with N=16 crew members(four missions with N=4 crew member seach).The primary goal is to identify changes in operational performance as assessed by NASA’s simulator of Canadarm2 operations, i.e., Robotic On-board Trainer (ROBoT-r) in response to MATRIKS. As part of Neo we will also identify if, and to what extent MATRIKS will promote transfer to general cognitive performance (Cognition battery), distinctive visuo-spatial tasks critical for telerobotic tasks (Spatial Cognition battery), and affect brain structural changes and the neural circuitry of key brain networks expected to be relevant for spaceflight-related performance. At the conclusion of the research, we will have defined and demonstrated the use of a neuroscience-based, adaptive training integrative knowledge system to potentially mitigate visuo-spatial and sensorimotor brain changes associated with prolonged isolation and confinement to reduce the likelihood or impact of potential decrements in human performance capabilities during long-duration space missions. The expected significance of this 4-year project relates to its relevance for facilitating effective countermeasure tools to acquire and retain operational skills that are critical for exploration class missions. This will support the development of necessary countermeasures and technologies in support of human space exploration, focusing on mitigating operational performance risks.

A C Stahn↗
DOE OSTI2018

ADAPT

The purpose of the ADAPT code is to generate Dynamic Event Trees (DET) using a user specified set of simulators. ADAPT can utilize any simulation tool which meets a minimal set of requirements. ADAPT is based on the concept of DET which uses explicit modeling of the deterministic dynamic processes that take place during a nuclear reactor plant system (or other complex system) evolution along with stochastic modeling. When DET are used to model various aspects of Probabilistic Risk Assessment (PRA), all accident progression scenarios starting from an initiating event are considered simultaneously. The DET branching occurs at user specified times and/or when an action is required by the system and/or the operator. These outcomes then decide how the dynamic system variables will evolve in time for each DET branch. Since two different outcomes at a DET branching may lead to completely different paths for system evolution, the next branching for these paths may occur not only at separate times, but can be based on different branching criteria. The computational infrastructure allows for flexibility in ADAPT to link with different system simulation codes, parallel processing of the scenarios under consideration, on-line scenario management (initiation as well as termination), analysis of results, and user friendly graphical capabilities. The ADAPT system is designed for a distributed computing environment; the scheduler can track multiple concurrent branches simultaneously. The scheduler is modularized so that the DET branching strategy can be modified (e.g. biasing towards the worst-case scenario/event). Independent database systems store data from the simulation tasks and the DET structure so that the event tree can be constructed and analyzed later. ADAPT is provided with a user-friendly client which can easily sort through and display the results of an experiment, precluding the need for the user to manually inspect individual simulator runs.

Reynolds, John↗
DOE OSTI2018

X-ray battery adapter system

An x-ray battery adapter system may include an x-ray battery adapter and a geometry adapter. The x-ray battery adapter may include a circuit board, a baseplate, a heat sink, a cover, and a battery input. The baseplate may include a connector that connects to an x-ray generating device. The geometry adapter may include a cable, a battery receptacle configured to house a battery, and a voltage sensor and battery connector block assembly. The x-ray battery adapter may allow a user of an x-ray generating device to utilize different power sources.

25 ENERGY STORAGE↗
DOE OSTI2023

Domain Adaptation for Measurements of Strong Gravitational Lenses

Upcoming surveys are predicted to discover galaxy-scale strong lenses on the order of $10^5$, making deep learning methods necessary in lensing data analysis. Currently, there is insufficient real lensing data to train deep learning algorithms, but the alternative of training only on simulated data results in poor performance on real data. Domain Adaptation may be able to bridge the gap between simulated and real datasets. We utilize domain adaptation for the estimation of Einstein radius ($\Theta_E$) in simulated galaxy-scale gravitational lensing images with different levels of observational realism. We evaluate two domain adaptation techniques - Domain Adversarial Neural Networks (DANN) and Maximum Mean Discrepancy (MMD). We train on a source domain of simulated lenses and apply it to a target domain of lenses simulated to emulate noise conditions in the Dark Energy Survey (DES). We show that both domain adaptation techniques can significantly improve the model performance on the more complex target domain dataset. This work is the first application of domain adaptation for a regression task in strong lensing imaging analysis. Our results show the potential of using domain adaptation to perform analysis of future survey data with a deep neural network trained on simulated data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Thermal Evaluation of CCS and NACS Reference Devices and Adapters

It is important for manufacturers of electric vehicle charging connectors, inlets, and adapters to understand the thermal performance of their devices. Various standards, such as SAE J1772, SAE J3400, IEC 62196, UL 2251, and UL 2252, list temperature limits that charging hardware needs to meet. However, there are currently very limited standardized reference devices against which to measure connector performance, and those that do currently exist generally serve charging currents less than 500A. This can make determining whether a charging connector meets the appropriate temperature limits difficult. Additionally, as automakers and charging station suppliers transition from the SAE J1772 CCS charging standard to SAE J3400 NACS, a number of CCS-to-NACS and NACS-to-CCS adapters are entering the market. These devices are being produced both by well-known automakers/equipment OEMs and lesser-known third-party suppliers, across a wide range of price points and construction qualities. Though SAE J3400/1 and UL 2252 lay out standards for adapter construction, performance and overtemperature response, there is no guarantee that any particular adapter will follow these standards and react to overtemperature events appropriately. This work addresses these issues by developing and evaluating a set of CCS and NACS reference inlet devices to validate the performance of charging connectors in the 500-800A range. The work also evaluates the performance of multiple NACS-to-CCS and CCS-to-NACS charging adapters with respect to UL 2252 temperature limits and SAE J3400/1 overtemperature signaling criteria.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Filtering adaptive output feedback control for multivariable nonlinear systems with mismatched uncertainties and unmodeled dynamics

This article synthesizes a filtering adaptive output feedback controller for multivariable nonlinear systems with mismatched uncertainties and unmodeled dynamics. The multivariable nonlinear systems under consideration have both matched and mismatched uncertainties, which satisfy the semiglobal Lipschitz condition. The unmodeled dynamics are bounded-input bounded-output stable. By adopting an estimation/cancellation strategy, a piecewise constant adaptive law drives the estimation error to zero at every time instant, which yields the adaptive parameters; a disturbance rejection control law is designed to compensate the nonlinear uncertainties within the bandwidth of low-pass filters. The matched uncertainties are cancelled directly by adopting their opposite in the control signal, while a dynamic inversion of the system is required to eliminate the effect of the mismatched uncertainties on the output. A feedforward control law is designed to track a given command. Since the virtual reference system defines the best performance that can be achieved by the closed-loop system, the uniform performance bounds are derived for the states and control signals via comparison. Both numerical and practical examples are provided to illustrate the effectiveness of the proposed filtering adaptive output feedback control architecture, comparisons with the model reference adaptive control demonstrates the superiority of the proposed control method.

filtering adaptive control, mismatched uncertainit↗
DOE OSTI2024

Adaptive immersed isogeometric level-set topology optimization

Here, this paper presents for the first time an adaptive immersed approach for level-set topology optimization using higher-order truncated hierarchical B-spline discretizations for design and state variable fields. Boundaries and interfaces are represented implicitly by the iso-contour of one or multiple level-set functions. An immersed finite element method, the eXtended IsoGeometric Analysis, is used to predict the physical response. The proposed optimization framework affords different adaptively refined higher-order B-spline discretizations for individual design and state variable fields. The increased continuity of higher-order B-spline discretizations together with local refinement enables direct control over the accuracy of the representation of each field while simultaneously reducing computational cost compared to uniformly refined discretizations. A flexible mesh adaptation strategy enables local refinement based on geometric measures or physics-based error indicators. These adaptive discretization and analysis approaches are integrated into gradient-based optimization schemes, evaluating the design sensitivities using the adjoint method. Numerical studies illustrate the features of the proposed framework with static, linear elastic, multi-material, two- and three-dimensional problems. The examples provide insight into the effect of refining the design variable field on the optimization result and the convergence rate of the optimization process. Using coarse higher-order B-spline discretizations for level-set fields promotes the development of smooth designs and suppresses the emergence of small features. Moreover, adaptive mesh refinement for state variable fields results in a reduction of overall computational cost. Higher-order B-spline discretizations are especially interesting when evaluating gradients of state variable fields due to their higher inter-element continuity.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Tradeoffs between phenotypic plasticity and local adaptation influence the ecophysiology of the moss, Sphagnum magellanicum

Bryophytes are a diverse plant group and are functionally different from vascular plants. Yet, their peculiarities are rarely considered in the theoretical frameworks for plants. Currently, we lack information about the magnitude and the importance of intraspecific variability in the ecophysiology of bryophytes and how these might translate to local adaptation—a prerequisite for adaptive evolution. Capitalizing on two ecologically distinct (hummock and hollow) phenotypes of Sphagnum magellanicum, we explored the magnitude and pattern of intraspecific variability in this species and asked whether the environmental-mediated changes in shoot and physiological traits are due to phenotypic plasticity or local adaptation. Size, pigmentation, and habitat type that distinguished the phenotypes in the field did not influence the trait responses under a transplant and factorial experiment. In addition, the magnitude and pattern of trait variability (e.g., branch, stem and capitulum mass) changed with the treatments, which suggest that trait responses were due largely to phenotypic plasticity. The trait responses also suggest that the ecophysiological needs for mosses to grow in clumps, where they maintain a uniform growth may have an overriding effect over the potential for a fixed adaptive response to environmental heterogeneity, which would constrain local adaptation. In this paper, we conclude that extending the trait-based framework to mosses or making comparisons between mosses and vascular plants under any theoretical framework would only be meaningful to the extent that growth form and dispersal strategies are considered.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Site-specific field management adaptation is key to feeding the world in the 21st century

Rapid climate change and growing population threaten global food security across the globe. Several studies have proposed early planting, increased irrigation, and increased fertilizer applications as climate adaptation strategies, yet none have considered combined and site-specific field management strategies as a comprehensive solution. Here, we analyzed non-irrigated wheat yield responses to climate change and field management adaptation using a mechanistic crop model evaluated against observed global non-irrigated wheat-yield over 3-year intervals spanning 13 years at 3749 sites (RMSE = 36 gC m -2 ). Early planting with later-maturing varieties provided the most benefit to future yields among the proposed field management adaptation strategies. Improved water use efficiency from increased CO 2 led to relatively low benefits of additional irrigation. Here we estimated that spatially heterogeneous adaption strategies had the potential to improve global wheat yields by 91% by 2100 compared to the present day. The yield improvements from combined field adaptation strategies were larger than the sum of improvements from the individual strategies. These synergistic benefits were shown to result from complementary processes regulating nutrient and water uptake, physiological tolerance to heat stress, and internal carbon and nutrient cycling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data-driven projection pursuit adaptation of polynomial chaos expansions for dependent high-dimensional parameters

Uncertainty quantification (UQ) and inference involving a large number of parameters are valuable tools for problems associated with heterogeneous and non-stationary behaviors. The difficulty with these problems is exacerbated when these parameters are statistically dependent requiring statistical characterization over joint measures. Probabilistic modeling methodologies stand as effective tools in the realms of UQ and inference. Among these, polynomial chaos expansions (PCE), when adapted to low-dimensional quantities of interest (QoI), provide effective yet accurate approximations for these QoI in terms of an adapted orthogonal basis. These adaptation techniques have been cast as projection pursuits in Gaussian Hilbert space in what has been referred to as a projection pursuit adaptation (PPA) by Xiaoshu Zeng and Roger Ghanem (2023). The PPA method efficiently identifies an optimal low-dimensional space for representing the QoI and simultaneously evaluates an optimal PCE within that space. The quality of this approximation clearly depends on the size of the training dataset, which is typically a function of the adapted reduced dimension. Here, the complexity of the problem is thus mediated by the complexity of the low-dimensional quantity of interest and not the complexity of the high-dimensional parameter space.

Data-driven↗
DOE OSTI2015

Extending the Shared Socioeconomic Pathways for sub-national impacts, adaptation, and vulnerability studies

The exploration of alternative socioeconomic futures is an important aspect of understanding the potential consequences of climate change. While socioeconomic scenarios are common and, at times essential, tools for the impact, adaptation and vulnerability and integrated assessment modeling research communities, their approaches to scenario development have historically been quite distinct. However, increasing convergence of impact, adaptation and vulnerability and integrated assessment modeling research in terms of scales of analysis suggests there may be value in the development of a common framework for socioeconomic scenarios. The Shared Socioeconomic Pathways represents an opportunity for the development of such a common framework. However, the scales at which these global storylines have been developed are largely incommensurate with the sub-national scales at which impact, adaptation and vulnerability, and increasingly integrated assessment modeling, studies are conducted. Our objective for this study was to develop sub-national and sectoral extensions of the global SSP storylines in order to identify future socioeconomic challenges for adaptation for the U.S. Southeast. A set of nested qualitative socioeconomic storyline elements, integrated storylines, and accompanying quantitative indicators were developed through an application of the Factor-Actor-Sector framework. Finally, in addition to revealing challenges and opportunities associated with the use of the SSPs as a basis for more refined scenario development, this study generated sub-national storyline elements and storylines that can subsequently be used to explore the implications of alternative subnational socioeconomic futures for the assessment of climate change impacts and adaptation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Moment-based adaptive time integration for thermal radiation transport

Here, in this paper we develop a framework for moment-based adaptive time integration of deterministic multifrequency thermal radiation transpot (TRT). We generalize our recent semi-implicit-explicit (IMEX) integration framework for gray TRT to multifrequency TRT, and also introduce a semi-implicit variation that facilitates higher-order integration of TRT, where each stage is implicit in all components except opacities. To appeal to the broad literature on adaptivity with Runge–Kutta methods, we derive new embedded methods for four asymptotic preserving IMEX Runge–Kutta schemes we have found to be robust in our previous work on TRT and radiation hydrodynamics. We then use a moment-based high-order-low-order representation of the transport equations. Due to the high dimensionality, memory is always a concern in simulating TRT. We form error estimates and adaptivity in time purely based on temperature and radiation energy, for a trivial overhead in computational cost and memory usage compared with the base second order integrators. We then test the adaptivity in time on the tophat and Larsen problem, demonstrating the ability of the adaptive algorithm to naturally vary the timestep across 4–5 orders of magnitude, ranging from the dynamical timescales of the streaming regime to the thick diffusion limit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Digital pulse deconvolution with adaptive shaping for real-time high-resolution high-throughput gamma spectroscopy

A high-resolution high-throughput real-time adaptive digital pulse processing system is developed for high count rate gamma-ray spectroscopy applications. The adaptive digital pulse processing algorithms are implemented on a reconfigurable FPGA and include a pulse deconvolver, adaptive shaping filter, timing filter, baseline restorer, and pile-up rejecter. Digital pulse deconvolution is implemented to reconstruct the original detector signal from the preamplifier signal, which reduces the resolution deterioration due to pulse pile-up. The deconvoluted signal is shaped with a trapezoid filter and the shaping parameter is selected adaptively based on the time separation between successive input pulses. Experimental measurements are performed with a 137Cs source under varying count-rate conditions and using germanium detectors equipped with resistive feedback and transistor reset preamplifiers (TRP). The results herein demonstrate that when using a TRP, adaptive digital signal processing allows handling 106 counts/s. In addition, the implementation of a deconvolution approach limits resolution deterioration for throughput rates that are 4 to 10 times better than achievable in typical digital and analog gamma-ray spectroscopy systems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Classical Preoptimization Approach for ADAPT-VQE: Maximizing the Potential of High-Performance Computing Resources to Improve Quantum Simulation of Chemical Applications

The ADAPT-VQE algorithm is a promising method for generating a compact ansatz based on derivatives of the underlying cost function, and it yields accurate predictions of electronic energies for molecules. In this work, we report the implementation and performance of ADAPT-VQE with our recently developed sparse wave function circuit solver (SWCS) in terms of accuracy and efficiency for molecular systems with up to 52 spin orbitals. The SWCS can be tuned to balance computational cost and accuracy, which extends the application of ADAPT-VQE for molecular electronic structure calculations to larger basis sets and a larger number of qubits. Using this tunable feature of the SWCS, we propose an alternative optimization procedure for ADAPT-VQE to reduce the computational cost of the optimization. Furthermore, by preoptimizing a quantum simulation with a parametrized ansatz generated with ADAPT-VQE/SWCS, we aim to utilize the power of classical high-performance computing in order to minimize the work required on noisy intermediate-scale quantum hardware, which offers a promising path toward demonstrating quantum advantage for chemical applications.

ADAPT-VQE↗
DOE OSTI2016

Adaptive radiation by waves of gene transfer leads to fine-scale resource partitioning in marine microbes

Adaptive radiations are important drivers of niche filling, since they rapidly adapt a single clade of organisms to ecological opportunities. Although thought to be common for animals and plants, adaptive radiations have remained difficult to document for microbes in the wild. Here we describe a recent adaptive radiation leading to fine-scale ecophysiological differentiation in the degradation of an algal glycan in a clade of closely related marine bacteria. Horizontal gene transfer is the primary driver in the diversification of the pathway leading to several ecophysiologically differentiated Vibrionaceae populations adapted to different physical forms of alginate. Furthermore, pathway architecture is predictive of function and ecology, underscoring that horizontal gene transfer without extensive regulatory changes can rapidly assemble fully functional pathways in microbes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Boundary-Aware Adversarial Learning Domain Adaption and Active Learning for Cross-Sensor Building Extraction

The use of convolutional neural networks (CNNs) for building extraction from remote sensing images has been widely studied and many public datasets have been made available for accelerating development of these CNN models. Yet adapting pretrained models at scale in real-world scenarios remains a challenging task. The main barrier is that certain new labels are still needed to compensate for domain shifting between the labeled data and new images that potentially cover new geographic locations or that are from a different sensor. In this article, we propose to add informatively labeled samples from a new image pool under the paradigm of active learning. To select the most useful samples based on model uncertainty, we first tackle the problem of uncalibrated uncertainty estimation due to distribution shifting by adapting feature extractors with boundary-based adversarial learning. Calibrated uncertainty is used as the query criterion in the active learning process, where the most uncertain samples are selected for annotation and included for model retraining. The proposed workflow was tested with three data pairs in which each workflow represents a scenario often encountered in real-world applications, including adapting pretrained models to new images collected with different sensors or to new geographic areas where appearances and types of buildings are very different. Compared to several baselines, including random sampling, temperature scaling (a well-known uncertainty calibration technique), different query strategies, and active domain adaptation methods, the proposed workflow shows that strategically querying a smaller set of samples for labeling achieves comparable or better building extraction performance. The proposed method reduces the number of labeled samples required to achieve sufficient model accuracy, thus significantly reducing hundreds of person-hours for labeled data creation. In addition, we include a few considerations when deploying this workflow in a GPU cluster that can be easily adapted to achieve operational building extraction model retraining.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Improving Deep Neural Networks’ Training for Image Classification With Nonlinear Conjugate Gradient-Style Adaptive Momentum

Momentum is crucial in stochastic gradient-based optimization algorithms for accelerating or improving training deep neural networks (DNNs). In deep learning practice, the momentum is usually weighted by a well-calibrated constant. However, tuning the hyperparameter for momentum can be a significant computational burden. In this article, we propose a novel adaptive momentum for improving DNNs training; this adaptive momentum, with no momentum-related hyperparame- ter required, is motivated by the nonlinear conjugate gradient (NCG) method. Stochastic gradient descent (SGD) with this new adaptive momentum eliminates the need for the momentum hyperparameter calibration, allows using a significantly larger learning rate, accelerates DNN training, and improves the final accuracy and robustness of the trained DNNs. For example, SGD with this adaptive momentum reduces classification errors for training ResNet110 for CIFAR10 and CIFAR100 from 5.25% to 4.64% and 23.75% to 20.03%, respectively. Furthermore, SGD, with the new adaptive momentum, also benefits adversarial training and, hence, improves the adversarial robustness of the trained DNNs.

97 MATHEMATICS AND COMPUTING↗