Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

The Effect of Spaceflight on the Ultrastructure of the Cerebellum

In weightlessness, astronauts and cosmonauts may experience postural illusions as well as motion sickness symptoms known as the space adaptation syndrome. Upon return to Earth, they have irregularities in posture and balance. The adaptation to microgravity and subsequent re-adaptation to Earth occurs over several days. At the cellular level, a process called neuronal plasticity may mediate this adaptation. The term plasticity refers to the flexibility and modifiability in the architecture and functions of the nervous system. In fact, plastic changes are thought to underlie not just behavioral adaptation, but also the more generalized phenomena of learning and memory. The goal of this experiment was to identify some of the structural alterations that occur in the rat brain during the sensory and motor adaptation to microgravity. One brain region where plasticity has been studied extensively is the cerebellar cortex-a structure thought to be critical for motor control, coordination, the timing of movements, and, most relevant to the present experiment, motor learning. Also, there are direct as well as indirect connections between projections from the gravity-sensing otolith organs and several subregions of the cerebellum. We tested the hypothesis that alterations in the ultrastructural (the structure within the cell) architecture of rat cerebellar cortex occur during the early period of adaptation to microgravity, as the cerebellum adapts to the absence of the usual gravitational inputs. The results show ultrastructural evidence for neuronal plasticity in the central nervous system of adult rats after 24 hours of spaceflight. Qualitative studies conducted on tissue from the cerebellar cortex (specifically, the nodulus of the cerebellum) indicate that ultrastructural signs of plasticity are present in the cerebellar zones that receive input from the gravity-sensing organs in the inner ear (the otoliths). These changes are not observed in this region in cagematched ground control animals. The specific changes include the formation of lamellar bodies, profoundly enlarged Purkinje cell mitochondria, the presence of inter-neuronal cellular protrusions in the molecular layer, and signs of degeneration in the distal dendrites of the Purkinje cells. Since these morphologic signs are not apparent in the control animals, they are not likely to be due to caging or tissue processing effects. The particular nature of the structural alterations in the nodulus, most notably the formation of lamellar bodies and the presence of degeneration, further suggests that excitotoxicity (damaging overstimulation of neurons) may play a role in the short-term neural response to spaceflight. These findings suggest a structural basis for the neuronal and synaptic plasticity accompanying the central nervous system response to altered gravity and help identify the cellular bases underlying the vestibular abnormalities experienced by astronauts during periods of adaptation and re-adaptation to different gravitational forces. Also, since the short- and long-term changes in neural structure occurring during such periods of adaptation resemble the neuronal alterations that occur in some neurologic disorders such as stroke, these findings may offer guidance in the development of strategies for rehabilitation and treatment of such disorders.

Holstein, Gay R.↗
DOE OSTI2026

From IMT Device Measurements to Network-Level Consequences: When Learning Suppresses Beyond-LIF Neuron Dynamics

Emerging neuromorphic devices such as insulator--metal transition (IMT) devices exhibit complex temporal dynamics, including slow internal state memory, hysteresis, and burst-like firing, which are poorly captured by conventional leaky integrate-and-fire (LIF) neurons. However, it remains unclear when such dynamics influence learning and inference at the network level, particularly under commonly used unsupervised plasticity rules. We present a controlled, full-stack co-design study spanning experimental characterization of individual IMT devices, compact neuron model development, and large-scale spiking network simulations with identical architectures and learning rules. Rather than optimizing benchmark accuracy, our goal is to diagnose when neuron-level dynamics survive learning and competition, and when they are suppressed, to inform the co-design of devices, networks, and learning rules that can exploit beyond-LIF complexity.

42 ENGINEERING↗
DOE OSTI2021

Computational Math Problems for a Clean Energy Future

Cutting edge computational mathematics are ubiquitous in renewable energy research. Problems in resilient and reliable electric grid operations, infrastructure planning, wind farm yaw control, and more demand sophisticated and scalable computational tools that enable the transition of renewable energy technologies from proof of concept to deployment into our energy system. The mission of the Computational Science Center at NREL is to lead the lab's efforts to solve energy challenges using high-performance computing (HPC), computational science, applied mathematics, scientific data management, visualization, and informatics. In this poster, we provide a short overview of three areas of computational mathematics research at NREL: wind power scenario generation for stochastic grid operations and infrastructure planning, improved rational function approximations for electromagnetic transients codes, and wind farm yaw control using a combination of the Alternating Direction Method of Multipliers (ADMM) and reinforcement learning (RL). Increasing penetrations of renewable energy into power grids motivate the investigation of new approaches to characterizing uncertainty for five-minute economic dispatch problems. Similarly, as the penetration of distributed energy resources on power grids increases, it becomes important to revisit our methods of modelling transient phenomena, i.e. electromagnetic transients programs. Finally, the combination of ADMM and RL for wind farm yaw control presented here can potentially increase the efficiency of the deployed distributed controllers by orders of magnitude.

ADMM↗
DOE OSTI2018

Embedded Hardware Solution for Cybersecurity in Industrial Control Systems

Industrial Control Systems are the backbone of manufacturing, power, and critical infrastructure. These systems are made up of electronic and mechanical devices that operate on complex feedback systems that allow the production of consumer products, electricity, clean water, and nuclear industries. This broad reach of cybersecurity has earned it a place in the strategic roadmaps for many government agencies, including the Department of Energy. Their efforts stem from two general initiatives which are to improve cybersecurity in the energy sector and to strengthen effectiveness of Department of Energy incident management capabilities. Particular emphasis is in improving learning and preservations of knowledge at the labs, and to encourage collaboration between the labs. This project aims to develop Savannah River National Laboratory’s knowledge of industrial control systems cybersecurity by providing our engineers the opportunity to learn and execute advanced concepts in cybersecurity to real problems in industrial control systems. Successful execution of this project will enhance Savannah River National Laboratory’s knowledge and capability in the realm of Industrial Control System and Operational Technology cybersecurity as well as advance understanding of defensive needs in these environments. This will directly impact Savannah River National Laboratory’s capability to contribute and collaborate with Department of Energy, other Labs, and commercial partners in meeting Department of Energy national industrial control systems/Operations Technology cybersecurity goals.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Divide and conquer: separating the two probabilities in seismic phase picking

There are two fundamental probabilities in the seismic phase picking process—the probability of the existence of a seismic phase (detection probability) and the probability associated with the phase arrival time estimation (timing probability). The nearly ubiquitous approach in developing deep learning phase picking models is to use a kernel, such as a truncated Gaussian, to mask the labelled phase arrival time and train a segmentation model. Once a model is trained, the times of the peaks in the output are taken as phase arrival times (picks), and the height of the peaks are taken as ‘probability’ of the picks. Here, we show that this ‘probability’ represents neither the detection nor the timing probability because this approach forces the output to follow the shape of the kernel. We introduce an approach using two models to estimate these two distinct probabilities. We use a binary classifier with a calibrated confidence to address the detection probability and a multiclass classifier to obtain a probability mass function to address the timing probability. This new approach can make the deep learning-based phase picking process more interpretable and provide options to logically control seismic monitoring workflows.

58 GEOSCIENCES↗
DOE OSTI2019

Alliance Project: Secure Control Systems for the Energy Sector

The Alliance Project addresses Area of Interest 4: Secure Remote Access for the Energy Sector, by combining physical and cyber access under one cybersecurity access system. The Alliance Project built on the successful completion of the Lemnos and Padlock Project (DOE-Funded Project started in 2007 and 2010) and researched and developed a solution for an Ethernet Security Gateway with the functionality required to integrate the physical access control cyber system and interface with legacy and new proximity card readers used for physical access requests. This project focused on securing and enhancing the cyber system the physical access control system operates on. The team tested and demonstrated the system solution on the SEL campus. Currently the physical access cyber system is completely separate from the cyber access control cyber system. With a single system industry benefits include: (1) Single system to learn and teach employees; (2) Single system that collects and alerts on logs and events simplifying incident response plans and NERC CIP compliance; (3) Unifies trust management to a single system reducing the potential errors in privilege escalation or revocation; (4) Provides a stronger cybersecurity platform the physical access control system operates on. Today they are mostly plain text protocols and little cyber awareness; (5) Integration of physical access awareness allows the cyber system to react and adjust. In some cases, the cyber access can be enhanced with authorized physical access and other cases the cyber access can be more restricted with unauthorized physical access; and (6) Enables the utility to establish as large or as small a physical access control system as they require. One example would be when a utility shares a substation with a neighbor utility and can’t rely on the substation door for the physical access control. The Alliance technology enables them to lock equipment racks simply with no scalability issues because it stands on the cyber security infrastructure which is already highly scalable.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Delamination-informed lifecycle decisions: A dielectric and machine learning framework for composite sorting and recycling

Composite materials are widely used in aerospace, marine, and automotive sectors due to their high strength-to-weight ratio and durability. However, their long-term reliability can be compromised by damage accumulation. Specifically, delamination initiation serves as a precursor to structural failure, which is often difficult to detect during damage inspection. Identifying and sorting delamination initiation in samples not only increases operational safety while providing critical information for end-of-life decisions, which influences both the service life extension value and the efficiency of fiber extraction during recycling. This research addresses two challenges: (1) developing a nondestructive, ex-situ framework to sort composite materials based on damage severity, particularly delamination, and (2) understanding how damage in composites influences resin removal during pyrolysis. Both experimental work and finite element analysis were performed to predict critical stress levels that are associated with delamination onset. Based on these results, three loading levels 50 %, 75 %, and 90 % of maximum stress, were selected for controlled experiments, generating composite samples with varying extents of damage for machine learning model training. Microscopic imaging of these samples confirmed the damage progression from matrix cracking to delamination, validating the computational predictions. We explored supervised machine learning using dielectric measurements to classify damage states. Preliminary results show an artificial neural network can identify early delamination which is a potential precursor to failure, with 94.44 % accuracy on our dataset. A parallel investigation into the effect of damage severity on pyrolysis recycling showed that heavily delaminated samples required significantly less energy for comparable matrix removal than undamaged samples.

dielectric variables↗
NASA NTRS1998

Effects of sleep loss, time of day, and extended mental work on implicit and explicit learning of sequences

Tacit knowledge is part of many professional skills and can be studied experimentally with implicit-learning paradigms. The authors explored the effects of 2 different stressors, loss of sleep and mental fatigue, on implicit learning in a serial-response time (RT) task. In the 1st experiment, 1 night of sleep deprivation was shown to impair implicit but not explicit sequence learning. In the 2nd experiment, no impairment of both types of sequence learning was found after 1.5 hr of mental work. Serial-RT performance, in contrast, suffered from both stressors. These findings suggest that sleep deprivation induces specific risks for automatic, skill-based behavior that are not present in consciously controlled performance.

Learning↗
DOE OSTI2021

A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem

Mobility on demand (MoD) systems show great promise in realizing flexible and efficient urban transportation. However, significant technical challenges arise from operational decision making associated with MoD vehicle dispatch and fleet rebalancing. For this reason, operators tend to employ simplified algorithms that have been demonstrated to work well in a particular setting. To help bridge the gap between novel and existing methods, we propose a modular framework for fleet rebalancing based on model-free reinforcement learning (RL) that can leverage an existing dispatch method to minimize system cost. In particular, by treating dispatch as part of the environment dynamics, a centralized agent can learn to intermittently direct the dispatcher to reposition free vehicles and mitigate against fleet imbalance. We formulate RL state and action spaces as distributions over a grid partitioning of the operating area, making the framework scalable and avoiding the complexities associated with multiagent RL. Numerical experiments, using real-world trip and network data, demonstrate that RL reduces waiting time by 28% to 38% for the same-day evaluation, 17% to 44% for cross-day evaluation, and 22% to 25% for cross-season evaluation compared with no rebalancing scenarios. This approach has several distinct advantages over baseline methods including: improved system cost; high degree of adaptability to the selected dispatch method; and the ability to perform scale-invariant transfer learning between problem instances with similar vehicle and request distributions.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Prediction of histone post-translational modifications using deep learning

Abstract Motivation Histone post-translational modifications (PTMs) are involved in a variety of essential regulatory processes in the cell, including transcription control. Recent studies have shown that histone PTMs can be accurately predicted from the knowledge of transcription factor binding or DNase hypersensitivity data. Similarly, it has been shown that one can predict PTMs from the underlying DNA primary sequence. Results In this study, we introduce a deep learning architecture called DeepPTM for predicting histone PTMs from transcription factor binding data and the primary DNA sequence. Extensive experimental results show that our deep learning model outperforms the prediction accuracy of the model proposed in Benveniste et al. (PNAS 2014) and DeepHistone (BMC Genomics 2019). The competitive advantage of our framework lies in the synergistic use of deep learning combined with an effective pre-processing step. Our classification framework has also enabled the discovery that the knowledge of a small subset of transcription factors (which are histone-PTM and cell-type-specific) can provide almost the same prediction accuracy that can be obtained using all the transcription factors data. Availabilityand implementation https://github.com/dDipankar/DeepPTM. Supplementary information Supplementary data are available at Bioinformatics online.

Baisya, Dipankar Ranjan (ORCID:0000000267847359)↗
NASA NTRS1993

The X-15 airplane - Lessons learned

The X-15 rocket research airplane flew to an altitude of 354,000 ft and reached Mach 6.70. In almost 200 flights, this airplane was used to gather aerodynamic-heating, structural loads, stability and control, and atmospheric-reentry data. This paper describes the origins, design, and operation of the X-15 airplane. In addition, lessons learned from the X-15 airplane that are applicable to designing and testing the National Aero-Space Plane are discussed.

Aeroplane↗
DOE OSTI2023

Deep reinforcement learning assisted co-optimization of Volt-VAR grid service in distribution networks

With the increasing penetration of distributed energy resources in distribution networks, Volt-VAR control and optimization (VVC/VVO) have become very important to ensure an acceptable quality of service to all customers. System operators can rely on slow-responding utility devices, including capacitor banks and on-load tap changing transformers, along with fast-responding battery and photovoltaic (PV) inverters for the VVC/VVO implementation. Because of variations in response time of these two classes of devices, and different control actions (discrete versus continuous), coordinated and optimal scheduling and operation have become of utmost importance. Here, this paper develops a look-ahead deep reinforcement learning (DRL)-based multi-objective VVO technique to improve the voltage profile of active distribution networks, decrease network and inverter power loss, and save the operational cost of the grid. It proposes a deep deterministic policy gradient (DDPG)-based approach to schedule the optimal reactive and/or active power set-points of fast-responding inverters, and a deep Q-network (DQN)-based DRL agent to schedule the discrete decisions variables of slow-responding assets. The reactive power output of PV and battery smart inverters are scheduled at 30-minute intervals and the capacitors’ commitment status is scheduled with several hour intervals. The proposed framework is validated on the modified IEEE 34-bus and 123-bus test cases with embedded PV and PV-plus-storage. To validate the efficacy of the proposed VVO, it is compared with several scenarios, including the base case without VVO, localized droop control of DERs, DDPG-only, and twin delayed DDPG (TD3) agent-based DRL techniques. The results justify the superior performance of the proposed method to improve the voltage profile, reduce network power loss, and minimize the look-ahead grid operational cost while minimizing the undesirable power losses in inverters as a result of power factor adjustments.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

An adaptive, data-driven multiscale approach for dense granular flows

The accuracy of coarse-grained continuum models of dense granular flows is limited by the lack of high-fidelity closure models for granular rheology. One approach to addressing this issue, referred to as the hierarchical multiscale method, is to use a high-fidelity fine-grained model to compute the closure terms needed by the coarse-grained model. The difficulty with this approach is that the overall model can become computationally intractable due to the high computational cost of the high-fidelity model. In this work, we describe a multiscale modeling approach for dense granular flows that utilizes neural networks trained using high-fidelity discrete element method (DEM) simulations to approximate the constitutive granular rheology for a continuum incompressible flow model. Our approach leverages an ensemble of neural networks to estimate predictive uncertainty that allows us to determine whether the rheology at a given point is accurately represented by the neural network model. Additional DEM simulations are only performed when needed, minimizing the number of additional DEM simulations required when updating the rheology. This adaptive coupling significantly reduces the overall computational cost of the approach while controlling the error. In addition, the neural networks are customized to learn regularized rheological behavior to ensure well-posedness of the continuum solution. We first validate the approach using two-dimensional steady-state and decelerating inclined flows. We then demonstrate the efficiency of our approach by modeling three-dimensional sub-aerial granular column collapse for varying initial column aspect ratios, where our multiscale method compares well with the computationally expensive computational fluid dynamics (CFD)-DEM simulation.

Dense granular flows↗
DOE OSTI2021

Best practices in catalysis: A perspective

Catalysis, from its roots in petrochemical refining and conversion, has emerged as a transdisciplinary field that now encompasses synthesis of materials and molecules that enable applications in energy conversion and storage, environmental remediation, medicine, plastics, and fertilizer production, among numerous others. A handful of disciplines can claim relevance and success over such an extended period of time and continue to claim a preeminent role in defining the state-of-the-art in science and technology. Syncretic and rapid advancements in formulation and spectroscopic characterization of materials and molecules useful as catalysts, high-level density functional and molecular orbital theory calculations, and a strong foundation in concepts of physical chemistry, thermodynamics, and chemical kinetics offer new and abundant opportunities at the present day for addressing the grand challenge of controlling chemical transformations using catalysis. Here, we examine what we have learned of concepts that underpin heterogeneous catalysis but more importantly, how we learned to archive our knowledge in context of a set of best practices and standards that have emerged in the course of our learnings—ones we seek to highlight herein. Our perspective emphasizes concepts in synthesis, characterization, kinetics, and theory, because these four elements combined enable description of molecular acts that happen on surfaces and how fast they occur. In revisiting best practices in heterogeneous catalysis in these sub-fields and in authorship and peer review we aspire to augment clarity, reproducibility, and rigor in the science and practice of catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Peatland fires in Alaska will double by the end of the century

During recent summers, warm and dry conditions have increased the occurrence of wildfires and potentially peat-fires across Alaska. Limitations in resolving the fine-scale distribution of peatlands and climate observations have constrained our ability to accurately predict peat-fire dynamics. Using a new high-resolution peatland map of Alaska, we evaluated the climate and environmental controls of past and future peat-fire activity. Ensemble machine learning models identified reduced soil moisture, higher temperatures, and evapotranspiration as key predictors of annual total burned peatland area (tenfold CV R 2 = 0.62, RMSE = 221.1 km 2 ). By the end of the twenty-first century, models forced with climate datasets from representative concentration pathways (RCPs) 4.5, 6.0, and 8.5 emission scenarios project a statewide doubling of burned peatlands (increasing 61–121%), with regional increases ranging from 25–165% in polar, 61–95% in boreal, and 102–106% in maritime ecoregions. These projections indicate that wildfires will progressively encroach further into organic-rich moist and wet peaty soils, potentially amplifying soil carbon release across Alaska.

climate-change ecology↗
DOE OSTI2023

Band gap predictions of double perovskite oxides using machine learning

Abstract The compositional and structural variety inherent to oxide perovskites spawn wide-ranging applications. In perovskites, the band gap E g , a key material parameter for these applications, can be optimally controlled by varying the composition. Here, we implement a hierarchical screening process in which two cross-validated and predictive machine learning models for band gap classification and regression, trained using exhaustive datasets that span 68 elements of the periodic table, are applied sequentially. The classification model separates wide band gap materials, with E g ≥ 0.5 eV, from materials which have zero or relatively small band gaps, namely E g < 0.5 eV, and the second regression model quantitatively predicts the gap value of the wide band gap compounds. The study down-selects 13,589 cubic oxide perovskite compositions that are predicted to be experimentally formable, thermodynamically stable, and have a wide band gap. Of these, a subset of 310 compounds, which are predicted to be stable and formable with a confidence greater than 90%, are identified for further investigation. Our models are methodically analyzed via performance metrics and inter-dependence of model features to gain physical insight into the band gap prediction problem. Design maps to identify the variation of band gap with substitution of different elements are also presented.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Accelerating Large-Format Metal Additive Manufacturing: How Controls R&D is Driving Speed, Scale, and Efficiency

This article highlights work at Oak Ridge National Laboratory’s Manufacturing Demonstration Facility to develop closed-loop, feedback control for laser-wire based Directed Energy Deposition, a form of metal Big Area Additive Manufacturing (m-BAAM), a process being developed in partnership with GKN Aerospace specifically for the production of Ti-6Al-4V pre-forms for aerospace components. A large-scale structural demonstrator component is presented as a case-study in which not just control, but the entire 3D printing workflow for m-BAAM is discussed in detail, including design principles for large-format metal AM, toolpath generation, parameter development, process control, and system operation, as well as post-print net-shape geometric analysis and finish machining. In terms of control, a multi-sensor approach has been utilized to measure both layer height and melt pool size, and multiple modes of closed-loop control have been developed to manipulate process parameters (laser power, print speed, deposition rate) to control these variables. Layer height control and melt pool size control have yielded excellent local (intralayer) and global (component-level) geometry control, and the impact of melt pool size control in particular on thermal gradients and material properties is the subject of continuing research. Further, these modes of control have allowed the process to advance to higher deposition rates (exceeding 7.5 lb/hr), larger parts (1-meter scale), shorter build times, and higher overall efficiency. The control modes are examined individually, highlighting their development, demonstration, and lessons learned, and it is shown how they operate concurrently to enable the printing of a large-scale, near net shape Ti-6Al-4V component.

Gibson, Brian↗
DOE OSTI2022

TULIP: An RNA-seq-based Primary Tumor Type Prediction Tool Using Convolutional Neural Networks

Background: With cancer as one of the leading causes of death worldwide, accurate primary tumor type prediction is critical in identifying genetic factors that can inhibit or slow tumor progression. There have been efforts to categorize primary tumor types with gene expression data using machine learning, and more recently with deep learning, in the last several years. Methods In this paper, we developed four 1-dimensional (1D) Convolutional Neural Network (CNN) models to classify RNA-seq count data as one of 17 highly represented primary tumor types or 32 primary tumor types regardless of imbalanced representation. Additionally, we adapted the models to take as input either all Ensembl genes (60,483) or protein coding genes only (19,758). Unlike previous work, we avoided selection bias by not filtering genes based on expression values. RNA-seq count data expressed as FPKM-UQ of 9,025 and 10,940 samples from The Cancer Genome Atlas (TCGA) were downloaded from the Genomic Data Commons (GDC) corresponding to 17 and 32 primary tumor types respectively for training and validating the models. Results: All 4 1D-CNN models had an overall accuracy of 94.7% to 97.6% on the test dataset. Further evaluation indicates that the models with protein coding genes only as features performed with better accuracy compared to the models with all Ensembl genes for both 17 and 32 primary tumor types. For all models, the accuracy by primary tumor type was above 80% for most primary tumor types. Conclusions: We packaged all 4 models as a Python-based deep learning classification tool called TULIP (TUmor CLassIfication Predictor) for performing quality control on primary tumor samples and characterizing cancer samples of unknown tumor type. Further optimization of the models is needed to improve the accuracy of certain primary tumor types.

Jones, Sara↗