Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

A Boundary Topology Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance has become a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization for light-weighting electric machines using traditional approaches typically explore a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods like cell-based density approaches suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the IEA-15MW radial flux direct-drive wind turbine generator. The free-from boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with upto 20-ton reduction in electrical steel mass.

additive manufacturing↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing: Preprint

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The free-form boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

Self-supervised learning of spatiotemporal thermal signatures in additive manufacturing using reduced order physics models and transformers

Microstructure control via additive manufacturing has enormous potential as manufacturers, materials scientists, and designers alike seek to exploit novel fabrication technologies to improve component performance. Recent works have demonstrated the feasibility of producing materials with controlled microstructures across various length scales. However, the experimental approach towards exploring the process-structure space can be laborious and costly. This is particularly true if also considering scan pattern optimization which is well suited for processes such as powder bed fusion electron beam melting. In this work we propose an approach for encoding additive manufacturing layer-wise thermal response signatures using self-supervised representation learning. Thermal simulations from a reduced order model are utilized to estimate the spatiotemporal response during printing. A machine learning framework, using video-transformers, is utilized to efficiently distill spatiotemporal patterns into a compact latent space representation. This latent state representation encodes the relevant physics which is then utilized to establish a data-driven process-structure model for an additively manufactured Ni-based superalloy. In conclusion, the proposed methodology could potentially be used towards in-situ process monitoring, scan pattern experimental design, and component qualification.

97 MATHEMATICS AND COMPUTING↗

Neural network representation and learning of mappings and their derivatives

Discussed here are recent theorems proving that artificial neural networks are capable of approximating an arbitrary mapping and its derivatives as accurately as desired. This fact forms the basis for further results establishing the learnability of the desired approximations, using results from non-parametric statistics. These results have potential applications in robotics, chaotic dynamics, control, and sensitivity analysis. An example involving learning the transfer function and its derivatives for a chaotic map is discussed.

White, Halbert↗

Effects of Learning on Performance When Computerized Dynamic Posturography Assessments Are Repeated

Background: Computerized dynamic posturography is widely used to measure balance control performance. Clinically, performance is assessed by comparing individual data against standards obtained from a normative population. When performing repeated assessments to track performance changes, one must be concerned with the influence of learning effects. Subjects do not have the opportunity to practice before the first session, and often a second session is not performed prior to an experiment. Thus, the objective of this activity was to examine learning effects on balance control performance. We hypothesize that subjects will perform better on the second session when compared to the first, and that the difference will be greater for more difficult conditions. Methods: Data were collected from 204 subjects using the NeuroCom Equitest system during quiet stance with arms crossed at the chest on up to two sessions. All subjects performed standard sensory organization tests (SOTs) including 1) normal vision, fixed support; 2) absent vision, fixed support; 3) sway-referenced vision, fixed support; 4) normal vision, swayreferenced support; 5) absent vision, sway-referenced support; and 6) sway-referenced vision, sway-referenced support. 120 of these subjects performed modified sensory organization tests (mSOTs 2 and 5) which included static (20 back) and dynamic (20, 0.33Hz) head tilts. Median equilibrium scores (mEQ) were calculated from peak-to-peak anterior-posterior sway across trials. Data collected on the first session were then compared with the second to examine learning effect. Results: There were no differences in mEQ scores between the first and second sessions for SOTs 1, 2, and 4, while mEQ scores were higher for the second session when compared to the first for SOTs 3, 5, and 6 and for all mSOTs. Discussion: An additional familiarization session or practice trials prior to the first session may be necessary for more challenging SOT and mSOT conditions to minimize learning effect.

Taylor, Laura C.↗

Controlling $H_{3}^{+}$ Formation From Ethane Using Shaped Ultrafast Laser Pulses

An adaptive learning algorithm coupled with 3D momentum-based feedback is used to identify intense laser pulse shapes that control $H_{3}^{+}$ formation from ethane. Specifically, we controlled the ratio of D 2 H + to $D_{3}^{+}$ produced from the D 3 C-CH 3 isotopologue of ethane, which selects between trihydrogen cations formed from atoms on one or both sides of ethane. We are able to modify the D 2 H + :$D_{3}^{+}$ ratio by a factor of up to three. In addition, two-dimensional scans of linear chirp and third-order dispersion are conducted for a few fourth-order dispersion values while the D 2 H + and $D_{3}^{+}$ production rates are monitored. The optimized pulse is observed to influence the yield, kinetic energy release, and angular distribution of the D 2 H + ions while the $D_{3}^{+}$ ion dynamics remain relatively stable. We subsequently conducted COLTRIMS experiments on C 2 D 6 to complement the velocity map imaging data obtained during the control experiments and measured the branching ratio of two-body double ionization. Two-body $D_{3}^{+}$ + $C_{2}D_{3}^{+}$ is the dominant final channel containing $D_{3}^{+}$ ions, although the three-body D + $D_{3}^{+}$ + $C_{2}D_{2}^{+}$ final state is also observed.

74 ATOMIC AND MOLECULAR PHYSICS↗

Overview of Advanced Stirling Convertor Dual Convertor Controller Development and Testing at NASA Glenn Research Center

For over two decades, NASA Glenn Research Center (GRC) has been supporting the development of Radioisotope Power Systems (RPS). NASA desires higher conversion efficiency RPS options that are reliable and robust with long life design. Dynamic conversion, such as Stirling offer the potential for higher conversion efficiencies than current RPS but have yet to be demonstrated in a flight application. GRC developed a non-nuclear representation of a RPS consisting of a pair of Advanced Stirling Convertors (ASC), a Dual Convertor Controller (DCC), and associated support equipment. The DCC was designed by the Johns Hopkins University/Applied Physics Laboratory (JHU/APL) to actively control a pair of ASCs. Based on lessons learned, three generations of DCCs were developed over the past decade. After each generation of the DCC was completed, tests were performed to verify functionality. These tests include acceptance testing, fault testing, characterization testing, and testing with the Radioisotope Power System Systems Integration Laboratory (RSIL). Acceptance testing verifies that the DCC can control a pair of ASCs to produce full convertor power output. The fault testing verifies that the DCC can maintain control of the ASCs during either internal or external faults. Characterization testing verifies the functionality of the DCC over a range of bus voltage values. RSIL provides insight into the electrical interactions between a representative radioisotope power generator, its associated control schemes, and realistic electric system loads. The DCC design, development, lessons learned, test results, and future work are presented in this paper.

Stirling↗

Multi-fidelity information fusion with concatenated neural networks

Recently, computational modeling has shifted towards the use of statistical inference, deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and leads to poorly generalizable data-driven models. This gap can be furnished by leveraging information from physics-based models. Exploiting prior knowledge about the problem at hand, this study puts forth a physics-guided machine learning (PGML) approach to build more tailored, effective, and efficient surrogate models. For our analysis, without losing its generalizability and modularity, we focus on the development of predictive models for laminar and turbulent boundary layer flows. In particular, we combine the self-similarity solution and power-law velocity profile (low-fidelity models) with the noisy data obtained either from experiments or computational fluid dynamics simulations (high-fidelity models) through a concatenated neural network. We illustrate how the knowledge from these simplified models results in reducing uncertainties associated with deep learning models applied to boundary layer flow prediction problems. The proposed multi-fidelity information fusion framework produces physically consistent models that attempt to achieve better generalization than data-driven models obtained purely based on data. While we demonstrate our framework for a problem relevant to fluid mechanics, its workflow and principles can be adopted for many scientific problems where empirical, analytical, or simplified models are prevalent. In line with grand demands in novel PGML principles, this work builds a bridge between extensive physics-based theories and data-driven modeling paradigms and paves the way for using hybrid physics and machine learning modeling approaches for next-generation digital twin technologies.

42 ENGINEERING↗

Third-integer Resonant Extraction Regulation System for Mu2e

A third-integer resonant slow extraction system is being developed for Fermilab's Delivery Ring to deliver protons to the upcoming Mu2e experiment. The timescale of the extraction (or spill) duration is 43 milliseconds, which is extremely short and unprecedented. Additionally, the experiment's strict and challenging requirements on the quality of the spill at this time scale has led to the development of a new Spill Regulation System (SRS) design. The SRS primarily consists of three components - slow regulation, fast regulation, and harmonic content suppressor. Contributions to the first two components of the SRS, i.e., Slow Regulation and Fast Regulation subsystems, will be presented in which new adaptive learning algorithm schemes for the slow regulation of the spill -- validated using particle tracking simulations -- shall be described. In addition to these novel methods for the enhancement of the spill regulation system, results of employing Machine Learning in enhancing the performance of the resonant extraction are also presented. At the forefront of applying ML techniques to solve non-linear accelerator control problems, this work includes optimizing the PID gains as well as the replacement of the traditional PID controller using Recurrent Neural Networks and Gated Recurrent Unit (GRU) ML models to achieve efficiencies greater than a PID controller. Cutting-edge on-going Reinforcement Learning efforts, including an actor-critic family of learning algorithms, to regulate the spill rate will be reviewed, as well as present analytical calculations pertaining the transit time of particles in a third-integer resonant extraction. Detailed numerical investigations and validations of such calculations, the model of which could be exported and reliably used in future analytical modeling of any resonant extraction, are discussed.

43 PARTICLE ACCELERATORS↗

Outlook towards deployable continual learning for particle accelerators

Particle accelerators are high power complex machines. To ensure uninterrupted operation of these machines, thousands of pieces of equipment need to be synchronized, which requires addressing many challenges including design, optimization and control, anomaly detection and machine protection. With recent advancements, machine learning (ML) holds promise to assist in more advance prognostics, optimization, and control. While ML based solutions have been developed for several applications in particle accelerators, only few have reached deployment and even fewer to long term usage, due to particle accelerator data distribution drifts caused by changes in both measurable and non-measurable parameters. In this paper, we identify some of the key areas within particle accelerators where continual learning can allow maintenance of ML model performance with distribution drifts. Particularly, we first discuss existing applications of ML in particle accelerators, and their limitations due to distribution drift. Next, we review existing continual learning techniques and investigate their potential applications to address data distribution drifts in accelerators. By identifying the opportunities and challenges in applying continual learning, this paper seeks to open up the new field and inspire more research efforts towards deployable continual learning for particle accelerators.

43 PARTICLE ACCELERATORS↗

UX Focused Development Work During Recent ORNL EPICS-Based Instrument Control System Upgrade Projects

The importance of usability and easy-to-use user interfaces (UI) have been recognized across many domains. However, the user-friendliness of scientific experiment control systems often lags behind industry standards in the flourishing user experience (UX) field. Scientific control systems can certainly benefit from these new UX research methods and approaches. Recent instrument control system upgrade projects at the SNS and HFIR facilities at Oak Ridge National Laboratory demonstrate the effectiveness of UX focused development work, and further reveal the need for more utilization of such techniques coming from the UX field. The ongoing control system upgrades are targeting the key facility-level priority of higher scientific productivity, and UX is one of the important tools to help us achieve this priority. We will highlight research methods and practices, introduce our findings and deliverables, and share challenges and lessons learned in applying UX methods to scientific control systems.

Yao, Marie Xingxing↗

Learning Sequential Distribution System Restoration via Graph-Reinforcement Learning

We report a distribution service restoration algorithm as a fundamental resilient paradigm for system operators provides an optimally coordinated, resilient solution to enhance the restoration performance. The restoration problem is formulated to coordinate distribution generators and controllable switches optimally. A model-based control scheme is usually designed to solve this problem, relying on a precise model and resulting in low scalability. To tackle these limitations, this work proposes a graph-reinforcement learning framework for the restoration problem. We link the power system topology with a graph convolutional network, which captures the complex mechanism of network restoration in power networks and understands the mutual interactions among controllable devices. Latent features over graphical power networks produced by graph convolutional layers are exploited to learn the control policy for network restoration using deep reinforcement learning. The solution scalability is guaranteed by modeling distributed generators as agents in a multi-agent environment and a proper pre-training paradigm. Comparative studies on IEEE 123-node and 8500-node test systems demonstrate the performance of the proposed solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Lessons learned: DC-X

The DC-X was conceived and developed specifically to lay the ground work for significantly lowering the cost of space operations. The system design was based on an initial set of program goals and a finite, limited set of resources. The goal in its simplest terms was to demonstrate vertical landing after rotation of the vehicle from a nose-first to an engines-first altitude. Finite resources actually drove the selection of a robust design to reduce fabrication and preflight testing costs. The result was a system with a large amount of flexibility which allowed expansion of the test goals as the system, and test program, evolved. The use of the vehicle flight computer interfacing with the ground control system for flight crew training was also not an initial concept. However, by defining an architecture for the system control modes which allowed additions and modifications as learning progressed, the 6 DOF codes used for flight controls software development were transported to the operating system to be used in a simulated flight mode. Flight data reduction was also greatly improved as the program progressed, and the data needs and presentation were refined. The software, avionics hardware, and the FOCC system development proceeded ahead of the vehicle, primarily because most of the hardware elements were existing at the outset of the program. The Built-in-Test (BIT) for avionics and propulsion systems were adequate. Particularly the flight readiness system which verified the vehicle health after engine start and before throttle-up for flight.

Steinmeyer, D. A.↗

Distributed Control with Collective Intelligence

We consider systems of interacting reinforcement learning (RL) algorithms that do not work at cross purposes , in that their collective behavior maximizes a global utility function. We call such systems COllective INtelligences (COINs). We present the theory of designing COINs. Then we present experiments validating that theory in the context of two distributed control problems: We show that COINs perform near-optimally in a difficult variant of Arthur's bar problem [Arthur] (and in particular avoid the tragedy of the commons for that problem), and we also illustrate optimal performance in the master-slave problem.

Wolpert, David H.↗

Optimal Reward Functions in Distributed Reinforcement Learning

We consider the design of multi-agent systems so as to optimize an overall world utility function when (1) those systems lack centralized communication and control, and (2) each agents runs a distinct Reinforcement Learning (RL) algorithm. A crucial issue in such design problems is to initialize/update each agent's private utility function, so as to induce best possible world utility. Traditional 'team game' solutions to this problem sidestep this issue and simply assign to each agent the world utility as its private utility function. In previous work we used the 'Collective Intelligence' framework to derive a better choice of private utility functions, one that results in world utility performance up to orders of magnitude superior to that ensuing from use of the team game utility. In this paper we extend these results. We derive the general class of private utility functions that both are easy for the individual agents to learn and that, if learned well, result in high world utility. We demonstrate experimentally that using these new utility functions can result in significantly improved performance over that of our previously proposed utility, over and above that previous utility's superiority to the conventional team game utility.

Wolpert, David H.↗

Balancing Training Techniques for Flight Controller Certification

Training of ground control teams has been a difficult task in space operations. There are several intangible skills that must be learned to become the steely eyed men and women of mission control who respond to spacecraft failures that can lead to loss of vehicle or crew if handled improperly. And as difficult as training is, it can also be costly. Every day, month or year an operator is in training, is a day that not only they are being trained without direct benefit to the organization, but potentially an instructor or mentor is also being paid for hours spent assisting them. Therefore, optimization of the training flow is highly desired. Recently the Expedition Division (DI) at Johnson Space Flight Center has recreated their training flows for the purpose of both moving to an operator/specialist/instructor hierarchy and to address past inefficiencies in the training flow. This paper will discuss the types of training DI is utilizing in their new flows, and the balance that has been struck between the ideal learning environments and realistic constraints. Specifically, the past training flow for the ISS Attitude Determination and Control Officer will be presented, including drawbacks that were encountered. Then the new training flow will be discussed and how a new approach utilizes more training methods and teaching techniques. We will look at how DI has integrated classes, workshops, checkouts, module reviews, scenarios, OJT, paper sims, Mini Sims, and finally Integrated Sims to balance the cost and timing of training a new flight controller.

Gosling, Christina↗

Insights and Impacts of Credentials: Energy Auditor, Quality Control Inspector, and Certification Updates

Join this session to learn about recent and upcoming Home Energy Professional credential and resource updates from the National Renewable Laboratory (NREL) in support of the U.S. Department of Energy's Weatherization Assistance Program (WAP). NREL staff will provide an in-depth overview of improvements to the EA and QCI certification schemes. Be prepared to provide feedback and share new ideas in pursuit of continuous improvement within WAP. These certifications are critical to ensuring the highest standards of quality, safety, and efficiency within the Weatherization Assistance Program, helping to elevate the skills of professionals and drive the program's overall success.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗