Search NASA⌕ Search

SEARCH · Search NASA

Results for “Continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Polarized target nuclear magnetic resonance measurements with deep neural networks

Continuous-wave Nuclear Magnetic Resonance (CW-NMR) operated in constant-current mode has served as a foundational technique for polarization measurement in solid-state dynamically polarized targets within nuclear and high-energy physics experiments for several decades, and it remains an essential tool. Conventional Q-meter-based phase-sensitive detection is critical for precise real-time determination of target polarization during scattering runs. However, the accuracy and reliability of these measurements are frequently compromised by elevated noise levels, baseline drift, and systematic uncertainties arising from signal isolation and fitting, ultimately degrading the overall experimental figure of merit. In this work, we report the first successful application of neural network architectures to continuous-wave NMR polarization metrology. By leveraging advanced machine learning techniques for signal extraction and denoising, we achieve a substantial reduction of fitting uncertainties under a variety of realistic simulated and experimental conditions. These improvements translate directly into more robust real-time (online) polarization monitoring and higher precision in subsequent offline analysis. By reducing analysis-induced uncertainty, the resulting methodology can improve the effective figure of merit for scattering experiments employing dynamically polarized targets and provides a new toolset for NMR-based polarimetry in high-energy and nuclear physics.

Metrology↗

Explainable and Differentiable Reinforcement Learning for Multi-objective Optimization in Particle Accelerators

Operating particle accelerators involves optimizing multiple goals simultaneously, which can be challenging due to trade-offs among objectives. While evolutionary algorithms like the genetic algorithm (GA) have been used for various Multi-Objective Optimization (MOO) tasks, they are not inherently suited for complex control problems. This talk highlights two variations of Reinforcement Learning (RL) for concurrently optimizing heat load and trip rates at the Continuous Electron Beam Accelerator Facility (CEBAF). The problem involves strict constraints on individual states, actions, and overall energy requirements of the beam. First, this talk highlights how differentiability can be harnessed through a Deep Differentiable Reinforcement Learning (DDRL) approach to address MOO issues within particle accelerators. We examine the DDRL method alongside Model Free Reinforcement Learning (MFRL), GA, and Bayesian Optimization (BO). The performance of these methods is assessed by generating a Pareto-front for two objectives. Our findings indicate that DDRL excels in handling high-dimensional problems more effectively than MFRL, BO, and GA. Next, we will show integration of explainable physics-based constraints into RL algorithms to enhance trans- parency and trust in decision-making processes by enabling users to verify that agents adhere to established physical principles. This surrogate function can be modeled using neural networks or sparse dictionary mod- els. By examining the mathematical form of the learned constraint function, we are able to confirm the agent has learned to use the established physics of each environment provided but the surrogate model. In addi- tion, we find that the introduction of a mathematical functional dictionary based surrogate model enables our reinforcement learning algorithms to reliably converge for difficult high-dimensional accelerator controls environments.

Rajput, Kishansingh [Thomas Jefferson National Acc↗

Scheduling lessons learned from the Autonomous Power System

The Autonomous Power System (APS) project at NASA LeRC is designed to demonstrate the applications of integrated intelligent diagnosis, control, and scheduling techniques to space power distribution systems. The project consists of three elements: the Autonomous Power Expert System (APEX) for Fault Diagnosis, Isolation, and Recovery (FDIR); the Autonomous Intelligent Power Scheduler (AIPS) to efficiently assign activities start times and resources; and power hardware (Brassboard) to emulate a space-based power system. The AIPS scheduler was tested within the APS system. This scheduler is able to efficiently assign available power to the requesting activities and share this information with other software agents within the APS system in order to implement the generated schedule. The AIPS scheduler is also able to cooperatively recover from fault situations by rescheduling the affected loads on the Brassboard in conjunction with the APEX FDIR system. AIPS served as a learning tool and an initial scheduling testbed for the integration of FDIR and automated scheduling systems. Many lessons were learned from the AIPS scheduler and are now being integrated into a new scheduler called SCRAP (Scheduler for Continuous Resource Allocation and Planning). This paper will service three purposes: an overview of the AIPS implementation, lessons learned from the AIPS scheduler, and a brief section on how these lessons are being applied to the new SCRAP scheduler.

Ringer, Mark J.↗

Novel Advancements in Internet-Based Real-Time Data Technologies

AZ Technology has been working with NASA MSFC (Marshall Space Flight Center) to find ways to make it easier for remote experimenters (RPI's) to monitor their International Space Station (ISS) payloads in real-time from anywhere using standard/familiar devices. That effort resulted in a product called 'EZStream' which is in use on several ISS-related projects. Although the initial implementation is geared toward ISS, the architecture and lessons learned are applicable to other space-related programs. This paper begins with a brief history on why Internet-based real-time data is important and where EZStream or products like it fit in the flow of data from orbit to experimenter/researcher. A high-level architecture is then presented along with explanations of the components used. A combination of commercial-off-the-shelf (COTS), Open Source, and custom components are discussed. The use of standard protocols is shown along with some details on how data flows between server and client. Some examples are presented to illustrate how a system like EZStream can be used in real world applications and how care was taken to make the end-user experience as painless as possible. A system such as EZStream has potential in the commercial (non-ISS) arena and some possibilities are presented. During the development and fielding of EZStream, a lot was learned. Good and not so good decisions were made. Some of the major lessons learned will be shared. The development of EZStream is continuing and the future of EZStream will be discussed to shed some light over the technological horizon.

Myers, Gerry↗

Integrated System Health Management (ISHM) Technology Demonstration Project Final Report

Integrated System Health Management (ISHM) is an essential capability that will be required to enable upcoming explorations mission systems such as the Crew Exploration Vehicle (CEV) and Crew Launch Vehicle (CLV), as well as NASA aeronautics missions. However, the lack of flight experience and available test platforms have held back the infusion by NASA Ames Research Center (ARC) and the Jet Propulsion Laboratory (JPL) of ISHM technologies into future space and aeronautical missions. To address this problem, a pioneer project was conceived to use a high-performance aircraft as a low-cost proxy to develop, mature, and verify the effectiveness of candidate ISHM technologies. Given the similarities between spacecraft and aircraft, an F/A-18 currently stationed at Dryden Flight Research Center (DFRC) was chosen as a suitable host platform for the test bed. This report describes how the test bed was conceived, how the technologies were integrated on to the aircraft, and how these technologies were matured during the project. It also describes the lessons learned during the project and a forward path for continued work.

Mackey, Ryan↗

Reinventing the International Space Station Payload Integration Processes and Capabilities

The fundamental ISS payload integration philosophy, processes and capabilities were established in the context of how NASA science programs were conducted and executed in the early 1990 s. Today, with the designation of the United States (US) portion of ISS as a National Lab, the ISS payload customer base is growing to include other government agencies, private and commercial research. The fields of research are becoming more diverse expanding from the NASA centric physical, materials and human research sciences to test beds for exploration and technology demonstration, biology and biotechnology, and as an Earth and Space science platform. This new customer base has a broader more diverse set of expectations and requirements for payload design, verification, integration, test, training, and operations. One size fits all processes are not responsive to this broader customer base. To maintain an organization s effectiveness it must listen to its customers, understand their needs, learn from its mistakes, and foster an environment of continual process improvement. The ISS Payloads office is evolving to meet these new customer expectations.

Jones, Rod↗

The Heliopause Electrostatic Rapid Transit System (HERTS) Design, Trades, and Analyses Performed in a Two Year NASA Investigation of Electric Sail Propulsion Systems

The Heliopause Electrostatic Rapid Transit System (HERTS) was one of the seven total Phase II NASA Innovative Advanced Concepts (NIAC) that was down-selected in 2015 for continued funding and research. In Phase I our team learned that a spacecraft propelled by an Electric Sail (E-Sail) can travel great astronomical distances, such as to the Heliopause region of the solar system (approx. 100 to 120 AU) in approximately one quarter of the time (10 years) versus the time it took the Voyager spacecraft launched in 1977 (36 years). The completed work within the Phase II NIAC funded effort builds upon the work that was done in the Phase I NIAC and is focused on: 1) Testing of plasma interaction with a charged wire in a MSFC simulated solar environment vacuum test chamber. 2) Development of a Particle-in-Cell (PIC) models that are validated in the plasma testing and used to extrapolate to the E-Sail propulsion system design. 3) Conceptual design of a Technology Demonstration Mission (TDM) spacecraft developed to showcase E-Sail propulsion systems. 4) Down selection of both: a) Materials for a multi km length conductor and, b) Best configuration of the proposed conductor deployment subsystem. This paper will document the findings to date (June, 2017) of the above focused areas.

Wiegmann, Bruce M.↗

NASA's Space Launch System and Deep Space Opportunities for Smallsats

Overview of the agency’s plans for deep space exploration: NASA has a phased approach to successful human exploration of deep space; We began LEO (Low Earth Orbit), where we’ve lived aboard the ISS continuously for more than 17 years; What have we learned in those years that will help us put boots on the moon with eyes toward Mars? And also help us on Earth? - Advances in materials research - 3D printing in space - Engineered life support systems for sustained stays in space - Better understanding of the effects of microgravity on the human body - We deploy CubeSats from the ISS (International Space Station) - We’ve cooperate with international partners - We’ve opened transportation to LEO to commercial vehicles; Allowing commercial companies to take over LEO frees NASA to explore deep space - next step is back to the Moon; NASA will establish a lunar Gateway near the moon (near rectilinear halo orbit);The Gateway will be crew tended (30-90 day missions); Gateway will communicate with Earth and lunar surface; Will open new opportunities for robotic exploration of the moon, especially far side of the moon and poles; Prospecting for volatiles will be high on the list of priorities; SLS (Space Launch System)/Orion will participate in gateway assembly and operation; Will serve as a testbed for new technologies and inform future Mars missions; After learning how to live and work in deep space like we did in LEO, NASA will move on Mars missions; SLS’s capability to accommodate primary, co-manifested and secondary payloads (when available) is a key component in making this vision a reality.

Bookout, Paul S.↗

Design and Test of an Electromechanical Rover Tether for the Exploration of Vertical Lunar Pit

Moon Diver is a proposed mission to land and deploy an extreme-terrain, tethered rover for the exploration of Tranquillitatis Pit, a large vertical cave entrance into the subsurface of Earth’s Moon. By leveraging a supportive tether, the Axel rover, developed by NASA’s Jet Propulsion Laboratory, would perform a controlled descent into the pit and deploy instruments along the pit wall. The purpose of this mission concept is to study a volcanic secondary crust as a function of depth in order to determine formation processes and chemical makeup. The lifeline of the mission would be the tether, which provides power from, and communication to the top-side lander. Critically, the tether also serves as mechanical support between the suspended rover and the lander, which acts as an anchor. While space tethers have been deployed both in orbit and terrestrially, the use of the proposed tether is unlike any known in the literature; the tether must come into contact with the terrain while under load. With respect to the environment, the tether must also survive abrasion from glassy regolith and volcanic rocks, bending around sharp edges, thermal extremes, and exposure to full spectrum ultra-violet (UV) radiation, all while reliably transferring up to 100 W of power and 1 Mbps of data. Furthermore, since the Axel rover pays out tether from an internal spool, the tether’s diameter must be minimized to increase spool capacity, allowing for up to a 300-m traverse while also meeting static and dynamic strength requirements. This paper covers several phases of the tether’s initial development, including i) a trade study of structure and materials with consideration for space heritage, ii) selected design justification, and iii) results from tests on prototype tethers looking into mechanical, electrical, and environmental properties, including exposure to rock regolith abrasion, load profiles at temperature, and degradation due to UV exposure while exposed to vacuum. Finally, we provide insights and lessons learned from lab and field tests, which inform our continued effort to design a tether capable of surviving rugged, lunar conditions.

Nensas, Issa↗

The Impact of the NASA – Keck Observatory Partnership

In the last thirty years, NASA Space Sciences and the W. M. Keck Observatory have established a partnership that has enabled both organizations to collaborate on scientific endeavors, some more successful than others. This ad-hoc relationship started with NASA participation in the Keck II construction around 1993 and it was formalized later in 1996 in the form of a Cooperative Agreement, a contractual vehicle which remains active until the present. The intention of documenting this partnership is to celebrate 30-years of Keck operations and for the benefit of future similar endeavors that could be established on protected lands. The value of lessons learned from these partnerships enables more effective ways to continue with future partnerships and agreements. In this document, we present the inception, evolution, and current status of this partnership by exploring four important past and current tasks or activities: Keck II development, Keck Interferometer and Outriggers, Keck Observatory Archive, and the continuous support of NASA space missions throughout the years. After diving into this sensitive and important topic, we offer some reflections on important points of the partnership and identify lessons that can be utilized in the future.

NASA history↗

Using Reinforcement Learning to Design Missed Thrust Resilient Trajectories

From ion thrusters to solar sails, spacecraft continue to adopt new and more efficient forms of propulsion. As these low-thrust propulsion meth- ods have become more prevalent, new challenges have arisen. Depending on the mission, low-thrust propulsion elements may need to thrust con- tinuously for days/months. During these thrusting periods, external fac- tors, such as a micro-meteoroid impact or a software glitch, may cause the spacecraft to prematurely cease its thrust stage. Half of all deep space missions enter a safe mode where they cannot thrust every four months. These missed thrust events can result in the complete loss of a space- craft for time-dependent trajectories like planetary rendezvous. This paper demonstrates how neural networks, trained using reinforcement learning, can autonomously correct for missed thrust events during an interplanetary trajectory.

Laipert, Frank E.↗

SRF CAVITY FAULT PREDICTION USING DEEP LEARNING AT JEFFERSON LAB

In this study, we present a deep learning-based pipeline for predicting superconducting radio-frequency (SRF) cavity faults in the Continuous Electron Beam Accelera-tor Facility (CEBAF) at Jefferson Lab. We leverage pre-fault RF signals from C100-type cavities and employ deep learning to predict faults in advance of their onset. We train a binary classifier model to distinguish between stable and impending fault signals. Test results show accuracies exceeding 99% for distinguishing between normal signals and pre-fault signals from a class of more slowly developing fault types, such as microphonics. We describe results from a proof-of-principle demonstration on a realistic, imbalanced data set and report performance metrics. Encouraging results suggest that future SRF systems could leverage this framework and implement measures to mitigate the onset in more slowly developing fault types.

Rahman, M.↗

Diagnostics, Prognostics, and Optimization for Lithium-Ion Battery Systems

Health management of lithium-ion battery systems presents a host of challenges due to their complex physics, large numbers of components, and a wide variety of degradation behaviors across different battery types. Dr. Paul Gasper will present on research from the Electrochemical Energy Storage Group on Lithium-ion battery diagnostics, prognostics, and optimization. Diagnostics research, including state-estimation via machine-learning from electrochemical impedance spectroscopy and DC pulses as well as continuous state-estimation via Kalman filters, will highlight the ongoing challenges for accurately measuring the state of batteries without performing time-consuming characterization tests. NLR's industry-recognized battery prognostics work, which predicts real-world battery degradation by identifying degradation rate models from accelerated aging data using statistical modeling and machine-learning, will be used to demonstrate the critical impact of battery controls, thermal management, and operating strategy on durability and lifetime. Finally, the use of prognostic models for financial or lifetime optimization will be discussed.

25 ENERGY STORAGE↗

Cross-domain digital twin architecture for predictive maintenance via machine learning and Large Language Models

This research introduces a comprehensive framework for creating and deploying a digital twin platform for continuous monitoring and predictive maintenance within industrial settings. Through utilizing advanced technologies, including Unreal Engine 5, Unity 3D, the Message Queue Telemetry Transport protocol, Random Forest machine learning algorithms, and Large Language Models (LLMs), we establish a platform that digitally reproduces physical equipment and translates digital controls into real-world actions. This facilitates preventive maintenance approaches and improves operational effectiveness. The digital twin platform gathers sensor data from operational equipment, analyzes it using machine learning, and delivers practical insights to prevent potential malfunctions and enhance equipment performance. Furthermore, the incorporation of a web portal enables efficient monitoring and access to historical data, educational materials, and equipment status information. Preliminary findings indicate that digital twins can transform industrial equipment management and maintenance methodologies.

97 MATHEMATICS AND COMPUTING↗

Surrogate construction via weight parameterization of residual neural networks

Surrogate model development is a critical step for uncertainty quantification or other sample-intensive tasks for complex computational models. Here, in this work, we develop a multi-output surrogate form using a class of neural networks (NNs) that employ shortcut connections, namely Residual NNs (ResNets). ResNets are known to regularize the surrogate learning problem and improve the efficiency and accuracy of the resulting surrogate. Inspired by the continuous, Neural ODE analogy, we augment ResNets with weight parameterization strategy with respect to ResNet depth. Weight-parameterized ResNets regularize the NN surrogate learning problem and allow better generalization with a drastically reduced number of learnable parameters. We demonstrate that weight-parameterized ResNets are more accurate and efficient than conventional feed-forward multi-layer perceptron networks. We also compare various options for parameterization of the weights as functions of ResNet depth. We demonstrate the results on both synthetic examples and a large scale earth system model of interest.

97 MATHEMATICS AND COMPUTING↗

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗

Machine Learning for Anomaly Detection in Neural Network Security and SRF Cavities

This dissertation explores the development and deployment of machine learning approaches to address critical challenges in anomaly detection across two distinct domains: neural network security in federated learning settings and cavity behavior analysis in particle accelerator operations at Jefferson Lab in Newport News, Virginia. Anomaly detection identifies deviations from expected patterns, safeguarding systems in cybersecurity, industry, and research against malicious activities and failures. This dissertation demonstrates how our machine learning approaches enhance detection accuracy and efficiency in both neural network security and industrial applications. First, we investigate vulnerabilities in deep neural networks deployed in federated learning. Although federated learning preserves user privacy by training models locally, it remains vulnerable to backdoor attacks, in which malicious participants embed hidden triggers that induce targeted misbehavior. We propose a self-supervised contrastive learning framework to detect and mitigate such backdoor attacks. In our experiments, this method achieves higher detection accuracy and lower false positive rates than existing defenses, while operating without access to local model updates or original training data and thus preserving the privacy guarantees of the federated setting. Second, we address the operational reliability of superconducting radio-frequency (SRF) cavities at the Continuous Electron Beam Accelerator Facility (CEBAF). Our research leverages an unsupervised learning approach, combined with Principal Component Analysis (PCA) and k-means clustering, to identify anomalous behaviors in SRF cavities. Our method detects subtle anomalous behavior by analyzing SRF signal data. This knowledge allows for the early detection and resolution of potential faults, significantly improving the efficiency and reliability of operations. Third, we extend these insights to time-series anomaly detection more broadly. We design a contrastive-learning based model tailored to increasingly dynamic environments and academic research. This model improves detection accuracy in settings that require real-time monitoring and predictive maintenance. Our research underscores the broader applicability and impact of advanced machine learning techniques in anomaly detection. By extracting meaningful patterns from complex data, machine learning can significantly enhance security in distributed neural networks and improve the efficiency of particle accelerator operations. This dissertation serves as a stepping stone for future investigations into the vast possibilities of anomaly detection, inspiring further exploration and development of machine learning techniques in this field.

Ferguson, Hal [Old Dominion University]↗

Entanglement engineering of optomechanical systems by reinforcement learning

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

97 MATHEMATICS AND COMPUTING↗