Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Improving Search Algorithms by Using Intelligent Coordinates

We consider algorithms that maximize a global function G in a distributed manner, using a different adaptive computational agent to set each variable of the underlying space. Each agent eta is self-interested; it sets its variable to maximize its own function g (sub eta). Three factors govern such a distributed algorithm's performance, related to exploration/exploitation, game theory, and machine learning. We demonstrate how to exploit alI three factors by modifying a search algorithm's exploration stage: rather than random exploration, each coordinate of the search space is now controlled by a separate machine-learning-based player engaged in a noncooperative game. Experiments demonstrate that this modification improves simulated annealing (SA) by up to an order of magnitude for bin packing and for a model of an economic process run over an underlying network. These experiments also reveal interesting small-world phenomena.

Wolpert, David H.↗

DOE Final Report Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation

This project set out with an ambitious goal: to develop and apply machine learning-based methods of discovering new controllers and operating regimes for achieving better performing plasmas in tokamaks. As summarized in the dozens of papers below, the project was a huge success. It developed several machine learning components and integrated them into a single ML system that was added to the DIII-D PCS. That functionality was demonstrated over a series of experiments on DIII-D. A brief summary of these results is given here with the details in the published papers below.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SAFE-OCC: A novelty detection framework for Convolutional Neural Network sensors and its application in process control

Herein we present a novelty detection framework for Convolutional Neural Network (CNN) sensors that we call Sensor-Activated Feature Extraction One-Class Classification (SAFE-OCC). We show that this framework enables the safe use of computer vision sensors in process control architectures. Emergent control applications use CNN models to map visual data to a state signal that can be interpreted by the controller. Incorporating such sensors introduces a significant system operation vulnerability because CNN sensors can exhibit high prediction errors when exposed to novel (abnormal) visual data. Unfortunately, identifying such novelties in real-time is nontrivial. To address this issue, the SAFE-OCC framework leverages the convolutional blocks of the CNN to create an effective feature space to conduct novelty detection using a desired one-class classification technique. This approach engenders a feature space that directly corresponds to that used by the CNN sensor and avoids the need to derive an independent latent space. We demonstrate the effectiveness of SAFE-OCC via simulated control environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hardware-accelerated inference for real-time gravitational-wave astronomy

The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Overall, our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine Learning-Assisted Stability Boundary Determination of Multiport Autonomous Reconfigurable Solar Power Plants

The multiport autonomous reconfigurable solar (MARS) power plant is a promising solution to integrate renewable resources and energy storage systems into the alternating current (ac) power grid and an high-voltage direct current (HVdc) link. In the MARS system, various input power sources are connected to the individual submodules (SMs) through direct current (dc)–dc converters. However, the presence of external power sources can result in unbalanced capacitor voltages of SMs, thereby violating stability constraints under multiple/diverse operating conditions. This article aims to address the gap by accurately determining the stability boundary of the MARS system. As such, a novel machine learning (ML)-assisted energy balancing control (EBC) criterion is proposed. Further, in conjunction with a refined EBC, this approach ensures balanced capacitor voltages across various types of SMs, significantly enhancing the overall system efficiency. The proposed EBC criterion effectively controls EBC activation and deactivation, achieving remarkable accuracy. Both power systems computer aided design (PSCAD)/electromagnetic transients including direct current (EMTDC) simulations and control hardware-in-the-loop (cHIL) tests are conducted to validate the feasibility and efficiency of the proposed method. By combining the EBC and ML-assisted EBC criterion, efficient energy management is achieved for systems featuring multiple input power sources, such as MARS. This approach enables the system to fully exploit its potential across an expanded operational range while upholding high-efficiency standards.

14 SOLAR ENERGY↗

HE Production Update at JLab - Introducing an Enhanced Nitrogen Purge for Clean String Assembly

A major limitation to cryomodule performance is field emission caused by particulates within the superconducting cavities. To reduce contamination of the inner surfaces during assembly in a cleanroom, the whole string can be connected to a purge system, which maintains a constant overpressure of dry, clean nitrogen gas. Following successes of similar systems at XFEL and Fermilab, Jefferson Lab followed this example for the production of LCLS-II HE cryomodules. Implementing this system required new procedures, infrastructure, and hardware, as well as significant testing of the system before production began. This paper will summarize the implemented controls and procedures, including lessons learned from Fermilab, as well as the results of mock-up tests. Based on the latter, the system was used to assemble the first article string in April 2022, and was also used during a rework required due to issues with cold FPC ceramics two months later. The benefits of using a purge system with regards to procedure, time savings, and added flexibility for potential rework have already proven to provide a significant improvement for the production of LCLS-II-HE cryomodules at Jefferson Lab.

Owen, P. D.↗

First Ever Polymer Flood Field Pilot To Enhance The Recovery Of Heavy Oils On Alaska’s North Slope - Pushing Ahead One Year Later

In June 2018 the team embarked on an ambitious project to address the slow development pace of Alaska’s 20+ billion barrels heavy oil resource via the first ever polymer flood pilot. Following the successful commencement of the pilot in August 2018, the field demonstration, supporting laboratory experiments and numerical simulation have steadily progressed. A significant amount of valuable data and lessons learned have been collected, and are reported in this paper. The ongoing pilot and the research activities is making headway toward the primary objective of validating the use of polymer flooding for extracting heavy oil in Alaska’s challenging environment. The pilot is conducted in two pre-existing pairs of horizontal injectors and producers in an isolated fault block of the Schrader Bluff heavy oil reservoir at the Milne Point Field. A customized polymer blending and pumping unit injects HPAM polymer at a concentration of 1,750 ppm to achieve a target viscosity of 45 cP. Supporting coreflood laboratory experiments have focused on quantification of polymer retention in the rock, and effect of injection water salinity, polymer, and their combinations on oil recovery. The injection and production response of the pilot flood pattern is utilized to develop a history matched reservoir simulation model for forecasting oil recovery beyond the pilot. Finally, specially designed laboratory experiments address anticipated operating concerns regarding post-polymer breakthrough such as oil-water separation efficiency and polymer induced fouling of heater tubes. Polymer has been injected continuously since startup except for two short equipment modification shutdowns, and more recently a prolonged disruption due to polymer hydration issues at the J-pad field site. Cumulatively, over 600,000 lbs. of polymer has been injected, corresponding to ~7%PV. The two producers show significant decrease in the water cut, gradually increasing oil rate, and no polymer breakthrough. Two main observations from the coreflood are a significant uncertainty in polymer retention values, and positive oil recovery response to low salinity water (2,600 mg/liter TDS). The heterogeneity in the flood pattern presents some challenges in obtaining a robust history matched simulation model. Experimental results on produced fluids treatment indicate the formation of a dense polymer deposit, at certain conditions, on heating tubes that can negatively impact the heat transfer efficiency. The scientific knowledge, including the lessons learned during unanticipated shutdowns, quality control, logistics and field data that is being acquired from this effort has referential value for other planned EOR projects. Finally, by all indications, the polymer field pilot is steadily progressing toward achieving the ultimate goal of unlocking the massive heavy oil resources on Alaska North Slope (ANS).

Dandekar, Abhijit↗

Advanced Instrumentation for Transient Reactor Testing

Transient testing involves placing fuel or material into the core of specialized materials test reactors that are capable of simulating a range of design basis accidents, including reactivity insertion accidents, that require the reactor produce short bursts of intense highpower neutron flux and gamma radiation. Testing fuel behavior in a prototypic neutron environment under high-power, accident-simulation conditions is a key step in licensing nuclear fuels for use in existing and future nuclear power plants. Transient testing of nuclear fuels is needed to develop and prove the safety basis for advanced reactors and fuels. In addition, modern fuel development and design increasingly relies on modeling and simulation efforts that must be informed and validated using specially designed material performance separate effects studies. These studies will require experimental facilities that are able to support variable scale, highly instrumented tests providing data that have appropriate spatial and temporal resolution. Finally, there are efforts now underway to develop advanced light water reactor (LWR) fuels with enhanced performance and accident tolerance. These advanced reactor designs will also require new fuel types. These new fuels need to be tested in a controlled environment in order to learn how they respond to accident conditions. For these applications, transient reactor testing is needed to help design fuels with improved performance. In order to maximize the value of transient testing, there is a need for in-situ transient realtime imaging technology (e.g., the neutron detection and imaging system like the hodoscope) to see fuel motion during rapid transient excursions with a higher degree of spatial and temporal resolution and accuracy. There also exists a need for new small, compact local sensors and instrumentation that are capable of collecting data during transients (e.g., local displacements, temperatures, thermal conductivity, neutron flux, etc.).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Operation, Manufacturing, and Supply Chain of Lithium-ion Batteries for Electric Vehicles

The US Department of Energy (DOE) has a rich history of funding key innovations in batteries through multiple programs, including the Energy Efficiency and Renewable Energy programs sponsored by the Vehicle Technologies Office and Advanced Manufacturing Office. These DOE-sponsored innovations have been critical in lowering the cost of lithium-ion batteries to less than $160/kWh and increasing their energy density to more than 250 Wh/kg, enhancing the nation’s electrification system and achieving higher degrees of decarbonization. These investments continue to be crucial for positioning the United States as the hub for the most cumulative battery R&D programs worldwide. However, major breakthroughs in battery manufacturing are still needed to enable an electrified future evolving to predominantly incorporate rechargeable lithium-ion batteries. This will require a strong battery manufacturing base that will not only enable cutting-edge advancements in materials and manufacturing sciences but will also allow the United States to become a world leader in this fast-growing area. This review aims at supporting DOE’s Advanced Technology Vehicle Manufacturing Loan Program to give technology background and information that can be used to develop the basis for loan topics and evaluate battery applications. Such a program can represent a significant stride toward reinforcing the US position in advanced manufacturing by introducing artificial intelligence, machine learning, and sensing and smart controls to facilitate, expedite, and lead the battery industry by 2030.

25 ENERGY STORAGE↗

BOOSTR: A Dataset for Accelerator Control Systems

The Booster Operation Optimization Sequential Time-series for Regression (BOOSTR) dataset was created to provide a cycle-by-cycle time series of readings and settings from instruments and controllable devices of the Booster, Fermilab’s Rapid-Cycling Synchrotron (RCS) operating at 15 Hz. BOOSTR provides a time series from 55 device readings and settings that pertain most directly to the high-precision regulation of the Booster’s gradient magnet power supply (GMPS). To our knowledge, this is one of the first well-documented datasets of accelerator device parameters made publicly available. We are releasing it in the hopes that it can be used to demonstrate aspects of artificial intelligence for advanced control systems, such as reinforcement learning and autonomous anomaly detection.

Kafkes, Diana (ORCID:000000021716463X)↗

A Data-Driven Framework for Direct Local Tensile Property Prediction of Laser Powder Bed Fusion Parts

This article proposes a generalizable, data-driven framework for qualifying laser powder bed fusion additively manufactured parts using part-specific in situ data, including powder bed imaging, machine health sensors, and laser scan paths. To achieve part qualification without relying solely on statistical processes or feedstock control, a sequence of machine learning models was trained on 6299 tensile specimens to locally predict the tensile properties of stainless-steel parts based on fused multi-modal in situ sensor data and a priori information. A cyberphysical infrastructure enabled the robust spatial tracking of individual specimens, and computer vision techniques registered the ground truth tensile measurements to the in situ data. The co-registered 230 GB dataset used in this work has been publicly released and is available as a set of HDF5 files. The extensive training data requirements and wide range of size scales were addressed by combining deep learning, machine learning, and feature engineering algorithms in a relay. The trained models demonstrated a 61% error reduction in ultimate tensile strength predictions relative to estimates made without any in situ information. Lessons learned and potential improvements to the sensors and mechanical testing procedure are discussed.

36 MATERIALS SCIENCE↗

Electronic Neural Networks

Viewgraphs on electronic neural networks for space station are presented. Topics covered include: electronic neural networks; electronic implementations; VLSI/thin film hybrid hardware for neurocomputing; computations with analog parallel processing; features of neuroprocessors; applications of neuroprocessors; neural network hardware for terrain trafficability determination; a dedicated processor for path planning; neural network system interface; neural network for robotic control; error backpropagation algorithm for learning; resource allocation matrix; global optimization neuroprocessor; and electrically programmable read only thin-film synaptic array.

Thakoor, Anil↗

New Technologies for Space Avionics, 1993

The report reviews a 1993 effort that investigated issues associated with the development of requirements, with the practice of concurrent engineering and with rapid prototyping, in the development of a next-generation Reaction Jet Drive Controller. This report details lessons learned, the current status of the prototype, and suggestions for future work. The report concludes with a discussion of the vision of future avionics architectures based on the principles associated with open architectures and integrated vehicle health management.

Aibel, David W.↗

New technologies for space avionics

This report reviews a 1994 effort that continued 1993 investigations into issues associated with the definition of requirements, with the practice concurrent engineering and rapid prototyping in the context of the development of a prototyping of a next-generation reaction jet driver controller. This report discusses lessons learned, the testing of the current prototype, the details of the current design, and the nature and performance of a mathematical model of the life cycle of a pilot operated valve solenoid.

Aibel, David W.↗

Interactive Learning During Solar Maximum

The goal of this project is to develop and distribute e-educational material for space science during times of solar activity that emphasizes underlying basic science principles of solar disturbances and their effects on Earth. This includes materials such as simulations, animations, group projects and other on-line materials to be used by students either in high school or at the introductory college level. The on-line delivery tool originally intended to be used is known as Interactive Multimedia Education at a Distance (IMED), which is a web-based software system used at UCLA for interactive distance learning. IMED is a password controlled system that allows students to access text, images, bulletin boards, chat rooms, animation, simulations and individual student web sites to study science and to collaborate on group projects.

Ashour-Abdalla, Maha↗

Direct Communication to Earth from Probes

A viewgraph presentation on outer planetary probe communications to Earth is shown. The topics include: 1) Science Rational for Atmospheric Probes to the Outer Planets; 2) Controlling the Scientific Appetite; 3) Learning more about Jupiter before we send more probes; 4) Sample Microwave Scan From Juno; 5) Jupiter s Deep Interior; 6) The Square Kilometer Array (SKA): A Breakthrough for Radio Astronomy; 7) Deep Space Array-based Network (DSAN); 8) Probe Direct-to-Earth Data Rate Calculations; 9) Summary; and 10) Enabling Ideas.

Bolton, Scott J.↗

Spitzer Observatory Operations -- Increasing Efficiency in Mission Operations

This paper explores the how's and why's of the Spitzer Mission Operations System's (MOS) success, efficiency, and affordability in comparison to other observatory-class missions. MOS exploits today's flight, ground, and operations capabilities, embraces automation, and balances both risk and cost. With operational efficiency as the primary goal, MOS maintains a strong control process by translating lessons learned into efficiency improvements, thereby enabling the MOS processes, teams, and procedures to rapidly evolve from concept (through thorough validation) into in-flight implementation. Operational teaming, planning, and execution are designed to enable re-use. Mission changes, unforeseen events, and continuous improvement have often times forced us to learn to fly anew. Collaborative spacecraft operations and remote science and instrument teams have become well integrated, and worked together to improve and optimize each human, machine, and software-system element.

operational efficiency↗

Blue Marble: Remote Characterization of Habitable Planets

The study of the nature and distribution of habitable environments beyond the Solar System is a key area for Astrobiology research. At the present time, our Earth is the only habitable planet that can be characterized in the same way that we might characterize planets beyond the Solar System. Due to limitations in our current and near-future technology, it is likely that extra-solar planets will be observed as single-pixel objects. To understand this data, we must develop skills in analyzing and interpreting the radiation obtained from a single pixel. These skills must include the study of the time variation of the radiation, and the range of its photometric, spectroscopic and polarimetric properties. In addition, to understand whether we are properly analyzing the single pixel data, we need to compare it with a ground truth of modest resolution images in key spectral bands. This paper discusses the concept for a mission called Blue Marble that would obtain data of the Earth using a combination of spectropolarimetry, spectrophotometry, and selected band imaging. To obtain imagery of the proper resolution, it is desirable to place the Blue Marble spacecraft no closer than the outer region of cis-lunar space. This paper explores a conceptual mission design that takes advantage of low-cost launchers, bus designs and mission elements to provide a cost effective observing platform located at one of the stable Earth-moon Lagrangian points (L4, L5). The mission design allows for the development and use of novel technologies, such as a spinning moon sensor for attitude control, and leverages lessons-learned from previous low-cost spacecraft such as Lunar Prospector to yield a low-risk mission concept.

Woolf, Neville↗