Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Mind the gap: Bridging the divide between AI aspirations and the reality of autonomous microscopy

What does materials science look like in the “Age of Artificial Intelligence?” Each material’s domain—synthesis, characterization, and modeling—has a different answer to this question, motivated by unique challenges and constraints. This work focuses on the tremendous potential of autonomous characterization within electron microscopy. We present our recent advancements in developing domain-aware, multimodal models for microscopy analysis capable of describing complex atomic systems. We then address the critical gap between the theoretical promise of autonomous microscopy and its current practical limitations, showcasing recent successes while highlighting the necessary developments to achieve robust, real-world autonomy.

2D materials↗
DOE OSTI2026

EPICS for small-scale laboratories with Python soft IOCs

While the Experimental Physics and Industrial Control System (EPICS) is widely used at large laboratories for slow controls and instrumentation, the deployment of a full EPICS installation can be difficult, with a steep learning curve to new users. Taking advantage of the pythonSoftIOC module, we developed an EPICS slow controls implementation for Jefferson Lab's Hall B cryotarget written entirely in Python and based on software IOCs that communicate with instruments over Ethernet. Here, this system ran successfully, interfacing with Jefferson Lab's full EPICS network, and we offer it as an example of the capabilities of pythonSoftIOC to build lightweight, yet robust and flexible instrumentation platforms that would be easily adapted for use at a small-scale laboratory. University groups can use these examples to build complete slow controls systems, from device communication to data archiving and display, using open-source, mature EPICS tools and student-friendly Python as an alternative to expensive and proprietary systems such as LabVIEW.

Computing↗
DOE OSTI2024

Four-dimensional phase-space reconstruction of flat and magnetized beams using neural networks and differentiable simulations

Beams with cross-plane coupling or extreme asymmetries between the two transverse phase spaces are often encountered in particle accelerators. Flat beams with large transverse-emittance ratios are critical for future linear colliders. Similarly, magnetized beams with significant cross-plane coupling are expected to enhance the performance of electron cooling in hadron beams. Preparing these beams requires precise control and characterization of the four-dimensional transverse phase space. In this study, we employ generative phase-space reconstruction techniques to rapidly characterize magnetized and flat-beam phase-space distributions using a conventional quadrupole-scan method. The reconstruction technique is experimentally demonstrated on an electron beam produced at the Argonne Wakefield Accelerator and successfully benchmarked against conventional diagnostics techniques. Specifically, we show that predicted beam parameters from the reconstructed phase-space distributions (e.g., as magnetization and flat-beam emittances) are in excellent agreement with those measured from the conventional diagnostic methods. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Enhancing Distribution System Resilience: A First-Order Meta-RL Algorithm for Critical Load Restoration

The increasing frequency of extreme events and the integration of distributed energy resources (DERs) into modern grids have elevated the need for resilient and efficient critical load restoration strategies in distribution systems. However, the stochastic nature of renewable DERs, limited energy resource availability and the intricate nonlinearities inherent in complex grid control problem make the problem challenging. Although reinforcement learning (RL) and warm-start RL methods have shown promising results, their performance often falls short in rapidly adapting to new, unseen situations and typically requires exhaustive problem-specific tuning. To address these gaps, we propose a First-Order Meta-based RL (FOM-RL) algorithm within an online framework for adaptive and robust critical load restoration. By harnessing local DERs as the enabling technology, FOM-RL allows the RL agent to swiftly adapt to new unseen scenarios by leveraging previously acquired knowledge of different tasks. Experimental results provide evidence that proposed algorithm learns more efficiently and showcases generalization capabilities across diverse set of operational scenarios. Moreover, a rigorous theoretical analysis yields a tight sublinear regret bound, sensitive to temporal variability, with a task-averaged optimality gap bounded by O(VM+D*/(Tsquare root(M))). These results suggest that optimality improves with task similarity and an increased number of tasks M, reaffirming the efficacy and scalability of the proposed approach in addressing the complexities of critical load restoration in distribution systems.

complexity theory↗
DOE OSTI2016

TH-AB-BRB-00: Research Opportunities with Digital Linear Accelerators

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TH-AB-BRB-01: Trajectory Modulated Arc Therapy: Application to Partial Breast Irradiation

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TH-AB-BRB-02: ET-Reloaded

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TH-AB-BRB-03: 4n Radiotherapy

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TH-AB-BRB-04: Quality Assurance for Advanced Digital Linac Implementations

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2017

Testing autonomous cyber-physical systems using fuzzing features from convolutional neural networks: work-in-progress

Autonomous cyber-physical systems rely on modern machine learning methods such as deep neural networks to control their interactions with the physical world. Testing of such intelligent cyber-physical systems is a challenge due to the huge state space associated with high-resolution visual sensory inputs. We demonstrate how fuzzing the input using patterns obtained from the convolutional filters of an unrelated convolutional neural network can be used to test computer vision algorithms implemented in intelligent cyber-physical systems. Our method discovers interesting counterexamples to a pedestrian detection algorithm implemented in the popular OpenCV library. Our approach also unearths counterexamples to the correct behavior of an autonomous car similar to NVIDIA's end-to-end self-driving deep neural net running on the Udacity open-source simulator.

Raj, Sunny↗
DOE OSTI2023

Quasi-Newton Variational Bayes v.3.0

SAND2024-09052O Quasi-Newton Variational Bayes (QNVB) is a training algorithm that performs high-dimensional variational inference on machine learning models. It provides mechanisms to calibrate and control model uncertainty during training. The PyTorch implementation of projective integral updates for Gaussian mean-fields supports the manuscript, "Projective Integral Updates for High-Dimensional Variational Inference." Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Duersch, Jed↗
DOE OSTI2024

Physics Model For The Agn-201 Dt

The surrogate model is a Gaussian Process Regression model based on sci-kit learn. The model takes the coarse and fine control rod position, along with the temperature of the reactor, and produces a corresponding k-eff value. Given k-eff over time, deviations can be determine and flagged for review at a later date.

Stewart, RyanH. [Idaho National Laboratory (INL), ↗
DOE OSTI2026

Leveraging generative artificial intelligence to bridge domain gaps in wind turbine research

A central challenge in wind turbine health monitoring is the scarcity of real-world data due to limited instrumentation, leading researchers to rely on simulation models that often suffer from reduced fidelity. However, even within simulation environments, discrepancies arise because of modeling assumptions, and configuration fidelities, creating domain gaps that limit the transferability of learned representations. Here, to investigate domain translation under controlled conditions, this project explores the use of generative artificial intelligence, specifically cycle-consistent generative adversarial networks (CGANs), to bridge the gap between OpenFAST simulation models representing 1.5 MW and 5 MW wind turbines. A physics-informed CGAN architecture is introduced, where a simplified turbine tower dynamics model is incorporated into the training loss to ensure physically consistent outputs. Quantitative results showed moderate to high agreement in frequency-domain features. Incorporating the physics-informed loss function improved the R 2 values by 30%, reduced the RMSE from 1.39 to 1.1 m/s 2 , and reduced training time by 82%. Furthermore, under increased turbulence intensity (IEC Category A), the RMSE remained stable at approximately 1.1 m/s 2 . While the present study is entirely simulation-based, it establishes a pipeline for evaluating physics-informed generative domain translation, which may serve as a foundation for future simulation-to-reality validation studies.

17 WIND ENERGY↗
DOE OSTI2019

Lessons Learned Assembling the SSR1 Cavities String for PIP-II

The string assembly of the prototype Single Spoke Resonator type 1 (SSR1) cryomodule for PIP-II at Fermilab was successfully completed. Lessons learned from the preparation, assembly and the quality control activities of the final fully integrated assembly will be presented.

43 PARTICLE ACCELERATORS↗
DOE OSTI2018

Perovskite Solar Cells: Addressing Low Cost, High Efficiency, and Reliability Through Novel Hole-Transport Materials

The ultimate goal of this project is to develop low-cost and scalable organic-based hole transport materials that will lead to thin film perovskite solar cells with high efficiencies (>25%) and long lifetimes (>20 years). A very important component of a perovskite solar cell is the hole transport layer (HTL). This layer is also generally the most expensive and problematic component of the device. Currently the state-of-the-art HTL is based on a lithium salt doped aromatic amine termed N 2 ,N 2 ,N 2' ,N 2' ,N 7 ,N 7 ,N 7' ,N 7' -octakis(4-methoxyphenyl)-9,9'-spirobi[9H-fluorene]-2,2',7,7'-tetramine (spiro-OMeTAD) that is very difficult to prepare with no paths for becoming cost effective at high volume. This project will directly prepare perovskite solar cells more easily commercialized by designing and preparing new HTL materials with properties that address the current bottlenecks, such as cost, tunable conductivity and energy levels, hydrophobicity, Li free dopants, and stability to name a few. We have preliminary results from new cost-effective HTLs and dopants that have led to high efficiency (>19%) and long operating lifetime devices without encapsulation – significantly improved over spiro-OMeTAD based devices prepared in our labs as controls. We will focus on using the lessons learned from that first departure from the norm to design even more ideal and scalable HTLs. We believe the outcomes of this proposal will lead to a substantial impact for the perovskite community to develop a low cost, scalable and high performing HTL. This will be a collaborative effort where our synthetic chemists will perform HTL design, chemical synthesis, and materials characterization, while our device engineers will perform device physics, fabrication/processing, and characterization.

14 SOLAR ENERGY↗
DOE OSTI2019

Engineered Reliability via Intrinsic Thermomechanical Stability of an Electrodeposited Au-Pt Nanocrystalline Alloy

This research objective of this EELDRD study was to learn to electrodeposit Pt Au alloys with independently controlled composition and grain size. What was accomplished was the capability to electrodeposit PtAu alloys with controlled composition and a nanocrysolline grain size. Nanocrystalline metals as a class and, specifically, the Pt 0.9 Au 0.1 alloy developed in 2015-17 via sputtering at Sandia National Labs have clear advantages in strength, wear resistance, and fatigue tolerance over commercially-available structural alloys. With this capability befitting coating of complex components and implementable at existing vendors, we can upgrade the electrical contact component reliability of selected Labs systems.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Development of a Nearly Autonomous Management and Control (NAMAC) System for Advanced Reactors (Final Report for ARPA-E Project)

The project formulates a technical basis for, and preliminary development of, a Nearly Autonomous Management and Control (NAMAC) system in advanced reactors. The system is intended to provide recommendations to operators during plant operation. The NAMAC system utilizes simulation-informed, data/knowledge-driven, AI-guided, plant-data-assimilated real-time operating procedures to effectively support the operator in risk-informed management of plant operations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗