Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

The influence of physical and algorithmic factors on simulated far-field waveforms and source–time functions of underground explosions using unsupervised machine learning

SUMMARY Characterizing explosion sources and differentiating between earthquake and underground explosions using distributed seismic networks becomes non-trivial when explosions are detonated in cavities or heterogeneous ground material. Moreover, there is little understanding of how changes in subsurface physical properties affect the far-field waveforms we record and use to infer information about the source. Simulations of underground explosions and the resultant ground motions can be a powerful tool to systematically explore how different subsurface properties affect far-field waveform features, but there are added variables that arise from how we choose to model the explosions that can confound interpretation. To assess how both subsurface properties and algorithmic choices affect the seismic wavefield and the estimated source functions, we ran a series of 2-D axisymmetric non-linear numerical explosion experiments and wave propagation simulations that explore a wide array of parameters. We then inverted the synthetic far-field waveform data using a linear inversion scheme to estimate source–time functions (STFs) for each simulation case. We applied principal component analysis (PCA), an unsupervised machine learning method, to both the far-field waveforms and STFs to identify the most important factors that control variance in the waveform data and differences between cases. For the far-field waveforms, the largest variance occurs in the shallower radial receiver channels in the 0–50 Hz frequency band. For the STFs, both peak amplitude and rise times across different frequencies contribute to the variance. We find that the ground equation of state (i.e. lithology and rheology) and the explosion emplacement conditions (i.e. tamped versus cavity) have the greatest effect on the variance of the far-field waveforms and STFs, with the ground yield strength and fracture pressure being secondary factors. Differences in the PCA results between the far-field waveforms and STFs could possibly be due to near-field non-linearities of the source that are not accounted for in the estimation of STFs and could be associated with yield strength, fracture pressure, cavity radius and cavity shape parameters. Other algorithmic parameters are found to be less important and cause less variance in both the far-field waveforms and STFs, meaning algorithmic choices in how we model explosions are less important, which is encouraging for the further use of explosion simulations to study how physical Earth properties affect seismic waveform features and estimated STFs.

58 GEOSCIENCES↗

Towards computational polar-topotronics: Multiscale neural-network quantum molecular dynamics simulations of polar vortex states in SrTiO3/PbTiO3 nanowires

Recent discoveries of polar topological structures ( e.g ., skyrmions and merons) in ferroelectric/paraelectric heterostructures have opened a new field of polar topotronics. However, how complex interplay of photoexcitation, electric field and mechanical strain controls these topological structures remains elusive. To address this challenge, we have developed a computational approach at the nexus of machine learning and first-principles simulations. Our multiscale neural-network quantum molecular dynamics molecular mechanics approach achieves orders-of-magnitude faster computation, while maintaining quantum-mechanical accuracy for atoms within the region of interest. This approach has enabled us to investigate the dynamics of vortex states formed in PbTiO 3 nanowires embedded in SrTiO 3 . We find topological switching of these vortex states to topologically trivial, uniformly polarized states using electric field and trivial domain-wall states using shear strain. These results, along with our earlier results on optical control of polar topology, suggest an exciting new avenue toward opto-electro-mechanical control of ultrafast, ultralow-power polar topotronic devices.

Linker, Thomas↗

Integrating Safety and Lessons-Learned Data with Human Performance for Successful Management and Oversight

This paper documents the improvements Fluor Hanford, Inc. (Fluor Hanford) is making in analyzing and using safety-related and lessons-learned data in cleaning up the U.S. Department of Energy's (DOE's) site at Hanford in southeastern Washington state. Results of the application of Statistical Process Control (SPC) and Dashboards to support planning and decision making have been shared at past Waste Management conferences. Recently, Fluor Hanford has implemented and refined a process called the 'Data Analysis Working Group' to integrate data from several sources, including opinions from subject-matter experts. The process also includes a risk-ranking tool used to prioritize potential risks and past problems for management and oversight of the Hanford cleanup. Human Performance and Lessons Learned information also is included in this process. Fluor Hanford has applied SPC in a non-traditional (that is non-manufacturing) manner. Dr. Shewhart's 75-year-old control-chart methodologies have been updated to modern data processing, but are still founded on his sound, tried and true principles. These methods are playing a key role in safety and quality at Hanford. The performance-indicator system used by Fluor Hanford has been featured by several professional societies in their publications, primarily the American Society of Safety Engineers and the American Society for Quality. The system also has been featured in past Waste Management conferences. Eleven years ago, Fluor Hanford's statistician produced 300 data files and accompanying charts a month. Today, those numbers exceed 3,000 a month, almost one chart for every employee. This activity also includes entering data for approximately 500 safety inspections each month. The challenge is in effectively analyzing and prioritizing this information and providing it to senior management to make pro-active decisions and policies. That challenge is being met by Fluor's Data Analysis Working Group process. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Use of Historical EM Practices and Policies for Management of Cleanup Program and Address GAO Concerns - 20222

As Department of Energy (DOE) Environmental Management (EM) program policies and management practices are revised over time, it might be useful to periodically reflect on the DOE EM program's past to identify practices that have worked and those that might be appropriate for possible reuse in the future. An added impetus to examine alternative approaches is the recent Government Accountability Office (GAO) report entitled 'Nuclear Waste Cleanup - DOE Could Improve Program and Project Management by Better Classifying Work and Following Leading Practices.' The February 2019 GAO report states that EM categorizes most of its work in a way that does not adequately involve independent experts and DOE senior leadership. It also noted that EM has not followed leading practices for program and project management that could help keep the cleanup efforts on schedule and control costs. The GAO report recommended that EM, working with DOE Office of Project Management (PM): - Establish requirements and then assess EM's ongoing operations activities to determine if some activities should be reclassified as capital asset projects based on these newly established requirements. - Review and revise EM's 2017 cleanup policy to include program management leading practices related to scope, cost, schedule performance, and independent reviews. - Update the cleanup policy to require that earned value management (EVM) systems be maintained and used in a way that follows EVM best practices. - Develop a policy to ensure that work is categorized as level of effort (LOE) only in appropriate, specified circumstances, such as when work is not measurable or when measurement is impractical. - Integrate EVM data into EM's performance metrics for operations activities. To assist with improving program performance and implementing audit recommendations, this paper reviewed past successful cleanups such as Weldon Springs, Rocky Flats, Fernald, Ashtabula, Battelle Columbus (abs, and other historical resources and people with experience during the early years of EM program. As such, there are several past practices which may well be suited for reuse today. Some of these practices include: - In 1990's, as the DOE EM cleanup program, known as Environmental Restoration came into effect, the known cleanup scope at each geographic location or site was organized into four levels ranging from overall site-wide cleanup effort to the individual 'release sites', providing high granularity to the program. - The cleanup program was organized by geography (Northwest, Southwest, Eastern Area Programs, etc.). These 'sub-program' managers provided a degree of Headquarters oversight and management allowing upper management (EM-1, 2, and 3) to focus on major decisions and issues. - Budget levels at selected cleanup sites were funded above 'minimum-safety' levels to accelerate actual cleanup work. - Past practice utilized EVM techniques and uniform EM oversight over all discrete project-like activities, providing for a coordinated cleanup effort. - EM managed LOE activities using benchmarking and best in class management practice techniques to help manage costs. - EM managed and reviewed entire site cleanup baselines, not only individual projects, focusing on a successful overall outcome. - Sites had a 'Road map' or 'Management Action Plan' that provided the overall strategy or plan for that site's cleanup - this helped with understanding and coordination of efforts. - EM had a robust lessons-learned program and database to capture and transmit worthy ideas. - EM had well-structured cleanup baseline change control policies to control cost and schedule changes, at the contractor and higher Headquarters levels. Finally, some of the GAO observations may be valid, however it is not clear as to their extent. For example, for some operation types of work, the use of the Level of Effort (LOE) earned value method to track progress may be appropriate. Also, to ensure independence of thought, and to obtain useful insight on past practices, it may be suitable to have former EM employees to assist with understanding past practices or to verify that activities have been properly identified. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Commercial Building Technology Demonstration (Final Scientific/Technical Report)

The background for this project was a unique and innovative concept that had been proposed and demonstrated by enVerid Systems, reducing the energy consumption in HVAC systems in commercial and public buildings by up to 50% at peak loads. The concept involves selective scrubbing of gas contaminants from indoor air as a practical substitute for outside air ventilation, the latter being the conventional practice today. This scrubbing enables recycling of most of the indoor air and significantly decreasing the amount of outside air, resulting in a reduced HVAC load and commensurate energy savings for the facility. Key to our approach is low cost scrubbing of all gas contaminants from indoor air using novel, efficient and regenerable sorbent materials. The total solution, labeled HLR (HVAC Load Reduction) is implemented by means of compact modules that can be retrofitted onto virtually any building, and utilizes novel sorbents that have been developed and brought to scale production by enVerid. Although the technology had been deployed and demonstrated, the US commercial building and HVAC markets, famously conservative with respect to innovation and new technologies, had yet to embrace the idea or the product. The overarching goal of the project was to help overcome market hesitancy and enable widespread adoption, by creating a critical mass of success stories across different regions and building types, all under oversight and verification of the DOE and NREL, to ensure credibility and accuracy. The project, overall, was a resounding success. Several installations were deployed and tested comprehensively for the impact on both energy consumption and indoor air quality, and results were not only excellent, but quantitatively in line with expectations. A total number of eight (8) installations were attempted, with 2 aborted due to building issues. Of the six successful installations, however, complete M&V was performed by NREL on 2 (Miami and NYC) and partial analysis on a third site (ArcBest), and these three, along with their results, were therefore presented from a financial and reporting standpoint. Although the number of case studies fell short of the original target of 10, we nevertheless had excellent demonstrations in vastly different climate zones: Southeast, Northeast and Midwest, and in very different building types. This included a modern high-rise office building in New York City and a University Campus health center in Miami, and a mid-rise high-density office in Arkansas. The cooling load reduction was shown to be significant, averaging 37% during the final cooling season in the Miami site. In the NYC site, the cooling energy savings were generally less, at around 12%, as expected. While this is a lower number for average/total savings, two comments are important to note: (i) the outside airflow (OA) reduction was not consistent during the data collection period, at least in part understating the attainable savings through incorrect measurement of the “high energy” reference state; and (ii) the peak impact in NYC is almost certainly as high as Miami, with critical ramifications for peak load reduction and equipment downsizing ability. Importantly, the measured energy savings in all locations were related to the outdoor climate conditions and the actual achievable reduction in outside air, very much in line with models and calculations; this leaves us with increased confidence in our understanding of the interaction between the technology and the building, and our ability to project the impact of this innovation in the future, through broad adoption. Simply put: the energy savings and load reduction impact of the HLR solution has been confirmed quantitatively. The results also confirmed the air quality objective. This may be even more significant, in that air quality is more complex and harder to measure and quantify, and the performance of the HLR as an air scrubber is the linchpin of the entire solution. In all sites, indoor air quality met or exceeded the required parameters, in terms of achieving the target (low) levels of indoor pollutants. Furthermore, the concentrations of outdoor sourced pollutants were markedly lower, as expected, mostly due to the reduction in outside air intake although in part also due to the scrubbing. The success was not immediate nor easy, and early challenges with the systems, especially (but not only) around controls and communication, caused delays in commissioning and undermined some of our M&V schedules. The good news is no fundamental issues were encountered and the number of such glitches was declining quickly by the end of the project. Other challenges had to do with coordinating the control of the building OA dampers, which the HLR needs to have in order to deliver the load reduction, but which the facility manager controls regularly and independently. This is not necessarily a problem for normal HLR operation but interferes with accurate M&V, where switching OA settings back and forth on a precise timetable is essential for clean data. The project provided valuable experience in retrofitting buildings that had been originally designed to operate with less recirculation and more outside air, and some key learnings related to the cyclical regeneration of the sorbents in the operational environment of the building. Some of these learnings gave already been incorporated into ongoing improvements in the design of the HLR module as well as the software that is used to control its operation. The cost and time of retrofit installations is much better understood; so is the test and balance procedure of the building that determines the available range of outside air reduction, which in turn determines the amount of load reduced. We had also implemented at least one annual cycle of sorbent cartridge replacement in the field, after which we tested the used sorbent to assess the rate of degradation of sorbent potency – an important factor affecting the long-term economics of HLR deployments. A notable shortfall of the project, other than the fact that the number of sites was below target, was that we had not (yet) completed testing to measure and verify (M&V) the winter energy savings. This is primarily due to late start on the NYC sites (Miami does not portend any heating savings associated with reduced outside air), combined with the issues of OA damper control. It is by no means suggested that such savings cannot be captured, only that the M&V with respect to winter in NYC has been incomplete. The value of this project and its interest to the general public are hard to overstate. The case studies created from Miami and especially from NYC have, without a doubt, opened up the interest of the broad HVAC industry to HLR in the past year. Major manufacturer reps have signed up to represent and promote the product, and dozens of top tier engineering consultants have introduced HLR as a base of design in upcoming construction and renovation projects – precisely the overarching goal of this project. These would not have happened without the highly visible installation in NYC and its ultimately satisfied customer. Furthermore, the DOE itself issued a report in late 2017 analyzing hundreds of candidate technologies for reducing energy consumption in HVAC; remarkably, the budding HLR solution ranked among the top 3(!); no doubt, its status as a viable and significant contender on this list is informed by the success of these demonstrations. And furthermore, in the wake of these demos, several major energy utilities, led by ConEdison in NYC, have endorsed the HLR solution and now routinely provide substantial cash rebates for customers choosing to incorporate the HLR in their buildings and reap the benefit of the reduced peak load as well as reduced cumulative energy demand. Last but not least, in January of 2019, as this report was being written, the HLR module won the AHR Expo Innovation Award for Green Buildings and, remarkably, the prestigious and only Product of the Year 2019, being selected by an independent professional panel of judges from AHR and ASHRAE. Given the confirmation of the enormous energy saving potential of HLR in widescale deployment, as well as ancillary but significant benefits in terms of equipment downsizing and indoor air quality, the benefit of this effort to the public speaks for itself. Accelerating adoption of HLR, without dependence on subsidies and driven by the private sector, is well under way. There is still much work to be done in terms of educating the HVAC and construction ecosystems and improving the product’s robustness and simplicity, to further facilitate the adoption of this technology and the capture of its potential value. But the American public will greatly benefit both directly and indirectly in the immediate future and beyond.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Rapid Bayesian High Entropy Alloy Designs Fabricated via Wire Arc Additive Manufacturing

Purpose: This project seeks to demonstrate a new high-throughput (rapid) alloy design technique applied to creating new high entropy alloys (HEAs) for extreme environments. High entropy alloys shift the design paradigm from being focused on a single principal element (e.g. nickel-based alloys) to target alloys that include high atomic fractions (X >10%) of multiple elements. These HEA materials can exhibit sluggish diffusion and enhanced corrosion resistance, ideal for potential applications in advanced ultra supercritical (A-USC) steam cycles for power generation. Scope: The addition of multiple elements in high atomic fractions creates an enormous design space that cannot easily be investigated by traditional material design strategies such as designed of experiments (DOE). This project utilizes a Bayesian machine learning algorithm that has been modified to work with calculation of phase diagrams (CALPHAD) software. This Bayesian algorithm reduces manual inputs and increase the likelihood of achieving an optimal solution. Compositional inputs to this algorithm will be assessed using existing material property models for high temperature strength and corrosion resistance. The target for alloy performance will be a 15% (~100 ⁰C) increase in allowable service temperature beyond heat-resistant stainless steels while maintaining or improving alloy cost and corrosion resistance. Haynes 230 was selected as a baseline, which is 57 wt% Ni with 22 wt% Cr 14 wt% W, and 2 wt% Mo as solid solution strengtheners. In addition to rapid design via Bayesian machine learning, the alloys were rapidly fabricated using a multi-wire arc additive manufacturing (mWAAM) technique which allows for precise control of alloy composition and assessing of alloy design “windows” to study composition effects. Build speeds for wire-arc additive processes are among the highest for additive technologies enabling rapid and reliable sample fabrication when compared to conventional methods such as arc button melting. The mWAAM samples will be rapidly characterized via instrumented indentation for room temperature modulus and strength and for elevated temperature strength via hot hardness tests. After being screened with hardness testing, potential alloys will be further evaluated with conventional microscopy techniques including scanning electron microscopy (SEM) and transmission electron microscopy (TEM) to assess agreement with modeling results. The most promising compositions will also be evaluated by printing full sized tensile specimens for mechanical behavior tests at elevated temperatures. Results: Bayesian machine learning of a single performance function was initially used to optimize five performance metrics: 1) single phase stability, 2) yield strength, 3) creep resistance (low diffusion coefficient), 4) freezing range (weldability), and 5) material cost. The single performance function was suboptimal as assumptions had to be made about the results while formulating the optimization. A goal-oriented Bayesian optimization strategy (Hanaoka, 2021) was implemented with CALPHAD for use with the five metrics above. This multi-objective Bayesian optimization (MOBO) enabled the design of NiCrCoFe alloys with V and W additions. A base composition of NiCoCr was selected as Ni provides a stable FCC matrix, Cr aids corrosion/oxidation resistance, and Co is a solid-solutions strengthener that also improves creep by increasing the activation energy. Fe helps reduce diffusion coefficients and cost. Finally, V and W were selected for their reasonable solubility and high atomic misfit to aid in solid solution strengthening. Cracking of the mWAAM specimens was an early issue, and the Easton solidification cracking model (Easton et al., 2014a) was selected for addition to the MOBO function. High performing alloys fabricated by mWAAM included Ni 28 Cr 25 Co 26 Fe 15 V 8 and Ni 62 Cr 18 Co 1 Fe 3 W 15 . It was observed that even after adapting the mWAAM process for W, the W did not fully dissolve. To fully evaluate the Ni 62 Cr 18 Co 1 Fe 3 W 15 composition, a cored wire (80-20 NiCr sheath/powder core) was manufactured and printed via WAAM, and HIP’ing was utilized to homogenize and densify the printed alloy. The V and W alloys produced met metrics 1 (solid solution), 4 (solidification cracking), and 5 (cost). However, an unmodeled mechanism of thermal stress cracking was identified in the WAAM produced materials, perhaps exacerbated by the lack of grain boundary strengthening elements (B, C). Conclusions & Recommendations: A high-throughput (rapid) alloy design technique was applied to designing and manufacturing new high entropy alloys (HEAs) for extreme environments utilizing MOBO and mWAAM. The developed process was rapid and effective in addressing the mechanisms included in the model. The lack of grain boundary strengthening element additions (e.g., B, C) was a simplification that likely produced thermal stress cracking that turned into a large part of the investigation. Additions on the order of 0.005 wt% B and 0.05 wt% C likely would have minimized thermal stress grain boundary cracking. Overall, the high throughput design strategy is promising for rapid design of metrics-driven alloys for advanced ultra supercritical (A-USC) steam cycles for power generation. The MOBO and mWAAM process could be commercialized to accelerate metrics-driven alloy design. In addition, the cored-wire process utilized for scale-up is a promising high-volume process for WAAM alloy development and scale-up.

36 MATERIALS SCIENCE↗

Contested environmental policy infrastructure: Socio-political acceptance of renewable energy, water, and waste facilities

The construction of new infrastructure is hotly contested. This paper presents a comparative study on three environmental policy domains in the Netherlands that all deal with legitimising building and locating infrastructure facilities. Such infrastructure is usually declared essential to environmental policy and claimed to serve sustainability goals. They are considered to serve (proclaimed) public interests, while the adverse impact or risk that mainly concerns environmental values as well is concentrated at a smaller scale, for example in local communities. The social acceptance of environmental policy infrastructure is institutionally determined. The institutional capacity for learning in infrastructure decision-making processes in the following three domains is compared: 1.The implementation of wind power as a renewable energy innovation; 2.The policy on space-water adaptation, with its claim to implement a new style of management replacing the current practice of focusing on control and 'hard' infrastructure; 3.Waste policy with a focus on sound waste management and disposal, claiming a preference for waste minimization (the 'waste management hierarchy'). All three cases show a large variety of social acceptance issues, where the appraisal of the impact of siting the facilities is confronted with the desirability of the policies. In dealing with environmental conflict, the environmental capacity of the Netherlands appears to be low. The policies are frequently hotly contested within the process of infrastructure decision-making. Decision-making on infrastructure is often framed as if consensus about the objectives of environmental policies exists. These claims are not justified, and therefore stimulating the emergence of environmental conflicts that discourage social acceptance of the policies. Authorities are frequently involved in planning infrastructure that conflicts with their officially proclaimed policy objectives. In these circumstances, they are often confronted with local actors who support alternatives that are in fact better in tune with the new policy paradigm.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

RL-HEMS: Reinforcement Learning Based Home Energy Management System for HVAC Energy Optimization

Heating, ventilation, and air conditioning (HVAC) is one of the major energy consumers in the residential sector. It is important to be able to monitor and control the energy consumed to provide utility services such as load shaping while satisfying the comfort and economic constraints of the homeowner. The objective of this work is to create the optimal schedule for HVAC operation to reduce the cost while satisfying the home-owner and equipment’s constraints using a model-free Reinforcement Learning (RL)-based optimization. The specific goal is to find the right balance between reducing energy cost, consumption, and customer comfort level. Our research effort addresses this optimization problem using multiple components: the development of initial learning test-bed and implementation of RL techniques on a real home. This will enable the rapid evaluation of the RL techniques and provide an early baseline to train before implementation on site. The RL algorithm is designed to learn the energy use patterns and generate the optimized schedule for HVAC within an acceptable time-interval to satisfy the homeowner’s comfort and minimize the energy usage. Our preliminary results are promising and we have observed a 17% reduction in the total cost and a 15% reduction in the power utilization using our RL-based HVAC model—RL-HEMS.

Kotevska, Olivera↗

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗

GATEWAY Demonstrations: Tuning Hospital Lighting: Evaluating Tunable LED Lighting at the Swedish Hospital Behavioral Health Unit in Seattle

The GATEWAY program evaluated a tunable LED lighting system installed in the new Swedish Medical Behavioral Health Unit in Seattle that incorporates color-tunable luminaires in common areas, and uses advanced controls for dimming and color tuning, with the goal of providing a better environment for staff and patients. The report reviews the design of the tunable lighting system, summarizes two sets of measurements, and discusses the circadian, energy, and commissioning implications as well as lessons learned from the project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Model-based and Model-free Designs for an Extended Continuous-time LQR with Exogenous Inputs

We present an extended linear quadratic regulator (LQR) design for continuous-time linear time-invariant (LTI) systems in the presence of exogenous inputs. We first propose a model-based solution with cost minimization guarantees for states and inputs using dynamic programming (DP). The control law consists of a combination of the optimal state feedback and an additional optimal term dependent on the exogenous inputs. The control gains for the two components are obtained by solving a set of matrix differential equations. We provide these solutions for both finite horizons and steady-state cases. In the second part of the paper, we formulate a reinforcement learning (RL) based algorithm which does not need any model information except the input matrix, and can compute an approximate steady-state LQR gain using measurements of the states, the control inputs, and the exogenous inputs. Both model-based and data-driven optimal control algorithms are tested with a numerical example under different exogenous inputs showcasing the effectiveness of the designs.

Mukherjee, Sayak↗

1.2.4.404 - Data-Driven Approach for Hydropower Plant Controller Prototyping Using Remote Hardware in the Loop (DR-HIL)

Real-time prototyping of hydropower plant controls is important for reducing the cost and the risk of field deployment. This project will 1) collect design and operational data from actual hydro plants and 2) use a physics-informed machine learning approach for real-time emulation of hydropower plants, including hydro turbine and hydrodynamics. The data-driven models will be interfaced with digital real-time simulation at NREL’s Flatirons campus for hardware-in-the-loop (HIL) testing of the governor hardware device or controller-HIL (CHIL). The proposed approach will also establish the connectivity based remote CHIL testing capability using real-time data streams from an actual hydro plant. This integrated hydro-plant emulation with CHIL will be used to prototype hydro-governor controls and eventually provide an opportunity to test hydropower integrated with various technologies (e.g. conventional and renewable generation, energy conversion, etc.) as HIL.

controls prototyping↗

A Machine Learning-based Approach to Predict the Aggregate Flexibility of HVAC Systems

Use of renewable energy resources can play a significant role in mitigation of climate change since they reduce the dependency on fossil fuels. However, high penetration of renewable energy resources into the power grid may cause some reliability problems. Ancillary services are key to realize the potential of renewable resources without disturbing the grid reliability. In recent years, many control approaches focused on exploiting the aggregate flexible heating, ventilation, and air-conditioning (HVAC) loads of buildings. However, there are still research gaps in assessing in advance the resulting indoor temperature responses for given total power and weather profiles before implementing the controls in the buildings. Such an assessment is critical to guarantee satisfying both the grid related objective (reliability) and the building related objective (occupants' comfort). Towards addressing this research gap, this paper presents a machine-learning approach for predicting the ratings of indoor temperature responses. In this approach, a prediction model was developed using a dataset generated by a set of model-free control simulations. The developed model achieved high prediction accuracy and showed the potential of the proposed approach.

Amasyali, Kadir↗

TU-A-BRF-01: MR Guided Radiation Therapy

In recent years, there has been an increasing interest in the development of new technologies focused on the deeper integration of MR in radiotherapy. The innovations span from image data acquisition and post-processing to clinical implementation of MR-guided RT systems and workflow development. The session is intended to provide a review of the key and most recent advancements. Targeted discussions will cover topics which currently define the concept of MR-guided radiotherapy including a) system commissioning, quality control and safety, b) MR data manipulation for dose computations and treatment simulation, c) quantification/management of organ motion and treatment delivery guidance. Learning Objectives: Understand the concept and specifics of MR-guided radiotherapy; Understand the requirements for system integration in clinical workflow; Become familiar with the proposed strategies for system commissioning, RT planning and delivery guidance.

60 APPLIED LIFE SCIENCES↗

Explainable Artificial Intelligence Technology for Predictive Maintenance

The domestic nuclear power plant fleet has relied on labor-intensive and time-consuming preventive maintenance programs, thus driving up operation and maintenance costs to achieve high-capacity factors. Artificial intelligence and machine learning can help simplify complex problems, such as diagnosing equipment degradation, to enable more effective decision-making. Benefits will be felt not only within existing analog and digital instrumentation and control, but also work processes, the integration of people with technology, and most importantly, the business case. Together, these hold promise to make nuclear power more efficient and reduce costs associated with operation and maintenance. While the artificial intelligence and machine learning technologies hold significant promise in the nuclear industry, there are challenges or barriers to their adoption. This report outlines the those different machine learning adoption barriers (categorized as historical, technical, economic, regulatory, and user) that the industry must overcome to realize the full benefits of artificial intelligence and machine learning capabilities for long-term economic sustainability. This report also provides solutions for some of these barriers by focusing on improving the explainability of machine learning to encourage trust from the end-user. Trust and explainability are essential to machine learning adoption. This report focuses on research-developed solutions to some of these barriers while analyzing a non-safety-related system, namely the circulating water system. This system frequently experiences waterbox fouling which our models preemptively diagnoses then explains to the operator how those conclusions were reached. This report presents and discusses the inherent trade-off between machine learning performance (in terms of accuracy) and explainability, where highly accurate machine learning methods (such as deep-learning) are the least explainable, and the most explainable methods (such as decision trees) are the least accurate. In addition, explainability of artificial intelligence techniques in terms of transparency and post-hoc metrics are discussed. This report outlines the importance of data novelty and value of new information in evaluating both the explainability and trustworthiness. Novelty detection helps to establish consistency or inconsistency of the new data with respect to the training data. On the other hand, value of information could be a part of the user-centric visualization recommendation system that request additional information to be collected, thereby strengthening the machine learning outcomes. During this project, a copyrighted user-centric visualization that aligns with a human-in-the-loop approach was developed. The user-centric visualization presents different levels of information and can be tailored as per user credentials to gain user confidence. One of the salient features of the user-centric visualization is it presents machine learning methods with explainability metrics. A simplified version of the user-centric visualization was presented to 32 users with varying levels of machine learning expertise. Feedback was solicited to test the hypothesis that the app contained sufficient explainability and that the users would trust the algorithm. Overall, the app was positively received, and the hypothesis was supported. This report discusses the trust-but-verify framework – a potential approach to build user trust artificial intelligence. The framework discusses trust from the human level to artificial intelligence level. The fundamental premise of the trust but verify framework is derived from an observation of nuclear safety culture (i.e., nuclear power plant personnel do not rely on a singular source of data to make a decision). This also ties back to the user-centric visualization that presents different levels of information to achieve both explainability and trustworthiness of artificial intelligence. Even so, the adoption of artificial intelligence and machine learning in the nuclear industry faces additional barriers, namely regulatory and stakeholder readiness. To overcome these challenges, new solutions must gain regulatory approval and cater to stakeholder needs. The Nuclear Regulatory Committee has a 5-year strategic plan which prepares them for reviewing artificial intelligence technologies in licensee submissions. Early and frequent engagement with the regulator is encouraged. Additionally, artificial intelligence solutions should incorporate human-in-the-loop considerations and offer explainability. Stakeholders must prepare by hiring or training staff to adapt to advancing technology in everyday plant tasks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Wireless Communication for Controlling Microgrids: Co-simulation and Performance Evaluation

A microgrid with wireless communication links for microgrid control has been designed and developed. The complete simulation model has been developed in MatLab SimuLink with seamless integration of the power subsystem and the communication subsystem. Unlike the conventional co-simulators that usually glue two existing simulators together by creating an interface, which has a steep learning curve, the proposed simulator is a compact single-unit model. Detailed modeling of the power subsystem and communication system is presented as well as the microgrid control architecture and strategies. The impact of different communication system performances on microgrid control has been studied and evaluated in the proposed simulator.

Mao, Rukun↗

Computer-Based Procedures for Field Workers in Nuclear Power Plants: Development of a Model of Procedure Usage and Identification of Requirements

The nuclear industry is constantly trying to find ways to decrease the human error rate, especially the human errors associated with procedure use. As a step toward the goal of improving procedure use performance, researchers, together with the nuclear industry, have been looking at replacing the current paper-based procedures with computer-based procedure systems. The concept of computer-based procedures is not new by any means; however most research has focused on procedures used in the main control room. Procedures reviewed in these efforts are mainly emergency operating procedures and normal operating procedures. Based on lessons learned for these previous efforts we are now exploring a more unknown application for computer based procedures - field procedures, i.e. procedures used by nuclear equipment operators and maintenance technicians. The Idaho National Laboratory and participants from the U.S. commercial nuclear industry are collaborating in an applied research effort with the objective of developing requirements and specifications for a computer-based procedure system to be used by field workers. The goal is to identify the types of human errors that can be mitigated by using computer-based procedures and how to best design the computer-based procedures to do so. This paper describes the development of a Model of Procedure Use and the qualitative study on which the model is based. The study was conducted in collaboration with four nuclear utilities and five research institutes. During the qualitative study and the model development requirements and for computer-based procedures were identified.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗