Search NASA⌕ Search

SEARCH · Search NASA

Results for “observation scheduling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Distributed Power Allocation for 6-GHz Unlicensed Spectrum Sharing via Multi-agent Deep Reinforcement Learning

We consider the problem of power allocation over the 6 GHz Unlicensed National Information Infrastructure (UNII)- 5 spectrum. We propose a novel deep Reinforcement Learning (DRL)-based distributed power allocation scheme which utilizes the multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm. In particular, we model the base stations (BSs) as DRL agents that simultaneously determine the transmit powers to their scheduled user equipment (UE) in a synchronized manner. The power decision of each BS is based on its own observation of the radio environment, which consists of several local interference measurements and a limited amount of information obtained from other BSs. One advantage of the proposed scheme is that it addresses the single-agent non-stationarity problem of RL in the multi-agent scenario by incorporating the actions and observations of other BSs into each BS’s own critic which helps it to gain a more accurate perception of the overall radio environment. A centralized-training-distributed execution framework is used to train the policies where the critics are trained over the joint actions and observations of all BSs while the actor of each BS only takes the local observation as input in order to produce the transmit power. Simulation shows that the proposed power allocation scheme can achieve better throughput performance than several state-of-the-art approaches.

99 GENERAL AND MISCELLANEOUS↗

Use of a Compliant Tether to Decouple Observation Buoy Motion for Auxiliary Wave Power

With the growth of the Blue Economy, the volume of data collection within the ocean environment has been rapidly increasing. Larger numbers of oceanographic, meteorological, and floating Light Detection And Ranging (LiDAR) buoys have been collecting high fidelity measurements while pushing against power budget limits. Power limitations lead to infrequent transmission of reduced data sets or recording data to local storage that must be physically collected when the buoy is serviced. Triton Systems, Inc. and its partners are developing a retrofittable wave energy converter (WEC) to provide auxiliary power to these observation buoys to increase mission duration and power budget, improve reliability, and reduce the need for service trips. One of the greatest challenges has been developing a method to interface Triton's WEC with these buoys without impacting measurement fidelity. This is especially critical for inertial wave and LiDAR wind measurements collected with sensors that could be adversely affected by additional buoy dynamics introduced by an integrated WEC. To address this, Triton and EOM Offshore developed a compliant tether to pair an observation buoy with a floating WEC while decoupling relative motion. Based on EOM's proven stretch hose technology, this compliant tether transmits power and data between the buoy-WEC system. In conclusion, modeling shows that the system has the potential to minimally adversely affect oceanographic, meteorological, wind resource characterization, and other measurements, with future testing scheduled to validate modeling efforts.

16 TIDAL AND WAVE POWER↗

Overview of the distributed image processing infrastructure to produce the Legacy Survey of Space and Time

The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the Observatory’s ten-year science mission scheduled to begin in 2025. Rubin’s 8.4-meter telescope will nightly scan the southern hemisphere collecting imagery in the wavelength range 320–1050 nm covering the entire observable sky every 4 nights using a 3.2 gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this article we present an overview of the system currently being constructed to perform data distribution as well as the annual campaigns which reprocess the entire image dataset collected since the beginning of the survey. These processing campaigns will utilize computing and storage resources provided by three Rubin data facilities (one in the US and two in Europe). Each year a Data Release will be produced and disseminated to science collaborations for use in studies comprising four main science pillars: probing dark matter and dark energy, taking inventory of solar system objects, exploring the transient optical sky and mapping the Milky Way. Also presented is the method by which we leverage some of the common tools and best practices used for management of large-scale distributed data processing projects in the high energy physics and astronomy communities. We also demonstrate how these tools and practices are utilized within the Rubin project in order to overcome the specific challenges faced by the Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

New Fracture Diagnostic Tool for Unconventionals: High-Resolution Distributed Strain Sensing via Rayleigh Frequency Shift during Production in Hydraulic Fracture Test 2

Fiber Optic monitoring in unconventional reservoirs has proven to be an invaluable diagnostic tool for assessing both near-wellbore stimulation effectiveness and to help describe the far-field frac geometries created by hydraulic fracture stimulation. Unfortunately, gaining any detailed qualitative and quantitative understanding of the near-wellbore frac geometry or cluster/stage productivity during production via Fiber Optic (FO) has proven to be more difficult, particularly in wells producing liquids. A new FO diagnostic method, Distributed Strain Sensing based on Rayleigh Frequency Shift (DSS-RFS), first demonstrated for oil and gas applications in the Hydraulic Test Site 2 (HFTS2) provides new insights about the characteristics of near-wellbore-region (NWR) during production. DSS-RFS is different from other FO strain measurements because it relies on accurate measurement of frequency shifts of Rayleigh backscattered spectrum obtained by scanning the fiber with a coherent optical time-domain reflectometer with a range of laser frequencies using a tunable-wavelength laser system. Changes in strain are measured with an extremely high spatial resolution of 20 cm and with high signal-to-noise ratios over long distances. In HFTS2, strain changes for the entire wellbore have been measured twice during scheduled shut-in and reopening operations (February 2020 and September 2020). After removing temperature effects, consistent strain changes have been observed at the location of most perforation clusters. These are caused by near wellbore fracture aperture changes due to pressure increases during shut-in within the near-wellbore fracture network. The strain-change patterns from the DSS-RFS during shut-in correlate very well with the location of clusters and allow for the definition of extending intervals with positive strain signals at each cluster and slightly compressing intervals with negative strain signals between the clusters and in the non stimulated intervals. The locations of the measured positive strain peaks also show good correspondence to DAS acoustic intensity measurements acquired during the stimulation. The geometry and magnitude of the strain changes differ significantly between the two tested completion designs in the same well. During shut in and reopening each cluster exhibit its own strain-change / pressure path. In addition, the September 2020 dataset also revealed the existence of small but measurable strain changes as consequence of pressure decline during production. These strain changes also correlate well with the presence of producing clusters, but the strain-rate signals are opposite to that obtained during shut-in and reopening operations. Although Downloaded from http://onepetro.org/URTECONF/proceedings-pdf/21URTC/2-21URTC/D021S031R002/2477551/urtec-2021-5408-ms.pdf/1 by Carol Worster on 28 February 2022 URTeC 5408 2 we are still in the early stages of exploring the potential of this novel FO technique, we believe that the highly detailed information contained in the measurement of strain changes using DSS-RFS during production can significantly improve our understanding of near-wellbore hydraulic fracture characteristics and the relationships between stimulation and production from unconventional oil and gas wells.

04 OIL SHALES AND TAR SANDS↗

Accelerated Lifetime Testing of Main Shaft Seals for Tidal Turbine Rotors

This document will briefly discuss the observations and results from an NREL conducted accelerated lifetime testing of the main shaft seal for the Verdant Power fifth generation Gen5 underwater Tidal Energy Converter (TEC) turbine, which successfully performed at the RITE project in 2020-2021. In order to evaluate a 5-year Service Interval ( SI) for this component, testing at NREL operated the main shaft seal nearly continuously for over 135 (text says 130 days on page 5 and 125 days on page 7 and 137 days on page 11) days at a rotational velocity of 160 rpm while the test stand recorded water pressure, barrier fluid pressure, temperature, and number of cycles., representing ~ 40% of the SI. An additional separate test was conducted to measure the aging behavior of the rubber drive rings. The water pressure reservoir was held constant as 29 psi. Barrier fluid pressure remained relatively constant throughout the duration of the test but was seen to sink to as low as 10.1 psi. No barrier fluid leakage was observed throughout the test. A sudden failure occurred within the seal after the power to test machine was interrupted for a scheduled building maintenance procedure. Upon restarting, the main shaft seal lost all ability to prevent water ingress. The exact cause is not known but is believed to be either a seal assembly issue or a change in the alignment of the seal components during or following the power outage. Following seal disassembly, significant wear was seen on one of the graphite sealing rings. Based on these results it is recommended that a follow-on TEAMER be conducted to rectify protocol and assembly issues to further evaluate SI of this component. The support and participation of Verdant Power Inc, Dovetail Solutions LLC and Garlock Manufacturing Inc were instrumental in understanding the results. NREL thanks them for their significant effort.

13 HYDRO ENERGY↗

Flexible Ramping Product Procurement in Day-Ahead Markets

Flexible ramping products (FRPs) emerge as a promising instrument for addressing steep and uncertain ramping needs through market mechanisms. Initial implementations of FRPs in North American electricity markets, however, revealed several shortcomings in existing FRP designs. Here, in many instances, FRP prices failed to signal the true value of ramping capacity, most notably evident in zero FRP prices observed in a myriad of periods during which the system was in acute need for rampable capacity. These periods were marked by scheduled but undeliverable FRPs, often calling for operator out-of-market actions. On top of that, the methods used for procuring FRPs have been primarily rule-based, lacking explicit economic underpinnings. In this paper, we put forth an alternative framework for FRP procurement, which seeks to set FRP requirements and schedule FRP awards such that the expected system operation cost is minimized. Using real-world data from U.S. ISOs, we showcase the relative merits of the framework in (i) reducing the total system operation cost, (ii) improving price formation, (iii) enhancing the the deliverability of FRP awards, and (iv) reducing the need for out-of-market actions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Job Scheduler-Driven Power Gateway for High Performance Computing

Power gateways in the form of a microgrid can incorporate multiple distributed energy resources (DER) in either grid forming or grid following mode and support high performance computing (HPC) power profiles including the large load-follow requirements observed in multi-user HPC systems. The microgrid’s flexibility to operate in either grid forming or grid following mode and to actively switch between these modes enables baseline power from multiple non-baseline DER while maintaining high power quality metrics for the HPC system. But this enormous flexibility in demand response and time of use shifting is generally programmed independently of any integration with an HPC job scheduler which can better inform the load shaping by the microgrid. While there are many existing approaches where the HPC job scheduler takes in information from the grid to make queue scheduling decisions, this work takes the opposite view and explores a scheduler where the jobs in the queue can directly impact the settings of the grid. Several HPC scheduler strategies are tested where the jobs in the queue directly impact the settings of a microgrid designed for HPC operation which is driving a datacenter with three classes of HPC architectures. The scheduler operation is shown using a microgrid with 64 kW of solar capacity and 320 kWh of battery over a period of 21 days operating with significant low-follow swings, a throttled grid, cloudy conditions, switching between grid following and grid forming modes, and a wide range of battery states-of-charge all while maintaining high quality power metrics. The scheduler provides a mechanism for the job queue to directly impact a power gateway like a microgrid and to improve HPC power outcomes such as maximizing renewable energy usage

microgrid↗

When to vaccinate for seasonal influenza: check the peak forecast

Background Seasonal influenza infects 5-20% of people every year in the United States, resulting in hospitalizations, deaths, and adverse economic impacts. To mitigate these impacts, influenza vaccines are developed and distributed annually; however, growing evidence suggests that vaccine effectiveness (VE) wanes over the course of a flu season. Delaying influenza vaccination for older adults has attracted attention as a potential public health strategy. However, given the uncertainties in seasonal peak, vaccine effectiveness, and waning rates, postponing vaccination could also lead to increased morbidity, motivating an evaluation of a range of potential scenarios. The aim of this study was to investigate favorable age group-specific vaccination schedules that could lead to the greatest disease burden reduction. Methods We systematically investigated a broad range of vaccination start times for five age groups under six combinations of initial effectiveness and waning rates, based on influenza cases and vaccine uptake data from 10 influenza seasons. We defined the most favorable vaccination schedule as the one that resulted in the greatest reduction in disease burden. Results In scenarios with fast waning, all age groups benefit from delaying vaccination regardless of initial VE and peak timing. In scenarios with slower waning, results are mixed. For the ≥65 group, high initial VE and slow waning suggests that in early-peaking seasons, early vaccination most effectively reduces disease burden, while in late-peaking seasons delaying vaccination is most effective. For the ≥65 group in medium and low initial VE, and slow waning scenarios, delaying vaccination appears to prevent the greatest number of cases, regardless of whether the season peaks early or late. Conclusion The most favorable vaccination schedule is sensitive to changes in initial VE, waning rate, and peak timing. Given estimates of these quantities from statistical and immunological models and observations, our methods can inform vaccination recommendations in order to most effectively reduce the annual disease burden caused by seasonal influenza. Specifically, accurate peak timing forecasts for the upcoming season have the potential to guide decisions on when to vaccinate.

59 BASIC BIOLOGICAL SCIENCES↗

Molecular-Level Dysregulation of Insulin Pathways and Inflammatory Processes in Peripheral Blood Mononuclear Cells by Circadian Misalignment

Circadian misalignment due to night work has been associated with elevated risk for chronic diseases. Here, we investigated the effects of circadian misalignment using shotgun protein profiling of peripheral blood mononuclear cells taken from healthy humans during a constant routine protocol, which was conducted immediately after participants had been subjected to a 3-day simulated night shift schedule or a 3-day simulated day shift schedule. By comparing proteomic profiles between the simulated shift conditions, we identified proteins and pathways that are associated with the effects of circadian misalignment, and observed that insulin regulation pathways and inflammation-related proteins displayed markedly different temporal patterns after simulated night shift. Further, by integrating the proteomic profiles with previously assessed metabolomic profiles in a network-based approach, we found key associations between circadian dysregulation of protein-level pathways and metabolites of interest in the context of chronic metabolic diseases. Overall, our results suggest that circadian misalignment is associated with a tug of war between central clock mechanisms controlling insulin secretion and peripheral clock mechanisms regulating insulin sensitivity, which may lead to adverse long-term outcomes such as diabetes and obesity. Our study provides a molecular-level mechanism linking circadian misalignment and adverse long-term health consequences of night work.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation: Preprint

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

Bayesian structural time series↗

Grating-Based Imaging-Scattering with Portable Neutron Generator

Company: Adelphi Technology, Inc. Title: Grating-Based Imaging-Scattering with Portable Neutron Generator PI: Dr. Jay Theodore Cremer, Jr. Topic: 26a Statement of the problem or situation that is being addressed. Successful plant growth depends upon an efficient and robust root system. The plant root is part of a larger system of water and microbial flows in the soil system. While much effort has been exerted to develop an imaging system for water, microbes, and roots, the problem is challenging, and no widely accepted imaging method currently exists. The optical solutions use a highly modified soil system. X-ray imaging methods are insensitive to the soft tissues in the presence of sand. Thermal neutron imaging has been often tested, but found inadequate, due to limited access and low image resolution. This project will develop a new strategy for neutron imaging of plant/soil systems. The project will allow long duration experiments in greenhouse environments and increase the image information content to the micron scale. General statement of how this problem is being addressed. Portable, rugged thermal and fast neutron sources are being developed where portable means a two-soldier team can carry the source and power unit to survey rough terrain for explosives. In the past decade, microfabrication of X-ray and thermal/cold neutron optics has opened a new imaging strategy. The standard transmission image is now supplemented with simultaneous acquisition of a phase contrast image and an image revealing scattering features. In materials science, the interferometric neutron scattering image has been used to detect early crack formation in stressed additive manufacturing test samples. The detection requires sensitivity to scattering features at the 1-micron scale. By addition of our proposed grating-optic to Adelphi Technology’s radiographic/tomographic imaging system, which is based on portable thermal neutron source, the resulting thermal neutron scatter image of the plant/soil system, will reveal details at 1-micron. Commercial Applications and Other Benefits Neutron interferometry imaging has greater penetration through large metal components compared to industrial X-ray imaging. The low-cost, large area optics developed for greenhouse applications, combined with the robust, portable neutron generator, can then be marketed as a system for inspection of additive manufactured components. In the aerospace industry, all freshly printed components are validated with X-ray CT. Scheduled maintenance again requires X-ray CT as the ability to predict aerospace component lifetime does not yet exist. Large aerospace components are only partially observed with X-ray imaging. Key Words Neutron radiography/tomography, grating interferometry, thermal neutron generator imaging, plant root and soil imaging, rhizosphere imaging, deployable neutron imaging systems Summary for Members of Congress A rugged, portable source of thermal neutrons is adapted for neutron interferometry imaging with the addition of low-cost, 3D printed optics. The first application of our proposed deployable, compact thermal neutron generator imaging system, using a grating optic, is plant root/soil science in greenhouse settings and agricultural laboratories.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

CubeSat constellations provide enhanced crop phenology and digital agricultural insights using daily leaf area index retrievals

Satellite remote sensing has great potential to deliver on the promise of a data-driven agricultural revolution, with emerging space-based platforms providing spatiotemporal insights into precision-level attributes such as crop water use, vegetation health and condition and crop response to management practices. Using a harmonized collection of high-resolution Planet CubeSat, Sentinel-2, Landsat-8 and additional coarser resolution imagery from MODIS and VIIRS, we exploit a multi-satellite data fusion and machine learning approach to deliver a radiometrically calibrated and gap-filled time-series of daily leaf area index (LAI) at an unprecedented spatial resolution of 3 m. The insights available from such high-resolution CubeSat-based LAI data are demonstrated through tracking the growth cycle of a maize crop and identifying observable within-field spatial and temporal variations across key phenological stages. Daily LAI retrievals peaked at the tasseling stage, demonstrating their value for fertilizer and irrigation scheduling. An evaluation of satellite-based retrievals against field-measured LAI data collected from both rain-fed and irrigated fields shows high correlation and captures the spatiotemporal development of intra- and inter-field variations. Novel agricultural insights related to individual vegetative and reproductive growth stages were obtained, showcasing the capacity for new high-resolution CubeSat platforms to deliver actionable intelligence for precision agricultural and related applications.

54 ENVIRONMENTAL SCIENCES↗

RL-HEMS: Reinforcement Learning Based Home Energy Management System for HVAC Energy Optimization

Heating, ventilation, and air conditioning (HVAC) is one of the major energy consumers in the residential sector. It is important to be able to monitor and control the energy consumed to provide utility services such as load shaping while satisfying the comfort and economic constraints of the homeowner. The objective of this work is to create the optimal schedule for HVAC operation to reduce the cost while satisfying the home-owner and equipment’s constraints using a model-free Reinforcement Learning (RL)-based optimization. The specific goal is to find the right balance between reducing energy cost, consumption, and customer comfort level. Our research effort addresses this optimization problem using multiple components: the development of initial learning test-bed and implementation of RL techniques on a real home. This will enable the rapid evaluation of the RL techniques and provide an early baseline to train before implementation on site. The RL algorithm is designed to learn the energy use patterns and generate the optimized schedule for HVAC within an acceptable time-interval to satisfy the homeowner’s comfort and minimize the energy usage. Our preliminary results are promising and we have observed a 17% reduction in the total cost and a 15% reduction in the power utilization using our RL-based HVAC model—RL-HEMS.

Kotevska, Olivera↗

Optimal Zeno Dragging for Quantum Control: A Shortcut to Zeno with Action-Based Scheduling Optimization

The quantum Zeno effect asserts that quantum measurements inhibit simultaneous unitary dynamics when the “collapse” events are sufficiently strong and frequent. This applies in the limit of strong continuous measurement or dissipation. It is possible to implement a dissipative control that is known as “Zeno dragging” by dynamically varying the monitored observable, and hence also the eigenstates, which are attractors under Zeno dynamics. This is similar to adiabatic processes, in that the Zeno-dragging fidelity is highest when the rate of eigenstate change is slow compared to the measurement rate. We demonstrate here two theoretical methods for using such dynamics to achieve control of quantum systems. The first, which we shall refer to as “shortcut to Zeno,” is analogous to the shortcuts to adiabaticity (counterdiabatic driving) that are frequently used to accelerate unitary adiabatic evolution. In the second approach, we apply the Chantasri-Dressel-Jordan stochastic action [PRA 88, 042110 (2013)], and demonstrate that the extremal-probability readout paths derived from this are well suited to setting up a Pontryagin-style optimization of the Zeno-dragging schedule. A fundamental contribution of the latter approach is to show that an action suitable for measurement-driven control optimization can be derived quite generally from statistical arguments. Implementing these methods on the Zeno dragging of a qubit, we find that both approaches yield the same solution, namely, that the optimal control is a unitary that matches the motion of the Zeno-monitored eigenstate. We then show that such a solution can be more robust than a unitary-only operation and we comment on solvable generalizations of our qubit example embedded in larger systems. These methods open up new pathways toward systematically developing dynamic control of Zeno subspaces to realize dissipatively stabilized quantum operations. Published by the American Physical Society 2024

Physics↗

Coupled Thermo–Hydro–Mechanical Modeling of Hydro-Shearing Stimulation in an Enhanced Geothermal System in the Raft River Geothermal Field, USA

The Raft River Enhanced Geothermal System (EGS) demonstration project aims to improve the geothermal production by enhancing the reservoir permeability via shear stimulation in well RRG-9. In this paper, we performed a series of 3D thermo– hydro–mechanical (THM) simulations to investigate the influence of hydraulic and thermal effects on the development of this EGS. The model includes synthetic fracture populations based on borehole televiewer images and in-situ stress measurements from well RRG-9. Fracture permeability evolution is determined using an empirical permeability law developed from laboratory experiments. The model was calibrated by comparing the hydraulic response to field observations, including wellhead pressure, injection rate, and well injectivity. Particularly, we analyzed the enhancement of reservoir permeability and the spatial extent of the stimulation zone for the given injection schedule. Our results indicate that the permeability enhancement of fractured geothermal reservoir is caused by the combined effects of injection-induced cooling and fluid pressure increase. The decrease of temperature plays a dominant role in reactivation of natural fractures under the hydro-shearing mechanism, while the higher injection pressure promotes shear failure and enlarges the stimulation zone. Finally, for the specified extensional stress state, the model favors greatest permeability enhancement along the maximum horizontal principal stress, a moderate vertical enhancement, and a smaller gain along the minimum horizontal principal stress.

58 GEOSCIENCES↗

Dynamic Human-in-the-Loop Simulated Nuclear Power Plant Thermal Dispatch System Demonstration and Evaluation Study

An Idaho National Laboratory research team performed a human-in-the-loop study with two formerly licensed retired operators to evaluate thermal power dispatch operations supported by the modified GSE Systems GPWR plant simulator. Virtual representations of the analog control panels were presented on touch-screen bays configured to mimic the control room layout in the newly renovated Human Systems Simulation Laboratory. The operators performed 15 scenarios covering normal evolutions to transition the plant from full turbine operation to joint turbine and thermal power dispatch operations in addition to transient response scenarios induced with simulated faults to evaluate the impact of thermal power dispatch system on operator and plant responses. A prototype human-system interface (HSI) was developed and displayed in tandem with the virtual analog panels to support the operators executing the procedurally drive evolutions and transient responses. An interdisciplinary team of operations experts, nuclear engineers, and human factors experts observed the operators performing the scenarios to evaluate the operations. Only a preliminary analysis of the results has been performed. The full analysis will be shared in a milestone report scheduled for release at the end of September; however, some high-level conclusions were readily available. Two high level findings for the system design were captured in the study. The manual control supported by the HSI to transition from standard operations to thermal power dispatch operation imposed a considerable amount of workload on the operators due to tedious manual valve manipulations and system monitoring required to verify their intended effect. An additional operator would be required in the control room to support the daily evolution. Automatic control for the transition was deemed a requirement for plant adoption without imposing additional staffing costs. The second finding was the necessity for an automatic thermal power dispatch system trip isolation function linked to a turbine and reactor trip signal. The operators completed scenarios with automatic isolation functionality and manually required actuation of the thermal power dispatch system. The operator response was sufficiently slower in the manual trip condition, such that operators were unable to manually actuate key post trip safety functions an indicate a degraded control capability that should be avoided. With an automatic trip signal little to no impact of the thermal power dispatch system was identified on the primary plant response and therefore the system could be readily and safely adopted. Together these two findings represent the need to support the adoption of thermal power dispatch capability into existing operations by leveraging automation to augment any additional operator tasking required to control and monitor an additional system beyond existing operations.

99 GENERAL AND MISCELLANEOUS↗

Unlocking Autonomous Telescopes through Reinforcement Learning: An Offline Framework and Insights from a Case Study

Optimizing observational astronomy campaigns is becoming a complex and expensive task for next-generation telescopes, where manual planning of observations may tend to reach suboptimal results in terms of optimization.Reinforcement Learning (RL) has been well-demonstrated as a valuable approach for training autonomous systems, and it may provide the basis for self-driving telescopes capable of scanning the sky and optimizing the scheduling for astronomy campaigns.We have developed a framework for the optimization of telescope scheduling using RL techniques, based on a dataset containing data on a discrete set of sky locations that the telescope should visit, and a reward metric. We compared several RL algorithms applied to an offline simulation dataset based at the Stone Edge Observatory, considering a discrete set of sky locations to visit and using “t-effective” as a reward metric, a measure of the quality of the data.Deep Q-Networks (DQNs), belonging to the class of value-based methods, have shown remarkable success in the optimization of astronomical observations in our dataset. In the full environment, the average reward value in each state was found to be 92%±5% of the maximum possible reward, while on the test set it resulted in 87%±9% of the maximum possible reward.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗