Search NASA⌕ Search

SEARCH · Search NASA

Results for “sequential decision making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1976

Applications of remote sensing to estuarine management

Projects for sewage outfall siting for pollution control in the lower Chesapeake Bay wetlands are reported. A dye-buoy/photogrammetry and remote sensing technique was employed to gather circulation data used in outfall siting. This technique is greatly favored over alternate methods because it is inexpensive, produces results quickly, and reveals Lagrangian current paths which are preferred in making siting decisions. Wetlands data were obtained by interpretation of color and color infrared photographic imagery from several altitudes. Historical sequences of photographs are shown that were used to document wetlands changes. Sequential infrared photography of inlet basins was employed to determine tidal prisms, which were input to mathematical models to be used by state agencies in pollution control. A direct and crucial link between remote sensing and management decisions was demonstrated in the various projects.

Munday, J. C., Jr.↗
DOE OSTI2025

River Dissolved Oxygen Prediction Using Machine Learning Models and Wireless Sensor Measurements

Simultaneous flooding&heat and droughts&heat events can potentially destabilize hydro-meteorological conditions to deteriorate the water quality of Neches River. Machine learning (ML) models utilizing wireless sensor measurements have been applied to predict water quality and optimize various water management strategies. This study aims to develop ML models to predict dissolved oxygen (DO) prediction under various hydro-meteorological conditions and enhance water management decision-making. Wireless sensor measurements of DO, water temperature, sample depth, conductivity, turbidity, and pH, along with discharge from the United States Geological Survey stations, are collected for model inputs at the Pine Island Bayou C749 station (PIB-C749) and Neches River Saltwater Barrier (SWB). Multilayer perceptron neural networks, recurrent neural networks, long short-term memory (LSTM), and bidirectional LSTM (BiLSTM) with and without attention mechanism (AT) are tested to determine the best model, which is applied the rolling forecast method to predict 14-day DO. Traditional and recurrent transfer learning (TL and RTL) methods are adopted to overcome insufficient data at the SWB. The input feature importance analysis using the integrated gradients (IG) algorithm is applied to determine dominant inputs. The results show LSTM-based models are capable handling long sequential data. AT-BiLSTM and RTL-LSTM demonstrate the best performance at the PIB-C749 (RMSE=0.054) and the SWB (RMSE=0.028), respectively. TL and RTL methods significantly improve model performance at the SWB. DO, temperature, and pH show higher importance, consistent with hydrodynamics and water chemistry. Both best models are applied to predict 14-day DO and demonstrate reasonable performance for decision-making. Hydro-meteorological conditions of 2017 flood and 2012 drought events are simulated and reveal that possible hypoxia occurs after flooding due to increasing temperature and turbidity, and DO concentration decreases significantly under heat and drought conditions. In conclusion, LSTM-based models utilizing wireless sensor data can be a timely and effective approach to make appropriate decisions on water resource management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Control co-design under uncertainty for offshore wind farms: Optimizing grid integration, energy storage, and market participation

Offshore wind farms (OWFs) are set to significantly contribute to global decarbonization efforts. Developers often use a sequential approach to optimize design variables and market participation for grid-integrated offshore wind farms. However, this method can lead to sub-optimal system performance, and uncertainties associated with renewable resources are often overlooked in decision-making. Here, this paper proposes a control co-design approach, optimizing design and control decisions for integrating OWFs into the power grid while considering energy market and primary frequency market participation. Additionally, we introduce optimal sizing solutions for energy storage systems deployed onshore to enhance revenue for OWF developers over time. This framework addresses uncertainties related to wind resources and energy prices. We analyze five U.S. west-coast offshore wind farm locations and potential interconnection points, as identified by the Bureau of Ocean Energy Management (BOEM). Results show that optimized control co-design solutions can increase market revenue by 3.2% and provide flexibility in managing wind resource uncertainties.

Control Co-design↗
DOE OSTI2020

The Kalai-Smorodinsky solution for many-objective Bayesian optimization

An ongoing aim of research in multiobjective Bayesian optimization is to extend its applicability to a large number of objectives. While coping with a limited budget of evaluations, recovering the set of optimal compromise solutions generally requires numerous observations and is less interpretable since this set tends to grow larger with the number of objectives. We thus propose to focus on a specific solution originating from game theory, the Kalai-Smorodinsky solution, which possesses attractive properties. In particular, it ensures equal marginal gains over all objectives. We further make it insensitive to a monotonic transformation of the objectives by considering the objectives in the copula space. A novel tailored algorithm is proposed to search for the solution, in the form of a Bayesian optimization algorithm: sequential sampling decisions are made based on acquisition functions that derive from an instrumental Gaussian process prior. Our approach is tested on four problems with respectively four, six, eight, and nine objectives. The method is available in the R package GPGame available on CRAN at https://cran.r-project.org/package=GPGame.

Game theory↗
DOE OSTI2020

Calibration and Uncertainty Estimation Using the Ensemble Kalman Filter with a Large Subsurface Flow and Transport Model - 20321

At routinely monitored groundwater contamination sites, periodically measured environmental conditions such as groundwater levels and contaminant concentrations are used to inform and confirm a conceptual site model (CSM) and guide the development and calibration of a numerical groundwater flow and transport model. The calibration of groundwater flow and transport models after each measurement (sampling) event can illuminate deficiencies in a CSM, identify areas where additional monitoring is warranted, and predict the behavior of the system to guide decision making. However, manual and automated (e.g. PEST) model calibration tools can be time-consuming and computationally expensive to implement after each sampling event. Perhaps as a result, such calibration tools generally utilize all available monitoring data simultaneously rather than sequentially assimilating monitoring data one sampling event at a time as the results from sampling become available. A more real-time data assimilation approach may reduce parameter uncertainty, quantify the value of additional monitoring data, and produce a usable model more quickly and with less effort. To mitigate the potential time-consuming aspects of manual and widely applied automated calibration techniques, a data assimilation algorithm called the ensemble Kalman filter (EnKF) was evaluated as a relatively efficient method of model calibration and uncertainty assessment via the sequential integration of monitoring data into a model. The EnKF was able to successfully and efficiently assimilate monitoring and modeling data to calibrate a complex flow and transport model at a real-world site with significant subsurface heterogeneity, uncertainty, and 12 years of monitoring data (over 4,000 individual measurements of groundwater levels and over 2,500 measurements of contaminant concentrations). Starting with an uncalibrated model data from annual sampling events were sequentially assimilated, and the resultant predication errors and estimated parameter uncertainties were tracked. After all monitoring data were assimilated, both flow and transport residuals at the end of the EnKF process were comparable to those produced via a concurrent PEST calibration effort but required fewer model simulations. Both uncertainty and prediction errors decreased over time. In a real-time application, the adequacy of the model could be assessed after each sampling event. The benefits of such a real-time approach to utilizing monitoring data include reduced costs (in the form of model updates or site characterization efforts), early flagging of possible errors in the CSM, and a reduced risk of overfitting and corresponding increased confidence in model predictions. This tool may be particularly useful compared to other calibration techniques (e.g. manual, PEST) when model runtimes are long, calibration parameters are many, or parameter uncertainty is large. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2010

Identification of Low-level Point Radioactive Sources using a sensor network

Identification of a low-level point radioactive source amidst background radiation is achieved by a network of radiation sensors using a two-step approach. Based on measurements from three or more sensors, a geometric difference triangulation method or an N-sensor localization method is used to estimate the location and strength of the source. Then a sequential probability ratio test based on current measurements and estimated parameters is employed to finally decide: (1) the presence of a source with the estimated parameters, or (2) the absence of the source, or (3) the insufficiency of measurements to make a decision. This method achieves specified levels of false alarm and missed detection probabilities, while ensuring a close-to-minimal number of measurements for reaching a decision. This method minimizes the ghost-source problem of current estimation methods, and achieves a lower false alarm rate compared with current detection methods. This method is tested and demonstrated using: (1) simulations, and (2) a test-bed that utilizes the scaling properties of point radioactive sources to emulate high intensity ones that cannot be easily and safely handled in laboratory experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Targeted materials discovery using Bayesian algorithm execution

Rapid discovery and synthesis of future materials requires intelligent data acquisition strategies to navigate large design spaces. A popular strategy is Bayesian optimization, which aims to find candidates that maximize material properties; however, materials design often requires finding specific subsets of the design space which meet more complex or specialized goals. We present a framework that captures experimental goals through straightforward user-defined filtering algorithms. These algorithms are automatically translated into one of three intelligent, parameter-free, sequential data collection strategies (SwitchBAX, InfoBAX, and MeanBAX), bypassing the time-consuming and difficult process of task-specific acquisition function design. Our framework is tailored for typical discrete search spaces involving multiple measured physical properties and short time-horizon decision making. We demonstrate this approach on datasets for TiO 2 nanoparticle synthesis and magnetic materials characterization, and show that our methods are significantly more efficient than state-of-the-art approaches. Overall, our framework provides a practical solution for navigating the complexities of materials design, and helps lay groundwork for the accelerated development of advanced materials.

42 ENGINEERING↗
DOE OSTI2017

Assessment of mobility and bioavailability of mercury compounds in sewage sludge and composts

Content of heavy metals, including mercury, determines the method of management and disposal of sewage sludge. Excessive concentration of mercury in composts used as organic fertilizer may lead to accumulation of this element in soil and plant material. Fractionation of mercury in sewage sludge and composts provides a better understanding of the extent of mobility and bioavailability of the different mercury species and helps in more informed decision making on the application of sludge for agricultural purposes. The experimental setup comprises the composing process of the sewage sludge containing 13.1 mg kg{sup −1} of the total mercury, performed in static reactors with forced aeration. In order to evaluate the bioavailability of mercury, its fractionation was performed in sewage sludge and composts during the process. An analytical procedure based on four-stage sequential extraction was applied to determine the mercury content in the ion exchange (water soluble and exchangeable Hg), base soluble (Hg bound to humic and fulvic acid), acid soluble (Hg bound to Fe/Mn oxides and carbonates) and oxidizable (Hg bound to organic matter and sulphide) fractions. The results showed that from 50.09% to 64.55% of the total mercury was strongly bound to organo-sulphur and inorganic sulphide; that during composting, increase of concentrations of mercury compounds strongly bound with organic matter and sulphides; and that mercury content in the base soluble and oxidizable fractions was strongly correlated with concentration of dissolved organic carbon in those fractions. - Highlights: • Composting of sewage sludge was conducted in batch mode. • Changes of mercury fractions and organic matter were investigated. • The relationship between Hg fractions and these parameters were discussed.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2003

Interfacing Computer Aided Parallelization and Performance Analysis

When porting sequential applications to parallel computer architectures, the program developer will typically go through several cycles of source code optimization and performance analysis. We have started a project to develop an environment where the user can jointly navigate through program structure and performance data information in order to make efficient optimization decisions. In a prototype implementation we have interfaced the CAPO computer aided parallelization tool with the Paraver performance analysis tool. We describe both tools and their interface and give an example for how the interface helps within the program development cycle of a benchmark code.

Jost, Gabriele↗
DOE OSTI2023

Blockchain for Fault-Tolerant Grid Operations Version 2.0

This report explores the potential of distributed ledger technology (DLT) as a transformative tool to enhance fault-tolerant operations in electrical distribution systems. Leveraging DLT's core attributes, including an immutable decentralized ledger, distributed consensus mechanisms, and state replication capabilities, this study focuses on three critical use cases. A central aspect of this research centers on the utilization of a consensus-driven ledger, providing actors within the system, such as distributed resources, with access to a reliable data repository. This empowers these actors to collaborate effectively and make informed decisions, all securely recorded on the blockchain. The first use case concentrates on data configuration, utilizing mathematical criteria---particularly, the chi-squared test for gross error detection---to identify trustworthy sensors for advanced decision-making. Building upon this foundation of trust, the second use case, topology identification, accurately determines circuit breaker states, unveiling the distribution network's topology. Ultimately, the third use case leverages this trust to execute switching actions, reconfiguring feeders and restoring power to disconnected customers after fault events. The concept of trust serves as a cornerstone in this approach, marking a departure from traditional fault location, isolation, and service restoration (FLISR) methods. Additionally, the blockchain-based architecture introduces decentralization, empowering disconnected areas to make autonomous decisions, even when communication with a central control center is disrupted. The primary contributions of this report are twofold: (1) a novel approach for evaluating distribution system voltage areas while preserving data ownership and (2) the implementation of interactions between distribution network areas using the actor model. Unlike the previous sequential approach for evaluating the area connection voltages, which required a radial network topology, this study's area model reduction enables a more versatile approach. The area model reduction addresses issues of prolonged data waiting times and multiple points of failure within the previous approach. Notably, the presented evaluation for the reduced network model area connection reveals a significant increase in the differences in voltage magnitudes. Simulation and evaluation of area agents across four distinct cases elucidate the area-level interaction behavior during a fault event. Simulations demonstrate that the proposed distributed FLISR (DFLISR) approach can successfully restore service to an affected area. Varying message delays and message loss probabilities in each simulation case underscore their impacts on restoration times, ranging from 3 min and 32 s to 6 min and 19 s. In contrast, power is not restored in an area in one of our simulation cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1971

Some sequential, distribution-free pattern classification procedures with applications

Some sequential, distribution-free pattern classification techniques are presented. The decision problem to which the proposed classification methods are applied is that of discriminating between two kinds of electroencephalogram responses recorded from a human subject: spontaneous EEG and EEG driven by a stroboscopic light stimulus at the alpha frequency. The classification procedures proposed make use of the theory of order statistics. Estimates of the probabilities of misclassification are given. The procedures were tested on Gaussian samples and the EEG responses.

Poage, J. L.↗
DOE OSTI2017

Calculating Probability Densities with Homotopy and Applications to Particle Filters

In this work, we explore a homotopy sampling procedure and its generalization, loosely based on importance sampling, known as annealed importance sampling. The procedure makes use of a known probability distribution to find, via homotopy, the unknown normalization of a target distribution, as well as samples of the target distribution. We propose a reformulation of the method that leads to a rejection sampling alternative. Estimates of the error as a function of homotopy stages and sample averages are derived for the algorithmic version of the method. These estimates are useful in making computational efficiency decisions on how the calculation should proceed, given a computer architecture. Consideration is given to how the procedure can be adapted to Bayesian stationary and nonstationary estimation problems. The connection between homotopy sampling and thermodynamic integration is made. Emphasis is placed on the non-stationary problems, and in particular, on a sequential estimation technique known as particle filtering. It is shown that a modification of the particle filter framework to include the homotopy process can improve the computational robustness of particle filters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Enhancing Building Energy Efficiency through Advanced Sizing and Dispatch Methods for Energy Storage

Energy storage and electrification of buildings hold great potential for future decarbonization. However, there are several technical and economic barriers that prevent large-scale adoption and integration of energy storage in buildings. These barriers include integration with building control systems, high capital costs, and the necessity to identify and quantify value streams for different stakeholders. To overcome these obstacles, it is crucial to develop advanced sizing and dispatch methods to assist planning and operational decision-making for integrating energy storage in buildings. This work develops simple and flexible optimal sizing and dispatch framework for thermal energy storage (TES) and battery energy storage (BES) systems in large-scale office building. The optimal sizes of TES, BES, as well as other building assets are determined in a joint manner instead of sequentially to avoid sub-optimal solutions. The interaction between the sizing at the planning stage and hourly or sub-hourly dispatch at the operating stage is explicitly modeled. The solution is determined considering both capital costs in optimal sizing and operational benefits in optimal dispatch. Comprehensive assessments are performed using simulation studies to quantify potential energy, economic, and emission benefits by different utility tariffs and climate locations, to improve our understanding of the techno-economic performance of different TES and BES systems, and to identify barriers for adopting energy storage for buildings. Finally, the proposed framework will provide guidance to a broad range of stakeholders to properly design energy storage in buildings and maximizes potential benefits, thereby advancing affordable building energy storage deployment and helping us accelerating the transition towards a cleaner and more equitable energy economy.

Yu, Mingyung↗
DOE OSTI2022

Development and assessment of prognosis digital twin in a NAMAC system

The nearly autonomous management and control (NAMAC) system is a comprehensive control system to assist plant operations by furnishing control recommendations to operators. Prognosis digital twin (DT-P) is a critical component in NAMAC for predicting action effects and supporting NAMAC decision-making during normal and accident scenarios. To quantifying and reducing uncertainty of machine-learning-based DT-Ps in multi-step predictions, this work investigates and derives insights from the application of three techniques for optimizing the performance of DT-P by long short-term memory recurrent neural networks, including manual search, sequential model-based optimization, and physics-guided machine learning. Finally, sequential model-based optimization and physics-guide machine learning result in smallest errors when the predicting transients are similar to the training data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Extreme-scale stochastic optimization and simulation via learning-enhanced decomposition and parallelization (Final Technical Report)

Stochastic optimization and simulation models ubiquitously arise in designing and operating complex service/engineering systems. They can be extreme in scale due to high-dimensional data and decisions, and can also involve decisions made sequentially in response to newly revealed data, both causing significant computational challenge. The objective of this research is to explore a unified framework that integrates machine learning with discrete optimization and risk-averse modeling, to improve the efficiency of decomposition paradigms for stochastic optimization and simulations at extreme scale. The models we consider represent a broad class of complex decision-making problems, where 0-1 or continuous decisions are made before and/or after knowing multiple sources of uncertainties that could be correlated. We will employ machine learning methods to dynamically decide and prioritize computational procedures, including cut generation, branching, and bounding of the optimal objective. Furthermore, the research will shed new lights on the traditional decomposition algorithms for extreme-scale computing. Deliverables of the research include new modeling and computational methods for advancing the state-of-the-art research in optimization and simulation, bringing many relevant risk-averse, data-driven optimization problems in practice within the range of tractability. Examples include distributed computing server scheduling and sensor deployment for monitoring critical infrastructures. Success in this effort will enable progress in solving multiple extreme-scale problems in the complex system design and operations arising from DoE missions in energy, environment, and national security.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2018

Next Generation Aircraft Design Considering Airline Operations and Economics

Traditional approaches to design and optimization of a new system often use a system-centric objective and do not take into consideration how the operator will use this new system alongside other existing systems. When the new system design is incorporated into the broader group of systems, the performance of the operator-level objective can be sub-optimal due to the unmodeled interaction between the new system and the other systems. Among the few available references that describe attempts to address this disconnect, most follow an MDO (Multidisciplinary Design Optimization)-motivated sequential decomposition approach of first designing a very good system and then providing this system to the operator who, decides the best way to use this new system along with the existing systems. This paper addresses this issue by including aircraft design, airline operations, and revenue management "subspaces"; and presents an approach that could simultaneously solve these subspaces posed as a monolithic optimization problem rather than the traditional approach described above. The monolithic approach makes the problem an expensive Mixed Integer Non-Linear Programming problem, which are extremely difficult to solve. To address the problem, we use a recently developed optimization framework that simultaneously solves the subspaces to capture the "synergy" in the problem that the previous decomposition approaches did not exploit, addresses mixed-integer/discrete type design variables in an efficient manner, and accounts for computationally expensive analysis tools. This approach solves an 11-route airline network problem consisting of 94 decision variables including 33 integer and 61 continuous type variables. Simultaneously solving the subspaces leads to significant improvement in the fleet-level objective of the airline when compared to the previously developed sequential subspace decomposition approach.

Roy, Satadru↗
DOE OSTI2023

Evolution of LIBS technology to mobile instrumentation for expediting firearm-related investigations at the laboratory and the crime scene

Gunshot residue (GSR) is one of the few forensic disciplines that lack accurate screening techniques. This study proposes using a mobile LIBS instrument to detect inorganic GSR and compares performance to a previously validated laboratory instrument. The mobile LIBS is designed with advanced configurations specifically for on-site GSR analysis, including a CMOS detector and a sampling chamber that holds up to six typical GSR collection devices with separate gas flow ports to prevent cross-contamination. A significant novelty of the portable instrument is its image magnification, which allows quick searching and visualization of GSR particle morphology. The single-particle imaging and elemental composition capability is one of a kind and offers superior confirmatory features for GSR. The mobile LIBS performance was evaluated for residues collected from the hands of shooters (100 samples) and non-shooters (200 background samples), analyzed sequentially by the mobile instrument and then the laboratory instrument. Accuracies better than 98.8% were obtained by both instruments, demonstrating their suitability for trace IGSR detection from skin specimens. Implementation of this methodology is anticipated to drastically speed up response times (i.e., from several hours per sample by standard SEM-EDS practice to a few minutes by LIBS). The screening methods can be easily incorporated into workflows to improve decision-making processes at the crime scene and laboratory settings, reduce backlogs, and improve case management.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Model Package Report: Central Plateau Vadose Zone Models

This model package report describes concisely the modeling objectives, conceptualization, implementation, uncertainty and sensitivity, configuration control, limitations, data needs, and recommendations for improvement of the Central Plateau Vadose Zone Models. This collection of models is developed to meet the vadose zone simulation needs of the Hanford Site Composite Analysis (CA), the Hanford Site Cumulative Impact Evaluation (CIE), and are expected to find other applications in Hanford Site remedial cleanup decision-making processes. This model package report describes and documents the development of the models themselves to fulfill technical approaches defined for the CA and the CIE. This report does not document any specific calculation using these models: instead, applications of individual vadose models to perform specific calculations will be documented in environmental calculation files, including inputs and results, as appropriate. Configuration management for the Central Plateau Vadose Zone Models is managed through assignment of unique sequential numerical version numbers and archival of the models in the Environmental Modeling Management Archive.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗