Search NASA⌕ Search

SEARCH · Search NASA

Results for “DECISION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Application of multi-criteria decision analysis techniques and decision support framework for informing plant select agent designation and decision making

The United States Department of Agriculture (USDA) Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents (Select Agents List) that threaten crops of economic importance to the United States and regulates the procedures governing containment, incident response, and the security of entities working with them. Every 2 years the USDA DASAT reviews their select agent list, utilizing assessments by subject matter experts (SMEs) to rank the agents. We explored the applicability of multi-criteria decision analysis (MCDA) techniques and a decision support framework (DSF) to support the USDA DASAT biennial review process. The evaluation includes both current and non-select agents to provide a robust assessment. We initially conducted a literature review of 16 pathogens against 9 criteria for assessing plant health and bioterrorism risk and documented the findings to support this analysis. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for ensuring accuracy. Scoring criteria were adopted to ensure consistency. The MCDA supported the expectation that select agents would rank high on the relative risk scale when considering the agricultural consequences of a bioterrorism attack; however, application of analytical thresholds as a basis for designating select agents led to some exceptions to current designations. A second analytical approach used agent-specific data to designate key criteria in a DSF logic tree format to identify pathogens of low concern that can be ruled out for further consideration as select agents. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Interactive statistical decision tools (GiSdT): An open source software integration of decision analysis and stakeholder judgment for sustainable waste management, disposal and remediation - 15650

The vast majority of remediation and waste management decisions are made without quantitative consideration of economic and socio-political factors. They are made instead based on quantitative metrics of human health risk. Sustainable decisions need to be made based on all three 'pillars of sustainability' (economics, environment and social), and require understanding and characterization of the costs and values associated with each pillar. In addition, such decisions need to conform to regulatory or other legal requirements, which often constrains the decision space of interest. Although efforts are often made to include factors across all three pillars (for example, for decisions made under CERCLA), these efforts are usually qualitative, and hence difficult to defend. They lack technical defensibility, transparency and traceability. The purpose of GiSdT (Guided Interactive Statistical Decision Tools) is to provide a quantitative framework whereby all aspects of a decision problem, such as remediation and waste management decisions, can be addressed quantitatively, and hence, defensibly, transparently and traceably. Most decision-makers do not currently have access to useful or usable methods and approaches when are presented with choices that have significant impacts across all three pillars of sustainability. The goal of GiSdT is to provide that access by identifying or developing effective and user-friendly decision methods and approaches that empower decision-makers to explicitly and routinely incorporate all aspects of sustainability into their decision-making. To identify and develop these methods and approaches, GiSdT provides the tools needed for decision-makers and stakeholders to understand and characterize their knowledge of their current decision-making processes, and what methods and approaches they need to pro-actively and quantitatively address all aspects of sustainability in their decisions. GiSdT is an open source interactive framework program that provides the tools needed to address the relevant components of a sustainability-based decision problem, including describing the decision landscape, translating that landscape into goals and objectives, valuing the measurable attributes that describe each objective, identifying decision options and addressing the uncertainty in the attributes (e.g., human health risk, institutional controls) through appropriate probabilistic models. In addition to addressing these quantitative technical components, the GiSdT program is aimed at facilitating stakeholder involvement so that the perspectives, values and objectives are all relevant stakeholders are addressed explicitly in the decision making process. The technical underpinnings of our software program, called Guided Interactive Statistical Decision Tools (GiSdT), are described. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Quantifying Uncertainty of Deep Reinforcement Learning Based Decision Making for Operations and Maintenance of Nuclear Power Plant

This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

Applicability of aquifer impact models to support decisions at CO 2 sequestration sites

The National Risk Assessment Partnership has developed a suite of tools to assess and manage risk at CO 2 sequestration sites. This capability includes polynomial or look-up table based reduced-order models (ROMs) that predict the impact of CO 2 and brine leaks on overlying aquifers. The development of these computationally-efficient models and the underlying reactive transport simulations they emulate has been documented elsewhere (Carroll et al., 2014a; Carroll et al., 2014b; Dai et al., 2014 ; Keating et al., 2016). Here in this paper, we seek to demonstrate applicability of ROM-based analysis by considering what types of decisions and aquifer types would benefit from the ROM analysis. We present four hypothetical examples where applying ROMs, in ensemble mode, could support decisions during a geologic CO 2 sequestration project. These decisions pertain to site selection, site characterization, monitoring network evaluation, and health impacts. In all cases, we consider potential brine/CO 2 leak rates at the base of the aquifer to be uncertain. We show that derived probabilities provide information relevant to the decision at hand. Although the ROMs were developed using site-specific data from two aquifers (High Plains and Edwards), the models accept aquifer characteristics as variable inputs and so they may have more broad applicability. We conclude that pH and TDS predictions are the most transferable to other aquifers based on the analysis of the nine water quality metrics (pH, TDS, 4 trace metals, 3 organic compounds). Guidelines are presented for determining the aquifer types for which the ROMs should be applicable.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Computational Tools and Workflows for Quantitative Risk Assessment and Decision Support for Geologic Carbon Storage Sites: Progress and Insights from the U.S. DOE’s National Risk Assessment Partnership

The 2005 Intergovernmental Panel on Climate Change (IPCC) Special Report on CCS raised the profile of CO2 capture and storage (CCS) as an important technology for reducing greenhouse gas (GHG) emissions. CCS is now recognized as a key component of most climate change mitigation scenarios. Since publication of that report the international research, development, and deployment (RD&D) community has advanced key technical aspects, clarified regulatory requirements, explored value chain and infrastructure solutions, and developed incentive paradigms to enable and promote large-scale deployment of CCS. These efforts have included research to better characterize geologic storage resources, to improve injection performance and storage efficiency, to assess and manage subsurface environmental risks, and to advance monitoring technologies to assure system conformance. These efforts have helped to build confidence in the viability of geologic carbon storage (GCS), but stakeholder concerns about long-term risks and liability associated with GCS remain a hurdle to broad acceptance and large-scale deployment of CCS. Since 2010, the U.S. DOE’s National Risk Assessment Partnership (NRAP) – a research collaboration between five contributing national laboratories – has worked to establish and demonstrate methods and tools to quantify and manage the subsurface environmental risks associated with GCS, amidst uncertainty. This work supports the Office of Fossil Energy and Carbon Management Carbon Transport and Storage Program’s goal of advancing safe and secure commercial-scale GCS deployment. To address the technical challenge of simulating the physical response of the GCS site to large-scale CO2 injection, NRAP has adopted an approach that relies on coupling computationally efficient reduced-order and/or data-driven proxy models of important system components (i.e., storage reservoir, sealing caprock, leakage pathways, intermediate formations, overlying groundwater aquifers, and the atmosphere) in integrated assessment framework. That integrated model of the physical system is complemented with fit-for purpose functionality to support site characterization and risk-related decisions. The recently released NRAP Phase II toolset includes the Open-Source Integrated Assessment Model (NRAP-Open-IAM) for evaluation of trends in leakage risk and potential impact, tools to support monitoring design optimization (Designs for Risk Evaluation and Management – DREAM v3.0 and Passive Seismic Monitoring Tool - PSMT), and tools for state of stress evaluation (State-of-Stress Analysis Tool - SOSAT) and forecasting induced seismicity risk. The NRAP team has also released a pair of reports describing conceptual workflows to incorporate physics-based, quantitative risk assessment into many of the design, planning, operation, and closure decisions for GCS projects. An online catalogue highlights published studies where these tools and methods are demonstrated. In this presentation, the utility of these products to assess risks and address key stakeholder questions will be highlighted through examples, and related insights about the safety and security of geologic carbon storage in qualified storage sites will be discussed. The prospect of rapid, large-scale deployment of GCS technology to aggressively reduce anthropogenic CO2 emissions requires careful consideration of interference between multiple commercial-scale storage projects within a basin. Going forward, NRAP is expanding and adapting site-scale risk quantification tools and methods to enable assessment of risks and inform management decisions for basin-scale deployment. Increasingly, this work will leverage next-generation approaches for surrogate modelling, fast prediction, and advanced visualization enabled by machine learning and artificial intelligence to promote virtual learning, scenario evaluation, and augment risk-based decision making.

quantitative risk assessment, geologic carbon stor↗
NASA NTRS1998

Automation: Decision Aid or Decision Maker?

This study clarified that automation bias is something unique to automated decision making contexts, and is not the result of a general tendency toward complacency. By comparing performance on exactly the same events on the same tasks with and without an automated decision aid, we were able to determine that at least the omission error part of automation bias is due to the unique context created by having an automated decision aid, and is not a phenomena that would occur even if people were not in an automated context. However, this study also revealed that having an automated decision aid did lead to modestly improved performance across all non-error events. Participants in the non- automated condition responded with 83.68% accuracy, whereas participants in the automated condition responded with 88.67% accuracy, across all events. Automated decision aids clearly led to better overall performance when they were accurate. People performed almost exactly at the level of reliability as the automation (which across events was 88% reliable). However, also clear, is that the presence of less than 100% accurate automated decision aids creates a context in which new kinds of errors in decision making can occur. Participants in the non-automated condition responded with 97% accuracy on the six "error" events, whereas participants in the automated condition had only a 65% accuracy rate when confronted with those same six events. In short, the presence of an AMA can lead to vigilance decrements that can lead to errors in decision making.

Skitka, Linda J.↗
NASA NTRS1995

Training for Aviation Decision Making: The Naturalistic Decision Making Perspective

This paper describes the implications of a naturalistic decision making (NDM) perspective for training air crews to make flight-related decisions. The implications are based on two types of analyses: (a) identification of distinctive features that serve as a basis for classifying a diverse set of decision events actually encountered by flight crews, and (b) performance strategies that distinguished more from less effective crews flying full-mission simulators, as well as performance analyses from NTSB accident investigations. Six training recommendations are offered: (1) Because of the diversity of decision situations, crews need to be aware that different strategies may be appropriate for different problems; (2) Given that situation assessment is essential to making a good decision, it is important to train specific content knowledge needed to recognize critical conditions, to assess risks and available time, and to develop strategies to verify or diagnose the problem; (3) Tendencies to oversimplify problems may be overcome by training to evaluate options in terms of goals, constraints, consequences, and prevailing conditions; (4) In order to provide the time to gather information and consider options, it is essential to manage the situation, which includes managing crew workload, prioritizing tasks, contingency planning, buying time (e.g., requesting holding or vectors), and using low workload periods to prepare for high workload; (5) Evaluating resource requirements ("What do I need?") and capabilities ("'What do I have?" ) are essential to making good decisions. Using resources to meet requirements may involve the cabin crew, ATC, dispatchers, and maintenance personnel; (6) Given that decisions must often be made under high risk, time pressure, and workload, train under realistic flight conditions to promote the development of robust decision skills.

Orasanu, Judith↗
DOE OSTI2017

Application of the Aquifer Impact Model to support decisions at a CO 2 sequestration site

The National Risk Assessment Partnership (NRAP) has developed a suite of tools to assess and manage risk at CO 2 sequestration sites. The NRAP tool suite includes the Aquifer Impact Model (AIM), which evaluates the potential for groundwater impacts from leaks of CO 2 and brine through abandoned wellbores. There are two aquifer reduced-order models (ROMs) included with the AIM tool, a confined alluvium aquifer, and an unconfined carbonate aquifer. The models accept aquifer parameters as a range of variable inputs so they may have broad applicability. The generic aquifer models may be used at the early stages of site selection, when site-specific data is not available. Guidelines have been developed for determining when the generic ROMs might be applicable to a new site. This work considers the application of the AIM to predicting the impact of CO 2 or brine leakage were it to occur at the Illinois Basin Decatur Project (IBDP). Results of the model sensitivity analysis can help guide characterization efforts; the hydraulic parameters and leakage source term magnitude are more sensitive than clay fraction or cation exchange capacity. Sand permeability was the only hydraulic parameter measured at the IBDP site. More information on the other hydraulic parameters could reduce uncertainty in risk estimates. Some non-adjustable parameters are significantly different for the ROM than for the observations at the IBDP site. The generic ROMs could be made more useful to a wider range of sites if the initial conditions and no-impact threshold values were adjustable parameters.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1998

Errors in Aviation Decision Making: Bad Decisions or Bad Luck?

Despite efforts to design systems and procedures to support 'correct' and safe operations in aviation, errors in human judgment still occur and contribute to accidents. In this paper we examine how an NDM (naturalistic decision making) approach might help us to understand the role of decision processes in negative outcomes. Our strategy was to examine a collection of identified decision errors through the lens of an aviation decision process model and to search for common patterns. The second, and more difficult, task was to determine what might account for those patterns. The corpus we analyzed consisted of tactical decision errors identified by the NTSB (National Transportation Safety Board) from a set of accidents in which crew behavior contributed to the accident. A common pattern emerged: about three quarters of the errors represented plan-continuation errors, that is, a decision to continue with the original plan despite cues that suggested changing the course of action. Features in the context that might contribute to these errors were identified: (a) ambiguous dynamic conditions and (b) organizational and socially-induced goal conflicts. We hypothesize that 'errors' are mediated by underestimation of risk and failure to analyze the potential consequences of continuing with the initial plan. Stressors may further contribute to these effects. Suggestions for improving performance in these error-inducing contexts are discussed.

Orasanu, Judith↗
NASA NTRS2004

An Integrated Decision-Making Model for Categorizing Weather Products and Decision Aids

The National Airspace System s capacity will experience considerable growth in the next few decades. Weather adversely affects safe air travel. The FAA and NASA are working to develop new technologies that display weather information to support situation awareness and optimize pilot decision-making in avoiding hazardous weather. Understanding situation awareness and naturalistic decision-making is an important step in achieving this goal. Information representation and situation time stress greatly influence attentional resource allocation and working memory capacity, potentially obstructing accurate situation awareness assessments. Three naturalistic decision-making theories were integrated to provide an understanding of the levels of decision making incorporated in three operational situations and two conditions. The task characteristics associated with each phase of flight govern the level of situation awareness attained and the decision making processes utilized. Weather product s attributes and situation task characteristics combine to classify weather products according to the decision-making processes best supported. In addition, a graphical interface is described that affords intuitive selection of the appropriate weather product relative to the pilot s current flight situation.

Elgin, Peter D.↗
DOE OSTI2022

A Decision Theoretic Approach To Optimizing Machine Learning Decisions with Prediction Uncertainty

While the use of machine learning (ML) classifiers is widespread, their output is often not part of any follow-on decision-making process. To illustrate, consider the scenario where we have developed and trained an ML classifier to find malicious URL links. In this scenario, network administrators must decide whether to allow a computer user to visit a particular website, or to instead block access because the site is deemed malicious. It would be very beneficial if decisions such as these could be made automatically using a trained ML classifier. Unfortunately, due to a variety of reasons discussed herein, the output from these classifiers can be uncertain, rendering downstream decisions difficult. Herein, we provide a framework for: (1) quantifying and propagating uncertainty in ML classifiers; (2) formally linking ML outputs with the decision-making process; and (3) making optimal decisions for classification under uncertainty with single or multiple objectives.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Decision blocks: A tool for automating decision making in CLIPS

The human capability of making complex decision is one of the most fascinating facets of human intelligence, especially if vague, judgemental, default or uncertain knowledge is involved. Unfortunately, most existing rule based forward chaining languages are not very suitable to simulate this aspect of human intelligence, because of their lack of support for approximate reasoning techniques needed for this task, and due to the lack of specific constructs to facilitate the coding of frequently reoccurring decision block to provide better support for the design and implementation of rule based decision support systems. A language called BIRBAL, which is defined on the top of CLIPS, for the specification of decision blocks, is introduced. Empirical experiments involving the comparison of the length of CLIPS program with the corresponding BIRBAL program for three different applications are surveyed. The results of these experiments suggest that for decision making intensive applications, a CLIPS program tends to be about three times longer than the corresponding BIRBAL program.

Eick, Christoph F.↗
NASA NTRS1994

Vista goes online: Decision-analytic systems for real-time decision-making in mission control

The Vista project has centered on the use of decision-theoretic approaches for managing the display of critical information relevant to real-time operations decisions. The Vista-I project originally developed a prototype of these approaches for managing flight control displays in the Space Shuttle Mission Control Center (MCC). The follow-on Vista-II project integrated these approaches in a workstation program which currently is being certified for use in the MCC. To our knowledge, this will be the first application of automated decision-theoretic reasoning techniques for real-time spacecraft operations. We shall describe the development and capabilities of the Vista-II system, and provide an overview of the use of decision-theoretic reasoning techniques to the problems of managing the complexity of flight controller displays. We discuss the relevance of the Vista techniques within the MCC decision-making environment, focusing on the problems of detecting and diagnosing spacecraft electromechanical subsystems component failures with limited information, and the problem of determining what control actions should be taken in high-stakes, time-critical situations in response to a diagnosis performed under uncertainty. Finally, we shall outline our current research directions for follow-on projects.

Barry, Matthew↗
DOE OSTI2016

Completing the Link between Exposure Science and Toxicology for Improved Environmental Health Decision Making: The Aggregate Exposure Pathway Framework

Driven by major scientific advances in analytical methods, biomonitoring, and computational exposure assessment, and a newly articulated vision for a greater impact in public health, the field of exposure science is undergoing a rapid transition from a field of observation to a field of prediction. Deployment of an organizational and predictive framework for exposure science analogous to the computationally enabled “systems approaches” used in the biological sciences is a necessary step in this evolution. Here we propose the aggregate exposure pathway (AEP) concept as the natural and complementary companion in the exposure sciences to the adverse outcome pathway (AOP) concept in the toxicological sciences. The AEP framework offers an intuitive approach to successful organization of exposure science data within individual units of prediction common to the field, setting the stage for exposure forecasting. Looking farther ahead, we envision direct linkages between aggregate exposure pathway and adverse outcome pathways, completing the source to outcome continuum and setting the stage for more efficient integration of exposure science and toxicity testing information. Together these frameworks form and inform a decision making framework with the flexibility for risk-based, hazard-based or exposure-based decisions.

Teeguarden, Justin G.↗
DOE OSTI2024

Markov Decision Processes for Intelligent, Risk-Informed Asset-Management Decision-Making

Advanced nuclear reactors are a promising option for aiding the world in achieving its net-zero carbon emission goals, however, there are significant challenges to attaining and maintaining economic competitiveness with other sources of electricity. To improve the economic competitiveness of advanced reactor designs, a project was initiated to explore the use of Markov Decision Processes (MDPs) to guide asset-management decision-making during advanced reactor operation. MDPs are a powerful tool for optimizing decision-making in complex environments and their application to advanced reactors can aid in planning maintenance and repair activities to minimize downtime and maximize generation. The described approach expands on previous work regarding the use of MDPs for operational decision-making through the direct incorporation of real-time plant information. The integral MDP analysis includes information from online component diagnostic tools and the plant’s real-time generation risk assessment (GRA) and probabilistic risk assessment (PRA), which evaluate plant risk from both an economic and safety perspective. The result is an asset-management optimization framework that is based on real-time data regarding plant component status and the current best-estimate of plant risk. The paper presents an overview of the theoretical framework to incorporate the different information pathways into an integral MDP analysis, along with example analyses.

Grabaskas, David↗
NASA NTRS1978

Thermal power systems small power systems applications project. Decision analysis for evaluating and ranking small solar thermal power system technologies. Volume 1: A brief introduction to multiattribute decision analysis

The principal concepts of the Keeney and Raiffa approach to multiattribute decision analysis are described. Topics discussed include the concepts of decision alternatives, outcomes, objectives, attributes and their states, attribute utility functions, and the necessary independence properties for the attribute states to be aggregated into a numerical representation of the preferences of the decision maker for the outcomes and decision alternatives.

Feinberg, A.↗
DOE OSTI2023

Application of multi-criteria decision analysis techniques and decision support framework for informing select agent designation for agricultural animal pathogens

The United States Department of Agriculture (USDA), Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents and toxins (Select Agent List) that potentially threaten agricultural health and safety, the procedures governing the transfer of those agents, and training requirements for entities working with them. Every 2 years the USDA DASAT reviews the Select Agent List, using subject matter experts (SMEs) to perform an assessment and rank the agents. To assist the USDA DASAT biennial review process, we explored the applicability of multi-criteria decision analysis (MCDA) techniques and a Decision Support Framework (DSF) in a logic tree format to identify pathogens for consideration as select agents, applying the approach broadly to include non-select agents to evaluate its robustness and generality. We conducted a literature review of 41 pathogens against 21 criteria for assessing agricultural threat, economic impact, and bioterrorism risk and documented the findings to support this assessment. The most prominent data gaps were those for aerosol stability and animal infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. The MCDA analysis supported the intuitive sense that select agents should rank high on the relative risk scale when considering agricultural health consequences of a bioterrorism attack. However, comparing select agents with non-select agents indicated that there was not a clean break in scores to suggest thresholds for designating select agents, requiring subject matter expertise collectively to establish which analytical results were in good agreement to support the intended purpose in designating select agents. The DSF utilized a logic tree approach to identify pathogens that are of sufficiently low concern that they can be ruled out from consideration as a select agent. In contrast to the MCDA approach, the DSF rules out a pathogen if it fails to meet even one criteria threshold. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

60 APPLIED LIFE SCIENCES↗