Search NASA⌕ Search

SEARCH · Search NASA

Results for “Decision Making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

IAEA Initiatives that Integrate Stakeholders, Models and Decision Making - 18646

The International Atomic Energy Agency (IAEA) has initiated an effort to provide stakeholder support services as part of Phase II of the Constraints to Implementing Decommissioning and Environmental Remediation (CIDER II) programs. The intent of this sub-group of CIDER II is to provide members states support in areas of stakeholder communication, engagement and participation, with the goal of building trust in decommissioning and environmental remediation (D and ER) decisions for radioactive contamination and facilities. IAEA has also initiated a follow-on effort to address Modeling and Data for Radiological Impact Assessments (MODARIA II), which is aimed at enhancing the capabilities of Member States to simulate radionuclide transfer in the environment, and to ensure appropriate levels of protection from ionizing radiation. Working Group 1 of MODARIA II is focused on the integration of modeling and decision analysis. These two groups have complementary and supporting objectives, which provides an opportunity for collaboration and mutual benefit. The technical integrator is the approach of structured decision making, which follows a five-step process that combines stakeholder values with models through a technically defensible decision analysis. Briefly, the steps are: 1. Provide the context and decision context for the problem; 2. Obtain costs, values and concerns from stakeholders, to develop objectives that need to be achieved (e.g., improve human health, minimize costs, increase jobs); 3. Identify options that might achieve the objectives (e.g., cleanup, institutional controls, education); 4. Develop probabilistic models that connect options to objectives so that the objectives can be evaluated collectively (e.g., a fate and transport and risk model to address the objective of reducing human health risk, a cost model to address costs of taking action); and, 5. Model evaluation, including sensitivity analysis, to determine if an action can be taken with sufficient certainty, or if collection of more data is needed to decrease uncertainty before a decision is made. This approach also supports adaptive management as new data are collected. This approach clarifies the roles of stakeholders and subject matter experts in the decision-making process, where stakeholders specify values, and subject matter experts focus on the models that are needed to evaluate the options. It also provides a technically defensible, reproducible, transparent and traceable approach to all of the components necessary to properly solve the types of complex decision problems that plague radioactive waste management, decommissioning and environmental remediation. This paper introduces the major challenges to implementing such a broad scale of decision analysis, and approaches to overcoming those challenges, which include not only the technical challenges, but also the need to develop capacity in a range of skills not usually accommodated in environmental modeling and includes the need for the IAEA to address decision making in different countries, and with different cultures, religions, political affiliations, and languages. This paper explores the potential for IAEA to benefit from both the CIDER II and MODARIA II programs, and hence to develop a fully integrated approach to effective decision making for radioactive waste management and environmental remediation. Note that there are many people involved in these efforts at the IAEA, and credit belongs to those people for the progress that has been made to date. Our intent here is simply to introduce these IAEA programs at the WM2018 Symposium to provide our perspective and some awareness of some of the directions in which IAEA appears to be headed regarding stakeholder engagement, environmental and risk modeling, data science, and decision analysis. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Stakeholder Engaged Structured Decision Making to Improve Performance and Reduce Costs While Protecting Human Health and the Environment - 18645

The objective of the Best Practice is to facilitate a paradigm shift when it comes to approaches to the decision making process for nuclear waste management, disposal, and remediation decisions. The stakeholder-engaged structured decision making (SDM) paradigm shift provides a transparent framework for developing optimal solutions to complex problems (Keeney, 1992, Gregory et al, 2012). This is a deliberative-analytical process. The deliberative side centers on understanding stakeholder concerns and values, and developing objectives while identifying options that may achieve those objectives. SDM is implemented with the aid of computer tools that are aimed specifically at capturing these deliberative aspects of a decision analysis. SDM captures this information in a structured format that allows access to the values, objectives, and options that have been identified to help. Through this approach we achieve transparency, traceability, and reproducibility. The goal of SDM at this stage is to provide a formal structure for capturing and processing deliberative information. The deliberative part sets the stage for the analytical part of SDM. A variety of Subject matter experts (SMEs) are engaged in how to evaluate the options through the objectives. Objectives often include minimizing human health risk and minimizing cost, but in the full scope of a sustainability-based approach to decision making, it can include objectives related to economic, environmental and social issues. Subject matter experts might provide other options for achieving the objectives, but their primary role is to evaluate/model the options to the endpoint defined by the objectives or in other words perform a consequence analysis. The structure of SDM makes it clear exactly what is needed from the SMEs, because the options are identified, and the endpoint (objectives) are defined - evaluations and/or models are needed to connect options to objectives. This consequence analysis completes the evaluation, and directly addresses which of the options is the best option. The same SDM approach to finding the best options can also be used for prioritization and resource allocation. Because all of the information is captured in a formal system with the help of computer tools (a software framework for implementing SDM), the decision models that are developed for an application can be fully evaluated numerically and for the insights gained from using a formal process for managing the multiple factors that need to be considered for complex decisions. This includes uncertainty and sensitivity analysis that can be used to guide the need for further data/information collection if the optimal decision is not adequately supported - that is, if there is insufficient confidence in the decision. Also, this feeds directly into adaptive management therefore if more data/information are collected then the efficacy of the current decision can be evaluated, potentially leading to a change in decisions if warranted. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A game theory perspective on environmental assessment: What games are played and what does this tell us about decision making rationality and legitimacy?

Game theory provides a useful theoretical framework to examine the decision process operating in the context of environmental assessment, and to examine the rationality and legitimacy of decision-making subject to Environmental Assessment (EA). The research uses a case study of the Environmental Impact Assessment and Sustainability Appraisal processes undertaken in England. To these are applied an analytical framework, based on the concept of decision windows to identify the decisions to be assessed. The conditions for legitimacy are defined, based on game theory, in relation to the timing of decision information, the behaviour type (competitive, reciprocal, equity) exhibited by the decision maker, and the level of public engagement; as, together, these control the type of rationality which can be brought to bear on the decision. Instrumental rationality is based on self-interest of individuals, whereas deliberative rationality seeks broader consensus and is more likely to underpin legitimate decisions. The results indicate that the Sustainability Appraisal process, conducted at plan level, is better than EIA, conducted at project level, but still fails to provide conditions that facilitate legitimacy. Game theory also suggests that Sustainability Appraisal is likely to deliver ‘least worst’ outcomes rather than best outcomes when the goals of the assessment process are considered; this may explain the propensity of such ‘least worst’ decisions in practise. On the basis of what can be learned from applying this game theory perspective, it is suggested that environmental assessment processes need to be redesigned and better integrated into decision making in order to guarantee the legitimacy of the decisions made. - Highlights: • Decision legitimacy is defined in terms of game theory. • Game theory is applied to EIA and SA decision windows. • Game theory suggests least worst outcomes prevail. • SA is more likely to be perceived legitimate than EIA.

54 ENVIRONMENTAL SCIENCES↗

Development of a Search and Rescue Simulation to Study the Effects of Prolonged Isolation on Team Decision Making

The goals of this project were to identify and investigate aspects of team and individual decision-making and risk-taking behaviors hypothesized to be most affected by prolonged isolation. A key premise driving our research approach is that effects of stressors that impact individual and team cognitive processes in an isolated, confined, and hazardous environment will be projected onto the performance of a simulation task. To elicit and investigate these team behaviors we developed a search and rescue task concept as a scenario domain that would be relevant for isolated crews. We modified the Distributed Dynamic Decision-making (DDD) simulator, a platform that has been extensively used for empirical research in team processes and taskwork performance, to portray the features of a search and rescue scenario and present the task components incorporated into that scenario. The resulting software is called DD-Search and Rescue (Version 1.0). To support the use of the DDD-Search and Rescue simulator in isolated experiment settings, we wrote a player's manual for teaching team members to operate the simulator and play the scenario. We then developed a research design and experiment plan that would allow quantitative measures of individual and team decision making skills using the DDD-Search and Rescue simulator as the experiment platform. A description of these activities and the associated materials that were produced under this contract are contained in this report.

Entin, Elliot E.↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Currently, two main approaches exist for improving the human-machine interface component of a system in order to improve overall system performance - display enhancement and intelligent decision making. Discussed here are the characteristic issues of these two decision-making strategies. Differences in expert and novice decision making are described in order to help determine whether a particular strategy may be better for a particular type of user. Research is outlined to compare and contrast the two technologies, as well as to examine the interaction effects introduced by the different skill levels and the different methods for training operators.

Kirlik, Alex↗

Multi-objective decision-making under uncertainty: Fuzzy logic methods

Selecting the best option among alternatives is often a difficult process. This process becomes even more difficult when the evaluation criteria are vague or qualitative, and when the objectives vary in importance and scope. Fuzzy logic allows for quantitative representation of vague or fuzzy objectives, and therefore is well-suited for multi-objective decision-making. This paper presents methods employing fuzzy logic concepts to assist in the decision-making process. In addition, this paper describes software developed at NASA Lewis Research Center for assisting in the decision-making process. Two diverse examples are used to illustrate the use of fuzzy logic in choosing an alternative among many options and objectives. One example is the selection of a lunar lander ascent propulsion system, and the other example is the selection of an aeration system for improving the water quality of the Cuyahoga River in Cleveland, Ohio. The fuzzy logic techniques provided here are powerful tools which complement existing approaches, and therefore should be considered in future decision-making activities.

Hardy, Terry L.↗

NASA Risk-Informed Decision Making Handbook

This handbook provides guidance for conducting risk-informed decision making in the context of NASA risk management (RM), with a focus on the types of direction-setting key decisions that are characteristic of the NASA program and project life cycles, and which produce derived requirements in accordance with existing systems engineering practices that flow down through the NASA organizational hierarchy. The guidance in this handbook is not meant to be prescriptive. Instead, it is meant to be general enough, and contain a sufficient diversity of examples, to enable the reader to adapt the methods as needed to the particular decision problems that he or she faces. The handbook highlights major issues to consider when making decisions in the presence of potentially significant uncertainty, so that the user is better able to recognize and avoid pitfalls that might otherwise be experienced.

Dezfuli, Homayoon↗

Therapeutic Decision-Making in Endoscopically Unmanageable Nonvariceal Upper Gastrointestinal Hemorrhage

The purpose of this study was to identify endoscopic and clinical parameters influencing the decision-making in salvage of endoscopically unmanageable, nonvariceal upper gastrointestinal hemorrhage (UGIH) and to report the outcome of selected therapy. We retrospectively retrieved all cases of surgery and arteriography for arrest of endoscopically unmanageable UGIH. Only patients with overt bleeding on endoscopy within the previous 24 h were included. Patients with preceding nonendoscopic hemostatic interventions, portal hypertension, malignancy, and transpapillar bleeding were excluded. Potential clinical and endoscopic predictors of allocation to either surgery or arteriography were tested using statistical models. Outcome and survival were regressed on the choice of rescue and clinical variables. Forty-six arteriographed and 51 operated patients met the inclusion criteria. Univariate analysis revealed a higher number of patients with a coagulation disorder in the catheterization group (41.4%, versus 20.4% in the laparotomy group; p = 0.044). With multivariate analysis, the identification of a bleeding peptic ulcer at endoscopy significantly steered decision-making toward surgical rescue (OR = 5.2; p = 0.021). Taking into account reinterventions, hemostasis was achieved in nearly 90% of cases in both groups. Overall therapy failure (no survivors), rebleeding within 3 days (OR = 3.7; p = 0.042), and corticosteroid use (OR = 5.2; p = 0.017) had a significant negative impact on survival. The odds of dying were not different for embolotherapy or surgery. In conclusion, decision-making was endoscopy-based, with bleeding peptic ulcer significantly directing the choice of rescue toward surgery. Unsuccessful hemostasis and corticosteroid use, but not the choice of rescue, negatively affected outcome.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Development of the Delphi display concept for alternative explanations decision making support - 120

Human operators of advanced technology systems, such as nuclear power, command and control, and deepwater oil drilling, must be able to evaluate and respond to a wide array of operational anomalies. Unfortunately, these circumstances are often complex and ambiguous, complicating decision making tasks. One common decision making error, called confirmation bias, occurs when decision makers prematurely focus on one explanation instead of systematically considering all plausible alternative explanations that could equally well account for an operational anomaly (Nickerson, 1998). The Delphi display is designed to counteract decision makers' tendencies towards confirmation bias and to encourage them to consider all plausible explanations, including high risk explanations, they might otherwise overlook. An initial Delphi display prototype was designed to help identify the underlying cause of operational anomalies in the complex, high-consequence technology of deepwater drilling. This prototype decision aid incorporates major indicators related to operational anomalies and presents corresponding plausible explanations for each indicator, ranging from high-risk system-critical explanations to lower-risk but still significant events. The Delphi display incorporates several innovative features to help decision makers detect and monitor operational anomalies and view the relationships among indicators and their associated plausible explanations. Preliminary evaluations of an early prototype Delphi display for detecting kicks in deepwater oil drilling operations have been promising. Moreover, the methodology used to design and develop the Delphi display can be readily generalized to numerous other operational contexts that require humans to make system-critical decisions. To illustrate, an initial Delphi display design for nuclear power plant control is described. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Critical Infrastructure Decision-Making under Long-Term Climate Hazard Uncertainty: The Need for an Integrated, Multidisciplinary Approach

U.S. critical infrastructure assets are often designed to operate for decades, and yet long-term planning practices have historically ignored climate change. With the current pace of changing operational conditions and severe weather hazards, research is needed to improve our ability to translate complex, uncertain risk assessment data into actionable inputs to improve decision-making for infrastructure planning. Decisions made today need to explicitly account for climate change – the chronic stressors, the evolution of severe weather events, and the wide-ranging uncertainties. If done well, decision making with climate in mind will result in increased resilience and decreased impacts to our lives, economies, and national security. We present a three-tier approach to create the research products needed in this space: bringing together climate projection data, severe weather event modeling, asset-level impacts, and contextspecific decision constraints and requirements. At each step, it is crucial to capture uncertainties and to communicate those uncertainties to decision-makers. While many components of the necessary research are mature (i.e., climate projection data), there has been little effort to develop proven tools for long-term planning in this space. The combination of chronic and acute stressors, spatial and temporal uncertainties, and interdependencies among infrastructure sectors coalesce into a complex decision space. By applying known methods from decision science and data analysis, we can work to demonstrate the value of an interdisciplinary approach to climate-hazard decision making for longterm infrastructure planning.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Test and Evaluation Metrics of Crew Decision-Making And Aircraft Attitude and Energy State Awareness

NASA has established a technical challenge, under the Aviation Safety Program, Vehicle Systems Safety Technologies project, to improve crew decision-making and response in complex situations. The specific objective of this challenge is to develop data and technologies which may increase a pilot's (crew's) ability to avoid, detect, and recover from adverse events that could otherwise result in accidents/incidents. Within this technical challenge, a cooperative industry-government research program has been established to develop innovative flight deck-based counter-measures that can improve the crew's ability to avoid, detect, mitigate, and recover from unsafe loss-of-aircraft state awareness - specifically, the loss of attitude awareness (i.e., Spatial Disorientation, SD) or the loss-of-energy state awareness (LESA). A critical component of this research is to develop specific and quantifiable metrics which identify decision-making and the decision-making influences during simulation and flight testing. This paper reviews existing metrics and methods for SD testing and criteria for establishing visual dominance. The development of Crew State Monitoring technologies - eye tracking and other psychophysiological - are also discussed as well as emerging new metrics for identifying channelized attention and excessive pilot workload, both of which have been shown to contribute to SD/LESA accidents or incidents.

Bailey, Randall E.↗

Putting SEA in context: A discourse perspective on how SEA contributes to decision-making

Over the last couple of years there is an ongoing debate in the environmental assessment literature about the contribution of Strategic Environmental Assessment (SEA) to public decision-making and how this can be understood and enhanced by better incorporating insights from policy analysis, planning theory and political sciences. By explicitly framing SEA as an element in a process where stakeholders with diverging interests struggle, acceptability of SEA processes and results by stakeholders has become an important element in SEA evaluation. In addition, the importance of other context variables, such as the institutional organisation, and the need for SEA to adapt to this context, is stressed. Thus far, publications in this area have been dealing with the operationalisation of SEA's 'contribution', typologies of roles that SEA can or should play in different policy settings and on factors that stimulate or impede SEA to play these roles. In this paper an alternative approach is suggested that starts from the deliberative processes around a particular policy issue or decision supported by SEA. Of particular interest are 'discourses': the frames through which groups of actors give meaning to aspects of the policy issues and decisions that are supported by SEA. Discourses do not only reflect conflicts of interests and power play, but also the ways in which actors perceive and understand aspects of the world. Decision-making is conceptualised as a 'system of competing discourse coalitions and their struggles to 'control shared meanings' and to gain acceptance of their framing of a policy issue' [Durning D. A review of Fischer and Forrester (1993) The argumentative turn in policy analysis and planning. Policy Sci 1995;28(1):102-8]. SEA is one of the events in this process that may impact upon dominant discourses. Discourse analysis allows for an understanding of arguments that are considered legitimate for (not) incorporating particular elements of SEA. In addition it opens the door to relatively new strategies for SEA professionals to enhance their contribution to decision-making.

54 ENVIRONMENTAL SCIENCES↗

Interorganizational decision making.

The papers are both theoretical and applied. They include contributions from a spectrum of academic specializations and from practitioners representing several organizations. The papers are divided into theoretical and applied groupings reflecting a variety of systems levels and institutional examples, and into those papers which emphasized the organization structure requirements of interorganizational decision making, those that emphasized the behavioral requirements of interorganizational decision making, and those that developed decision technologies for interorganizational decision making.

Tuite, M.↗

Enhanced Surgical Decision-Making Tools in Breast Cancer: Predicting 2-Year Postoperative Physical, Sexual, and Psychosocial Well-Being following Mastectomy and Breast Reconstruction (INSPiRED 004)

Background: We sought to predict clinically meaningful changes in physical, sexual, and psychosocial well-being for women undergoing cancer-related mastectomy and breast reconstruction 2 years after surgery using machine learning (ML) algorithms trained on clinical and patient-reported outcomes data. Patients and Methods: We used data from women undergoing mastectomy and reconstruction at 11 study sites in North America to develop three distinct ML models. We used data of ten sites to predict clinically meaningful improvement or worsening by comparing pre-surgical scores with 2 year follow-up data measured by validated Breast-Q domains. We employed ten-fold cross-validation to train and test the algorithms, and then externally validated them using the 11th site’s data. We considered area-under-the-receiver-operating-characteristics-curve (AUC) as the primary metric to evaluate performance. Results: Overall, between 1454 and 1538 patients completed 2 year follow-up with data for physical, sexual, and psychosocial well-being. In the hold-out validation set, our ML algorithms were able to predict clinically significant changes in physical well-being (chest and upper body) (worsened: AUC range 0.69–0.70; improved: AUC range 0.81–0.82), sexual well-being (worsened: AUC range 0.76–0.77; improved: AUC range 0.74–0.76), and psychosocial well-being (worsened: AUC range 0.64–0.66; improved: AUC range 0.66–0.66). Baseline patient-reported outcome (PRO) variables showed the largest influence on model predictions. Conclusions: Machine learning can predict long-term individual PROs of patients undergoing postmastectomy breast reconstruction with acceptable accuracy. This may better help patients and clinicians make informed decisions regarding expected long-term effect of treatment, facilitate patient-centered care, and ultimately improve postoperative health-related quality of life.

60 APPLIED LIFE SCIENCES↗

Hurricane risk assessment to rollback or ride out a cost versus loss decision making approach

The potential exists that a hurricane striking the Kennedy Space Center while a Space Shuttle is on the pad. Winds in excess of 74.5 knots could cause the failure of the holddown bolts bringing about the catastrophic loss of the entire vehicle. Current plans call for the rollback of the shuttle when winds of that magnitude are forecast to strike the center. As this is costly, a new objective method for making rollback/rideout decisions based upon Bayesian Analysis and economic cost versus loss is presented.

Wohlman, Richard A.↗

Decision-Making in Flight with Different Convective Weather Information Sources: Preliminary Results

This paper reports preliminary and partial results of a flight experiment to address how General Aviation (GA) pilots use weather cues to make flight decisions. This research presents pilots with weather cue conditions typically available to GA pilots in visual meteorological conditions (VMC) and instrument meteorological conditions (IMC) today, as well as in IMC with a Graphical Weather Information System (GWIS). These preliminary data indicate that both VMC and GWIS-augmented IMC conditions result in better confidence, information sufficiency and perceived performance than the current IMC condition. For all these measures, the VMC and GWIS-augmented conditions seemed to provide similar pilot support. These preliminary results are interpreted for their implications on GWIS display design, training, and operational use guidelines. Final experimental results will compare these subjective data with objective data of situation awareness and decision quality.

Latorella, Kara A.↗

Taking Risk Assessment and Management to the Next Level: Program-Level Risk Analysis to Enable Solid Decision-Making on Priorities and Funding

A multi-level (facility and programmatic) risk assessment was conducted for the facilities in the Nevada National Security Site (NNSS) Readiness in Technical Base and Facilities (RTBF) Program and results were included in a new Risk Management Plan (RMP), which was incorporated into the fiscal year (FY) 2010 Integrated Plans. Risks, risk events, probability, consequence(s), and mitigation strategies were identified and captured, for most scope areas (i.e., risk categories) during the facilitated risk workshops. Risk mitigations (i.e., efforts in addition to existing controls) were identified during the facilitated risk workshops when the risk event was identified. Risk mitigation strategies fell into two broad categories: threats or opportunities. Improvement projects were identified and linked to specific risks they mitigate, making the connection of risk reduction through investments for the annual Site Execution Plan. Due to the amount of that was collected, analysis to be performed, and reports to be generated, a Risk Assessment/ Management Tool (RAMtool) database was developed to analyze the risks in real-time, at multiple levels, which reinforced the site-level risk management process and procedures. The RAMtool database was developed and designed to assist in the capturing and analysis of the key elements of risk: probability, consequence, and impact. The RAMtool calculates the facility-level and programmatic-level risk factors to enable a side-by-side comparison to see where the facility manager and program manager should focus their risk reduction efforts and funding. This enables them to make solid decisions on priorities and funding to maximize the risk reduction. A more active risk management process was developed where risks and opportunities are actively managed, monitored, and controlled by each facility more aggressively and frequently. risk owners have the responsibility and accountability to manage their assigned risk in real-time, using the RAMtool database.

Nelson, J. G.↗