Search NASA⌕ Search

SEARCH · Search NASA

Results for “decisions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Application of Multi-Criteria Decision Analysis Techniques for Informing Select Agent Designation and Decision Making

The Centers for Disease Control and Prevention (CDC) Select Agent Program establishes a list of biological agents and toxins that potentially threaten public health and safety, the procedures governing the possession, utilization, and transfer of those agents, and training requirements for entities working with them. Every 2 years the Program reviews the select agent list, utilizing subject matter expert (SME) assessments to rank the agents. In this study, we explore the applicability of multi-criteria decision analysis (MCDA) techniques and logic tree analysis to support the CDC Select Agent Program biennial review process, applying the approach broadly to include non-select agents to evaluate its generality. We conducted a literature search for over 70 pathogens against 15 criteria for assessing public health and bioterrorism risk and documented the findings for archiving. The most prominent data gaps were found for aerosol stability and human infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. Analysis of results obtained from a two-dimensional plot of weighted scores for difficulty of attack (i.e., exposure and production criteria) vs. consequences of an attack (i.e., consequence and mitigation criteria) provided greater fidelity for understanding agent placement compared to a 1-to-n ranking and was used to define a region in the upper right-hand quadrant for identifying pathogens for consideration as select agents. A sensitivity analysis varied the numerical weights attributed to various properties of the pathogens to identify potential quantitative (x and y) thresholds for classifying select agents. The results indicate while there is some clustering of agent scores to suggest thresholds, there are still pathogens that score close to any threshold, suggesting that thresholding “by eye” may not be sufficient. The sensitivity analysis indicates quantitative thresholds are plausible, and there is good agreement of the analytical results with select agent designations. A second analytical approach that applied the data using a logic tree format to rule out pathogens for consideration as select agents arrived at similar conclusions.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1993

A decision-theoretic approach to the display of information for time-critical decisions: The Vista project

We describe a collaborative research and development effort between the Palo Alto Laboratory of the Rockwell Science Center, Rockwell Space Operations Company, and the Propulsion Systems Section of NASA JSC to design computational tools that can manage the complexity of information displayed to human operators in high-stakes, time-critical decision contexts. We shall review an application from NASA Mission Control and describe how we integrated a probabilistic diagnostic model and a time-dependent utility model, with techniques for managing the complexity of computer displays. Then, we shall describe the behavior of VPROP, a system constructed to demonstrate promising display-management techniques. Finally, we shall describe our current research directions on the Vista 2 follow-on project.

Horvitz, Eric↗
DOE OSTI2021

Evaluating Probability of Containment Effectiveness at a GCS Sites using integrated assessment modeling approach with Bayesian decision Networks

Improved scientific and engineering understanding of the behavior of geologic CO2 storage together with established regulatory framework and incentive structures raise the prospects for accelerated, large-scale deployment of this greenhouse gas emissions reduction approach. Incentive structures call for the establishment of appropriate verification and accounting approaches to support claims of the integrity of a geologic storage complex and to justify taking credit for long-term storage. In this study, we present a framework for assessing the probability of containment effectiveness over the lifetime of a geologic carbon storage site (e.g., after 70 years of injection and post-injection site performance) using forward stochastic model realizations based on site characterization data and using a monitoring-informed Bayesian network based on hypothetical detectability from surface seismic surveys over the site injection and post-injection phases. The National Risk Assessment Partnership’s open-source Integrated Assessment Model (NRAP-Open-IAM) was utilized to develop an ensemble of 10,000 a priori stochastic forecasts of CO2 containment. Those simulations were used to train the Bayesian network model to estimate the prior probabilities of the CO2 leakage mass into overlying, monitorable aquifers considering the uncertainties in the reservoir properties, permeability of potentially leaky wells and the overlying aquifers. The conditional probabilities in the Bayesian network were either learned from the NRAP-Open-IAM simulations or derived from the predefined detection thresholds for the monitoring method. Observations obtained from monitoring, over time during the site operation phases were then used to generate updated posterior probabilities of containment (and any loss from containment) in the Bayesian network by propagating the prior probabilities through the conditional probabilities. We demonstrate how to construct and use the Bayesian network for verifying the long-term storage complex effectiveness informed by monitoring based on the NRAP-Open-IAM simulations previously developed for the FutureGen 2.0 site. This approach may have relevance for stake holders to demonstrate secure geologic storage, provide a defensible, probabilistic approach to claim credit for geologic storage, and to estimate the likelihood that any fraction of the claimed credit may need to be refunded to the creditor based on available monitoring information.

Bayesian network, Risk assessment, Monitoring, car↗
DOE OSTI2020

Stakeholder-Engaged Structured Decision Making for the Los Alamos Legacy Cleanup Mission - 20501

The Los Alamos National Laboratory (LANL) environmental legacy cleanup program requires decisions to be made for environmental remediation, decommissioning and disposal or management of radioactive waste. This legacy cleanup program was established to address groundwater contamination, material disposal areas (MDAs) that have been used to dispose of radioactive and other waste material, and 'aggregate areas' that might produce radioactive or other chemical waste as a result of remediation activities. The LANL site is regulated for environmental concerns under the Resource Conservation and Recovery Act (RCRA). However, some parts of LANL, such as material disposal area G (MDA G), have disposed of radioactive waste under DOE Order 435.1, and are subject to other regulations. For example, decommissioning the remote-handled TRU material stored in 33 shafts at MDA G falls under EPA's 40 CFR 191. Collectively, the regulations are all aimed in the same direction of finding the best solution, either through constructs such as 'as low as reasonably achievable' (ALARA), considering balancing factors as opposed to only cost and human health risk, and, under EPA regulations such as RCRA and NEPA, evaluating impact from all chemicals and both human health and ecological endpoints. Despite the basic goals and objectives of the regulations or their guidance, the main challenge is in their implementation. Arguably perhaps, but really in principle, all of these (and similar) regulations are asking for a decision analysis to be performed. Implementation challenges encountered have included lack of understanding of decision analysis in the industry, lack of effective stakeholder engagement in the decision analysis process, and lack of appreciation of the need to separate value judgments from science, the latter leading to developing conservative, or protective, science-based models. Conservative models lead to poor solutions, lack of effective stakeholder engagement leads to long drawn out protracted approaches to finding a solution (which also might never be found with this approach), and lack of understanding of decision analysis and Bayesian statistics causes poor models to be built, which creates unfortunate situations of 'garbage in, garbage out' becoming the basis for decision making. Stakeholder-engaged structured decision making (SDM) is an approach to solving problems that relies on the theory of decision science to involve stakeholders in the decision-making process. This approach incorporates stakeholder values using a scientifically rigorous methodology that separates value judgments from science in a way that helps avoid the pitfalls of biased, protective, or conservative modeling. This approach has its foundation in Keeney's 1992 treatise on value-focused thinking [1]. Keeney advocated a paradigm shift in decision making based on the idea that the standard way of thinking about decisions is backwards. The standard approach of focusing first on identifying alternatives rather than on articulating values results in a reactive approach with the emphasis on mechanics and fixed choices instead of the core values that have meaning to stakeholders. This paradigm shift effectively engages all stakeholders in the decision-making process while using a values focused thinking approach that can lead to the identification of decision opportunities and the creation of better alternatives. The intent is to be proactive and generate solutions that are related directly to values and objectives as identified by stakeholders. There are, perhaps, two overarching reasons why SDM can be used to benefit LANL's environmental legacy cleanup. Some of LANL's remaining waste management and environmental management problems are challenging and complex (for example, the Cr and RDX plumes, and MDAs) and while the traditional approach has, arguably, worked well for relatively simple risk-based problems, it cannot, or should not, be applied to more complex problems if the most effective and efficient solutions are desired. The second reason is cost. This has perhaps become more critical since publication of the Government Accountability Office (GAO) reports that DoE's environmental liability is considered a high-risk concern for the nation [2]. The focus of SDM is on structuring solutions to decision risk problems by first addressing stakeholder and decision maker values and subsequently developing decision objectives and ways to measure those objectives, preference weighting across objectives, identifying decision alternatives that best achieve those values, and characterizing uncertainty in predictions of the measures. Because a complete decision model is created using SDM, it can be evaluated to find the main elements of the model that drive, or predict, the best solution. This approach creates complete decision models that are transparent, traceable, reproducible and technically defensible. The science behind SDM, or decision analysis, is well founded, yet it is not unusual to see ad hoc approaches to decision making implemented under various environmental regulations that are pertinent to the LANL site, including NEPA, RCRA and DOE Order 435.1. Such ad hoc approaches are often not transparent or traceable, and lack reproducibility and technical defensibility. The LANL legacy cleanup program has embarked on using SDM to address the complex problems that remain. Stakeholder meetings have been held, and a prototype version of the stakeholder value system has been developed. Further meetings are expected in the future to address specific project needs. This is a long-term endeavor considering the complex environmental problems faced by DOE EM in Los Alamos (EM-LA), and careful planning, consideration of stakeholder value systems, and engagement with stakeholders throughout the SDM process is expected to lead to a successful endpoint. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1994

Decision Making in Action: Applying Research to Practice

The importance of decision-making to safety in complex, dynamic environments like mission control centers and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. A similar observation has been made in nuclear power plants. Yet laboratory research on decision making has not proven especially helpful in improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multidimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking in response to a problem. This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for spaceflight and training for offshore installations will be discussed.

Orasanu, Judith↗
NASA NTRS1994

Decision Making in Action

The importance of decision-making to safety in complex, dynamic environments like mission control centers and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. A similar observation has been made in nuclear power plants. Yet laboratory research on decision making has not proven especially helpful in improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multidimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking in response to a problem. This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for spaceflight and training for offshore installations will be discussed.

Orasanu, Judith↗