Search NASA⌕ Search

SEARCH · Search NASA

Results for “decision analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Application of multi-criteria decision analysis techniques and decision support framework for informing plant select agent designation and decision making

The United States Department of Agriculture (USDA) Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents (Select Agents List) that threaten crops of economic importance to the United States and regulates the procedures governing containment, incident response, and the security of entities working with them. Every 2 years the USDA DASAT reviews their select agent list, utilizing assessments by subject matter experts (SMEs) to rank the agents. We explored the applicability of multi-criteria decision analysis (MCDA) techniques and a decision support framework (DSF) to support the USDA DASAT biennial review process. The evaluation includes both current and non-select agents to provide a robust assessment. We initially conducted a literature review of 16 pathogens against 9 criteria for assessing plant health and bioterrorism risk and documented the findings to support this analysis. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for ensuring accuracy. Scoring criteria were adopted to ensure consistency. The MCDA supported the expectation that select agents would rank high on the relative risk scale when considering the agricultural consequences of a bioterrorism attack; however, application of analytical thresholds as a basis for designating select agents led to some exceptions to current designations. A second analytical approach used agent-specific data to designate key criteria in a DSF logic tree format to identify pathogens of low concern that can be ruled out for further consideration as select agents. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

59 BASIC BIOLOGICAL SCIENCES↗

Application of multi-criteria decision analysis techniques and decision support framework for informing select agent designation for agricultural animal pathogens

The United States Department of Agriculture (USDA), Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents and toxins (Select Agent List) that potentially threaten agricultural health and safety, the procedures governing the transfer of those agents, and training requirements for entities working with them. Every 2 years the USDA DASAT reviews the Select Agent List, using subject matter experts (SMEs) to perform an assessment and rank the agents. To assist the USDA DASAT biennial review process, we explored the applicability of multi-criteria decision analysis (MCDA) techniques and a Decision Support Framework (DSF) in a logic tree format to identify pathogens for consideration as select agents, applying the approach broadly to include non-select agents to evaluate its robustness and generality. We conducted a literature review of 41 pathogens against 21 criteria for assessing agricultural threat, economic impact, and bioterrorism risk and documented the findings to support this assessment. The most prominent data gaps were those for aerosol stability and animal infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. The MCDA analysis supported the intuitive sense that select agents should rank high on the relative risk scale when considering agricultural health consequences of a bioterrorism attack. However, comparing select agents with non-select agents indicated that there was not a clean break in scores to suggest thresholds for designating select agents, requiring subject matter expertise collectively to establish which analytical results were in good agreement to support the intended purpose in designating select agents. The DSF utilized a logic tree approach to identify pathogens that are of sufficiently low concern that they can be ruled out from consideration as a select agent. In contrast to the MCDA approach, the DSF rules out a pathogen if it fails to meet even one criteria threshold. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

60 APPLIED LIFE SCIENCES↗

Hydropower Potential at Non-Powered Dams: A Multi-Criteria Decision Analysis Tool based on Grid, Community, Industry, and Environmental Impacts

Non-powered dams (NPDs) are dams that do not include hydraulic turbine (hydropower) equipment. Currently, there are more than 80,000 such dams in the United States, which provide a variety of non-energy benefits, including flood control, water supply, navigation, and recreation. Approximately 500 of these NPDs are identified as having the potential to add hydropower generation (totaling up to a capacity of more than 8200 MW). A large share of investment costs and environmental impacts of dam construction have already been incurred at these NPDs. Hence, adding power to the existing dam structure is hypothesized to be achieved at a lower cost, with less risk, and a shorter timeframe than the development required for new dam construction. The abundance of NPDs, the associated environmental favorability, and cost advantages, combined with the reliability, predictability, and dispatchability of hydropower, make NPDs a strong candidate in the nation’s renewable energy portfolio. To assess the NPD to hydropower conversion potential, in this study, we developed a GIS-based multi-criterial decision analysis tool, which allows users to rank these NPDs based on the grid, community, industry, and environmental impacts (i.e., GCIE impacts). This web-based interactive tool (developed using open-source Python and JavaScript) lets the user choose from a wide range of features to define each of the GCIE impact scores through a user-friendly graphical user interface. These features are related to dam operation, hydropower generation opportunity, power market economy, social vulnerability and risk, proximity to critical infrastructure and energy generating facilities, environmental concerns (air, water, and critical habitat), and exposure to natural hazards. The overall priority score of NPDs is calculated based on user-defined weights for each of the GCIE impact scores. Besides ranking NPDs, the tool can also be used to estimate the energy-storage feasibility (battery, hydrogen, and pump-storage hydropower) at each of the potential sites.

13 HYDRO ENERGY↗

Thermal power systems small power systems applications project. Decision analysis for evaluating and ranking small solar thermal power system technologies. Volume 1: A brief introduction to multiattribute decision analysis

The principal concepts of the Keeney and Raiffa approach to multiattribute decision analysis are described. Topics discussed include the concepts of decision alternatives, outcomes, objectives, attributes and their states, attribute utility functions, and the necessary independence properties for the attribute states to be aggregated into a numerical representation of the preferences of the decision maker for the outcomes and decision alternatives.

Feinberg, A.↗

Stochastic decision analysis

Small space flight project design at NASA Langley Research Center goes through a multi-phase process from preliminary analysis to flight operations. The process insures that each system achieves its technical objectives with demonstrated quality and within planned budgets and schedules. A key technical component of early phases is decision analysis, which is a structure procedure for determining the best of a number of feasible concepts based upon project objectives. Feasible system concepts are generated by the designers and analyzed for schedule, cost, risk, and technical measures. Each performance measure value is normalized between the best and worst values and a weighted average score of all measures is calculated for each concept. The concept(s) with the highest scores are retained, while others are eliminated from further analysis. This project automated and enhanced the decision analysis process. Automation of the decision analysis process was done by creating a user-friendly, menu-driven, spreadsheet macro based decision analysis software program. The program contains data entry dialog boxes, automated data and output report generation, and automated output chart generation. The enhancements to the decision analysis process permit stochastic data entry and analysis. Rather than enter single measure values, the designers enter the range and most likely value for each measure and concept. The data can be entered at the system or subsystem level. System level data can be calculated as either sum, maximum, or product functions of the subsystem data. For each concept, the probability distributions are approximated for each measure and the total score for each concept as either constant, triangular, normal, or log-normal distributions. Based on these distributions, formulas are derived for the probability that the concept meets any given constraint, the probability that the concept meets all constraints, and the probability that the concept is within a given amount of the best score. Formulas are also derived for the probability that one concept's total score is within a given amount of a second concept's total score. These probabilistic calculations provide more realistic data entry and output information for designers, enabling designers to better determine which concepts to eliminate and which concepts to retain at the decision points of each design phase.

Lacksonen, Thomas A.↗

Application of Multi-Criteria Decision Analysis Techniques for Informing Select Agent Designation and Decision Making

The Centers for Disease Control and Prevention (CDC) Select Agent Program establishes a list of biological agents and toxins that potentially threaten public health and safety, the procedures governing the possession, utilization, and transfer of those agents, and training requirements for entities working with them. Every 2 years the Program reviews the select agent list, utilizing subject matter expert (SME) assessments to rank the agents. In this study, we explore the applicability of multi-criteria decision analysis (MCDA) techniques and logic tree analysis to support the CDC Select Agent Program biennial review process, applying the approach broadly to include non-select agents to evaluate its generality. We conducted a literature search for over 70 pathogens against 15 criteria for assessing public health and bioterrorism risk and documented the findings for archiving. The most prominent data gaps were found for aerosol stability and human infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. Analysis of results obtained from a two-dimensional plot of weighted scores for difficulty of attack (i.e., exposure and production criteria) vs. consequences of an attack (i.e., consequence and mitigation criteria) provided greater fidelity for understanding agent placement compared to a 1-to-n ranking and was used to define a region in the upper right-hand quadrant for identifying pathogens for consideration as select agents. A sensitivity analysis varied the numerical weights attributed to various properties of the pathogens to identify potential quantitative (x and y) thresholds for classifying select agents. The results indicate while there is some clustering of agent scores to suggest thresholds, there are still pathogens that score close to any threshold, suggesting that thresholding “by eye” may not be sufficient. The sensitivity analysis indicates quantitative thresholds are plausible, and there is good agreement of the analytical results with select agent designations. A second analytical approach that applied the data using a logic tree format to rule out pathogens for consideration as select agents arrived at similar conclusions.

60 APPLIED LIFE SCIENCES↗

Applications of decision analysis and related techniques to industrial engineering problems at KSC

This report provides: (1) a discussion of the origination of decision analysis problems (well-structured problems) from ill-structured problems; (2) a review of the various methodologies and software packages for decision analysis and related problem areas; (3) a discussion of how the characteristics of a decision analysis problem affect the choice of modeling methodologies, thus providing a guide as to when to choose a particular methodology; and (4) examples of applications of decision analysis to particular problems encountered by the IE Group at KSC. With respect to the specific applications at KSC, particular emphasis is placed on the use of the Demos software package (Lumina Decision Systems, 1993).

Evans, Gerald W.↗

City Decision Analysis Resources and Tools

The City Decision Analysis at Any Scale Workshop was held February 17-18, 2021. This brochure was created to provide participants with a collection of tools and resources that support planning and implementation of clean energy goals for communities and businesses.

ACES↗

The application of decision analysis to life support research and technology development

Applied research and technology development is often characterized by uncertainty, risk, and significant delays before tangible returns are obtained. Decision making regarding which technologies to advance and what resources to devote to them is a challenging but essential task. In the application of life support technology to future manned space flight, new technology concepts typically are characterized by nonexistent data and rough approximations of technology performance, uncertain future flight program needs, and a complex, time-intensive process to develop technology to a flight-ready status. Decision analysis is a quantitative, logic-based discipline that imposes formalism and structure to complex problems. It also accounts for the limits of knowledge that may be available at the time a decision is needed. The utility of decision analysis to life support technology R & D was evaluated by applying it to two case studies. The methodology was found to provide insight that is not possible from more traditional analysis approaches.

Ballin, Mark G.↗

Planning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners

This paper describes design and logistical aspects of a decision analysis study to assess the performance of qualified firearms examiners working in accredited laboratories in the United States in terms of accuracy (error rate), repeatability, and reproducibility of decisions involving comparisons of fired bullets and cartridge cases. The purpose of the study was to validate current practice of the forensic discipline of firearms/toolmarks (F/T) examination. It elicited error rate data by counting the number of false positive and false negative conclusions. Preceded by the experimental design, decisions, and logistics described herein, testing was ultimately administered 173 qualified, practicing F/T examiners in public and private crime laboratories. The first round of testing evaluated accuracy, while two subsequent rounds evaluated repeatability and reproducibility of examiner conclusions. This project expands on previous studies by involving many F/T examiners in challenging comparisons and by executing the study in the recommended double-blind format.

99 GENERAL AND MISCELLANEOUS↗

ISHM Decision Analysis Tool: Operations Concept

The state-of-the-practice Shuttle caution and warning system warns the crew of conditions that may create a hazard to orbiter operations and/or crew. Depending on the severity of the alarm, the crew is alerted with a combination of sirens, tones, annunciator lights, or fault messages. The combination of anomalies (and hence alarms) indicates the problem. Even with much training, determining what problem a particular combination represents is not trivial. In many situations, an automated diagnosis system can help the crew more easily determine an underlying root cause. Due to limitations of diagnosis systems,however, it is not always possible to explain a set of alarms with a single root cause. Rather, the system generates a set of hypotheses that the crew can select from. The ISHM Decision Analysis Tool (IDAT) assists with this task. It presents the crew relevant information that could help them resolve the ambiguity of multiple root causes and determine a method for mitigating the problem. IDAT follows graphical user interface design guidelines and incorporates a decision analysis system. I describe both of these aspects.

Source record↗

Spaceborne power systems preference analyses. Volume 2: Decision analysis

Sixteen alternative spaceborne nuclear power system concepts were ranked using multiattribute decision analysis. The purpose of the ranking was to identify promising concepts for further technology development and the issues associated with such development. Four groups were interviewed to obtain preference. The four groups were: safety, systems definition and design, technology assessment, and mission analysis. The highest ranked systems were the heat-pipe thermoelectric systems, heat-pipe Stirling, in-core thermionic, and liquid-metal thermoelectric systems. The next group contained the liquid-metal Stirling, heat-pipe Alkali Metal Thermoelectric Converter (AMTEC), heat-pipe Brayton, liquid-metal out-of-core thermionic, and heat-pipe Rankine systems. The least preferred systems were the liquid-metal AMTEC, heat-pipe thermophotovoltaic, liquid-metal Brayton and Rankine, and gas-cooled Brayton. The three nonheat-pipe technologies selected matched the top three nonheat-pipe systems ranked by this study.

Smith, J. H.↗

Risk-Based Prioritization of Research for Aviation Security Using Logic-Evolved Decision Analysis

The National Aeronautics and Space Administration is developing advanced technologies to reduce terrorist risk for the air transportation system. Decision support tools are needed to help allocate assets to the most promising research. An approach to rank ordering technologies (using logic-evolved decision analysis), with risk reduction as the metric, is presented. The development of a spanning set of scenarios using a logic-gate tree is described. Baseline risk for these scenarios is evaluated with an approximate reasoning model. Illustrative risk and risk reduction results are presented.

Eisenhawer, S. W.↗

A pilot level decision analysis of thermionic reactor development strategy for nuclear electric propulsion

The development policy for thermionic reactors to provide electric propulsion and power for space exploration was analyzed to develop a logical procedure for selecting development alternatives that reflect the technical feasibility, JPL/NASA project objectives, and the economic environment of the project. The partial evolution of a decision model from the underlying philosophy of decision analysis to a deterministic pilot phase is presented, and the general manner in which this decision model can be employed to examine propulsion development alternatives is illustrated.

Menke, M. M.↗

Life support technology investment strategies for flight programs: An application of decision analysis

Applied research and technology development (R&TD) is often characterized by uncertainty, risk, and significant delays before tangible returns are obtained. Given the increased awareness of limitations in resources, effective R&TD today needs a method for up-front assessment of competing technologies to help guide technology investment decisions. Such an assessment approach must account for uncertainties in system performance parameters, mission requirements and architectures, and internal and external events influencing a development program. The methodology known as decision analysis has the potential to address these issues. It was evaluated by performing a case study assessment of alternative carbon dioxide removal technologies for NASA's proposed First Lunar Outpost program. An approach was developed that accounts for the uncertainties in each technology's cost and performance parameters as well as programmatic uncertainties such as mission architecture. Life cycle cost savings relative to a baseline, adjusted for the cost of money, was used as a figure of merit to evaluate each of the alternative carbon dioxide removal technology candidates. The methodology was found to provide a consistent decision-making strategy for development of new life support technology. The case study results provided insight that was not possible from more traditional analysis approaches.

Schlater, Nelson J.↗

Life support technology investment strategies for flight programs: An application of decision analysis

Applied research and technology development (R&TD) is often characterized by uncertainty, risk, and significant delays before tangible returns are obtained. Given the increased awareness of limitations in resources, effective R&TD today needs a method for up-front assessment of competing technologies to help guide technology investment decisions. Such an assessment approach must account for uncertainties in system performance parameters, mission requirements and architectures, and internal and external events influencing a development program. The methodology known as decision analysis has the potential to address these issues. It was evaluated by performing a case study assessment of alternative carbon dioxide removal technologies for NASA"s proposed First Lunar Outpost program. An approach was developed that accounts for the uncertainties in each technology's cost and performance parameters as well as programmatic uncertainties such as mission architecture. Life cycle cost savings relative to a baseline, adjusted for the cost of money, was used as a figure of merit to evaluate each of the alternative carbon dioxide removal technology candidates. The methodology was found to provide a consistent decision-making strategy for the develpoment of new life support technology. The case study results provided insight that was not possible from more traditional analysis approaches.

Schlater, Nelson J.↗

An application of multiattribute decision analysis to the Space Station Freedom program. Case study: Automation and robotics technology evaluation

The results are described of an application of multiattribute analysis to the evaluation of high leverage prototyping technologies in the automation and robotics (A and R) areas that might contribute to the Space Station (SS) Freedom baseline design. An implication is that high leverage prototyping is beneficial to the SS Freedom Program as a means for transferring technology from the advanced development program to the baseline program. The process also highlights the tradeoffs to be made between subsidizing high value, low risk technology development versus high value, high risk technology developments. Twenty one A and R Technology tasks spanning a diverse array of technical concepts were evaluated using multiattribute decision analysis. Because of large uncertainties associated with characterizing the technologies, the methodology was modified to incorporate uncertainty. Eight attributes affected the rankings: initial cost, operation cost, crew productivity, safety, resource requirements, growth potential, and spinoff potential. The four attributes of initial cost, operations cost, crew productivity, and safety affected the rankings the most.

Smith, Jeffrey H.↗