SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Decisions made in the earliest phases of system development have the most leverage to influence the success of the entire development effort, and yet must be made when information is incomplete and uncertain. We have developed a scalable cost-benefit model to support this critical phase of early-lifecycle decision-making.
This paper describes the implications of a naturalistic decision making (NDM) perspective for training air crews to make flight-related decisions. The implications are based on two types of analyses: (a) identification of distinctive features that serve as a basis for classifying a diverse set of decision events actually encountered by flight crews, and (b) performance strategies that distinguished more from less effective crews flying full-mission simulators, as well as performance analyses from NTSB accident investigations. Six training recommendations are offered: (1) Because of the diversity of decision situations, crews need to be aware that different strategies may be appropriate for different problems; (2) Given that situation assessment is essential to making a good decision, it is important to train specific content knowledge needed to recognize critical conditions, to assess risks and available time, and to develop strategies to verify or diagnose the problem; (3) Tendencies to oversimplify problems may be overcome by training to evaluate options in terms of goals, constraints, consequences, and prevailing conditions; (4) In order to provide the time to gather information and consider options, it is essential to manage the situation, which includes managing crew workload, prioritizing tasks, contingency planning, buying time (e.g., requesting holding or vectors), and using low workload periods to prepare for high workload; (5) Evaluating resource requirements ("What do I need?") and capabilities ("'What do I have?" ) are essential to making good decisions. Using resources to meet requirements may involve the cabin crew, ATC, dispatchers, and maintenance personnel; (6) Given that decisions must often be made under high risk, time pressure, and workload, train under realistic flight conditions to promote the development of robust decision skills.
Many complex dynamical systems consist of a large number of interacting subsystems that operate harmoniously and make decisions that are designed for the benefit of the entire enterprise. If, in an attempt to disrupt the operation of the entire system, one subsystem gets attacked and is made to operate in a manner that is adversarial with the others, then the entire system suffers, resulting in an adversarial decision-making environment among its subsystems. Such an environment may affect not only the decision-making process of the attacked subsystem but also possibly the other remaining subsystems as well. The disruption caused by the attacked subsystem may cause the remaining subsystems to either coalesce as a unified team making team-based decisions, or disintegrate and act as independent decision-making entities. The decision-making process in these types of complex systems of systems is best analyzed within the general framework of cooperative and non-cooperative game theory. In this paper, we will develop an analysis that provides a theoretical basis for modeling the decision-making process in such complex systems. We show how cooperation among the subsystems can produce Noninferior Nash Strategies (NNS) that are fair and acceptable to all subsystems within the team while at the same time provide the subsystems in the team with the security of the Nash equilibrium against the opposing attacked subsystem. We contrast these strategies with the all Nash Strategies (NS) that would result if the operation of the entire system disintegrated and became adversarial among all subsystems as a result of the attack. An example of a system consisting of three subsystems with one opposing subsystem as a result of an attack is included to illustrate the results.
Despite efforts to design systems and procedures to support 'correct' and safe operations in aviation, errors in human judgment still occur and contribute to accidents. In this paper we examine how an NDM (naturalistic decision making) approach might help us to understand the role of decision processes in negative outcomes. Our strategy was to examine a collection of identified decision errors through the lens of an aviation decision process model and to search for common patterns. The second, and more difficult, task was to determine what might account for those patterns. The corpus we analyzed consisted of tactical decision errors identified by the NTSB (National Transportation Safety Board) from a set of accidents in which crew behavior contributed to the accident. A common pattern emerged: about three quarters of the errors represented plan-continuation errors, that is, a decision to continue with the original plan despite cues that suggested changing the course of action. Features in the context that might contribute to these errors were identified: (a) ambiguous dynamic conditions and (b) organizational and socially-induced goal conflicts. We hypothesize that 'errors' are mediated by underestimation of risk and failure to analyze the potential consequences of continuing with the initial plan. Stressors may further contribute to these effects. Suggestions for improving performance in these error-inducing contexts are discussed.
Significant technology advances will enable future aerospace systems to safely and reliably make decisions autonomously, or without human interaction. The decision-making may result in actions that enable an aircraft or spacecraft in an off-nominal state or with slightly degraded components to achieve mission performance and safety goals while reducing or avoiding damage to the aircraft or spacecraft. Some key technology enablers for autonomous decision-making include: a continuous state awareness through the maturation of the prognostics health management field, novel sensor development, and the considerable gains made in computation power and data processing bandwidth versus system size. Sophisticated algorithms and physics based models coupled with these technological advances allow reliable assessment of a system, subsystem, or components. Decisions that balance mission objectives and constraints with remaining useful life predictions can be made autonomously to maintain safety requirements, optimal performance, and ensure mission objectives. This autonomous approach to decision-making will come with new risks and benefits, some of which will be examined in this paper. To start, an account of previous work to categorize or quantify autonomy in aerospace systems will be presented. In addition, a survey of perceived risks in autonomous decision-making in the context of piloted aircraft and remotely piloted or completely autonomous unmanned autonomous systems (UAS) will be presented based on interviews that were conducted with individuals from industry, academia, and government.
Decisions requiring passenger comfort technology were shown to depend on: the relationship between comfort and other factors (e.g., cost, urgency, alternate modes) in traveler acceptance of the systems, serving a selected market require technology to quantify effects of comfort versus offsetting factors in system acceptance. Public predict the maximum percentage of travelers who willingly accept the overall comfort of any trip ride. One or the other of these technology requirements apply to decisions on system design, operation and maintenance.
The Severe Weather Planning Simulator (SWPS), developed by Los Alamos National Laboratory (LANL), is a computer-based learning environment of conditions and response options to potential severe weather conditions at the Macondo Well (MC252) during response and recovery operations. SWPS is a computer aid designed to expose users to uncertain hurricane conditions and allow them to make decisions at a high level about ship deployment and operations and be exposed to potential consequences in personnel and equipment safety and pollution prevention efforts. The goal is not to predict the future but rather to expose decision makers to potential scenarios and the tradeoffs that will need to be considered when making decisions about personnel and ship deployment. Although this work is focused solely on Macondo response operations, it is readily extensible to other recovery operations involving a range of conditions, geographic locations and exploration assets. Documented herein is a brief summary of the results of an initial trial of SWPS with four employees of BP involved with Macondo response operations. SWPS uses system level models to represent ship operations including movements to port under storm threat and the return to operations, ship fragility, personnel movements and vulnerability in storm conditions, pollution prevention results, a hurricane scenario generation model and a decision model. The models are wrapped in an interface enabling users to observe conditions, make decisions on ship and personnel movements and evaluate the results of their actions. A two hour workshop was conducted on August 18 at the BP Westlake offices in Houston to assess a preliminary version of the simulator. The workshop goal was to assess the potential utility of SWPS, evaluate its interface, and function and gather suggestions for further development. Four BP employees - Ed Bracken, Hugh Banon, Earnest Bush, and Troy Endicott - were introduced to the simulator and asked to run through a scenario in a hands-on evaluation of its current and potential utility.
Flight crews must make decisions and take action when systems fail or emergencies arise during flight. These situations may involve high stress. Full-missiion flight simulation studies have shown that crews differ in how effectively they cope in these circumstances, judged by operational errors and crew coordination. The present study analyzed the problem solving and decision making strategies used by crews led by captains fitting three different personality profiles. Our goal was to identify more and less effective strategies that could serve as the basis for crew selection or training. Methods: Twelve 3-member B-727 crews flew a 5-leg mission simulated flight over 1 1/2 days. Two legs included 4 abnormal events that required decisions during high workload periods. Transcripts of videotapes were analyzed to describe decision making strategies. Crew performance (errors and coordination) was judged on-line and from videotapes by check airmen. Results: Based on a median split of crew performance errors, analyses to date indicate a difference in general strategy between crews who make more or less errors. Higher performance crews showed greater situational awareness - they responded quickly to cues and interpreted them appropriately. They requested more decision relevant information and took into account more constraints. Lower performing crews showed poorer situational awareness, planning, constraint sensitivity, and coordination. The major difference between higher and lower performing crews was that poorer crews made quick decisions and then collected information to confirm their decision. Conclusion: Differences in overall crew performance were associated with differences in situational awareness, information management, and decision strategy. Captain personality profiles were associated with these differences, a finding with implications for crew selection and training.
Decision making structures, such as control boards, process information on many topics as they select options for the system and project. The decisions are based on the information known to the board members and presenters (subject matter experts) and shared at the board during discussion. This information flow through this process can be modelled using information theory. Information theory provides a mathematical basis to understand the flow of information through the decision making process and the information needed for a particular decision. Information theory also provides the mathematical relationships on which to base the optimal decision making structure for a specific system development and organizational structure. Since decision making bodies provide control for the system or project, control theory can be used to construct a decision making model. This provides a starting point for adding cognitive science models. Information processing by each individual board participant can be represented through cognitive processes which are integrated across the board participants through information theory relationship. The set theory view of information theory provides a structure in which to look at the relationships between the participants in a decision making structure.
Decision making structures, such as control boards, process information on many topics as they select options for the system and project. The decisions are based on the information known to the board members and presenters (subject matter experts) and shared at the board during discussion. This information flow through this process can be modelled using information theory. Information theory provides a mathematical basis to understand the flow of information through the decision making process and the information needed for a particular decision. Information theory also provides the mathematical relationships on which to base the optimal decision making structure for a specific system development and organizational structure. Since decision making bodies provide control for the system or project, control theory can be used to construct a decision making model. This provides a starting point for adding cognitive science models. Information processing by each individual board participant can be represented through cognitive processes which are integrated across the board participants through information theory relationship. The set theory view of information theory provides a structure in which to look at the relationships between the participants in a decision making structure.
This article studies the participation of stakeholders in climate change decision-making in Alaska s National Parks. We place stakeholder participation within literatures on environmental and climate change decision-making. We conducted participant observation and interviews in two planning workshops to investigate the decision-making process, and our findings are three-fold. First, the inclusion of diverse stakeholders expanded climate change decision-making beyond National Park Service (NPS) institutional constraints. Second, workshops of the Climate Change Scenario Planning Project (CCSPP) enhanced institutional understandings of participants attitudes towards climate change and climate change decision-making. Third, the geographical context of climate change influences the decisionmaking process. As the first regional approach to climate change decision-making within the NPS, the CCSPP serves as a model for future climate change planning in public land agencies. This study shows how the participation of stakeholders can contribute to robust decisions, may move climate change decision-making beyond institutional barriers, and can provide information about attitudes towards climate change decision-making.
Uncertainty is an important aspect to data understanding. Without awareness of the variability, error, or reliability of a dataset, the ability to make decisions on that data is limited. However, practices around uncertainty visualization remain domain-specific, rooted in convention, and in many instances, absent entirely. Part of the reason for this may be a lack of established guidelines for navigating difficult choices of when uncertainty should be added, how to visualize uncertainty, and how to evaluate its effectiveness. Unsurprisingly, the inclusion of uncertainty into visualizations is a major challenge to visualization. As work concerned with uncertainty visualization grows, it has become clear that simple visual additions of uncertainty information to traditional visualization methods do not appropriately convey the meaning of the uncertainty, pose many perceptual challenges, and, in the worst case, can lead a viewer to a completely wrong understanding of the data. These challenges are the driving motivator for this special issue.
This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.
Research on human decision making has traditionally focused on how people actually make decisions, how good their decisions are, and how their decisions can be improved. Recent research suggests that this model is inadequate. Affective as well as cognitive components drive the way information about relevant outcomes and events is perceived, integrated, and used in the decision making process. The affective components include how the individual frames outcomes as good or bad, whether the individual anticipates regret in a decision situation, the affective mood state of the individual, and the psychological stress level anticipated or experienced in the decision situation. A focus of the current work has been to propose empirical studies that will attempt to examine in more detail the relationships between the latter two critical affective influences (mood state and stress) on decision making behavior.
The contamination legacy of industrialization, militarization, and nuclear arms race poses current or future risks to populations and the environment. Responsible parties and regulators make decisions regarding which sites to clean up, how, how much, and when. This study aimed to provide an information needs template to evaluate and reduce risks to human health when considering whether to initiate or delay remediation. This investigation focused on four aspects of timing and prioritization: 1) management, planning and implementation, 2) source terms, pathways, and exposures, 3) risks and receptors, and 4) external drivers. Within each type, issues were identified and described. Management class included personnel, health and safety data, funding, equipment, and structural integrity. Source term included contaminant sources, pathways, initiating events, and barriers to exposure. Risk included types and exposures to workers and general public. External drivers included regulatory framework, stakeholders, Congressional mandates, and economic and social contexts. Risk may increase over time as contamination spreads, enters aquifers, and reaches receptors, and may decline as radionuclides decay, and plumes dissipate. The overall objective was to provide a template of information that is useful to managers and regulators, and might be used by the public to understand the risks and benefits of re-prioritization cleanup.
The increasing frequency and severity of extreme weather events underscore the need to bolster the resilience of energy infrastructure in remote coastal communities exposed to climate hazards. In recent years, considerable effort has been made to harden the grid infrastructure of remote communities through investment in energy storage, advanced metering, renewable generation and energy-efficient loads. However, simulation-based studies are still needed to identify appropriate locations for investment and determine the adequacy of existing infrastructure in supporting new resources. Preparing the required models may often be challenging due to insufficient metering, disparate data sources and workforce limitations. This paper describes modeling efforts undertaken to represent, within a unified co-simulation platform: (a) the electric distribution network and (b) the thermal behavior of a community medical center, in the remote community of Cordova, Alaska. With the help of case-studies, it is shown how the developed simulation platform can help the local utility in making decisions regarding capital investment aimed at enhancing community resilience.
Driven by major scientific advances in analytical methods, biomonitoring, and computational exposure assessment, and a newly articulated vision for a greater impact in public health, the field of exposure science is undergoing a rapid transition from a field of observation to a field of prediction. Deployment of an organizational and predictive framework for exposure science analogous to the computationally enabled “systems approaches” used in the biological sciences is a necessary step in this evolution. Here we propose the aggregate exposure pathway (AEP) concept as the natural and complementary companion in the exposure sciences to the adverse outcome pathway (AOP) concept in the toxicological sciences. The AEP framework offers an intuitive approach to successful organization of exposure science data within individual units of prediction common to the field, setting the stage for exposure forecasting. Looking farther ahead, we envision direct linkages between aggregate exposure pathway and adverse outcome pathways, completing the source to outcome continuum and setting the stage for more efficient integration of exposure science and toxicity testing information. Together these frameworks form and inform a decision making framework with the flexibility for risk-based, hazard-based or exposure-based decisions.
Human decision making in manned space flight including topics on memory models, signal detection, and pilot performance