Search NASA⌕ Search

SEARCH · Search NASA

Results for “human-machine teaming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

46 records · Page 3

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗

Preliminary Framework for Human-Automation Collaboration

The Department of Energy’s Advanced Reactor Technologies Program sponsors research, development and deployment activities through its Next Generation Nuclear Plant, Advanced Reactor Concepts, and Advanced Small Modular Reactor (aSMR) Programs to promote safety, technical, economical, and environmental advancements of innovative Generation IV nuclear energy technologies. The Human Automation Collaboration (HAC) Research Project is located under the aSMR Program, which identifies developing advanced instrumentation and controls and human-machine interfaces as one of four key research areas. It is expected that the new nuclear power plant designs will employ technology significantly more advanced than the analog systems in the existing reactor fleet as well as utilizing automation to a greater extent. Moving towards more advanced technology and more automation does not necessary imply more efficient and safer operation of the plant. Instead, a number of concerns about how these technologies will affect human performance and the overall safety of the plant need to be addressed. More specifically, it is important to investigate how the operator and the automation work as a team to ensure effective and safe plant operation, also known as the human-automation collaboration (HAC). The focus of the HAC research is to understand how various characteristics of automation (such as its reliability, processes, and modes) effect an operator’s use and awareness of plant conditions. In other words, the research team investigates how to best design the collaboration between the operators and the automated systems in a manner that has the greatest positive impact on overall plant performance and reliability. This report addresses the Department of Energy milestone M4AT-15IN2302054, Complete Preliminary Framework for Human-Automation Collaboration, by discussing the two phased development of a preliminary HAC framework. The framework developed in the first phase was used as the basis for selecting topics to be investigated in more detail. The results and insights gained from the in-depth studies conducted during the second phase were used to revise the framework. This report describes the basis for the framework developed in phase 1, the changes made to the framework in phase 2, and the basis for the changes. Additional research needs are identified and presented in the last section of the report.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Enabling Situation Awareness Under High Levels of Automation: Results From An Experimental Study

The Department of Energy’s Advanced Reactor Technologies (ART) program sponsors research, development and deployment activities through its Next Generation Nuclear Plant, Advanced Reactor Concepts, and Advanced Small Modular Reactor (aSMR) programs to promote safety, technical, economical, and environmental advancements of innovative Generation IV nuclear energy technologies. The Human Automation Collaboration (HAC) research project is located under the aSMR program, which identifies developing advanced instrumentation and controls and human-machine interfaces as one of four key research areas. New nuclear plants are expected to employ significantly more advanced technology than the systems in the current reactor fleet as well as utilize automation to a greater extent. However, advancing technology and increasing automation does not necessarily imply improved efficiency and safety of the plant. Instead, a number of concerns about how these technologies will affect human performance and the overall safety of the plant need to be addressed. More specifically, it is important to investigate how the operator and the automation work as a team to ensure effective and safe plant operation, also known as the human-automation collaboration (HAC). The HAC project at INL, investigates collaboration methods between a system’s automation and human operators and how that collaboration impacts the performance and reliability of overall system performance. Some well documented human performance issues associated with typical human automation collaboration methods include reduced operator situation awareness (SA), complacency, and over reliance on the system automation (Endsley, 1995, 1996, 1997; Endsley & Kaber, 1999; Kaber & Endsley, 1997, 2004; Parasuraman et al., 2000; Sheridan, 2002; Wickens & Hollands, 2000; Wright & Kaber, 2005). The HAC research effort addresses how to best design the collaboration between the operators and the automated systems in a manner that has the greatest positive impact on overall plant performance and reliability, hence addressing many of the documented issues. The ultimate goal of the HAC research effort is to develop design guidance that supports optimal interaction between humans and automated systems.

99 GENERAL AND MISCELLANEOUS↗

Advancements in Development and Testing of Thermal Power Dispatch Simulators

Flexible plant operations and generation (FPOG) offer nuclear power plants (NPPs) the chance to leverage alternative, non-electric revenue streams while ensuring their continued role as reliable, clean, and constant sources of baseload electrical power. The excess thermal energy generated from NPPs during periods of low electricity demand can be channeled as raw materials to numerous industrial processes via a thermal power dispatch (TPD) system. Hydrogen production via high-temperature steam electrolysis (HTSE) is an optimal use case based on technical and economic feasibility. Researchers at Idaho National Laboratory (INL) have conducted previous works that developed and implemented TPD system models within the GSE Solutions Generic Pressurized Water Reactor (GPWR) simulator to support human-in-the-loop (HITL) scenario-based evaluations. The first part of this report documents modifications made to the GPWR TPD model and HMI from the previous iteration in line with a new Sargent and Lundy (S&L) TPD design with an automatic control system. The was done in collaboration with Westinghouse using their three-loop pressurizer water reactor (W3LPWR) simulator which contains an industrial grade automatic control system for the TPD. This was installed in the Human Systems Simulation Laboratory (HSSL) at INL. The second part of the report documents findings from an all-hands-on-deck integration and verification workshop that was conducted in the HSSL over several days. The research team comprised INL human factors and TPD experts, a nuclear engineer from GSE Solutions who implemented the revised TPD model for GPWR, the human-machine interface (HMI) prototyping and human factors team from the University of Idaho, and personnel with operations experience with pressurized water reactors. The workshop provided time and expertise to conduct the final activities to bring the operations, HMI, and simulator into a functional state. The goals of the integration and verification workshop were: 1. to install the revised GPWR TPD model into the HSSL 2. verify the TPD HMI prototype was functional 3. integrate the HTSE Simulink model to GPWR. 3. Issues were identified for resolution, but overall the workshop accomplished its goal to integrated and verify the majority of the intended functional. Future work will resolve the identified issues and use the integrated simulation to support an evaluation and demonstration in the next fiscal year.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Models and Processes to Extract Drug-like Molecules From Natural Language Text

Researchers worldwide are seeking to repurpose existing drugs or discover new drugs to counter the disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). A promising source of candidates for such studies is molecules that have been reported in the scientific literature to be drug-like in the context of viral research. However, this literature is too large for human review and features unusual vocabularies for which existing named entity recognition (NER) models are ineffective. We report here on a project that leverages both human and artificial intelligence to detect references to such molecules in free text. We present 1) a iterative model-in-the-loop method that makes judicious use of scarce human expertise in generating training data for a NER model, and 2) the application and evaluation of this method to the problem of identifying drug-like molecules in the COVID-19 Open Research Dataset Challenge (CORD-19) corpus of 198,875 papers. We show that by repeatedly presenting human labelers only with samples for which an evolving NER model is uncertain, our human-machine hybrid pipeline requires only modest amounts of non-expert human labeling time (tens of hours to label 1778 samples) to generate an NER model with an F-1 score of 80.5%—on par with that of non-expert humans—and when applied to CORD’19, identifies 10,912 putative drug-like molecules. This enriched the computational screening team’s targets by 3,591 molecules, of which 18 ranked in the top 0.1% of all 6.6 million molecules screened for docking against the 3CLPro protein.

60 APPLIED LIFE SCIENCES↗

Learning from Automation Surprises and "Going Sour" Accidents: Progress on Human-Centered Automation

Advances in technology and new levels of automation on commercial jet transports has had many effects. There have been positive effects from both an economic and a safety point of view. The technology changes on the flight deck also have had reverberating effects on many other aspects of the aviation system and different aspects of human performance. Operational experience, research investigations, incidents, and occasionally accidents have shown that new and sometimes surprising problems have arisen as well. What are these problems with cockpit automation, and what should we learn from them? Do they represent over-automation or human error? Or instead perhaps there is a third possibility - they represent coordination breakdowns between operators and the automation? Are the problems just a series of small independent glitches revealed by specific accidents or near misses? Do these glitches represent a few small areas where there are cracks to be patched in what is otherwise a record of outstanding designs and systems? Or do these problems provide us with evidence about deeper factors that we need to address if we are to maintain and improve aviation safety in a changing world? How do the reverberations of technology change on the flight deck provide insight into generic issues about developing human-centered technologies and systems (Winograd and Woods, 1997)? Based on a series of investigations of pilot interaction with cockpit automation (Sarter and Woods, 1992; 1994; 1995; 1997a, 1997 b), supplemented by surveys, operational experience and incident data from other studies (e.g., Degani et al., 1995; Eldredge et al., 1991; Tenney et al., 1995; Wiener, 1989), we too have found that the problems that surround crew interaction with automation are more than a series of individual glitches. These difficulties are symptoms that indicate deeper patterns and phenomena concerning human-machine cooperation and paths towards disaster. In addition, we find the same kinds of patterns behind results from studies of physician interaction with computer-based systems in critical care medicine (e.g., Moll van Charante et al., 1993; Obradovich and Woods, 1996; Cook and Woods, 1996). Many of the results and implications of this kind of research are synthesized and discussed in two comprehensive volumes, Billings (1996) and Woods et al. (1994). This paper summarizes the pattern that has emerged from our research, related research, incident reports, and accident investigations. It uses this new understanding of why problems arise to point to new investment strategies that can help us deal with the perceived "human error" problem, make automation more of a team player, and maintain and improve safety.

Woods, David D.↗

Demonstration of a Safety Analysis on a Complex System

For the past 17 years, Professor Leveson and her graduate students have been developing a theoretical foundation for safety in complex systems and building a methodology upon that foundation. The methodology includes special management structures and procedures, system hazard analyses, software hazard analysis, requirements modeling and analysis for completeness and safety, special software design techniques including the design of human-machine interaction, verification, operational feedback, and change analysis. The Safeware methodology is based on system safety techniques that are extended to deal with software and human error. Automation is used to enhance our ability to cope with complex systems. Identification, classification, and evaluation of hazards is done using modeling and analysis. To be effective, the models and analysis tools must consider the hardware, software, and human components in these systems. They also need to include a variety of analysis techniques and orthogonal approaches: There exists no single safety analysis or evaluation technique that can handle all aspects of complex systems. Applying only one or two may make us feel satisfied, but will produce limited results. We report here on a demonstration, performed as part of a contract with NASA Langley Research Center, of the Safeware methodology on the Center-TRACON Automation System (CTAS) portion of the air traffic control (ATC) system and procedures currently employed at the Dallas/Fort Worth (DFW) TRACON (Terminal Radar Approach CONtrol). CTAS is an automated system to assist controllers in handling arrival traffic in the DFW area. Safety is a system property, not a component property, so our safety analysis considers the entire system and not simply the automated components. Because safety analysis of a complex system is an interdisciplinary effort, our team included system engineers, software engineers, human factors experts, and cognitive psychologists.

Leveson, Nancy↗

What to Do Until the Money Runs Out: A Refinement Framework for Cognitive Engineering in the Real World

A case study is presented to illustrate some of the problems of applying cognitive science to complex human-machine systems. Disregard for facts about human cognition often undermines the safety, reliability, and cost-effectiveness of complex systems. Yet single-point methods (for example, better user-interface design), whether rooted in computer science or in experimental psychology, fall far short of addressing systems-level problems in a timely way using realistic resources. A model-based methodology is proposed for organizing and prioritizing the cognitive engineering effort, focusing appropriate expertise on major problems first, then moving to more sophisticated refinements if time and resources permit. This case study is based on a collaborative effort between the Human Factors Division at NASA-Ames and the Spaceborne Imaging Radar SIR-C/X-Band Synthetic Aperture Radar (SIR-C/X-SAR) Project at the Jet Propulsion Laboratory (JPL), California institute of Technology. The first SIR-C/X-SAR Shuttle mission flew successfully in April, 1994. A series of such missions is planned to provide radar data to study Earth's ecosystems, climatic and geological processes, hydrologic cycle, and ocean circulation. In addition to JPL and NASA personnel, the SIR-C/X-SAR operations team included Scientists and engineers from the German and Italian space agencies.

Shafto, Michael G.↗

Examining the Changing Roles and Responsibilities of Humans in Envisioned Future In-Time Aviation Safety Management Systems

Advances in technology are enabling new concepts of operations that will trans-form aviation including increasingly autonomous capabilities to handle evolving complex dynamic ecosystems like those associated with Advanced Aerial Mobility. A major challenge is how to ensure today’s safety levels are maintained as the system scales for rapid detection and timely mitigation of safety issues. NASA has developed a concept of operation for In-Time Aviation Safety Management Systems (IASMS) that represents a system-of-system perspective on interconnected capabilities needed to proactively reduce risk in complex operational environments where unknown hazards may exist. As a result, NASA research priorities include under-standing how the balance between humans and automation changes in such envisioned systems, which may lead to novel human-machine interaction paradigms and human-autonomy teaming for informed contingency management.

Lawrence Prinzel↗

Adaptation of Commercially Available Robots for Conditioning and Packaging ILW at Sellafield - 18282

The Legacy Ponds and Silos at Sellafield site contain some of the most hazardous Intermediate Level Waste (ILW) in the UK. As part of a multi-billion pound decommissioning programme, this waste will be retrieved and transported across the site for conditioning and packaging in the Box Encapsulation Plant (BEP). Current plans are to commence plant active commissioning in 2022, which will represent a major milestone in the UK nuclear decommissioning programme. Within the plant, skips of waste will be transferred from the shielded transport package into standard 3 cubic metre ILW containers. Waste from the Pile Fuel Storage Pond and First Generation Magnox Storage Pond will be immobilised in cementitious grout before being transferred to an adjacent store. Waste from the Magnox Swarf Storage Silo will not be immobilised in grout, but will be packaged, providing multi-barrier containment. During the concept design, the project team selected commercially available robots as the most viable technology for carrying out the numerous dexterous and repetitive tasks involved in characterising, conditioning and packaging the waste within the shielded 'hot' cells. Significant technical challenges had to be overcome during the design to adapt a commercially available robot for use within a high radiation / high contamination environment, where human access is not safe even for short periods of time. These challenges included: - Designing robot assemblies that could be retrofitted into the existing cell structure that was constructed as part of an earlier project but never completed; - Designing robot assemblies that could be recovered to their 'transport' position without requiring manual intervention; - Designing robot assemblies that could be remotely removed and replaced with new ones if they failed part way through the plant operational life; - Designing through-wall service and power connections that allow maintenance and recovery; - Designing control systems and human-machine interfaces that enable both manual and automated operation of the robot, whilst avoiding collisions with the in-cell cranes and other in cell furniture; - Assessing the radiation tolerance of all items. Bespoke computer simulations and full-scale development trials have been carried out, using non-active test materials, in order to demonstrate the Technology Readiness Level (TRL) required by Sellafield Limited (SL) at each stage of the project [1]. The results of these trials have been recorded in both video and written form so that they can form part of the project's Knowledge Management database. Detailed designs and specifications for the robot assemblies have been updated to incorporate the recommendations from the development trials. Procurement and manufacture of robot assemblies has already commenced to deliver two waste handling robots, two waste container lidding / swabbing robots and associated critical spares. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗