Results for “complex task performance” — Page 8

NASA NTRS2015

Activity Planning for a Lunar Orbital Mission

This paper describes a challenging, real-world planning problem within the context of a NASA mission called LADEE (Lunar Atmospheric Dust Environment Explorer). LADEEs science phase was performed in an equatorial, retrograde orbit around the Moon. The science observations were constrained with respect to key points in the spacecrafts orbit. We present the approach taken to reduce the complexity of the activity planning task in order to effectively perform it within the time pressures imposed by the mission requirements. One key aspect of this approach is the design of the activity planning process based on principles of problem decomposition and planning abstraction levels. The second key aspect is the mixed-initiative system developed for this task, called LASS (LADEE Activity Scheduling System). The primary challenge for LASS was representing and managing the orbit-based science constraints, given their dynamic nature due to the continually updated orbit determination solution.

Bresina, John L.↗

NASA NTRS1987

A task-based metric for telerobotic performance assessment

A methodology is described for developing a task complexity index based on combining the six basic motion primitives (three translation, three orientation) with force control and accuracy requirements. The result of this development is a set of complexity values that can be assigned to the high-level task primitives derived from a relatively shallow top-down mission analysis. These values are then averaged to arrive at total average mission complexities, such as for the mission of exchanging the Hubble Space Telescope (HST) battery modules. Application of this metric to a candidate set of NASA Flight Telerobotic Servicer evaluation tasks is discussed using the HST battery module mission for an in-depth example.

Barnes, J. F.↗

NASA NTRS2015

Understanding Community Needs and Desires

This panel exchange is focused on the Integration Test phase within the development lifecycle with special emphasis and dedicated discussion on integration and testing of complex systems. Layout and scheduling of integration tasks come from the verification of interface and performance requirements. However, planning for integration activities of complex systems is inherently different from traditional systems engineering integration planning activities. Decisions about the systems under development have to consider not only the technical and programmatic viewpoints but also the political, societal, operational, and economic viewpoints. Definition of performance measures, found intrinsic in the plan, with trans-disciplinary implications will be discussed. A scenario of integration of UAS in the NAS will be used as a benchmark of current views and lifecycle challenges.

Murphy, James R.↗

NASA NTRSDate not supplied

Validation of Fitness for Duty Standards Using Pre- and Post-Flight Capsule Egress and Suited Functional Performance Tasks in Simulated Reduced Gravity

The transition between gravity environments will involve one of the most complex, high-risk phases of exploration missions. The reduced functional capacity caused by physiological deconditioning adaptations in microgravity coupled with the stressors of re-entry into partial gravity environments will increase risks to crew, even with rigorous adherence to inflight countermeasures. Specifically, two high-risk scenarios may be required to be performed soon after gravity transitions: 1) nominal and/or emergency unassisted capsule egress task after return to Earth, and 2) planetary extravehicular activity (EVA) soon after landing on Mars or the Moon. Quantification of crewmember’s functional performance after long-duration spaceflight is necessary to inform concepts of operations for future exploration missions. The overarching aim of this study is to quantify post-landing functional performance with deconditioning after long-duration ISS missions. This study is broken down into two phases. Phase 1 includes a pilot study to assess the overall feasibility and demonstrate the capability to perform mission-like tasks shortly after landing. Phase 2, the Egress Fitness study, which is part of the Complement of Integrated Protocols for Human Exploration Research (CIPHER), uses a task-based approach to characterize functional performance in long-duration ISS crewmembers before flight and shortly after return to Earth. The pilot and full Egress Fitness study includes pre-flight and post-flight testing of simulated emergency egress out of a functional capsule mockup and a Mars gravity EVA simulation at the Active Response Gravity Offload System (ARGOS) facility. The EVA simulation tasks include suit donning, hatch egress, ladder descent, task board cable operations, baggage transfer over sand/rocky regolith, alignment with a rear entry port, and suit egress. The post-flight simulated capsule egress test occurs 1–4 h after landing and the planetary EVA simulation occurs 18–36 h after landing. The full CIPHER Egress Fitness study has additional pre-flight sessions, longer EVA tasks that include traverse and geology sampling, and post-flight sessions on R+1, 4, and 8 to characterize the timeframe of recovery. The Pilot Egress Fitness study has completed baseline and post-flight testing on four crewmembers. All subjects were able to complete the post-flight simulated planetary EVA; three subjects were able to complete the postflight capsule egress simulation. CIPHER study data collection is ongoing. This study will quantify post-landing functional performance in operationally relevant simulations to help inform future planetary concepts of operations shortly after landing.

egress↗

NASA NTRSDate not supplied

Validation of Fitness for Duty Standards Using Pre- and Post-Flight Capsule Egress and Suited Functional Performance Tasks in Simulated Reduced Gravity

The transition between gravity environments will involve one of the most complex, high-risk phases of any mission. For example, the reduced functional capacity caused by physiological deconditioning adaptations in microgravity coupled with the stressors of re-entry into partial gravity environments will increase risks to crew, even with rigorous adherence to inflight countermeasures. Quantification of the astronauts’ post-landing functional performance is necessary to design ConOps for exploration missions. Specifically, these two high-risk scenarios may be required to be performed soon after gravity transitions: • Nominal and/or emergency unassisted capsule egress task after return to Earth • Planetary extravehicular activity (EVA) soon after landing on Mars or the Moon This study is broken down into two phases. Phase 1: A feasibility study that will assess the overall feasibility and demonstrate the capability to do these tasks shortly after landing. Phase 2: the full Egress Fitness study, which is part of the CIPHER complement. This study uses a task-based approach to characterize functional performance of these high-risk scenarios in long-duration ISS crewmembers before flight and shortly after return to Earth. Prior to any testing, each astronaut subject completes a suit fit check to ensure adequate sizing and a mobility assessment to confirm completion of the EVA tasks. Pilot Egress Fitness pre-flight and post-flight testing includes an Earth-based emergency egress out of a functional capsule mockup and a short Mars gravity EVA simulation including suit donning, hatch egress, ladder descent, task board cable operations, baggage transfer over sand/rocky regolith, alignment with a rear entry port, and suit egress. Pre-flight testing will occur at any time point prior to flight. Post-flight assessment is much more critical with the capsule egress test that will occur 1–4 hours after landing and the planetary EVA approximately 18–36 hours after landing. The CIPHER study will incorporate additional pre-flight sessions, longer EVA tasks that include traverse and geology sampling, and post-flight sessions on R+1, 4, and 8 to characterize the timeframe of recovery. Data collected for both tasks include task completion time, photo, and video. The EVA portion also includes collection of metabolic and heart rate. Pilot Egress Fitness study has completed both baseline and post-flight testing on four astronaut subjects, with all four able to complete post-flight EVA testing and three able to complete postflight capsule egress testing. Preliminary results observe individual physiological variations, which were to be expected but also suggest the need to carefully track the timeline from undock to landing to testing. Furthermore, some task performance instructions and equipment may need to be adjusted to ensure results are primarily physiological. These and other lessons learned will be addressed with minor protocol changes in the full CIPHER Egress Fitness study.

J R Norcross↗

NASA NTRS2004

Balanced Expertise Distribution in Remote Ultrasound Imaging Aboard The International Space Station (ISS)

Astronaut training for ISS operations usually ensures independent performance. With small crew size same crews also conduct all science work onboard. With diverse backgrounds, a good "match" between the existing and required skills can only be anecdotal. Furthermore, full proficiency in most of the complex tasks can be attained only through long training and practice, which may not be justified and may be impossible given the scarcity of training time. To enable a number of operational and science advancements, authors have developed a new approach to expertise distribution in time and among the space and ground personnel. Methods: As part of NASA Operational Ultrasound Project (1998-2003) and the NASA-solicited experiment "Advanced Diagnostic Ultrasound in Microgravity-ADUM" (P.I. -S.D., ongoing), the authors have created a "Balanced Expertise Distribution" approach to perform complex ultrasound imaging tasks on ISS for both operational and science use. The four components of expertise are a) any pre-existing pertinent expertise; b) limited preflight training c) adaptive onboard proficiency enhancement tools; d) real-time ' guidance from the ground. Throughout the pre-flight training and flight time preceding the experiments, the four components are shaped in a dynamic fashion to meet in an optimum combination during the experiment sessions. Results: Procedure validation sessions and feasibility studies have given encouraging results. While several successful real-time remote guidance sessions have been conducted on ISS, Expedition 8 is the first to use an "on-orbit proficiency enhancement" tool. Conclusions: In spite of severely limited training time, daring peer-reviewed research and operational enhancements are feasible through a balanced distribution of expertise in time, as well as among the crewmembers and ground personnel. This approach shows great promise for biomedical research, but may be applicable for other areas of micro gravity-based science

Sargsyan, Ashot↗

NASA NTRS2007

Filling the Assurance Gap on Complex Electronics

Many of the methods used to develop software bare a close resemblance to Complex Electronics (CE) development. CE are now programmed to perform tasks that were previously handled by software, such as communication protocols. For example, the James Webb Space Telescope will use Field Programmable Gate Arrays (FPGAs), which can have over a million logic gates, to send telemetry. System-on-chip (SoC) devices, another type of complex electronics, can combine a microprocessor, input and output channels, and sometimes an FPGA for programmability. With this increased intricacy, the possibility of software-like bugs such as incorrect design, logic, and unexpected interactions within the logic is great. Since CE devices are obscuring the hardware/software boundary, mature software methodologies have been proposed, with slight modifications, to develop these devices. By using standardized S/W Engineering methods such as checklists, missing requirements and bugs can be detected earlier in the development cycle, thus creating a development process for CE that can be easily maintained and configurable based on the device used.

Plastow, Richard A.↗

DOE OSTI2024

Hydrologic applicability of satellite-based precipitation estimates for irrigation water management in the data-scarce region

Reliable precipitation estimates are crucial for planning and managing water resources, monitoring hydrologic extremes, and fulfilling irrigation water requirements. Accurate precipitation estimates are particularly challenging in complex mountain terrains, where monitoring gauges are often sparsely distributed due to their remote locations, and high installation and long-term operation costs. Recent advances in satellite-based precipitation estimates offer promising opportunities to improve our understanding of hydrologic processes and their applications for irrigation water management. Several datasets are available varying considerably in terms of their data sources, quality control methods, estimation procedure, and spatiotemporal resolutions. Choosing the most suitable dataset for a particular application is a complex task. In this study, we (1) evaluate the performance of six satellite-based precipitation estimates (SPEs): i) CHIRPS v2.0, ii) CMORPH v1.0, iii) ERA5, iv) IMERG v6, v) MSWEP v2.8, and vi) PERSIANN-CDR against the gauge precipitation using continuous statistical and categorical indices, (2) integrate SPEs with a calibrated semi-distributed hydrologic model to predict streamflow, and (3) demonstrate practical implications of improved streamflow prediction for irrigation water management in the central Himalayan region, Nepal. Our results illustrate that satellite-based precipitation estimates have competitive performance in capturing a wide range of rainfall characteristics, with demonstrated variability across river basins and time scales. Further, there are no significant discrepancies observed in satellite-based precipitation estimates for estimating irrigation water requirements for the three major crops (maize, wheat, and paddy) during the cropping period across the selected river basins, showing a greater promise for irrigation water management planning and decision making.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Opportunities for retrieval and tool augmented large language models in scientific facilities

Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities’ users and accelerate scientific output.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1967

A review of quasi-linear pilot models.

Review of quasilinear pilot models

TASK COMPLEXITY↗

NASA NTRS1992

Fault detection and fault tolerance in robotics

Robots are used in inaccessible or hazardous environments in order to alleviate some of the time, cost and risk involved in preparing men to endure these conditions. In order to perform their expected tasks, the robots are often quite complex, thus increasing their potential for failures. If men must be sent into these environments to repair each component failure in the robot, the advantages of using the robot are quickly lost. Fault tolerant robots are needed which can effectively cope with failures and continue their tasks until repairs can be realistically scheduled. Before fault tolerant capabilities can be created, methods of detecting and pinpointing failures must be perfected. This paper develops a basic fault tree analysis of a robot in order to obtain a better understanding of where failures can occur and how they contribute to other failures in the robot. The resulting failure flow chart can also be used to analyze the resiliency of the robot in the presence of specific faults. By simulating robot failures and fault detection schemes, the problems involved in detecting failures for robots are explored in more depth.

Visinsky, Monica↗

NASA NTRS1995

An investigation of bleed configurations and their effect on shock wave/boundary layer interactions

The design of high efficiency supersonic inlets is a complex task involving the optimization of a number of performance parameters such as pressure recovery, spillage, drag, and exit distortion profile, over the flight Mach number range. Computational techniques must be capable of accurately simulating the physics of shock/boundary layer interactions, secondary corner flows, flow separation, and bleed if they are to be useful in the design. In particular, bleed and flow separation, play an important role in inlet unstart, and the associated pressure oscillations. Numerical simulations were conducted to investigate some of the basic physical phenomena associated with bleed in oblique shock wave boundary layer interactions that affect the inlet performance.

Hamed, Awatef↗

NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

reinforcement learning↗

NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗

NASA NTRS2012

Make Your Workflows Smarter

Do you have workflows with many manual tasks that slow down your business? Or, do you scale back workflows because there are simply too many manual tasks? Basic workflow robots can automate some common tasks, but not everything. This presentation will show how advanced robots called "expression robots" can be set up to perform everything from simple tasks such as: moving, creating folders, renaming, changing or creating an attribute, and revising, to more complex tasks like: creating a pdf, or even launching a session of Creo Parametric and performing a specific modeling task. Expression robots are able to utilize the Java API and Info*Engine to do almost anything you can imagine! Best of all, these tools are supported by PTC and will work with later releases of Windchill. Limited knowledge of Java, Info*Engine, and XML are required. The attendee will learn what task expression robots are capable of performing. The attendee will learn what is involved in setting up an expression robot. The attendee will gain a basic understanding of simple Info*Engine tasks

Jones, Corey↗

NASA NTRS1985

Predicted versus experienced workload and performance on a supervisory control task

The multitask simulation of a supervisory control system was examined in order to evaluate the ability of operators to predict the workload and performance impact of unfamiliar task features, using their basic knowledge and specific information provided before each scenario. Task difficulty and experienced workload were varied by manipulating the number of elements per task, the number of tasks, task schedule, and availability of task elements for performance. The results have indicated that an operator might correctly predict the workload of a realistically complex task if (1) he is familiar with the basic system, and (2) the design, functional requirements, and operational procedures of the proposed modifications are described clearly. He is less able to predict unfamiliar rate or schedule complexity manipulations for which timing is an important element.

Battiste, V.↗

NASA NTRS1985

Measuring pilot workload in a motion base trainer - A comparison of four techniques

Various techniques have been developed to predict and measure pilot workload. This simulation was conducted in order to compare four widely used methods: A visual two- and four-choice reaction time task, time production, retrospective multi-dimensional subjective ratings and in-flight verbal workload estimates. Two scenarios with different levels of difficulty determined by preliminary research were designed to test these techniques. The insertion of the secondary tasks did not significantly affect flight performance. All four techniques were able to distinguish among levels of scenario complexity. In addition, the three secondary tasks and workload ratings obtained in-flight were generally able to distinguish among levels of difficulty for different segments within the scenarios.

Bortolussi, M. R.↗