Search NASA⌕ Search

SEARCH · Search NASA

Results for “Workload Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Performance Analysis and Optimization for Scientific Data Workloads

Scientific data generated at experimental and observational facilities are increasingly being processed on large-scale compute systems. Most of the experimental data analysis workflows are not designed or implemented to run on large scale environments and take full advantage of HPC compute and storage resources. These applications are unlike the traditional tightly-coupled scientific applications and hence face significant performance and scalability challenges as the volume of data increases exponentially. In this paper, we conduct a performance and scalability analysis for experimental analysis applications and workflows operating on data from light sources. Our analysis detects and quantifies I/O performance, scalability and runtime bottlenecks for three data analysis applications that run on NERSC resources. Based on our analysis we propose and implement a set of optimizations that lead to reducing the amount of time spent on I/O operations by almost 90%.

97 MATHEMATICS AND COMPUTING↗

Voice measures of workload in the advanced flight deck

Voice samples were obtained from 14 male subjects under high and low workload conditions. Acoustical analysis of the voice suggested that high workload conditions can be revealed by their effects on the voice over time. Aircrews in the advanced flight deck will be voicing short, imperative sentences repeatedly. A drop in the energy of the voice, as reflected by reductions in amplitude and frequency over time, and the failure to achieve old amplitude and frequency levels after rest periods, can signal that the workload demands of the situation are straining the speaker. This kind of measurement would be relatively unaffected by individual differences in acoustical measures.

Schneider, Sid J.↗

Cardiovascular group

As a starting point, the group defined a primary goal of maintaining in flight a level of systemic oxygen transport capacity comparable to each individual's preflight upright baseline. The goal of maintaining capacity at preflight levels would seem to be a reasonable objective for several different reasons, including the maintenance of good health in general and the preservation of sufficient cardiovascular reserve capacity to meet operational demands. It is also important not to introduce confounding variables in whatever other physiological studies are being performed. A change in the level of fitness is likely to be a significant confounding variable in the study of many organ systems. The principal component of the in-flight cardiovascular exercise program should be large-muscle activity such as treadmill exercise. It is desirable that at least one session per week be monitored to assure maintenance of proper functional levels and to provide guidance for any adjustments of the exercise prescription. Appropriate measurements include evaluation of the heart-rate/workload or the heart-rate/oxygen-uptake relationship. Respiratory gas analysis is helpful by providing better opportunities to document relative workload levels from analysis of the interrelationships among VO2, VCO2, and ventilation. The committee felt that there is no clear evidence that any particular in-flight exercise regimen is protective against orthostatic hypotension during the early readaptation phase. Some group members suggested that maintenance of the lower body muscle mass and muscle tone may be helpful. There is also evidence that late in-flight interventions to reexpand blood volume to preflight levels are helpful in preventing or minimizing postflight orthostatic hypotension.

Blomqvist, Gunnar↗

SHAPA: An interactive software tool for protocol analysis applied to aircrew communications and workload

As modern transport environments become increasingly complex, issues such as crew communication, interaction with automation, and workload management have become crucial. Much research is being focused on holistic aspects of social and cognitive behavior, such as the strategies used to handle workload, the flow of information, the scheduling of tasks, the verbal and non-verbal interactions between crew members. Traditional laboratory performance measures no longer sufficiently meet the needs of researchers addressing these issues. However observational techniques are better equipped to capture the type of data needed and to build models of the requisite level of sophistication. Presented here is SHAPA, an interactive software tool for performing both verbal and non-verbal protocol analysis. It has been developed with the idea of affording the researchers the closest possible degree of engagement with protocol data. The researcher can configure SHAPA to encode protocols using any theoretical framework or encoding vocabulary that is desired. SHAPA allows protocol analysis to be performed at any level of analysis, and it supplies a wide variety of tools for data aggregation, manipulation. The output generated by SHAPA can be used alone or in combination with other performance variables to get a rich picture of the influences on sequences of verbal or nonverbal behavior.

James, Jeffrey M.↗

Effect of Dynamic Sector Boundary Changes on Air Traffic Controllers

The effect of dynamic sector boundary changes on air traffic controller workload was investigated with data from a human-in-the-loop simulation. Multiple boundary changes were made during simulated operations, and controller rating of workload was recorded. Analysis of these data showed an increase of 16.9% in controller workload due to boundary changes. This increased workload was correlated with the number of aircraft handoffs and change in sector volume. There was also a 12.7% increase in average workload due to the changed sector design after boundary changes. This increase was correlated to traffic flow crossing points getting closer to sector boundaries and an increase in the number of flights with short dwell time in a sector. This study has identified some of the factors that affect controller workload when sector boundaries are changed, but more research is needed to better understand their relationships.

Jung, Jaewoo↗

An Analysis of Grid Operator Survey Responses: Inexperience, Workload and Fatigue in the Control Room

Although a wide array of tools and technologies have been developed over the last decade to support power grid operators, deployment of these tools has been less successful. One reason for unsuccessful deployment may be an inadequate understanding of the factors that contribute to operator error in the control room. An analysis of operators’ current vulnerabilities may provide the baseline understanding needed to inform new technology integration. In an attempt to learn more about these vulnerabilities and their perceived impact on human error we collected and analyzed survey data from 20 electric grid control room operators. We asked survey respondents to consider the various operator, technology and interaction vulnerabilities that may arise during work in the control room and record their attitudes and experiences toward each. Results suggest operator inexperience, high mental workload and fatigue are the most common vulnerabilities experienced during a shift. Survey results were analyzed to explore these vulnerabilities in greater depth.

Inexperience, Workload, Fatigue↗

Quantum Computing Technology Roadmaps and Capability Assessment for Scientific Computing - An analysis of use cases from the NERSC workload

The National Energy Research Scientific Computing Center (NERSC), as the high-performance computing (HPC) facility for the Department of Energy’s Office of Science, recognizes the essential role of quantum computing in its future mission. In this report, we analyze the NERSC workload and identify materials science, quantum chemistry, and high-energy physics as the science domains and application areas that stand to benefit most from quantum computers. These domains jointly make up over 50% of the current NERSC production workload, which is illustrative of the impact quantum computing could have on NERSC’s mission going forward. We perform an extensive literature review and determine the quantum resources required to solve classically intractable problems within these science domains. This review also shows that the quantum resources required have consistently decreased over time due to algorithmic improvements and a deeper understanding of the problems. At the same time, public technology roadmaps from a collection of ten quantum computing companies predict a dramatic increase in capabilities over the next five to ten years. Our analysis reveals a significant overlap emerging in this time frame between the technological capabilities and the algorithmic requirements in these three scientific domains. We anticipate that the execution time of large-scale quantum workflows will become a major performance parameter and propose a simple metric, the Sustained Quantum System Performance (SQSP), to compare system-level performance and throughput for a heterogeneous workload.

97 MATHEMATICS AND COMPUTING↗

Pilot workload and fatigue: A critical survey of concepts and assessment techniques

The principal unresolved issues in conceptualizing and measuring pilot workload and fatigue are discussed. These issues are seen as limiting the development of more useful working concepts and techniques and their application to systems engineering and management activities. A conceptual analysis of pilot workload and fatigue, an overview and critique of approaches to the assessment of these phenomena, and a discussion of current trends in the management of unwanted workload and fatigue effects are presented. Refinements and innovations in assessment methods are recommended for enhancing the practical significance of workload and fatigue studies.

Gartner, W. B.↗

Performance Analysis of the NAS Y-MP Workload

This paper describes the performance characteristics of the computational workloads on the NAS Cray Y-MP machines, a Y-MP 832 and later a Y-MP 8128. Hardware measurements indicated that the Y-MP workload performance matured over time, ultimately sustaining an average throughput of 0.8 GFLOPS and a vector operation fraction of 87%. The measurements also revealed an operation rate exceeding 1 per clock period, a well-balanced architecture featuring a strong utilization of vector functional units, and an efficient memory organization. Introduction of the larger memory 8128 increased throughput by allowing a more efficient utilization of CPUs. Throughput also depended on the metering of the batch queues; low-idle Saturday workloads required a buffer of small jobs to prevent memory starvation of the CPU. UNICOS required about 7% of total CPU time to service the 832 workloads; this overhead decreased to 5% for the 8128 workloads. While most of the system time went to service I/O requests, efficient scheduling prevented excessive idle due to I/O wait. System measurements disclosed no obvious bottlenecks in the response of the machine and UNICOS to the workloads. In most cases, Cray-provided software tools were- quite sufficient for measuring the performance of both the machine and operating, system.

Bergeron, Robert J.↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

The effects of participatory mode and task workload on the detection of dynamic system failures

The ability of operators to detect step changes in the dynamics of control systems is investigated as a joint function of, (1) participatory mode: whether subjects are actively controlling those dynamics or are monitoring an autopilot controlling them, and (2) concurrent task workload. A theoretical analysis of detection in the two modes identifies factors that will favor detection in either mode. Three subjects detected system failures in either an autopilot or manual controlling mode, under single-task conditions and concurrently with a subcritical tracking task. Latency and accuracy of detection were assessed and related through a speed accuracy tradeoff representation. It was concluded that failure detection performance was better during manual control than during autopilot control, and that the extent of this superiority was enhanced as dual-task load increased. Ensemble averaging and multiple regression techniques were then employed to investigate the cues utilized by the subjects in making their detection decisions.

Wickens, C. D.↗

Feasibility study for ergonomic analysis and design of future helicopter cockpit systems

The Army's light scout-attack helicopters (LHXs), planned for deployment in the 1990's, will fly nap-of-the-earth (NOE) missions in high threat environments, often under poor visibility and adverse atmospheric conditions, and probably with a one man crew. A procedure for the analysis of pilot workload that will identify and explicate the main characteristics of those LHX mission components holding overload potential is described. A principled, in-depth, explication of the cognitive demans of LHX piloting is essential to any effective effort to address the human factors issues. A task-analytic procedure that will yield the detail and organizstion needed to achieve these goals is examined.

Hawkins, H. L.↗

Individual differences in strategic flight management and scheduling

A group of 30 instrument-rated pilots was made to fly simulator approaches to three airports under conditions of low, medium, and high workload conditions. An analysis is presently conducted of the difference in discrete task scheduling between the group of 10 highest and 10 lowest performing pilots in the sample; this categorization was based on the mean of various flight-profile measures. The two groups were found to differ from each other only in terms of the time when specific events were conducted, and of the optimality of scheduling for certain high-priority tasks. These results are assessed in view of the relative independence of task-management skills from aircraft-control skills.

Wickens, Christopher D.↗

Traffic Aware Planner (TAP) Flight Evaluation

NASA's Traffic Aware Planner (TAP) is a cockpit decision support tool that has the potential to achieve significant fuel and time savings when it is embedded in the data-rich Next Generation Air Transportation System (NextGen) airspace. To address a key step towards the operational deployment of TAP and the NASA concept of Traffic Aware Strategic Aircrew Requests (TASAR), a system evaluation was conducted in a representative flight environment in November, 2013. Numerous challenges were overcome to achieve this goal, including the porting of the foundational Autonomous Operations Planner (AOP) software from its original simulation-based, avionics-embedded environment to an Electronic Flight Bag (EFB) platform. A flight-test aircraft was modified to host the EFB, the TAP application, an Automatic Dependent Surveillance Broadcast (ADS-B) processor, and a satellite broadband datalink. Nine Evaluation Pilots conducted 26 hours of TAP assessments using four route profiles in the complex eastern and north-eastern United States airspace. Extensive avionics and video data were collected, supplemented by comprehensive inflight and post-flight questionnaires. TAP was verified to function properly in the live avionics and ADS-B environment, characterized by recorded data dropouts, latency, and ADS-B message fluctuations. Twelve TAP-generated optimization requests were submitted to ATC, of which nine were approved, and all of which resulted in fuel and/or time savings. Analysis of subjective workload data indicated that pilot interaction with TAP during flight operations did not induce additional cognitive loading. Additionally, analyses of post-flight questionnaire data showed that the pilots perceived TAP to be useful, understandable, intuitive, and easy to use. All program objectives were met, and the next phase of TAP development and evaluations with partner airlines is in planning for 2015.

Maris, John M.↗

Twentieth Annual Conference on Manual Control, Volume 2

Volume II contains thirty two complete manuscripts and five abstracts. The topics covered include the application of event-related brain potential analysis to operational problems, the subjective evaluation of workload, mental models, training, crew interaction analysis, multiple task performance, and the measurement of workload and performance in simulation.

Hart, S. G.↗

Brain-wave measures of workload in advanced cockpits: The transition of technology from laboratory to cockpit simulator, phase 2

The present Phase 2 small business innovation research study was designed to address issues related to scalp-recorded event-related potential (ERP) indices of mental workload and to transition this technology from the laboratory to cockpit simulator environments for use as a systems engineering tool. The project involved five main tasks: (1) Two laboratory studies confirmed the generality of the ERP indices of workload obtained in the Phase 1 study and revealed two additional ERP components related to workload. (2) A task analysis' of flight scenarios and pilot tasks in the Advanced Concepts Flight Simulator (ACFS) defined cockpit events (i.e., displays, messages, alarms) that would be expected to elicit ERPs related to workload. (3) Software was developed to support ERP data analysis. An existing ARD-proprietary package of ERP data analysis routines was upgraded, new graphics routines were developed to enhance interactive data analysis, and routines were developed to compare alternative single-trial analysis techniques using simulated ERP data. (4) Working in conjunction with NASA Langley research scientists and simulator engineers, preparations were made for an ACFS validation study of ERP measures of workload. (5) A design specification was developed for a general purpose, computerized, workload assessment system that can function in simulators such as the ACFS.

Horst, Richard L.↗

Crew procedures for microwave landing system operations

The objective of this study was to identify crew procedures involved in Microwave Landing System (MLS) operations and to obtain a preliminary assessment of crew workload. The crew procedures were identified for three different complements of airborne equipment coupled to an autopilot. Using these three equipment complements, crew tasks were identified for MLS approaches and precision departures and compared to an ILS approach and a normal departure. Workload comparisons between the approaches and departures were made by using a task-timeline analysis program that obtained workload indexes, i.e., the radio of time required to complete the tasks to the time available. The results showed an increase in workload for the MLS scenario for one of the equipment complements. However, even this workload was within the capacity of two crew members.

Summers, Leland G.↗

Inflight evaluation of four measures of pilot workload

Four measures of pilot workload were tested in the NASA C-141 Kuiper Airborne Observatory. The measured included a communications analysis, subjective ratings of workload, subjective ratings of additional factors related to workload, and heart rate. Data were collected for 11 flights, each of which lasted approximately seven hours. Heart rate was found to be significantly higher for the pilot who was flying than for the pilot who was not flying and it varied significantly across flight segments, peaking during landing and take off, particularly for the pilot in the left seat who was resonsible for aircraft control. For both left and right seats, the subjective assessment of stress rather than the subjective assessment of workload was significantly correlated with variation in heart rate. Frequencies of different types of communications varied significantly across segments of flight, however, they were not correlated with subjective ratings of workload. There was a significant difference between the left and right seats in the types of activities that contributed to their workload, however, workload was considered to be equivalent for the two.

Hart, S. G.↗