Search NASA⌕ Search

SEARCH · Search NASA

Results for “Workload Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Understanding the Interplay between Hardware Errors and User Job Characteristics on the Titan Supercomputer

Designing dependable supercomputers begins with an understanding of errors in real-world, large-scale systems. The Titan supercomputer at Oak Ridge National Laboratory provides a unique opportunity to investigate errors when an actual system is actively used by multiple concurrent users and workloads from diverse domains at varying scales. This study presents a thorough analysis of 6, 908, 497 hardware errors from 18, 688 compute nodes of Titan for 312, 215 user jobs over a 3-year time period. Through careful joining of two system logs – the Machine Check Architecture (MCA) log and the job scheduler log – we show the correlated pattern of hardware errors for each job and user, in addition to individual descriptive statistics of errors, jobs, and users. Since the majority of hardware errors are memory errors, this study also shows the importance of error correcting in memory systems.

Lim, Seung-Hwan↗
DOE OSTI2023

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Preparing for the deployment of large scientific and engineering codes on upcoming exascale systems with GPU-dense nodes is made challenging by the unprecedented diversity of device architectures and heterogeneous programming models. In this work, we evaluate the process of porting a massively parallel, fluid dynamics code written in CUDA to SYCL, HIP, and Kokkos with a range of backends, using a combination of automated tools and manual tuning. We use a proxy application along with a custom performance model to inform the results and identify additional optimization strategies. At scale performance of the programming model implementations are evaluated on pre-production GPU node architectures for Frontier and Aurora, as well as on current NVIDIA device-based systems Summit and Polaris. Real-world workloads representing 3D blood flow calculations in complex vasculature are assessed. Our analysis highlights critical trade-offs between code performance, portability, and development time.

Martin, Aristotle↗
NASA NTRS1973

A display evaluation methodology applied to vertical situation displays

An approach to display evaluation based on the optimal-control or state-variable model of the human operator is described. The approach evolved over the past several years, and is believed to have significant advantages for display evaluation. The foundations of the methodology are briefly described, and results are presented of its application to the analysis of vertical situation displays for STOL approach. This analysis includes the effects of both status and command displays on pilot workload and system performance.

Baron, S.↗
NASA NTRS1986

Fault latency in the memory - An experimental study on VAX 11/780

Fault latency is the time between the physical occurrence of a fault and its corruption of data, causing an error. The measure of this time is difficult to obtain because the time of occurrence of a fault and the exact moment of generation of an error are not known. This paper describes an experiment to accurately study the fault latency in the memory subsystem. The experiment employs real memory data from a VAX 11/780 at the University of Illinois. Fault latency distributions are generated for s-a-0 and s-a-1 permanent fault models. Results show that the mean fault latency of a s-a-0 fault is nearly 5 times that of the s-a-1 fault. Large variations in fault latency are found for different regions in memory. An analysis of a variance model to quantify the relative influence of various workload measures on the evaluated latency is also given.

Chillarege, Ram↗
NASA NTRS1992

Structured analysis and modeling of complex systems

The Aircrew Evaluation Sustained Operations Performance (AESOP) facility at Brooks AFB, Texas, combines the realism of an operational environment with the control of a research laboratory. In recent studies we collected extensive data from the Airborne Warning and Control Systems (AWACS) Weapons Directors subjected to high and low workload Defensive Counter Air Scenarios. A critical and complex task in this environment involves committing a friendly fighter against a hostile fighter. Structured Analysis and Design techniques and computer modeling systems were applied to this task as tools for analyzing subject performance and workload. This technology is being transferred to the Man-Systems Division of NASA Johnson Space Center for application to complex mission related tasks, such as manipulating the Shuttle grappler arm.

Strome, David R.↗
NASA NTRS2015

A Validated Task Analysis of the Single Pilot Operations Concept

The current day flight deck operational environment consists of a two-person Captain/First Officer crew. A concept of operations (ConOps) to reduce the commercial cockpit to a single pilot from the current two pilot crew is termed Single Pilot Operations (SPO). This concept has been under study by researchers in the Flight Deck Display Research Laboratory (FDDRL) at the National Aeronautics and Space Administration's (NASA) Ames (Johnson, Comerford, Lachter, Battiste, Feary, and Mogford, 2012) and researchers from Langley Research Centers (Schutte et al., 2007). Transitioning from a two pilot crew to a single pilot crew will undoubtedly require changes in operational procedures, crew coordination, use of automation, and in how the roles and responsibilities of the flight deck and ATC are conceptualized in order to maintain the high levels of safety expected of the US National Airspace System. These modifications will affect the roles and the subsequent tasks that are required of the various operators in the NextGen environment. The current report outlines the process taken to identify and document the tasks required by the crew according to a number of operational scenarios studied by the FDDRL between the years 2012-2014. A baseline task decomposition has been refined to represent the tasks consistent with a new set of entities, tasks, roles, and responsibilities being explored by the FDDRL as the move is made towards SPO. Information from Subject Matter Expert interviews, participation in FDDRL experimental design meetings, and study observation was used to populate and refine task sets that were developed as part of the SPO task analyses. The task analysis is based upon the proposed ConOps for the third FDDRL SPO study. This experiment possessed nine different entities operating in six scenarios using a variety of SPO-related automation and procedural activities required to guide safe and efficient aircraft operations. The task analysis presents the roles and responsibilities in a manner that can facilitate testing future scenarios. Measures of task count and workload were defined and analyzed to assess the impact of transitioning to a SPO environment.

task analysis↗
DOE OSTI2025

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns

Coupled AI-Simulation workflows are becoming the major workloads for HPC facilities, and their increasing complexity necessitates new tools for performance analysis and prototyping of new in-situ workflows. We present SimAI-Bench, a tool designed to both prototype and evaluate these coupled workflows. In this paper, we use SimAI-Bench to benchmark the data transport performance of two common patterns on the Aurora supercomputer: a one-to-one workflow with co-located simulation and AI training instances, and a many-to-one workflow where a single AI model is trained from an ensemble of simulations. For the one-to-one pattern, our analysis shows that node-local and DragonHPC data staging strategies provide excellent performance compared Redis and Lustre file system. For the many-to-one pattern, we find that data transport becomes a dominant bottleneck as the ensemble size grows. Our evaluation reveals that file system is the optimal solution among the tested strategies for the many-to-one pattern.

Tummalapalli, Harikrishna [Argonne National Labora↗
NASA NTRS1977

Statistical evaluation of control inputs and eye movements in the use of instruments clusters during aircraft landing

Two different types of analyses were done on data from a study in which eye movements and other variables were recorded while four pilots executed landing sequences in a Boeing 737 simulation. Various conditions were manupulated, including changes in turbulence, starting position, and instrumentation. Control inputs were analyzed in the context of the various conditions and compared against ratings of workload obtained using the Cooper-Harper scale. A number of eye-scanning measures including mean dwell time and transition from one instrument to another were entered into a principal components factor analysis. The results show a differentiation between control inputs and eye-scanning behavior. This shows the need for improved definition of workload and experiments to uncover the important differences among control inputs, eye-scanning and cognitive processes of the pilot.

Dick, A. O.↗
NASA NTRS1983

An analysis of the processing requirements of a complex perceptual-motor task

Current concerns in the assessment of mental workload are discussed, and the event-related brain potential (ERP) is introduced as a promising mental-workload index. Subjects participated in a series of studies in which they were required to perform a target acquisition task while also covertly counting either auditory or visual probes. The effects of several task-difficulty manipulations on the P300 component of the ERP elicited by the counted stimulus probes were investigated. With sufficiently practiced subjects the amplitude of the P300 was found to decrease with increases in task difficulty. The second experiment also provided evidence that the P300 is selectively sensitive to task-relevant attributes. A third experiment demonstrated a convergence in the amplitude of the P300s elicited in the simple and difficult versions of the tracking task. The amplitude of the P300 was also found to covary with the measures of tracking performance. The results of the series of three experiments illustrate the sensitivity of the P300 to the processing requirements of a complex target acquisition task. The findings are discussed in terms of the multidimensional nature of processing resources.

Kramer, A. F.↗
NASA NTRS1987

Measurement-based analysis of error latency

This paper demonstrates a practical methodology for the study of error latency under a real workload. The method is illustrated with sampled data on the physical memory activity, gathered by hardware instrumentation on a VAX 11/780 during the normal workload cycle of the installation. These data are used to simulate fault occurrence and to reconstruct the error discovery process in the system. The technique provides a means to study the system under different workloads and for multiple days. An approach to determine the percentage of undiscovered errors is also developed and a verification of the entire methodology is performed. This study finds that the mean error latency, in the memory containing the operating system, varies by a factor of 10 to 1 (in hours) between the low and high workloads. It is found that of all errors occurring within a day, 70 percent are detected in the same day, 82 percent within the following day, and 91 percent within the third day. The increase in failure rate due to latency is not so much a function of remaining errors but is dependent on whether or not there is a latent error.

Chillarege, Ram↗
NASA NTRS2010

Analysis of Different Cost Functions in the Geosect Airspace Partitioning Tool

A new cost function representing air traffic controller workload is implemented in the Geosect airspace partitioning tool. Geosect currently uses a combination of aircraft count and dwell time to select optimal airspace partitions that balance controller workload. This is referred to as the aircraft count/dwell time hybrid cost function. The new cost function is based on Simplified Dynamic Density, a measure of different aspects of air traffic controller workload. Three sectorizations are compared. These are the current sectorization, Geosect's sectorization based on the aircraft count/dwell time hybrid cost function, and Geosect s sectorization based on the Simplified Dynamic Density cost function. Each sectorization is evaluated for maximum and average workload along with workload balance using the Simplified Dynamic Density as the workload measure. In addition, the Airspace Concept Evaluation System, a nationwide air traffic simulator, is used to determine the capacity and delay incurred by each sectorization. The sectorization resulting from the Simplified Dynamic Density cost function had a lower maximum workload measure than the other sectorizations, and the sectorization based on the combination of aircraft count and dwell time did a better job of balancing workload and balancing capacity. However, the current sectorization had the lowest average workload, highest sector capacity, and the least system delay.

Wong, Gregory L.↗
DOE OSTI2021

Enabling discovery data science through cross-facility workflows

Experimental and observational instruments for scientific research (such as light sources, genome sequencers, accelerators, telescopes and electron microscopes) increasingly require High Performance Computing (HPC) scale capabilities for data analysis and workflow processing. Next-generation instruments are being deployed with higher resolutions and faster data capture rates, creating a big data crunch that cannot be handled by modest institutional computing resources. Often these big data analysis pipelines also require near real-time computing and have higher resilience requirements than the simulation and modeling workloads more traditionally seen at HPC centers. While some facilities have enabled workflows to run at a single HPC facility, there is a growing need to integrate capabilities across HPC facilities to enable cross-facility workflows, either to provide resilience to an experiment, increase analysis throughput capabilities, or to better match a workflow to a particular architecture. In this paper we describe the barriers to executing complex data analysis workflows across HPC facilities and propose an architectural design pattern for enabling scientific discovery using cross-facility workflows that includes orchestration services, application programming interfaces (APIs), data access and co-scheduling.

Antypas, Katerina B.↗
NASA NTRSDate not supplied

Evaluation of Initial and Mid-Term Air Traffic Procedures for Urban Air Mobility Operations

Urban air mobility (UAM) operations are expected to expand in scale over the next several years as novel aircraft types, including electric vertical takeoff and landing aircraft, are certified and begin operations. These new aircraft may increase safety, decrease noise, and lower operating costs compared with helicopters, allowing them to operate in ways existing aircraft do not. It is vital that these expanded operations are compatible with and do not disrupt existing operations or the air traffic management system. To study the ways in which scaled UAM operations can best integrate in the national airspace system, NASA and Joby Aviation partnered to conduct a high-fidelity air traffic controller-in-the-loop study. Building on air traffic procedures used to manage high tempo operations in other parts of the airspace, new procedures, routes, and communications protocols were developed and tested by retired controllers in NASA’s Future Flight Central tower simulation facility. In addition, new cooperative airspace constructs in the form of corridors were developed to understand their potential contributions to even greater scales of operation. The controllers managed traffic scenarios in the Dallas-Fort Worth and Dallas Love Field airports consisting of fleets of up to 100 UAM aircraft operating alongside traditional traffic . Metrics for air traffic controller workload, duration of communications, departure delays, and other measures of allowable aircraft throughput were collected. The analysis indicates that using today’s procedures for initial UAM operations under nominal conditions could enable up to 40 operations per hour to an airport’s central terminal area if that involved crossing a runway and up to 55operations per hour if reaching the central terminal did not involve crossing a runway. Operations at these tempos did not delay or otherwise interfere with simulated runway traffic and were rated acceptable by the air traffic controllers. The new corridor constructs dramatically lowered controller workload in certain circumstances, suggesting they may be effective in further increasing the allowable scale of operations.

Urban Air Mobility↗
NASA NTRSDate not supplied

Evaluation of Initial and Mid-Term Air Traffic Procedures for Urban Air Mobility

Urban air mobility (UAM) operations are expected to expand in scale over the next several years as novel aircraft types, including electric vertical takeoff and landing aircraft, are certified and begin operations. These new aircraft may increase safety, decrease noise, and lower operating costs compared with helicopters, allowing them to operate in ways existing aircraft do not. It is vital that these expanded operations are compatible with and do not disrupt existing operations or the air traffic management system. To study the ways in which scaled UAM operations can best integrate in the national airspace system, NASA and Joby Aviation partnered to conduct a high-fidelity air traffic controller-in-the-loop study. Building on air traffic procedures used to manage high tempo operations in other parts of the airspace, new procedures, routes, and communications protocols were developed and tested by retired controllers in NASA’s Future Flight Central tower simulation facility. In addition, new cooperative airspace constructs in the form of corridors were developed to understand their potential contributions to even greater scales of operation. The controllers managed traffic scenarios in the Dallas-Fort Worth and Dallas Love Field airports consisting of fleets of up to 100 UAM aircraft operating alongside traditional traffic. Metrics for air traffic controller workload, duration of communications, departure delays, and other measures of allowable aircraft throughput were collected. The analysis indicates that using today’s procedures for initial UAM operations under nominal conditions could enable up to 40 operations per hour to an airport’s central terminal area if that involved crossing a runway and up to 55 operations per hour if reaching the central terminal did not involve crossing a runway. Operations at these tempos did not delay or otherwise interfere with simulated runway traffic and were rated acceptable by the air traffic controllers. The new corridor constructs dramatically lowered controller workload in certain circumstances, suggesting they may be effective in further increasing the allowable scale of operations.

Advanced Air Mobility↗
NASA NTRS1986

Fault and Error Latency Under Real Workload: an Experimental Study

A practical methodology for the study of fault and error latency is demonstrated under a real workload. This is the first study that measures and quantifies the latency under real workload and fills a major gap in the current understanding of workload-failure relationships. The methodology is based on low level data gathered on a VAX 11/780 during the normal workload conditions of the installation. Fault occurrence is simulated on the data, and the error generation and discovery process is reconstructed to determine latency. The analysis proceeds to combine the low level activity data with high level machine performance data to yield a better understanding of the phenomena. A strong relationship exists between latency and workload and that relationship is quantified. The sampling and reconstruction techniques used are also validated. Error latency in the memory where the operating system resides was studied using data on the physical memory access. Fault latency in the paged section of memory was determined using data from physical memory scans. Error latency in the microcontrol store was studied using data on the microcode access and usage.

Chillarege, Ram↗
NASA NTRS1982

An optimal control model approach to the design of compensators for simulator delay

The effects of display delay on pilot performance and workload and of the design of the filters to ameliorate these effects were investigated. The optimal control model for pilot/vehicle analysis was used both to determine the potential delay effects and to design the compensators. The model was applied to a simple roll tracking task and to a complex hover task. The results confirm that even small delays can degrade performance and impose a workload penalty. A time-domain compensator designed by using the optimal control model directly appears capable of providing extensive compensation for these effects even in multi-input, multi-output problems.

Baron, S.↗
NASA NTRS1987

Prediction of physical workload in reduced gravity environments

The background, development, and application of a methodology to predict human energy expenditure and physical workload in low gravity environments, such as a Lunar or Martian base, is described. Based on a validated model to predict energy expenditures in Earth-based industrial jobs, the model relies on an elemental analysis of the proposed job. Because the job itself need not physically exist, many alternative job designs may be compared in their physical workload. The feasibility of using the model for prediction of low gravity work was evaluated by lowering body and load weights, while maintaining basal energy expenditure. Comparison of model results was made both with simulated low gravity energy expenditure studies and with reported Apollo 14 Lunar EVA expenditure. Prediction accuracy was very good for walking and for cart pulling on slopes less than 15 deg, but the model underpredicted the most difficult work conditions. This model was applied to example core sampling and facility construction jobs, as presently conceptualized for a Lunar or Martian base. Resultant energy expenditures and suggested work-rest cycles were well within the range of moderate work difficulty. Future model development requirements were also discussed.

Goldberg, Joseph H.↗
NASA NTRS1988

Prediction of physical workload in reduced gravity

The background, development, and application of a methodology to predict human energy expenditure and physical workload in low gravity environments, such as a Lunar or Martian base, is described. Based on a validated model to predict energy expenditures in earth-based industrial jobs, the model relies on an elemental analysis of the proposed job. Because the job itself need not physically exist, many alternative job designs may be compared in their physical workload. The feasibility of using the model for prediction of low gravity work was evaluated by lowering body and load weights, while maintaining basal energy expenditure. Comparison of model results was made both with simulated low gravity energy expendiure studies and with reported Apollo 14 Lunar EVA expenditure. Prediction accuracy was very good for walking and for cart pulling on slopes less than 15 deg, but the model underpredicted the most difficult work conditions. This model was applied to example core sampling and facility construction jobs, as presently conceptualized for a Lunar or Martian base. Resultant energy expenditures and suggested work-rest cycles were well within the range of moderate work difficulty. Future model development requirements were also discussed.

Goldberg, Joseph H.↗