Search NASA⌕ Search

SEARCH · Search NASA

Results for “workload”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Parallel Particle Advection Bake-Off for Scientific Visualization Workloads

There are multiple algorithms for parallelizing particle advection for scientific visualization workloads. While many previous studies have contributed to the understanding of individual algorithms, our study aims to provide a holistic understanding of how algorithms perform relative to each other on various workloads. To accomplish this, we consider four popular parallelization algorithms and run a “bake-off” study (i.e., an empirical study) to identify the best matches for each. The study includes 216 tests, going to a concurrency of up to 8192 cores and considering data sets as large as 34 billion cells with 300 million particles. Overall, our study informs three important research questions: (1) which parallelization algorithms perform best for a given workload?, (2) why?, and (3) what are the unsolved problems in parallel particle advection? In terms of findings, we find that the seeding box is the most important factor in choosing the best algorithm, and also that there is a significant opportunity for improvement in execution time, scalability, and efficiency.

Pugmire, Dave↗

Heart Rate Variability as a Measure of Airport Ramp-Traffic Controllers Workload

Heart Rate Variability (HRV) has been reported to reflect the person's cognitive and emotional stress levels, and may offer an objective measure of human-operator's workload levels, which are recorded continuously and unobtrusively to the task performance. The present paper compares the HRV data collected during a human-in-the-loop simulation of airport ramp-traffic control operations with the controller participants' own verbal self-reporting ratings of their workload.

workload↗

Evaluation of Performance, Fatigue and Workload during Real-time, Reactive Telerobotic Mission Control Operations

Telerobotic operations involve a user operating a robot from a different location from where the activity is taking place. It can be difficult for humans to maintain performance when faced with physiological stressors, such as fatigue or illness. Operations require vigilance for extended periods, raising safety concerns surrounding operator’s fatigue and workload. Every hour of wakefulness increases the drive to sleep, causing decreased reaction time (RT), increased lapses in attention (RT > 500 ms), and decreased memory capability. The NASA Task Load Index (NASA-TLX) was created to evaluate the multiple attributes surrounding workload (e.g., mental and physical demands). The upcoming Volatiles Investigating Polar Exploration Rover (VIPER) mission involves remotely controlling a lunar vehicle from an Earth-based mission control station. The goal of VIPER is to excavate the moon for volatiles (water) deep in the surface near the South Pole for a 100-day, continuous operation.

Fatigue↗

Predictive Model for Workload in Remote Operators During sUAS Contingency Scenarios

The increase in automated capabilities of small Uncrewed Aerial Systems (sUAS) has enabled the human operators to manage larger numbers of vehicles simultaneously. As this happens, the operational paradigm shifts to an m:N configuration where multiple operators (m) are managing multiple vehicles (N) together. However, many questions about how operators will interact with each other and share interaction across the vehicle pool are yet unanswered. Therefore, stakeholders from government and industry have partnered to develop ground control station concepts for such operations. The work presented in this paper aims to identify factors that contribute to operator workload. A supervised machine learning-based method built using Support Vector Machines and K-fold cross-validation was used to create workload prediction models for various NASA TLX subscales by leveraging features related to interactions and their relative timings during m:N operations. Results show that the models yielded fairly high predictive accuracies ranging from ~60-75%.

workload prediction↗

Early Evaluation of Fugaku A64FX Architecture Using Climate Workloads

The Energy Exascale Earth System Model (E3SM) Project is an ongoing, state-of-the-science Earth system modeling, simulation, and prediction project that targets efficient utilization of U.S. Department of Energy’s (DOE) supercomputers to meet the science needs of the nation and the mission needs of DOE. This work focuses on our early evaluation of the A64FX architecture on Fugaku supercomputer using E3SM benchmarks. We will present results that track hardware trends, facilitate architecture comparison and the specific impact on our workload using an atmospheric model benchmark. We have two variants of the code written in Fortran and C++/Kokkos respectively which were used to collect data on a variety of CPU and GPU platforms. Furthermore, we have conducted a comparative evaluation of the compilers on the A64FX architecture and found GNU to be the best performer for our workload. Our experience so far indicates that Fugaku/A64FX shows promising energy efficiency (performance/Watt) with further performance gains possible through architecture-aware optimization efforts.

Sreepathi, Sarat↗

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

The power & energy demands of HPC machines have grown significantly. Modern exascale HPC systems require tens of megawatts of combined power for computing resources and cooling facilities at full capacity. The current energy trend is not sustainable for future HPC systems, and there is a need to work toward the energy efficiency aspect of HPC performance. Energy awareness of the HPC applications at the job level is essential for running an efficient HPC system. This work aims to develop a pipeline to provide a production-level system-wide overview of the HPC workloads' power profile while handling evolving workloads exhibiting new power trends. We developed an open-set classification model for HPC jobs based on the properties of power profiles to continuously provide a system-wide holistic view of recently completed jobs. The pipeline helps continuously monitor the job-level power usage pattern of HPC and enables us to capture the new trends in applications' power behavior. We employed a comprehensive set of techniques to generate job-level data, custom-designed feature extraction methods to extract critical features from jobs' power profiles, clustering techniques powered by generative modeling, and open-set classification for identifying job profiles into known classes or an unknown set. With extensive evaluations, we demonstrate the effectiveness of each component in our pipeline. We provide an analysis of the resulting clusters that characterize the power profile landscape of the Summit supercomputer from more than 60K jobs executed in a year. The open-set classification classifies the known data sets into known classes with high accuracy and identifies unknown data noints with over 85% accuracy.

Karimi, Ahmad Maroof↗

SU-F-T-101: Insight into Dosimetry Workload and Planning Timelines: A 6 Year Review at One Institution

Purpose: To elucidate realistic clinical treatment planning workload and timelines to improve understanding for patients, payers, and other institutions involved in radiotherapy processes. Methods: A web based tool was developed using Oracle Express (Oracle Corp, Redwood City, CA) which allowed communication between the physicians and staff about the current state of the patient plan. For 6 years, all patient courses were logged and time-stamped in 22 discreet steps which detailed start and stop times for simulation, contouring, and treatment planning tasks. This data was combined with the treatment planning database (TPDB) using the Eclipse Scripting API (Varian Medical Systems, Palo Alto, CA) to cross-identify plans between the two systems. This time data was analyzed across our dosimetry staff and treatment modality. Results: In 6 years, 110,477 patient statuses were time-logged for 9683 courses of treatment using our internal software. The courses contained 8305 unique patients who were binned into one of 11 diagnosis site categories. 8253 courses could be reconciled against the TPDB using timestamp data from patient statuses. The average planning volume per dosimetrist was 375.8 ± 142.4 plans per year with the average number of planning revisions per dosimetrist of 71.0 ± 27.1 plans per year. The median treatment planning times by modality ranged from to 48.3 hours for IMRT plans 5 fields or less to 119.6 hours for IMRT with 8 or more fields. Two arc VMAT, three arc VMAT, and 3D plans median times were 89.1 hours, 113.8 hours, and 50.9 hours respectively. Conclusion: Using our web based tool, we have demonstrated the ability to quantify treatment planning timelines and workloads which could help in setting appropriate expectations for patients, payers, and hospital administration. COI: Author received monies from Varian Medical Systems for research and teaching honorarium.

60 APPLIED LIFE SCIENCES↗

Comparative I/O workload characterization of two leadership class storage clusters. In: PDSW '15 Proceedings of the 10th Parallel Data Storage Workshop

The Oak Ridge Leadership Computing Facility (OLCF) is a leader in large-scale parallel file system development, design, deployment and continuous operation. For the last decade, the OLCF has designed and deployed two large center-wide parallel file systems. The first instantiation, Spider 1, served the Jaguar supercomputer and its predecessor, Spider 2, now serves the Titan supercomputer, among many other OLCF computational resources. The OLCF has been rigorously collecting file and storage system statistics from these Spider systems since their transition to production state. In this paper we present the collected I/O workload statistics from the Spider 2 system and compare it to the Spider 1 data. Our analysis show that the Spider 2 workload is more more write-heavy I/O compared to Spider 1 (75% vs. 60%, respectively). The data also show the OLCF storage policies such as periodic purges are effectively managing the capacity resource of Spider 2. Furthermore, due to improvements in tdm_multipath and ib_srp software, we are utilizing the Spider 2 system bandwidth and latency resources more effectively. The Spider 2 bandwidth usage statistics shows that our system is working within the design specifications. However, it is also evident that our scientific applications can be more effectively served by a burst buffer storage layer. All the data has been collected by monitoring tools developed for the Spider ecosystem. We believe the observed data set and insights will help us better design the next-generation Spider file and storage system. It will also be helpful to the larger community for building more effective large-scale file and storage systems.

Gunasekaran, Raghul↗

Tuyere: Enabling Scalable Memory Workloads for System Exploration

Memory technologies are under active development. Meanwhile, workloads on contemporary computing systems are increasing rapidly in size and diversity. Such dynamics in hardware and software further widen the gap between memory system design and performance evaluation. In this work, we propose a data-centric abstraction of high-performance computing applications for fast exploration of new memory technologies. We also provide a framework that uses a formal modeling language to describe the abstraction, automatically translates abstractions into memory traffic, and directly interfaces with cycle-accurate simulators. We evaluated the framework using 20 workloads and validated the memory traffic profile, the simulation results, and the relative memory changes of four memory technologies. Our results show that the data-centric abstraction can accurately capture application behavior adaptable to different input problems and can expedite system exploration.

Peng, Ivy Bo↗

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗

FY17 CSSE L2 Milestone Report: Analyzing Power Usage Characteristics of Workloads Running on Trinity.

This report summarizes the work performed as part of a FY17 CSSE L2 milestone to in- vestigate the power usage behavior of ASC workloads running on the ATS-1 Trinity plat- form. Techniques were developed to instrument application code regions of interest using the Power API together with the Kokkos profiling interface and Caliper annotation library. Experiments were performed to understand the power usage behavior of mini-applications and the SNL/ATDM SPARC application running on ATS-1 Trinity Haswell and Knights Landing compute nodes. A taxonomy of power measurement approaches was identified and presented, providing a guide for application developers to follow. Controlled scaling study experiments were performed on up to 2048 nodes of Trinity along with smaller scale ex- periments on Trinity testbed systems. Additionally, power and energy system monitoring information from Trinity was collected and archived for post analysis of "in-the-wild" work- loads. Results were analyzed to assess the sensitivity of the workloads to ATS-1 compute node type (Haswell vs. Knights Landing), CPU frequency control, node-level power capping control, OpenMP configuration, Knights Landing on-package memory configuration, and algorithm/solver configuration. Overall, this milestone lays groundwork for addressing the long-term goal of determining how to best use and operate future ASC platforms to achieve the greatest benefit subject to a constrained power budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Performance Analysis of Scientific Computing Workloads on Trusted Execution Environments

Scientific computing sometimes involves computation on sensitive data. Depending on the data and the execution environment, the HPC (high-performance computing) user or data provider may require confidentiality and/or integrity guarantees. To study the applicability of hardware-based trusted execution environments (TEEs) to enable secure scientific computing, we deeply analyze the performance impact of AMD SEV and Intel SGX for diverse HPC benchmarks including traditional scientific computing, machine learning, graph analytics, and emerging scientific computing workloads. We observe three main findings: 1) SEV requires careful memory placement on large scale NUMA machines (1x -3.4x slowdown without and 1x -1.15x slowdown with NUMA aware placement), 2) virtualization - a prerequisite for SEV - results in performance degradation for workloads with irregular memory accesses and large working sets (1x -4x slowdown compared to native execution for graph applications) and 3) SGX is inappropriate for HPC given its limited secure memory size and inflexible programming model (1.2x -126x slowdown over unsecure execution). Finally, we discuss forthcoming new TEE designs and their potential impact on scientific computing.

97 MATHEMATICS AND COMPUTING↗

Evaluating the Cloud for Capability Class Leadership Workloads

Cloud platforms offer a variety of benefits that are very appealing for a large scale HPC facility with a diverse and dynamic user base and workload set. At the same time, there is cause for concern about transitioning to the cloud. Incorporating cloud resources into existing HPC facilities or even fully transitioning to a cloud deployment poses significant challenges at the technical, organizational, and economic levels. Regardless, based on current trends it is highly likely that cloud platforms will become an integral component of many HPC centers in some form. To gain a better understanding of both the limitations and capabilities of current cloud infrastructures we evaluated the public offerings of the three leading cloud platforms (Amazon Web Services, Microsoft Azure, and Google Cloud Platform) using a selection of representative application workloads from our facility. Our findings show that while current HPC offerings are still nascent, significant progress is being made to address the present shortcomings. At the same time, significant challenges and questions remain about whether HPC cloud offerings will be able to deliver the full range of expected benefits.

97 MATHEMATICS AND COMPUTING↗

Modeling Workloads of a Linear Electromagnetic Code for Load Balancing Matrix Assembly

This report presents our work to model the workloads of a linear electromagnetic application based on the method of moments in the frequency domain to effectively load balance the matrix assembly. This application is particularly challenging to load balance due to its lack of persistent iterative behavior, its operation under tight memory constraint (where the matrix may fill 80% of memory on each node), and the algorithmic complexity of the computational method. This report describes the first step in our work to apply an inspector-executor approach for load balancing workloads where key parameters are exposed during the inspector phase and a pre-trained model is applied to predict relative task weights for the load balancer.

97 MATHEMATICS AND COMPUTING↗

A direct procedure for partitioning scanning workload in control display system design

Experimental eye scanning measurements were made from simulated instrument approaches in a flight-like cockpit representing a contemporary jet transport. The procedure for predicting the partition of the pilot's scanning workload required for monitoring and controlling a task with status displays and a flight director was simplified. When there is but a single director control display, iteration in the preliminary design computations is eliminated. The preliminary design computations are based on predictions of closed-loop input-correlated errors in displayed variables with respect to the trimmed flight values. Methods for predicting multiloop error coherence, and for correcting the predicted partition of scanning workload when the pilot's scanning remnant contribution is significant are included.

Clement, W. F.↗

Verbal Workload in Distributed Air Traffic Management

The effects of alternative traffic management possibilities on task performance and pilot controller verbal workloads were studied. Two new rule structures - sequencing and advisory - in addition to vectoring were studied in conjunction with CRT pilot displays incorporating traffic situation displays with and without aircraft flight path predictors. The sequencing and advisory systems gave increasing control responsibility to the pilots. It was concluded that distributed management systems could in practice significantly reduce controller verbal workload without reducing system performance. Implications of this conclusion suggest that distributed management would allow controllers to handle a larger volume of traffic safely either as a normal operating procedure or as a failure mode alternative in a highly automated ground centered system.

Kreifeldt, J. G.↗

An investigation of correlation between pilot scanning behavior and workload using stepwise regression analysis

An electro-optical device called an oculometer which tracks a subject's lookpoint as a time function has been used to collect data in a real-time simulation study of instrument landing system (ILS) approaches. The data describing the scanning behavior of a pilot during the instrument approaches have been analyzed by use of a stepwise regression analysis technique. A statistically significant correlation between pilot workload, as indicated by pilot ratings, and scanning behavior has been established. In addition, it was demonstrated that parameters derived from the scanning behavior data can be combined in a mathematical equation to provide a good representation of pilot workload.

Waller, M. C.↗