Search NASA⌕ Search

SEARCH · Search NASA

Results for “Workload”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

DRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing

Cluster schedulers are crucial in high-performance computing (HPC). They determine when and which user jobs should be allocated to available system resources. Existing cluster scheduling heuristics are developed by human experts based on their experience with specific HPC systems and workloads. However, the increasing complexity of computing systems and the highly dynamic nature of application workloads have placed tremendous burden on manually designed and tuned scheduling heuristics. More aggressive optimization and automation are needed for cluster scheduling in HPC. In this work, we present an automated HPC scheduling agent named DRAS (Deep Reinforcement Agent for Scheduling) by leveraging deep reinforcement learning. DRAS is built on a hierarchical neural network incorporating special HPC scheduling features such as resource reservation and backfilling. An efficient training strategy is presented to enable DRAS to rapidly learn the target environment. Once being provided a specific scheduling objective given by the system manager, DRAS automatically learns to improve its policy through interaction with the scheduling environment and dynamically adjusts its policy as workload changes. We implement DRAS into a HPC scheduling platform called CQGym. CQGym provides a common platform allowing users to flexibly evaluate DRAS and other scheduling methods such as heuristic and optimization methods. Furthermore, the experiments using CQGym with different production workloads demonstrate that DRAS outperforms the existing heuristic and optimization approaches by up to 50%.

97 MATHEMATICS AND COMPUTING↗

Scatter radiation intensities around a clinical digital breast tomosynthesis unit and the impact on radiation shielding considerations

Purpose: To measure the scattered radiation intensity around a clinical digital breast tomosynthesis (DBT) unit and to provide updated data for radiation shielding design for DBT systems with tungsten-anode x-ray tubes. Methods: The continuous distribution of scattered x-rays from a clinical DBT system (Hologic Selenia Dimensions) was measured within an angular range of 0°–180° using a linear-array x-ray detector (X-Scan 0.8f3-512, Detection Technology, Inc., Finland), which was calibrated for the x-ray spectrum range of the DBT unit. The effects of x-ray field size, phantom size, and x-ray kVp/filter combination were investigated. Following a previously developed methodology by Simpkin, scatter fraction was determined for the DBT system as a function of angle around the phantom center. Detailed calculations of the scatter intensity from a DBT system were demonstrated using the measured scatter fraction data. Results: For the 30 and 35 kVp acquisition, the scatter-to-primary-ratio and scatter fraction data closely matched with data previously measured by Simpkin. However, the measured data from this study demonstrated the nonisotropic distribution of the scattered radiation around a DBT system, with two strong peaks around 25° and 160°. The majority scatter radiation (>70%) originated from the imaging detector assembly, instead of the phantom. With a workload from a previous survey performed at MGH, the scatter air kerma at 1 m from the phantom center for wall/door is 1.76 × 10{sup −2} mGy patient{sup −1}, for floor is 1.64 × 10{sup −1} mGy patient{sup −1}, and for ceiling is 3.66 × 10{sup −2} mGy patient{sup −1}. Conclusions: Comparing to previously measured data for mammographic systems, the scatter air kerma from Holgoic DBT is at least two times higher. The main reasons include the harder primary beam with higher workload (measured with total mAs/week), added tomosynthesis acquisition, and strong small angle forward scattering. Due to the highly conservative initial assumptions, the shielding recommendation from NCRP Report 147 is still sufficient for the Hologic DBT system given the workload from a previous survey at MGH. With the data provided from this study, accurate shielding calculation can be performed for Hologic DBT systems with specific workload and barrier distance.

61 RADIATION PROTECTION AND DOSIMETRY↗

WE-DE-207B-09: Scatter Radiation Measurement From a Digital Breast Tomosynthesis System and Its Impact On Shielding Consideration

Purpose: To accurately measure the scatter radiation from a Hologic digital breast tomosynthesis (DBT) system and to provide updated scatter distribution to guide radiation shielding calculation for DBT rooms. Methods: A high sensitivity GOS-based linear detector was used to measure the angular distribution of scatter radiation from a Hologic Selenia Dimensions DBT system. The linear detector was calibrated for its energy response of typical DBT spectra. Following the NCRP147 approach, the measured scatter intensity was normalized by the primary beam area and primary air kerma at 1m from the scatter phantom center and presented as the scatter fraction. Direct comparison was made against Simpkin’s initial measurement. Key parameters including the phantom size, primary beam area, and kV/anode/target combination were also studied. Results: The measured scatter-to-primary-ratio and scatter fraction data closely matched with previous data from Simpkin. The measured data demonstrated the unique nonisotropic distribution of the scattered radiation around a Hologic DBT system, with two strong peaks around 25° and 160°. The majority scatter radiation (>70%) originated from the imaging detector assembly, instead of the phantom. With a workload from a previous local survey, the scatter air kerma at 1m from the phantom center for wall/door is 0.018mGy/patient, for floor is 0.164mGy/patient, and for ceiling is 0.037mGy/patient. Conclusion: Comparing to Simpkin’s previous data, the scatter air kerma from Holgoic DBT is at least two times higher. The main reasons include the harder primary beam with higher workload, added tomosynthesis acquisition, and strong small angle forward scattering. Due to the highly conservative initial assumptions, the shielding recommendation from NCRP147 is still sufficient for the Hologic DBT system given the workload from a previous local survey. With the data provided from this study, accurate shielding calculation can be performed for Hologic DBT systems with specific workload and barrier distance.

60 APPLIED LIFE SCIENCES↗

Distributed caching for processing raw arrays

As applications continue to generate multi-dimensional data at exponentially increasing rates, fast analytics to extract meaningful results is becoming extremely important. The database community has developed array databases that alleviate this problem through a series of techniques. In-situ mechanisms provide direct access to raw data in the original format---without loading and partitioning. Parallel processing scales to the largest datasets. In-memory caching reduces latency when the same data are accessed across a workload of queries. However, we are not aware of any work on distributed caching of multi-dimensional raw arrays. In this paper, we introduce a distributed framework for cost-based caching of multi-dimensional arrays in native format. Given a set of files that contain portions of an array and an online query workload, the framework computes an effective caching plan in two stages. First, the plan identifies the cells to be cached locally from each of the input files by continuously refining an evolving R-tree index. In the second stage, an optimal assignment of cells to nodes that collocates dependent cells in order to minimize the overall data transfer is determined. We design cache eviction and placement heuristic algorithms that consider the historical query workload. A thorough experimental evaluation over two real datasets in three file formats confirms the superiority -- by as much as two orders of magnitude -- of the proposed framework over existing techniques in terms of cache overhead and workload execution time.

Zhao, Weijie↗

Software Defined Architectures for Data Analytics

Data analytics applications increasingly are complex workflows composed of phases with very different program behaviors (e.g., graph algorithms and machine learning, algorithms operating on sparse an dense data structures, etc). To reach the levels of efficiency required to process these workflows in real time, upcoming architectures will need to leverage even more workload specialization. If, at one end, we may find even more heterogenous processors composed by a myriad of specialized processing elements, at the other end we may see novel reconfigurable architectures, composed of sets of functional units and memories interconnected with (re)configurable on-chip networks, able to adapt dynamically to adapt the workload characteristics. Field Programmable Gate Arrays are more and more used for accelerating various workloads and, in particular, inferencing in machine learning, providing higher efficiency than other solutions. However, their fine grained nature still leads to issues for the design software and still makes dynamic reconfiguration impractical. Future, more coarse-grained architectures could offer the features to execute diverse workloads at high efficiency while providing better reconfiguration mechanisms for dynamic adaptability. Nevertheless, we argue that the challenges for reconfigurable computing remain in the software. In this position paper, we describe a possible toolchain for reconfigurable architectures targeted at data analytics.

FPGA, Dataflow, Reconfigurable Architectures, Soft↗

Deffe: A Data-efficient Framework for Performance Characterization in Domain-Specific Computing

Predicting workload performance is a crucial task for many architecture and system research. In this paper we present De￿e, a framework to estimate the workload performances under varying architectural configurations. The infrastructure component of Deffe is based on scalable and easy-to-use open-source software components. By casting the performance modeling as transfer learning tasks, the modeling component of Deffe can leverage the learned knowledge on one workload, and “transfer” it to a new workload. Extensive experimental results show that the method can achieve superior testing accuracy with an effective reduction of 32-80x in terms of the amount of required training data.

Liu, Frank↗

Detection of system failures in multi-axes tasks

The effects of the pilot's participation mode in the control task on his workload level and failure detection performance were examined considering a low visibility landing approach. It is found that the participation mode had a strong effect on the pilot's workload, the induced workload being lowest when the pilot acted as a monitoring element during a coupled approach and highest when the pilot was an active element in the control loop. The effects of workload and participation mode on failure detection were separated. The participation mode was shown to have a dominant effect on the failure detection performance, with a failure in a monitored (coupled) axis being detected significantly faster than a comparable failure in a manually controlled axis.

Ephrath, A. R.↗

Adaptation of time line analysis program to single pilot instrument flight research

A data base was developed for SPIFR operation and the program was run. The outputs indicated that further work was necessary on the workload models. In particular, the workload model for the cognitive channel should be modified as the output workload appears to be too small. Included in the needed refinements are models to show the workload when in turbulence, when overshooting a radial or glideslope, and when copying air traffic control clearances.

Hinton, D. A.↗

Practical guidance for the design of controls and displays for single pilot IFR

This paper represents a first step in developing the criteria for pilot interaction with advanced controls and displays in a single pilot IFR (SPIFR) environment. The research program presented is comprised of an analytical phase and an experimental phase. The analytical phase consisted of a review of fundamental considerations for pilot workload taking into account existing data, and using that data to develop a SPIFR pilot workload model. The rationale behind developing such a model was based on the concept that it is necessary to identify and quantify the most important components of pilot workload to guide the experimental phase of the research which consisted of an abbreviated flight test program. The purpose of the flight tests was to evaluate the workload associated with certain combinations of controls and displays in a flight environment. This was accommplished as a first step in building a data base for single pilot IFR controls and displays.

Hoh, R. H.↗

Levels of Information Processing in a Fitts law task (LIPFitts)

State-of-the-art flight technology has restructured the task of human operators, decreasing the need for physical and sensory resources, and increasing the quantity of cognitive effort required, changing it qualitatively. Recent technological advances have the most potential for impacting a pilot in two areas: performance and mental workload. In an environment in which timing is critical, additional cognitive processing can cause performance decrements, and increase a pilot's perception of the mental workload involved. The effects of stimulus processing demands on motor response performance and subjective mental workload are examined, using different combinations of response selection and target acquisition tasks. The information processing demands of the response selection were varied (e.g., Sternberg memory set tasks, math equations, pattern matching), as was the difficulty of the response execution. Response latency as well as subjective workload ratings varied in accordance with the cognitive complexity of the task. Movement times varied according to the difficulty of the response execution task. Implications in terms of real-world flight situations are discussed.

Mosier, K. L.↗

A measurement-based study of concurrency in a multiprocessor

A systematic measurement-based methodology for characterizing the amount of concurrency present in a workload, and the effect of concurrency on system performance indices such as cache miss rate and bus activity are developed. Hardware and software instrumentation of an Alliant FX/8 was used to obtain data from a real workload environment. Results show that 35% of the workload is concurrent, with the concurrent periods typically using all available processors. Measurements of periods of change in concurrency show uneven usage of processors during these times. Other system measures, including cache miss rate and processor bus activity, are analyzed with respect to the concurrency measures. Probability of a cache miss is seen to increase with concurrency. The change in cache miss rate is much more sensitive to the fraction of concurrent code in the worklaod than the number of processors active during concurrency. Regression models are developed to quantify the relationships between cache miss rate, bus activity, and the concurrency measures. The model for cache miss rate predicts an increase in the median miss rate value as much as 300% for a 100% increase in concurrency in the workload.

Mcguire, Patrick John↗

Measurement-based analysis of error latency

This paper demonstrates a practical methodology for the study of error latency under a real workload. The method is illustrated with sampled data on the physical memory activity, gathered by hardware instrumentation on a VAX 11/780 during the normal workload cycle of the installation. These data are used to simulate fault occurrence and to reconstruct the error discovery process in the system. The technique provides a means to study the system under different workloads and for multiple days. An approach to determine the percentage of undiscovered errors is also developed and a verification of the entire methodology is performed. This study finds that the mean error latency, in the memory containing the operating system, varies by a factor of 10 to 1 (in hours) between the low and high workloads. It is found that of all errors occurring within a day, 70 percent are detected in the same day, 82 percent within the following day, and 91 percent within the third day. The increase in failure rate due to latency is not so much a function of remaining errors but is dependent on whether or not there is a latent error.

Chillarege, Ram↗

Operational testing of a figure of merit for overall task performance

An overall indicator or figure of merit (FOM), for the quality of pilot performance is needed to define optimal workload levels, predict system failure, measure the impact of new automation in the cockpit, and define the relative contributions of subtasks to overall task performance. A normative FOM was developed based on the calculation of a standard score for each component of a complex task. It reflected some effects, detailed in an earlier study, of the introduction of new data link technology into the cockpit. Since the technique showed promise, further testing was done. A new set of data was obtained using the recently developed Multi-Attribute Task Battery. This is a complex battery consisting of four tasks which can be varied in task demand, and on which performance measures can be obtained. This battery was presented to 12 subjects in a 20 minute trial at each of three levels of workload or task demand, and performance measures collected on all four tasks. The NASA-TLX workload rating scale was presented at minutes 6, 12, and 18, of each trial. A figure of merit was then obtained for each run of the battery by calculating a mean, SD, and standard score for each task. Each task contributed its own proportion to the overall FOM, and relative contributions changed with increasing workload. Thus, the FOM shows the effect of task changes, not only on the individual task that is changed, but also on the performance of other tasks and of the whole task. The cost to other tasks of maintaining constant performance on an individual task can be quantified.

Lemay, Moira↗

A study of the relationship between the performance and dependability of a fault-tolerant computer

This thesis studies the relationship by creating a tool (FTAPE) that integrates a high stress workload generator with fault injection and by using the tool to evaluate system performance under error conditions. The workloads are comprised of processes which are formed from atomic components that represent CPU, memory, and I/O activity. The fault injector is software-implemented and is capable of injecting any memory addressable location, including special registers and caches. This tool has been used to study a Tandem Integrity S2 Computer. Workloads with varying numbers of processes and varying compositions of CPU, memory, and I/O activity are first characterized in terms of performance. Then faults are injected into these workloads. The results show that as the number of concurrent processes increases, the mean fault latency initially increases due to increased contention for the CPU. However, for even higher numbers of processes (less than 3 processes), the mean latency decreases because long latency faults are paged out before they can be activated.

Goswami, Kumar K.↗

Population-based learning of load balancing policies for a distributed computer system

Effective load-balancing policies use dynamic resource information to schedule tasks in a distributed computer system. We present a novel method for automatically learning such policies. At each site in our system, we use a comparator neural network to predict the relative speedup of an incoming task using only the resource-utilization patterns obtained prior to the task's arrival. Outputs of these comparator networks are broadcast periodically over the distributed system, and the resource schedulers at each site use these values to determine the best site for executing an incoming task. The delays incurred in propagating workload information and tasks from one site to another, as well as the dynamic and unpredictable nature of workloads in multiprogrammed multiprocessors, may cause the workload pattern at the time of execution to differ from patterns prevailing at the times of load-index computation and decision making. Our load-balancing policy accommodates this uncertainty by using certain tunable parameters. We present a population-based machine-learning algorithm that adjusts these parameters in order to achieve high average speedups with respect to local execution. Our results show that our load-balancing policy, when combined with the comparator neural network for workload characterization, is effective in exploiting idle resources in a distributed computer system.

Mehra, Pankaj↗

Measuring fault tolerance with the FTAPE fault injection tool

This paper describes FTAPE (Fault Tolerance And Performance Evaluator), a tool that can be used to compare fault-tolerant computers. The major parts of the tool include a system-wide fault-injector, a workload generator, and a workload activity measurement tool. The workload creates high stress conditions on the machine. Using stress-based injection, the fault injector is able to utilize knowledge of the workload activity to ensure a high level of fault propagation. The errors/fault ratio, performance degradation, and number of system crashes are presented as measures of fault tolerance.

Tsai, Timothy K.↗

Measurement of taskload in the analysis of aircrew performance

The objective of the study was to perform a quantitative analysis of a high workload portion of a full mission flight simulation in order to test the hypothesis that taskload area is a valid, objective measure of workload management. This methodology provides a tool for the researcher attempting to quantify the management of workload in a complex environment. The researcher can then produce a reliable quantitative evaluation of behavior related to workload management.

Laudeman, Irene V.↗

UNIX-based operating systems robustness evaluation

Robust operating systems are required for reliable computing. Techniques for robustness evaluation of operating systems not only enhance the understanding of the reliability of computer systems, but also provide valuable feed- back to system designers. This thesis presents results from robustness evaluation experiments on five UNIX-based operating systems, which include Digital Equipment's OSF/l, Hewlett Packard's HP-UX, Sun Microsystems' Solaris and SunOS, and Silicon Graphics' IRIX. Three sets of experiments were performed. The methodology for evaluation tested (1) the exception handling mechanism, (2) system resource management, and (3) system capacity under high workload stress. An exception generator was used to evaluate the exception handling mechanism of the operating systems. Results included exit status of the exception generator and the system state. Resource management techniques used by individual operating systems were tested using programs designed to usurp system resources such as physical memory and process slots. Finally, the workload stress testing evaluated the effect of the workload on system performance by running a synthetic workload and recording the response time of local and remote user requests. Moderate to severe performance degradations were observed on the systems under stress.

Chang, Yu-Ming↗