Search NASA⌕ Search

SEARCH · Search NASA

Results for “data movement”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

PLUM: Parallel Load Balancing for Adaptive Unstructured Meshes

Mesh adaption is a powerful tool for efficient unstructured-grid computations but causes load imbalance among processors on a parallel machine. We present a novel method called PLUM to dynamically balance the processor workloads with a global view. This paper presents the implementation and integration of all major components within our dynamic load balancing strategy for adaptive grid calculations. Mesh adaption, repartitioning, processor assignment, and remapping are critical components of the framework that must be accomplished rapidly and efficiently so as not to cause a significant overhead to the numerical simulation. A data redistribution model is also presented that predicts the remapping cost on the SP2. This model is required to determine whether the gain from a balanced workload distribution offsets the cost of data movement. Results presented in this paper demonstrate that PLUM is an effective dynamic load balancing strategy which remains viable on a large number of processors.

Oliker, Leonid↗

Parallel Load Balancing for Adaptive Unstructured Meshes

Mesh adaption is a powerful tool for efficient unstructured-grid computations but causes load imbalance among processors on a parallel machine. We describe a novel method to dynamically balance the processor workloads with a global view. Mesh question, repartitioning, processor assignment, and remapping are critical components of the framework that must be accomplished rapidly and efficiently so as not to cause a significant overhead to the numerical simulation. A data redistribution model will also be presented that predicts the remapping cost. This model is required to determine whether the gain from a balanced workload distribution offsets the cost of data movement. Results presented will demonstrate that this is an effective dynamic load balancing strategy which remains viable on a large number of processors.

Biswas, Rupak↗

Functional Testing and Evaluation of Actiwatch Spectrum Devices for Launch on STS-133/ULF5

The Actiwatch Spectrum (AWS) is a wrist-worn device that may be used for obtaining ground or on-orbit light exposure patterns and movement data. The objective of this project was to prepare AWS devices for launch on STS-133/ULF5 by a means of implementing functional tests and engineering evaluations. The data obtained from these tests and evaluations served as a means for detecting any plausible issues that the AWS may encounter while on-orbit. Subsequent steps after detecting anomalies with AWS devices encompassed identifying their root causes and taking the steps needed to mitigate them. As a result of this study, the overall success of sleep/wake research studies for STS-133/ULF5 and future missions will be enhanced.

Rollins, Selisa F.↗

High Data Rate Architecture (HiDRA)

One of the greatest challenges in developing new space technology is in navigating the transition from ground based laboratory demonstration at Technology Readiness Level 6 (TRL-6) to conducting a prototype demonstration in space (TRL-7). This challenge is com- pounded by the relatively low availability of new spacecraft missions when compared with aeronautical craft to bridge this gap, leading to the general adoption of a low-risk stance by mission management to accept new, unproven technologies into the system. Also in consideration of risk, the limited selection and availability of proven space-grade components imparts a severe limitation on achieving high performance systems by current terrestrial technology standards. Finally from a space communications point of view the long duration characteristic of most missions imparts a major constraint on the entire space and ground network architecture, since any new technologies introduced into the system would have to be compliant with the duration of the currently deployed operational technologies, and in some cases may be limited by surrounding legacy capabilities. Beyond ensuring that the new technology is verified to function correctly and validated to meet the needs of the end users the formidable challenge then grows to additionally include: carefully timing the maturity path of the new technology to coincide with a feasible and accepting future mission so it flies before its relevancy has passed, utilizing a limited catalog of available components to their maximum potential to create meaningful and unprecedented new capabilities, designing and ensuring interoperability with aging space and ground infrastructures while simultaneously providing a growth path to the future. The International Space Station (ISS) is approaching 20 years of age. To keep the ISS relevant, technology upgrades are continuously taking place. Regarding communications, the state-of-the-art communication system upgrades underway include high-rate laser terminals. These must interface with the existing, aging data infrastructure. The High Data Rate Architecture (HiDRA) project is designed to provide networked store, carry, and forward capability to optimize data flow through both the existing radio frequency (RF) and new laser communications terminal. The networking capability is realized through the Delay Tolerant Networking (DTN) protocol, and is used for scheduling data movement as well as optimizing the performance of existing RF channels. HiDRA is realized as a distributed FPGA memory and interface controller that is itself controlled by a local computer running DTN software. Thus HiDRA is applicable to other arenas seeking to employ next-generation communications technologies, e.g. deep space. In this paper, we describe HiDRA and its far-reaching research implications.

DTN↗

On the Development and Application of High Data Rate Architecture (HiDRA) in Future Space Networks

Historically, space missions have been severely constrained by their ability to downlink the data they have collected. These constraints are a result of relatively low link rates on the spacecraft as well as limitations on the time during which data can be sent. As part of a coherent strategy to address existing limitations and get more data to the ground more quickly, the Space Communications and Navigation (SCaN) program has been developing an architecture for a future solar system Internet. The High Data Rate Architecture (HiDRA) project is designed to fit into such a future SCaN network. HiDRA's goal is to describe a general packet-based networking capability which can be used to provide assets with efficient networking capabilities while simultaneously reducing the capital costs and operational costs of developing and flying future space systems.Along these lines, this paper begins by reviewing various characteristics of modern satellite design as well as relevant characteristics of emerging technologies (such as free-space optical links capable of working at 100+ Gbps). Next, the paper describes HiDRA's design, and how the system is able to both integrate and support the operation of not only today's high-rate systems, but also the high-rate systems likely to be found in the future. This section also explores both existing and future networking technologies, such as Delay Tolerant Networking (DTN) protocol (RFC4838 citeRFC:1, RFC5050citeRFC:2), and explains how HiDRA supports them. Additionally, this section explores how HiDRA is used for scheduling data movement through both proactive and reactive link management. After this, the paper moves on to explore a reference implementation of HiDRA. This implementation is currently being realized based on a Field Programmable Gate Array (FPGA) memory and interface controller that is itself controlled by a local computer running DTN software. Next, this paper explores HiDRA's natural evolution, which includes an integration path for software-defined networking (SDN) switches. This section also describes considerations for both near-Earth and deep-space instantiations of HiDRA, describing how differences in latencies between the environments will necessarily influence how the system is configured and the networks operate. Finally, this paper describes future work. This section includes a description of a potential ISS implementation which will allow rapid advancement through the technology readiness levels (TRL). This section also explores work being done to support HiDRA's successful implementation and operation in a heterogeneous network: such a network could include communications equipment spanning many vintages and capabilities, and one significant aspect of HiDRA's future development involves balancing compatibility with capability.

DTN↗

Cross Recurrence Analysis as a Measure of Pilots' Coordination Strategy

When solving problems, multi-person airline crews can choose whether to work together, or to address different aspects of a situation with a divide and conquer strategy. Knowing which of these strategies is most effective may help airlines develop better procedures and training. This paper concentrates on joint attention as a measure of crew coordination. We report results obtained by applying cross recurrence analysis to eye movement data from two-person crews, collected in a flight simulator experiment. The analysis shows that crews exhibit coordinated gaze roughly 1/6th of the time, with a tendency for the captain to lead the first officer’s visual attention. The degree to which crews coordinate their gaze is not significantly correlated with performance ratings assigned by instructors; further research questions and approaches are discussed.

cross recurrence analysis↗

Cross Recurrence Analysis as a Measure of Pilots' Coordination Strategy

When solving problems, multi-person airline crews can choose whether to work together, or to address different aspects of a situation with a divide and conquer strategy. Knowing which of these strategies is most effective may help airlines develop better procedures and training. This paper concentrates on joint attention as a measure of crew coordination. We report results obtained by applying cross recurrence analysis to eye movement data from two-person crews, collected in a flight simulator experiment. The analysis shows that crews exhibit coordinated gaze roughly 16th of the time, with a tendency for the captain to lead the first officers visual attention. The degree to which crews coordinate their gaze is not significantly correlated with performance ratings assigned by instructors; further research questions and approaches are discussed.

non-linear models↗

Enabling Execution of a Legacy CFD Mini Application on Accelerators Using OpenMP

We describe the process and outcome of our efforts to port a legacy Fortran benchmark code to heterogeneous GPU-accelerated computing architectures using OpenMP. The benchmark code is one of the multi-zone NAS Parallel Benchmarks (NPB-MZ) called SP-MZ. This “mini-app” mimics the computation and data movement that is found in popular legacy and modern implicit computational fluid dynamics (CFD)solvers. Our objective was to examine how efficiently legacy Fortran codes can be ported to accelerators by leveraging OpenMP directives. We describe the development and optimization process and demonstrate the performance impact of various code modifications. We show select profiling results from the Nvidia nvvp profiler to help others diagnose and overcome performance issues in their own applications. We present results for two compute systems endowed with Nvidia V100 accelerators.

Ioannis Nompelis↗

Towards Gbps Downlinks from Low-Cost Active Phased Arrays

Spacecraft performing science missions use high-directivity antennas to quickly downlink large amounts of collected data. Movement required to keep gimbaled reflector antennas trained on target receivers can impart blockages or vibrations which perturb precision science instruments. Recent manufacturing advances have made Ka-band electronically-steered antenna arrays a cost-effective option to mitigate these challenges, but only if these devices can be proven to deliver comparable quality of service. In this work we present a hardware and software architecture for high-rate links using an active phased array-based terminal in a 1U (10cm cube) form factor. Over-the-air tests in an antenna range characterize two key features of the architecture: high-order (32APSK and above) modulations and dual carriers. We calculate an optimal modulation-dependent input power backoff from array saturation and perform orbital simulations of the link at this operating point. We conclude that reliable links with rates in excess of 1Gbps are possible with current-generation hardware.

Adam Gannon↗

Comparison of Active and Passive Head Impulse Testing of the Horizontal Vestibulo-Ocular Reflex: Exploring the Feasibility of Different Approaches for Spaceflight

INTRODUCTION: Astronauts experience a wide variety of sensorimotor disturbances primarily due to microgravity-induced vestibular adaptations during spaceflight. Head Impulse Testing (HIT) will be conducted during the Complement of Integrated Protocols for Human Exploration Research program(CIPHER) Vestibular Health study to examine changes in the horizontal vestibulo-ocular reflex in response to high-velocity head movements to detect changes in peripheral vestibular function [1,2]. However, correct interpretation will require consideration of potential artifacts and the constraints of conducting this test across different phases of the mission. Therefore, the aims of our study were to (1) examine reliability across different test operators, and (2) compare results of active (aHIT) versus passive (pHIT) approaches to evaluate the feasibility of self-administered versus operator-assisted approaches. A comparison of responses with visual viewing of a wall target (default condition) versus vision occluded evaluated the influence of other oculomotor control influence across conditions, and comparison with computer-generated rotator head impulse tests (rHIT) examined the variability associated with the ocular responses independent of the variability in executing the head movements themselves. METHODS: Seventeen non-astronaut volunteers (male n=12, age=22.9 ± 3.0; female n=5, age=27.0 ± 6.0, mean ± std) completed HIT testing using video-oculography (VOG) goggles and a high-torque rotator system. The test order was counterbalanced across conditions: (1) passive head-on-torso (pHIT, default condition for flight study) using two operators (Op1 and Op2), (2) active head-on-torso (aHIT, subject initiated), and (3) passive head and torso using rotary chair (rHIT). Eye and head movement data were processed to obtain gain in each direction. The main outcome measures were average gain and asymmetry [1], as well as the percentage of acceptable trials not excluded due to insufficient head amplitude or recording artifacts. RESULTS: While the pHIT gains were similar with vision (1.032 ± 0.043) and vision occluded (1.029 ± 0.038) conditions, the percentage of acceptable trials was greater with vision (Op1 = 93.0%, Op2 = 93.2%) versus occluded (Op1 = 70.7%, Op2 = 67.6%). The reliability between operators was greater for pHIT gain (Intraclass Correlation, ICC = 0.66, p = 0.001) than for pHIT asymmetry (ICC = 0.57, p = 0.01). The percentage of acceptable trials reduced by ~20% during the self-administered aHITs for both visual conditions and tended to be lower than computer-generated rHITs (76% versus 83%). While the aHIT gains were not significantly different than pHIT gains for vision or vision occluded conditions, these measures were poorly correlated. Both aHIT and pHIT gains were significantly greater than the rHIT gains, presumably due to the reduced velocities from the rotator. The asymmetry measures were poorly correlated across pHIT, aHIT, and rHIT conditions, although none of the subjects had asymmetries greater than 16%. DISCUSSION: Our findings support the feasibility of using the standard pHIT methodology for spaceflight. Similarities between visual conditions reflect that these responses are mediated by the peripheral lateral canals rather than other oculomotor mechanisms. The inter-tester reliability was acceptable despite differences in the tester training. In addition to concerns of non-vestibular mechanisms introduced during self-administered aHITs [2], operator-assisted pHITs resulted in higher percentage of acceptable trials and should result in more efficient and reliable measures during spaceflight.

M R Ehrenburg↗

Network-friendly one-sided communication through multinode cooperation on petascale cray xt5 systems

ne-sided communication is important to enable asynchronous communication and data movement for Global Address Space (GAS) programming models. Such communication is typically realized through direct messages between initiator and target processes. For petascale systems with 10,000s of nodes and 100,000s of cores, these direct messages require dedicated communication buffers and/or channels, which can lead to significant scalability challenges for GAS programming models. In this paper, we describe a network-friendly communication model, multinode cooperation, to enable indirect one-sided communication. Compute nodes work together to handle one-sided requests through (1) request forwarding in which one node can intercept a request and forward it to a target node, and (2) request aggregation in which one node can aggregate many requests to a target node. We have implemented multinode cooperation for a popular GAS runtime library, Aggregate Remote Memory Copy Interface (ARMCI). Our experimental results on a large-scale Cray XT5 system demonstrate that, multinode cooperation is able to greatly increase the memory scalability by reducing the number of communication buffers. In addition, multinode cooperation improves the resiliency of GAS runtime system to network contention. Furthermore, multinode cooperation can benefit the performance of scientific applications. In one case, it reduces the total execution time of an NWChem application by 52%.

99 GENERAL AND MISCELLANEOUS↗

Network-friendly one-sided communication through multinode cooperation on petascale cray xt5 systems

ne-sided communication is important to enable asynchronous communication and data movement for Global Address Space (GAS) programming models. Such communication is typically realized through direct messages between initiator and target processes. For petascale systems with 10,000s of nodes and 100,000s of cores, these direct messages require dedicated communication buffers and/or channels, which can lead to significant scalability challenges for GAS programming models. In this paper, we describe a network-friendly communication model, multinode cooperation, to enable indirect one-sided communication. Compute nodes work together to handle one-sided requests through (1) request forwarding in which one node can intercept a request and forward it to a target node, and (2) request aggregation in which one node can aggregate many requests to a target node. We have implemented multinode cooperation for a popular GAS runtime library, Aggregate Remote Memory Copy Interface (ARMCI). Our experimental results on a large-scale Cray XT5 system demonstrate that, multinode cooperation is able to greatly increase the memory scalability by reducing the number of communication buffers. In addition, multinode cooperation improves the resiliency of GAS runtime system to network contention. Furthermore, multinode cooperation can benefit the performance of scientific applications. In one case, it reduces the total execution time of an NWChem application by 52%.

Tipparaju, Vinod↗

A Science Driven Production Cyberinfrastructure-the Open Science Grid

This article describes the Open Science Grid, a large distributed computational infrastructure in the United States which supports many different high-throughput scientific applications, and partners (federates) with other infrastructures nationally and internationally to form multi-domain integrated distributed systems for science. The Open Science Grid consortium not only provides services and software to an increasingly diverse set of scientific communities, but also fosters a collaborative team of practitioners and researchers who use, support and advance the state of the art in large-scale distributed computing. The scale of the infrastructure can be expressed by the daily throughput of around seven hundred thousand jobs, just under a million hours of computing, a million file transfers, and half a petabyte of data movement. In this paper we introduce and reflect on some of the OSG capabilities, usage and activities.

97 MATHEMATICS AND COMPUTING↗

Boosting Big National Lab Data

Introduction: Big data. Love it or hate it, solving the world’s most intractable problems requires the ability to make sense of huge and complex sets of data and do it quickly. Speeding up the process – from hours to minutes or from weeks to days – is key to our success. One major source of such big data are physical experiments. As many will know, these physical experiments are commonly used to solve challenges in fields such as energy security, manufacturing, medicine, pharmacology, environmental protection and national security. Experiments use different instruments and sensor types to research for example the validity of new drugs, the base cause for diseases, more efficient energy sources, new materials for every day goods, effective methods for environmental cleanup, the optimal ingredients composition for chocolate or determine how to preserve valuable antics. This is done by experimentally determining the structure, properties and processes that govern biological systems, chemical processes and materials. The speed and quality at which we can acquire new insights from experiments directly influences the rate of scientific progress, industrial innovation and competitiveness. And gaining new groundbreaking insights, faster, is key to the economic success of our nations. Recent years have seen incredible advances in sensor technologies, from house size detector systems in large experiments such as the Large Hadron Collider and the ‘Eye of Gaia’ billion pixel camera detector to high throughput genome sequencing. These developments have led to an exponential increase in data volumes, rates and variety produced by instruments used for experimental work. This increase is coinciding with a need to analyze the experimental results at the time they are collected. This speed is required to optimize the data taking and quality, and also to enable new adaptive experiments, where the sample is manipulated as it is observed, e.g. a substance is injected into a tissue sample and the gradual effect is observed as more of the substance is injected, providing better insights into the natural processes that are occurring, as well as result driven sampling adjustment to capture particularly interesting features --- as they emerge. The Department of Energy’s Pacific Northwest National Laboratory (PNNL) is recognized for it’s expertise in the development of new measurement techniques and their application to challenges of national importance. So it was obvious to us to address the need for in-situ analysis of large scale experimental data. We have a wide range of experimental instruments on site, in facilities such as DOE’s national scientific user facility, the William R. Wiley Environmental Molecular Sciences Laboratory (EMSL). Commonly, scientists would create an individual analysis pipeline for each of those instruments; but even the same type of instrument would not necessarily share the same analysis tools. With the rapid increase of data volumes and rates we were facing two key challenges: how to bring a wider set of capabilities to bear to achieve in-situ analysis, and how to do so across a wide range of heterogeneous instruments at affordable costs and in a reasonable timeframe. We decided to take an unconventional approach to the problem, rather than developing customized, one-off solutions for specific instruments we wanted to explore if a more common solution could be found that would go beyond shared, basic infrastructures such as data movement and workflow engines.

97 MATHEMATICS AND COMPUTING↗

Building America Case Study: Initial and Long-Term Movement of Cladding Installed Over Exterior Rigid Insulation (Fact Sheet)

Changes in the International Energy Conservation Code (IECC) from 2009 to 2012 have resulted in the use of exterior rigid insulation becoming part of the prescriptive code requirements. With more jurisdictions adopting the 2012 IECC builders are going to finding themselves required to incorporate exterior insulation in the construction of their exterior wall assemblies. For thick layers of exterior insulation (levels greater than 1.5 inches), the use wood furring strips attached through the insulation back to the structure has been used by many contractors and designers as a means to provide a convenient cladding attachment location. However, there has been a significant resistance to its widespread implementation due to a lack of research and understanding of the mechanisms involved and potential creep effects of the assembly under the sustained dead load of a cladding. This research was an extension on previous research conducted by BSC in 2011, and 2012. Each year the understanding of the system discrete load component interactions, as well as impacts of environmental loading has increased. The focus of the research was to examine more closely the impacts of screw fastener bending on the total system capacity, effects of thermal expansion and contraction of materials on the compressive forces in the assembly, as well as to analyze a full years worth of cladding movement data from assemblies constructed in an exposed outdoor environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

TacNet Tracker Software

The TacNet Tracker will be used for the monitoring and real-time tracking of personnel and assets in an unlimited number of specific applications. The TacNet Tracker software is a VxWorks Operating System based programming package that controls the functionality for the wearable Tracker. One main use of the TacNet Tracker is in Blue Force Tracking, the ability to track the good guys in an adversarial situation or in a force-on-force or real battle conditions. The purpose of blue force tracking is to provide situational awareness to the battlefield commanders and personnel. There are practical military applications with the TacNet Tracker.The mesh network is a wireless IP communications network that moves data packets from source IP addresses to specific destination IP addresses. Addresses on the TacNet infrastructure utilize an 8-bit network mask (255.0.0.0). In other words, valid TacNet addresses range from 10.0.0.1 to 10.254.254.254. The TacNet software design uses uni-cast transmission techniques because earlier mesh network software releases did not provide for the ability to utilize multi-cast data movement. The TacNet design employs a list of addresses to move information within the TacNet infrastructure. For example, a convoy text file containing the IP addresses of all valid receivers of TacNet information could be used for transmitting the information and for limiting transmission to addresses on the list.

WISEMAN, JAMES↗

MapReduce MPI library (MR-MPI) v. 1.0

The MapReduce MPI library is a software tool for performing MapReduce operations on a distributed memory parallel computer via message passing (MPI). These are data-processing or computational operations which achieve parallelism by breaking a large task into two stages, a map and a reduce . Each of these are formulated as simple on-processor functions which the user can easily write. The library assigns independent tasks to processors and performs the parallel data movement and transformations behind the scenes.

PLIMPTON, STEVEN↗

Quality-Aware Data Management for Large Scale Scientific Applications

Increasingly larger scale simulations are generating an unprecedented amount of output data, causing researchers to explore new data staging methods that buffer, use, and/or reduce such data online rather than simply pushing it to disk. Leveraging the capabilities of data staging, this study explores the potential for data reduction via online data compression, first using general compression techniques and then proposing usespecific methods that permit users to define simple data queries that cause only the data identified by those queries to be emitted. Using online methods for code generation and deployment, with such dynamic data queries, end users can precisely identify the quality of information (QoI) of their output data, by explicitly determining what data may be lost vs. retained, in contrast to general-purpose lossy compression methods that do not provide such levels of control. The paper also describes the key elements of a quality-aware data management system (QADMS) for highend machines enabled by this approach. Initial experimental results demonstrate that QADMS can effectively reduce data movement cost and improve the QoS while meeting the QoI constraint stated by users.

Zou, Hongbo↗