Search NASA⌕ Search

SEARCH · Search NASA

Results for “TRANSFER TOOLING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Comparative Performance Evaluation of High-performance Data Transfer Tools

Data transfer in wide-area networks has been long studied in different contexts, from data sharing among data centers to online access to scientific data. Many software tools and platforms have been developed to facilitate easy, reliable, fast, and secure data transfer over wide area networks, such as GridFTP, FDT, bbcp, mdtmFTP, and XDD. However, few studies have shown the full capabilities of existing data transfer tools from the perspective of whether such tools have fully adopted state-of-the-art techniques through meticulous comparative evaluations. In this paper, we evaluate the performance of the four highperformance data transfer tools (GridFTP, FDT, mdtmFTP, and XDD) in various environments. Our evaluation suggests that each tool has strengths and weaknesses. FDT and GridFTP perform consistently in diverse environments. XDD and mdtmFTP show improved performance in limited environments and datasets during our evaluation. Unlike other studies on data transfer tools, we also evaluate the predictability of the tools' performance, an important factor for scheduling different stages of science workflows. Performance predictability also helps in (auto)tuning the configurable parameters of the data transfer tool. We apply statistical learning techniques such as linear/polynomial regression, and k-nearest neighbors (kNN), to assess the performance predictability of each tool using its control parameters. Our results show that we can achieve good prediction performance for GridFTP and mdtmFTP using linear regression and kNN, respectively.

Nadig, Deepak↗

Data Transfer Tool (HPC Annual Report V.3.1)

Sandia has been developing and supporting data transfer tools for over 20 years and has the expertise to take DOE into the Extreme Scale era. In looking at Exascale and beyond (Extreme Scale Computing), data sets can be thousands of 500TBs in size, a single file can be in the 100TB range, and billions of files are expected. Huge bursts of data need to be transferred, even today. While data archiving is often not thought about, it is an integral part of the full data management path when data is generated on HPC systems. In order to move generated data to its final resting place (data archive) or to transfer between file systems, a capable data transfer tool is required.

97 MATHEMATICS AND COMPUTING↗

Friendly Extensible Transfer Tool Beta Version

Often data transfer software is designed to meet specific requirements or apply to specific environments. Frequently, this requires source code integration for added functionality. An extensible data transfer framework is needed to more easily incorporate new capabilities, in modular fashion. Using FrETT framework, functionality may be incorporated (in many cases without need of source code) to handle new platform capabilities: I/O methods (e.g., platform specific data access), network transport methods, data processing (e.g., data compression.).

Collins, William P.↗

The heat pipe - A simple, versatile, efficient heat transfer tool

Heat pipe transports large quantities of heat from source to sink with only small temperature drop. Thermal energy is transferred to and from heat pipe by any combination of conduction, convection, or radiation heat transfer. Pipes transport energy from open flames, nuclear sources, and electronic equipment.

Schwartz, J.↗

PAMTRA 1.0: the Passive and Active Microwave radiative TRAnsfer tool for simulating radiometer and radar measurements of the cloudy atmosphere

Forward models are a key tool to generate synthetic observations given knowledge of the atmospheric state. In this way, they are an integral part of inversion algorithms that aim to retrieve geophysical variables from observations or in data assimilation. Their application for the exploitation of the full information content of remote sensing observations becomes increasingly important when these are used to evaluate the performance of cloud-resolving models (CRMs). Herein, CRM profiles or fields provide the input to the forward model whose simulation results are subsequently compared to the observations. This paper introduces the freely available comprehensive microwave forward model PAMTRA (Passive and Active Microwave TRAnsfer), demonstrates its capabilities to simulate passive and active measurements across the microwave spectral region for upward- and downward-looking geometries, and illustrates how the forward simulations can be used to evaluate CRMs and to interpret measurements to improve our understanding of cloud processes. PAMTRA is unique as it treats passive and active radiative transfer (RT) in a consistent way with the passive forward model providing upwelling and downwelling polarized brightness temperatures and radiances for arbitrary observation angles. The active part is capable of simulating the full radar Doppler spectrum and its moments. PAMTRA is designed to be flexible with respect to instrument specifications and interfaces to many different formats of input and output, especially CRMs, spanning the range from bin-resolved microphysical output to one- and two-moment schemes, and to in situ measured hydrometeor properties. A specific highlight is the incorporation of the self-similar Rayleigh–Gans approximation (SSRGA) for both active and passive applications, which becomes especially important for the investigation of frozen hydrometeors.

54 ENVIRONMENTAL SCIENCES↗

mdtmFTP

To address the high-performance challenges of data transfer in big data era, we research, develop, and implement mdtmFTP: a High-performance Data Transfer Tool in Bigdata Era. DOE’s Advanced Scientific Computing Research (ASCR) office has funded Fermilab and Brookhaven National Laboratory to collaboratively work on the Multicore-Aware Data Transfer Middleware (MDTM) project. MDTM aims to accelerate data movement toolkits on multicore systems. mdtmFTP is the latest outcome of this continued research effort. mdtmFTP is a high-performance data transfer tool that builds upon the MDTM middleware. Initial tests show that mdtmFTP performs better than existing data transfer tools

Zhang, L.↗

Throughput Analytics of Data Transfer Infrastructures

To support increasingly distributed scientific and big-data applications, powerful data transfer infrastructures are being built with dedicated networks and software frameworks customized to distributed file systems and data transfer nodes. The data transfer performance of such infrastructures critically depends on the combined choices of file, disk, and host systems as well as network protocols and file transfer software, all of which may vary across sites. The randomness of throughput measurements makes it challenging to assess the impact of these choices on the performance of infrastructure or its parts. We propose regression-based throughput profiles by aggregating measurements from sites of the infrastructure, with RTT as the independent variable. The peak values and convex-concave shape of a profile together determine the overall throughput performance of memory and file transfers, and its variations show the performance differences among the sites. We then present projection and difference operators, and coefficients of throughput profiles to characterize the performance of infrastructure and its parts, including sites and file transfer tools. In particular, the utilization-concavity coefficient provides a value in the range [0, 1] that reflects overall transfer effectiveness. We present results of measurements collected using (i) testbed experiments over dedicated 0–366 ms 10 Gbps connections with combinations of TCP versions, file systems, host systems and transfer tools, and (ii) Globus GridFTP transfers over production infrastructure with varying site configurations.

Rao, Nageswara S.↗

Simplified Applied Loads of a Transonic Truss-Braced Wing Derived from Computational Fluid Dynamics

The transonic truss-braced wing (TTBW) concept is under consideration by the NASA Advanced Air Transport Technology (AATT) project due to its potential to reduce fuel consumption of transport aircraft. To properly evaluate the TTBW concept, detailed structural modeling and subsequent test planning is underway, which requires a simplified set of discrete applied loads that simulate the distributed aerodynamic pressures. Given the unique architecture of the TTBW and its intended operation in the transonic regime, computational fluid dynamics (CFD) is the ideal approach to employ to ensure the aerodynamics of this configuration are sufficiently captured. To convert aerodynamic results into input for structural models, application of a data transfer tool, Discrete Data Transfer Between Dissimilar Meshes (DDTBDM), is presented to resolve aerodynamic pressures from CFD into single load vectors at hardpoints along both the wing and the strut. Evaluation of mapping the aerodynamic forces to hardpoints at rib and spar intersections in a structural model is performed, and the results are also compared with a linear static aeroelastic analysis. The structural responses indicate that distributing forces along only the wing and strut forward spars is insufficient for simulating the distributed aerodynamic loads. Adding moments along the forward spars improved the global response of the wing, but the point moments created unrealistic local rotations within the structure. When distributing loads along both the forward and aft spars of the wing and strut, the global response was less sensitive to the inclusion of point moments, which indicated the arrangement of point forces alone was sufficient input for structural design work and testing and provided a more continuous loading profile.

Finite Element↗

Simplified Applied Loads of a Transonic Truss-Braced Wing Derived from Computational Fluid Dynamic

The transonic truss-braced wing (TTBW) concept is under consideration by the NASA Advanced Air Transport Technology (AATT) project due to its potential to reduce fuel consumption of transport aircraft. To properly evaluate the TTBW concept, detailed structural modeling and subsequent test planning is underway, which requires a simplified set of discrete applied loads that simulate the distributed aerodynamic pressures. Given the unique architecture of the TTBW and its intended operation in the transonic regime, computational fluid dynamics (CFD) is the ideal approach to employ to ensure the aerodynamics of this configuration are sufficiently captured. To convert aerodynamic results into input for structural models, application of a data transfer tool, Discrete Data Transfer Between Dissimilar Meshes (DDTBDM), is presented to resolve aerodynamic pressures from CFD into single load vectors at hardpoints along both the wing and the strut. Evaluation of mapping the aerodynamic forces to hardpoints at rib and spar intersections in a structural model is performed, and the results are also compared with a linear static aeroelastic analysis. The structural responses indicate that distributing forces along only the wing and strut forward spars is insufficient for simulating the distributed aerodynamic loads. Adding moments along the forward spars improved the global response of the wing, but the point moments created unrealistic local rotations within the structure. When distributing loads along both the forward and aft spars of the wing and strut, the global response was less sensitive to the inclusion of point moments, which indicated the arrangement of point forces alone was sufficient input for structural design work and testing and provided a more continuous loading profile.

Finite Element↗

XDD (ORNL extensions)

XDD is a disk benchmarking tool and data transfer tool. It is well known to move data particularly efficiently both to and from storage devices.

Settlemyer, Bradley W.↗

BigData Express: Toward Schedulable, Predictable, and High-Performance Data Transfer

Big Data has emerged as a driving force for scientific discoveries. Large scientific instruments (e.g., colliders, and telescopes) generate exponentially increasing volumes of data. To enable scientific discovery, science data must be collected, indexed, archived, shared, and analyzed, typically in a widely distributed, highly collaborative manner. Data transfer is now an essential function for science discoveries, particularly within big data environments. Although significant improvements have been made in the area of bulk data transfer, the currently available data transfer tools and services can not successfully address the high-performance and time-constraint challenges of data transfer required by extreme-scale science applications for the following reasons: disjoint end-to-end data transfer loops, cross-interference between data transfers, and existing data transfer tools and services are oblivious to user requirements (deadline and QoS requirements). Fermilab has been working on the BigData Express project to address these problems. BigData Express seeks to provide a schedulable, predictable, and high-performance data transfer service for big data science. The BigData Express software is being deployed and evaluated at multiple research institutions, which include UMD, StarLight, FNAL, KISTI, KSTAR, SURFnet, Ciena, and other sites. Meanwhile, the BigData Express research team is collaborating with the StarLight International/National Communications Exchange Facility to deploy BigData Express at various research platforms, including Pacific Research Platform, National Research Platform, and Global Research Platform. It is envisioned that we are working toward building a high-performance data transfer federation for big data science.

Lu, Qiming↗

mdtmFTP and its evaluation on ESNET SDN testbed

In this paper, to address the high-performance challenges of data transfer in the big data era, we are developing and implementing mdtmFTP: a high-performance data transfer tool for big data. mdtmFTP has four salient features. First, it adopts an I/O centric architecture to execute data transfer tasks. Second, it more efficiently utilizes the underlying multicore platform through optimized thread scheduling. Third, it implements a large virtual file mechanism to address the lots-of-small-files (LOSF) problem. In conclusion, mdtmFTP integrates multiple optimization mechanisms, including–zero copy, asynchronous I/O, pipelining, batch processing, and pre-allocated buffer pools–to enhance performance. mdtmFTP has been extensively tested and evaluated within the ESNET 100G testbed. Evaluations show that mdtmFTP can achieve higher performance than existing data transfer tools, such as GridFTP, FDT, and BBCP.

97 MATHEMATICS AND COMPUTING↗

An Overview of the Patch Integral Method (PIM), a New Heat Transfer Analysis Tool for Hypersonic Wind Tunnel Facilities at NASA Langley

NASA Langley’s hypersonic wind tunnels are heavily leveraged for planetary missions. The data collection method in these tunnels is thermography, and surface temperature measurements of the model surface are collected and reduced to produce surface heating data, as seen in Fig 1. However, during model injection, no temperature data are collected, and thus conventional, integral heat transfer methods cannot be used to solve for surface heating. A method was developed in the 1990’s to reduce this data despite the data gap, known as the step approximation method. The method assumes that the film coefficient behaves as a step function, the model is semi-infinite, and thermal properties are constant. With these simplifying assumptions, a Laplace transform can be performed to result in an equation that takes the initial temperature of the model and a temperature at some point in time to back out the film coefficient at that time. This is the method that is used in the current thermographic data reduction software, IHEAT. While computationally light-weight, the step approximation has several issues associated with it. The time-history of temperature is not accounted for, which is vital as heat transfer is an integral process. Additionally, the required semi-infinite assumption is unnecessary and might be violated during runtime. Thermal variation of material properties can have a sizeable impact on heating results and are not modeled by the method. This method also takes multiple seconds to “collapse” to a steady state, which is undesirable from both a facility and data reduction standpoint. The method is also very sensitive to the “effective time” approximation, an approximation of when heating instantaneously starts (which is a nonphysical simplification), and a small variation in this value can result in an error in heating results.

J. S. Cheatwood↗