Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data migration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Data migration schedule prediction using machine learning

Various embodiments provide for one or more processor instructions and memory instructions that enable a memory sub-system to predict a schedule for migrating data between memory devices, which can be part of a memory sub-system.

Roberts, David Andrew↗

Unified Memory: GPGPU-Sim/UVM Smart Integration

CPU/GPU heterogeneous compute platforms are an ubiquitous element in computing and a programming model specified for this heterogeneous computing model is important for both performance and programmability. A programming model that exposes the shared, unified, address space between the heterogeneous units is a necessary step in this direction as it removes the burden of explicit data movement from the programmer while maintaining performance. GPU vendors, such as AMD and NVIDIA, have released software-managed runtimes that can provide programmers the illusion of unified CPU and GPU memory by automatically migrating data in and out of the GPU memory. However, this runtime support is not included in GPGPU-Sim, a commonly used framework that models the features of a modern graphics processor that are relevant to non-graphics applications. UVM Smart was developed, which extended GPGPU-Sim 3.x to in- corporate the modeling of on-demand pageing and data migration through the runtime. This report discusses the integration of UVM Smart and GPGPU-Sim 4.0 and the modifications to improve simulation performance and accuracy.

97 MATHEMATICS AND COMPUTING↗

Athena: High-Performance Sparse Tensor Contraction Sequence on Heterogeneous Memory

Sparse tensor contraction sequence has been widely employed in many fields, such as chemistry and physics. However, how to efficiently implement the sequence faces multiple challenges, such as redundant computations and memory operations, massive memory consumption, and inefficient utilization of hardware. To address the above challenges, we introduce Athena, a high-performance framework for SpTC sequences. Athena introduces new data structures, leverages emerging Optane-based heterogeneous memory (HM) architecture, and stage parallelism. In particular, Athena introduces shared hash table-represented sparse accumulator to eliminate unnecessary input processing and data migration; Athena uses a novel data-semantic guided dynamic migration solution to make the best use of the Optane-based HM for high performance; Athena also co-runs execution phases with different characteristics to enable high hardware utilization. Evaluating with 12 datasets, we show that Athena brings 327-7362× speedup over the state-of-the-art SpTC algorithm. With the dynamic data placement guided by data semantics, Athena brings performance improvement on Optane-based HM over a state-of-the-art software-based data management solution, a hardware-based data management solution, and PMM-only by 1.58×, 1.82×, and 2.34× respectively.

Liu, Jiawen↗

Evaluating Unified Memory Performance in HIP

Heterogeneous unified memory management between a CPU and a GPU is a major challenge in GPU computing. Recently, unified memory (UM) has been supported by software and hardware components on AMD computing platforms. The support could simplify the complexities of memory management. In this paper, we attempt to have a better understanding of UM by evaluating the performance of UM programs on an AMD MI100 GPU. More specifically, we evaluate data migration using UM against other data transfer techniques for the overall performance of an application, assess the impacts of three commonly used optimization techniques on the kernel execution time of a vector add sample, and compare the performance and productivity of selected benchmarks with and without UM. The performance overhead associated with UM is not trivial, but it can improve programming productivity by reducing lines of code for scientific applications. We aim to present early results and feedback on the UM performance to the vendor.

Jin, Zheming↗

Chameleon: An Adaptive Wear Balancer for Flash Clusters

NAND flash-based Solid State Devices (SSDs) offer the desirable features of high performance, energy efficiency, and fast growing capacity. Thus, the use of SSDs is increasing in distributed storage systems. A key obstacle in this context is that the natural unbalance in distributed I/O workloads can result in wear imbalance across the SSDs in a distributed setting. This, in turn can have significant impact on the reliability, performance, and lifetime of the storage deployment. Extant load balancers for storage systems do not consider SSD wear imbalance when placing data, as the main design goal of such balancers is to extract higher performance. Consequently, data migration is the only common technique for tackling wear imbalance, where existing data is moved from highly loaded servers to the least loaded ones. In this paper, we explore an innovative holistic approach, Chameleon, that employs data redundancy techniques such as replication and erasure-coding, coupled with endurance-aware write offloading, to mitigate wear level imbalance in distributed SSD-based storage. Chameleon aims to balance the wear among different flash servers while meeting desirable objectives of: extending life of flash servers; improving I/O performance; and avoiding bottlenecks. Evaluation with a 50 node SSD cluster shows that Chameleon reduces the wear distribution deviation by 81% while improving the write performance by up to 33%.

Zhao, Nannan↗

CT_Data_of_Gas_Migration_in_Setting_Cement

Computed tomography experimental data associated with the submitted manuscript "Migration of air bubbles in a column of cement slurry" by N’dri Arthur Konan, Eilis Rosenbaum, Dustin Crandall, Mehrdad Massoudi. Full description with citation to be updated when manuscript is accepted.

Computed Tomography↗

FUSRAP Case Study - Benefits and Lessons Learned from Implementation of a Modern Data Solution at Maywood - 18399

This paper focuses on data production and management practices dating back to 1999 that continue to evolve to support the project today. In 2000, the FUSRAP Maywood Project began using a software environmental data management system and laboratory information management system, developed by a single database administrator (DA) and authored in Microsoft Access{sup TM} (MS Access). The original databases included basic functionality including sample number assignment and label generation, tracking of LIMS gamma spec QC and assignment of basic qualifiers and basic database queries. The DA continued over the next fifteen years to refine the EDMS/LIMS by integrating project-specific data evaluation guidance document processes and Quality Assurance/Quality Control (QA/QC) charting and excursion warning tools. With the retirement of the original DA, the U.S. Army Corps of Engineers (USACE)-Cabrera Team procured and implemented a commercial-leaning solution using modern database tools and an established EDMS vendor. For the database transition process, the project team established and configured the new EDMS/LIMS with basic architecture and accessibility; evaluated existing workflows; established/revised LIMS and EDMS-related documentation (manuals and procedures); and conducted dry runs and validation testing. The overall team coordinated closely to facilitate a seamless transition from initial assessment and authoring, to data migration, and finally to resumption of normal ongoing operations. Key features of the new EDMS Subcontractor's software included lookup tables, an import wizard, data checking options and unique indexes. Since the database systems became operational, the technical staff gathered useful feedback from end users (e.g., lab staff, field engineers, task managers, and the third-party data validator) to refine the EDMS/LIMS operation. This feedback triggered improvements in the performance of onsite laboratory qualification forms, promoted consistency in sample ID numbers between the database sample planning screens and field chain-of-custodies, corrected bugs in the LIMS Duplicate Evaluation Report, eliminated data import issues such as blank, inconsistent or missing data from key fields. One of the advantages of the commercial database solution was that it allowed the project to cut cost over time due to the lower cost of database maintenance provided by the commercial database vendor versus the cost of an on-staff DA. Cost savings are estimated at $40,000 per year. There were also indirect cost savings resulting from implementation of the new database since it allowed better integration of the LIMS and EDMS. While there will always be challenges associated with long term records/data management for any old remediation site, the Maywood Team's approach to an upgraded EDMS/LIMS implementation serves as one element of the overall effort to enhance the integrity and reproducibility of critical data that supports the remediation program while at the same time, more effectively using available resources. These lessons-learned will enhance implementation of cost-effective solutions for similar environmental remediation sites. (authors)

97 MATHEMATICS AND COMPUTING↗

dCache: The Storage System of Choice for Data-Intensive Applications

The ever-increasing volumes of data produced by modern scientific facilities like EuXFEL and LHC put significant stress on data management infrastructure operated by laboratories and research centers. The challenges to be addressed span the entire data life cycle, from ingest and efficient data analysis to long-term preservation, typically involving large tape libraries. dCache, a storage system developed in collaboration between the Deutsches Elektronen-Synchrotron (DESY), Fermi National Accelerator Laboratory, and Nordic e-Infrastructure Collaboration (NeIC), is designed to manage a large number of disk servers and to facilitate transparent data migration to and from archival storage. Its multifaceted approach offers a unified method to support a variety of scientific use cases with the same storage infrastructure, including high-throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters, and long-term data preservation on tertiary storage. Initially developed for high energy physics (HEP) experiments, dCache is now used by various scientific communities, including astrophysics, biomedical research, and life sciences, each having specific requirements. This paper presents architecture, deployment strategies, performance and scalability enhancements, and recent advancements in dCache addressing the needs of scientific communities. Finally, we touch on the development and release process, ensuring the software’s high quality.

DCache↗

Winter-Rearing Temperature Affects Growth Profiles, Age of Maturation, and Smolt-to-Adult Returns for Yearling Summer Chinook Salmon in the Upper Columbia River Basin

Abstract We assessed the effects of rearing conditions in four hatchery programs from the upper Columbia River basin on the survival and demographics of yearling summer Chinook Salmon Oncorhynchus tshawytscha over four release years. Juveniles from each hatchery program were initially reared at Eastbank Hatchery near Wenatchee, Washington, (which uses groundwater for fish rearing) and experienced similar rearing temperatures until their first autumn in culture. Fish that were to be used for two of the programs were subsequently transferred to surface water acclimation sites, where they were reared until release the following spring (surface water winter rearing). Fish to be used for the other two programs were overwintered at the Eastbank Hatchery and then transferred to their acclimation and release sites 1 to 2 months before spring release (groundwater winter rearing). Fish from the two rearing strategies experienced contrasting temperature profiles, which in turn affected winter growth, age at maturation, and smolt-to-adult survival (SAS). Overall, the two release groups that were overwintered in colder surface water experienced reduced winter growth, reduced minijack rate, and smaller size at release, but achieved a two- to threefold higher SAS than did the two release groups overwintered in warmer groundwater at Eastbank Hatchery. In addition, based on migration data compiled from fish tagged with PIT tags, smaller juveniles tended to mature at older age-classes than did larger smolts. We concluded that rearing yearling hatchery summer Chinook Salmon under more natural thermal regimes (surface water) may result in the return of larger, older adults that have a higher survival rate than would fish reared under constant or less natural thermal regimes (ground water). These results highlight the importance of the hatchery-rearing environment in shaping the survival and life history of summer Chinook Salmon juveniles released into the Columbia River basin.

Harstad, Deborah L.↗

Age at Release, Size, and Maturation Status Influence Residualism in Hatchery Steelhead

Abstract Steelhead Oncorhynchus mykiss that fail to emigrate seaward after release from hatcheries, commonly referred to as “residuals,” can have negative impacts on natural populations ranging from competition and predation to interbreeding with returning anadromous adults. We investigated how age at release, size, and maturation status influenced the rate of residual production in hatchery summer-run steelhead released from the Winthrop National Fish Hatchery (Methow River, Washington) between 2010 and 2015. Migration data from 21,598 individuals implanted with PIT tags identified 1,783 residual steelhead expressing two distinct phenotypes: immature male and female parr; and precociously mature males. We found that age at release significantly affected the predominant residual phenotype. Age-1 steelhead residuals (S1 rearing strategy) were dominated by smaller parr of both sexes (fish < 146 mm FL), while age-2 residuals (S2 rearing strategy) were dominated by mature males, although both phenotypes were present in both S1 and S2 residual groups. Collections of residual steelhead in the Methow River indicated that parr phenotype residuals grew as well as natural-origin juvenile O. mykiss, suggesting potential competition for food resources and habitat. Detections of PIT tags within the Methow River basin indicated that precocious male residuals may overlap both spatially and temporally with previously documented spawning anadromous adults, posing a potential genetic management risk. Both residual phenotypes had poor overwinter survival, and only 1 of the 1,783 residual fish eventually returned to the Methow River as an anadromous adult. We conclude that the ecological and genetic consequences of residual steelhead far outweigh their potential contribution to anadromous production, and measures should be taken to reduce their production by changing hatchery rearing practices.

Tatara, Christopher P.↗

olcf/hsi_xfer

A wrapper for the `hsi` tool that provides a simple user interface to allow the most efficient and least stressful (to the system) way to migrate data off of HPSS filesystems

Wynne, JamesRiley [Oak Ridge National Laboratory (↗

Replication Data for: Hydrogen migration at restructuring palladium-silver oxide boundaries dramatically enhances reduction rate of silver oxide

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Microseismic Monitoring at the Farnsworth CO 2 -EOR Field

The Farnsworth Unit in northern Texas is a field site for studying geologic carbon storage during enhanced oil recovery (EOR) using CO 2 . Microseismic monitoring is essential for risk assessment by detecting fluid leakage and fractures. We analyzed borehole microseismic data acquired during CO 2 injection and migration, including data denoising, event detection, event location, magnitude estimation, moment tensor inversion, and stress field inversion. We detected and located two shallow clusters, which occurred during increasing injection pressure. The two shallow clusters were also featured by large b values and tensile cracking moment tensors that are obtained based on a newly developed moment tensor inversion method using single-borehole data. The inverted stress fields at the two clusters showed large deviations from the regional stress field. The results provide evidence for microseismic responses to CO 2 /fluid injection and migration.

02 PETROLEUM↗

Replication Data for: Facilitating hydrogen atom migration via a dense phase on palladium islands to a surrounding silver surface

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Replication Data for: Facilitating hydrogen atom migration via a dense phase on palladium islands to a surrounding silver surface

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗