Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data migration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Migratory stopover timing is predicted by breeding latitude, not habitat quality, in a long-distance migratory songbird

The timing of migration can have important survival impacts, as birds must synchronize their movements with favourable environmental conditions to reach their destination. The timing of arrival at and duration of migratory stopover may be largely governed by environmental conditions experienced en route as well as by endogenous factors, but our understanding of these processes is limited. We used light-level geolocators to collect start-to-finish spatio-temporal migration data for a declining aerial insectivore, the Purple Martin ( Progne subis ), that travels seasonally between North and South America. Using data obtained for birds originating from range-wide breeding populations, our objectives were to test intrinsic and extrinsic hypotheses for migration stopover duration as well as to identify important stopover regions during fall migration. We examined whether breeding latitude, fall migration timing, age, sex or habitat quality at stopover sites (measured using Normalized Difference Vegetation Index) influenced the duration of stopovers. We found that most individuals rely on the eastern coast of the Yucatan Peninsula, Honduras, and Nicaragua for stopovers during fall migration, where duration ranged from 1 to 36 days (average 6.8 ± 8.2). Stopovers in these regions were later and of longer duration for more northern breeding populations. Only breeding latitude predicted stopover duration, and not habitat quality at stopovers, lending support to the hypothesis that duration is prescribed by endogenous factors. Lastly, the important core stopover regions we documented could be targeted for conservation efforts, particularly for steeply-declining, more northern breeding populations that have greater stopover duration in these areas.

54 ENVIRONMENTAL SCIENCES↗

FUSRAP Case Study - Benefits and Lessons Learned from Implementation of a Modern Data Solution at Maywood - 18399

This paper focuses on data production and management practices dating back to 1999 that continue to evolve to support the project today. In 2000, the FUSRAP Maywood Project began using a software environmental data management system and laboratory information management system, developed by a single database administrator (DA) and authored in Microsoft Access{sup TM} (MS Access). The original databases included basic functionality including sample number assignment and label generation, tracking of LIMS gamma spec QC and assignment of basic qualifiers and basic database queries. The DA continued over the next fifteen years to refine the EDMS/LIMS by integrating project-specific data evaluation guidance document processes and Quality Assurance/Quality Control (QA/QC) charting and excursion warning tools. With the retirement of the original DA, the U.S. Army Corps of Engineers (USACE)-Cabrera Team procured and implemented a commercial-leaning solution using modern database tools and an established EDMS vendor. For the database transition process, the project team established and configured the new EDMS/LIMS with basic architecture and accessibility; evaluated existing workflows; established/revised LIMS and EDMS-related documentation (manuals and procedures); and conducted dry runs and validation testing. The overall team coordinated closely to facilitate a seamless transition from initial assessment and authoring, to data migration, and finally to resumption of normal ongoing operations. Key features of the new EDMS Subcontractor's software included lookup tables, an import wizard, data checking options and unique indexes. Since the database systems became operational, the technical staff gathered useful feedback from end users (e.g., lab staff, field engineers, task managers, and the third-party data validator) to refine the EDMS/LIMS operation. This feedback triggered improvements in the performance of onsite laboratory qualification forms, promoted consistency in sample ID numbers between the database sample planning screens and field chain-of-custodies, corrected bugs in the LIMS Duplicate Evaluation Report, eliminated data import issues such as blank, inconsistent or missing data from key fields. One of the advantages of the commercial database solution was that it allowed the project to cut cost over time due to the lower cost of database maintenance provided by the commercial database vendor versus the cost of an on-staff DA. Cost savings are estimated at $40,000 per year. There were also indirect cost savings resulting from implementation of the new database since it allowed better integration of the LIMS and EDMS. While there will always be challenges associated with long term records/data management for any old remediation site, the Maywood Team's approach to an upgraded EDMS/LIMS implementation serves as one element of the overall effort to enhance the integrity and reproducibility of critical data that supports the remediation program while at the same time, more effectively using available resources. These lessons-learned will enhance implementation of cost-effective solutions for similar environmental remediation sites. (authors)

97 MATHEMATICS AND COMPUTING↗

dCache: The Storage System of Choice for Data-Intensive Applications

The ever-increasing volumes of data produced by modern scientific facilities like EuXFEL and LHC put significant stress on data management infrastructure operated by laboratories and research centers. The challenges to be addressed span the entire data life cycle, from ingest and efficient data analysis to long-term preservation, typically involving large tape libraries. dCache, a storage system developed in collaboration between the Deutsches Elektronen-Synchrotron (DESY), Fermi National Accelerator Laboratory, and Nordic e-Infrastructure Collaboration (NeIC), is designed to manage a large number of disk servers and to facilitate transparent data migration to and from archival storage. Its multifaceted approach offers a unified method to support a variety of scientific use cases with the same storage infrastructure, including high-throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters, and long-term data preservation on tertiary storage. Initially developed for high energy physics (HEP) experiments, dCache is now used by various scientific communities, including astrophysics, biomedical research, and life sciences, each having specific requirements. This paper presents architecture, deployment strategies, performance and scalability enhancements, and recent advancements in dCache addressing the needs of scientific communities. Finally, we touch on the development and release process, ensuring the software’s high quality.

DCache↗

Tuple spaces in hardware for accelerated implicit routing

Organizing and optimizing data objects on networks with support for data migration and failing nodes is a complicated problem to handle as systems grow. The goal of this work is to demonstrate that high levels of speedup can be achieved by moving responsibility for finding, fetching, and staging data into an FPGA-based network card. We present a system for implicit routing of data via FPGA-based network cards. In this system, data structures are requested by name, and the network of FPGAs finds the data within the network and relays the structure to the requester. This is acheived through successive examination of hardware hash tables implemented in the FPGA. By avoiding software stacks between nodes, the data is quickly fetched entirely through FPGA-FPGA interaction. The performance of this system is orders of magnitude faster than software implementations due to the improved speed of the hash tables and lowered latency between the network nodes.

42 ENGINEERING↗

Multi-jagged: A scalable parallel spatial partitioning algorithm

Geometric partitioning is fast and effective for load-balancing dynamic applications, particularly those requiring geometric locality of data (particle methods, crash simulations). We present, to our knowledge, the first parallel implementation of a multidimensional-jagged geometric partitioner. In contrast to the traditional recursive coordinate bisection algorithm (RCB), which recursively bisects subdomains perpendicular to their longest dimension until the desired number of parts is obtained, our algorithm does recursive multi-section with a given number of parts in each dimension. By computing multiple cut lines concurrently and intelligently deciding when to migrate data while computing the partition, we minimize data movement compared to efficient implementations of recursive bisection. We demonstrate the algorithm's scalability and quality relative to the RCB implementation in Zoltan on both real and synthetic datasets. Our experiments show that the proposed algorithm performs and scales better than RCB in terms of run-time without degrading the load balance. Lastly, our implementation partitions 24 billion points into 65,536 parts within a few seconds and exhibits near perfect weak scaling up to 6K cores.

97 MATHEMATICS AND COMPUTING↗

Winter-Rearing Temperature Affects Growth Profiles, Age of Maturation, and Smolt-to-Adult Returns for Yearling Summer Chinook Salmon in the Upper Columbia River Basin

Abstract We assessed the effects of rearing conditions in four hatchery programs from the upper Columbia River basin on the survival and demographics of yearling summer Chinook Salmon Oncorhynchus tshawytscha over four release years. Juveniles from each hatchery program were initially reared at Eastbank Hatchery near Wenatchee, Washington, (which uses groundwater for fish rearing) and experienced similar rearing temperatures until their first autumn in culture. Fish that were to be used for two of the programs were subsequently transferred to surface water acclimation sites, where they were reared until release the following spring (surface water winter rearing). Fish to be used for the other two programs were overwintered at the Eastbank Hatchery and then transferred to their acclimation and release sites 1 to 2 months before spring release (groundwater winter rearing). Fish from the two rearing strategies experienced contrasting temperature profiles, which in turn affected winter growth, age at maturation, and smolt-to-adult survival (SAS). Overall, the two release groups that were overwintered in colder surface water experienced reduced winter growth, reduced minijack rate, and smaller size at release, but achieved a two- to threefold higher SAS than did the two release groups overwintered in warmer groundwater at Eastbank Hatchery. In addition, based on migration data compiled from fish tagged with PIT tags, smaller juveniles tended to mature at older age-classes than did larger smolts. We concluded that rearing yearling hatchery summer Chinook Salmon under more natural thermal regimes (surface water) may result in the return of larger, older adults that have a higher survival rate than would fish reared under constant or less natural thermal regimes (ground water). These results highlight the importance of the hatchery-rearing environment in shaping the survival and life history of summer Chinook Salmon juveniles released into the Columbia River basin.

Harstad, Deborah L.↗

Age at Release, Size, and Maturation Status Influence Residualism in Hatchery Steelhead

Abstract Steelhead Oncorhynchus mykiss that fail to emigrate seaward after release from hatcheries, commonly referred to as “residuals,” can have negative impacts on natural populations ranging from competition and predation to interbreeding with returning anadromous adults. We investigated how age at release, size, and maturation status influenced the rate of residual production in hatchery summer-run steelhead released from the Winthrop National Fish Hatchery (Methow River, Washington) between 2010 and 2015. Migration data from 21,598 individuals implanted with PIT tags identified 1,783 residual steelhead expressing two distinct phenotypes: immature male and female parr; and precociously mature males. We found that age at release significantly affected the predominant residual phenotype. Age-1 steelhead residuals (S1 rearing strategy) were dominated by smaller parr of both sexes (fish < 146 mm FL), while age-2 residuals (S2 rearing strategy) were dominated by mature males, although both phenotypes were present in both S1 and S2 residual groups. Collections of residual steelhead in the Methow River indicated that parr phenotype residuals grew as well as natural-origin juvenile O. mykiss, suggesting potential competition for food resources and habitat. Detections of PIT tags within the Methow River basin indicated that precocious male residuals may overlap both spatially and temporally with previously documented spawning anadromous adults, posing a potential genetic management risk. Both residual phenotypes had poor overwinter survival, and only 1 of the 1,783 residual fish eventually returned to the Methow River as an anadromous adult. We conclude that the ecological and genetic consequences of residual steelhead far outweigh their potential contribution to anadromous production, and measures should be taken to reduce their production by changing hatchery rearing practices.

Tatara, Christopher P.↗

OptEase and TrapEase Vena Cava Filters: A Single-Center Experience in 258 Patients

We aimed to evaluate the efficacy and safety of the OptEase and TrapEase (both from Cordis, Roden, Netherlands) vena cava filters in the prevention of pulmonary embolism (PE). Between May 2004 and December 2008, OptEase (permanent/retrievable; n = 228) or TrapEase (permanent; n = 30) vena cava filters were placed in 258 patients (160 female and 98 male; mean age 62 years [range 22 to 97]). Indications were as follows: prophylaxis for PE (n = 239), contraindication for anticoagulation in the presence of PE or DVT (n = 10), and development of PE or DVT despite anticoagulation (n = 9). Medical records were retrospectively reviewed for indications, clinical results, and procedure-related complications during placement and retrieval. Clinical PE did not develop in any of the patients. However, radiologic signs of segmental PE were seen in 6 of 66 patients with follow-up imaging data. Migration or fracture of the filter or cava perforation was not seen in any of the patients. Except for a single case of asymptomatic total cava thrombosis, no thrombotic occlusion was observed. One hundred forty-one patients were scheduled to undergo filter removal; however, 17 of them were not suitable for such based on venography evaluation. Removal was attempted in 124 patients and was successful in 115 of these (mean duration of retention 11 days [range 4 to 23]). Nine filters could not be removed. Permanent/retrievable vena cava filters are safe and effective devices for PE prophylaxis and for the management of venous thromboembolism by providing the option to be left in place.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A hybrid incremental projection method for thermal-hydraulics applications

In this paper, a new second-order accurate, hybrid, incremental projection method for time-dependent incompressible viscous flow is introduced in this paper. The hybrid finite-element/finite-volume discretization circumvents the well-known Ladyzhenskaya–Babuška–Brezzi conditions for stability, and does not require special treatment to filter pressure modes by either Rhie–Chow interpolation or by using a Petrov–Galerkin finite element formulation. The use of a co-velocity with a high-resolution advection method and a linearly consistent edge-based treatment of viscous/diffusive terms yields a robust algorithm for a broad spectrum of incompressible flows. The high-resolution advection method is shown to deliver second-order spatial convergence on mixed element topology meshes, and the implicit advective treatment significantly increases the stable time-step size. The algorithm is robust and extensible, permitting the incorporation of features such as porous media flow, RANS and LES turbulence models, and semi-/fully-implicit time stepping. A series of verification and validation problems are used to illustrate the convergence properties of the algorithm. The temporal stability properties are demonstrated on a range of problems with 2 ≤ CFL ≤ 100. The new flow solver is built using the Hydra multiphysics toolkit. The Hydra toolkit is written in C++ and provides a rich suite of extensible and fully-parallel components that permit rapid application development, supports multiple discretization techniques, provides I/O interfaces, dynamic run-time load balancing and data migration, and interfaces to scalable popular linear solvers, e.g., in open-source packages such as HYPRE, PETSc, and Trilinos.

97 MATHEMATICS AND COMPUTING↗

dCache, agile adoption of storage technology

For over a decade, dCache has been synonymous with large-capacity, fault-tolerant storage using commodity hardware that supports seamless data migration to and from tape. In this paper we provide some recent news of changes within dCache and the community surrounding it. We describe the flexible nature of dCache that allows both externally developed enhancements to dCache facilities and the adoption of new technologies. Finally, we present information about avenues the dCache team is exploring for possible future improvements in dCache.

Millar, A. P.↗

olcf/hsi_xfer

A wrapper for the `hsi` tool that provides a simple user interface to allow the most efficient and least stressful (to the system) way to migrate data off of HPSS filesystems

Wynne, JamesRiley [Oak Ridge National Laboratory (↗

Integrated Status and Effectiveness Monitoring Program Population Estimates for Juvenile Salmonids in Nason Creek, WA ; 2008 Annual Report.

This report summarizes juvenile coho, spring Chinook, and steelhead salmon migration data collected at a 1.5m diameter cone rotary fish trap on Nason Creek during 2008; providing abundance and freshwater productivity estimates. We used species enumeration at the trap and efficiency trials to describe emigration timing and to estimate the number of emigrants. Trapping began on March 2, 2008 and was suspended on December 11, 2008 when snow and ice accumulation prevented operation. During 2008, 0 brood year (BY) 2006 coho, 1 BY2007 coho, 906 BY2006 spring Chinook, 323 BY2007 fry Chinook, 2,077 BY2007 subyearling Chinook, 169 steelhead smolts, 414 steelhead fry and 2,390 steelhead parr were trapped. Mark-recapture trap efficiency trials were performed over a range of stream discharge stages. A total of 2,639 spring Chinook, 2,154 steelhead and 12 bull trout were implanted with Passive Integrated Transponder (PIT) tags. Most PIT tagged fish were used for trap efficiency trials. We were unable to identify a statistically significant relationship between stream discharge and trap efficiency, thus, pooled efficiency estimates specific to species and trap size/position were used to estimate the number of fish emigrating past the trap. We estimate that 5,259 ({+-} 359; 95% CI) BY2006 Chinook, 16,816 ({+-} 731; 95% CI) BY2007 Chinook, and 47,868 ({+-} 3,780; 95% CI) steelhead parr and smolts emigrated from Nason Creek in 2008.

13 HYDRO ENERGY↗

Active Flash: Performance-Energy Tradeoffs for Out-of-Core Processing on Non-Volatile Memory Devices

In this abstract, we study the performance and energy tradeoffs involved in migrating data analysis into the flash device, a process we refer to as Active Flash. The Active Flash paradigm is similar to 'active disks', which has received considerable attention. Active Flash allows us to move processing closer to data, thereby minimizing data movement costs and reducing power consumption. It enables true out-of-core computation. The conventional definition of out-of-core solvers refers to an approach to process data that is too large to fit in the main memory and, consequently, requires access to disk. However, in Active Flash, processing outside the host CPU literally frees the core and achieves real 'out-of-core' analysis. Moving analysis to data has long been desirable, not just at this level, but at all levels of the system hierarchy. However, this requires a detailed study on the tradeoffs involved in achieving analysis turnaround under an acceptable energy envelope. To this end, we first need to evaluate if there is enough computing power on the flash device to warrant such an exploration. Flash processors require decent computing power to run the internal logic pertaining to the Flash Translation Layer (FTL), which is responsible for operations such as address translation, garbage collection (GC) and wear-leveling. Modern SSDs are composed of multiple packages and several flash chips within a package. The packages are connected using multiple I/O channels to offer high I/O bandwidth. SSD computing power is also expected to be high enough to exploit such inherent internal parallelism within the drive to increase the bandwidth and to handle fast I/O requests. More recently, SSD devices are being equipped with powerful processing units and are even embedded with multicore CPUs (e.g. ARM Cortex-A9 embedded processor is advertised to reach 2GHz frequency and deliver 5000 DMIPS; OCZ RevoDrive X2 SSD has 4 SandForce controllers, each with 780MHz max frequency Tensilica core). Efforts that take advantage of the available computing cycles on the processors on SSDs to run auxiliary tasks other than actual I/O requests are beginning to emerge. Kim et al. investigate database scan operations in the context of processing on the SSDs, and propose dedicated hardware logic to speed up scans. Also, cluster architectures have been explored, which consist of low-power embedded CPUs coupled with small local flash to achieve fast, parallel access to data. Processor utilization on SSD is highly dependent on workloads and, therefore, they can be idle during periods with no I/O accesses. We propose to use the available processing capability on the SSD to run tasks that can be offloaded from the host. This paper makes the following contributions: (1) We have investigated Active Flash and its potential to optimize the total energy cost, including power consumption on the host and the flash device; (2) We have developed analytical models to analyze the performance-energy tradeoffs for Active Flash, by treating the SSD as a blackbox, this is particularly valuable due to the proprietary nature of the SSD internal hardware; and (3) We have enhanced a well-known SSD simulator (from MSR) to implement 'on-the-fly' data compression using Active Flash. Our results provide a window into striking a balance between energy consumption and application performance.

42 ENGINEERING↗

Area 2: Inexpensive Monitoring and Uncertainty Assessment of CO 2 Plume Migration using Injection Data

In-depth understanding of the long-term fate of CO₂ in the subsurface requires study and analysis of the reservoir formation, the overlaying caprock formation, and adjacent faults. Because there is significant uncertainty in predicting the location and extent of geologic heterogeneity that can impact the future migration of CO₂ in the subsurface, there is a need to develop algorithms that can reliably quantify this uncertainty in plume migration. This project is focused on the development of a model selection algorithm that refines an initial suite of subsurface models representing the prior uncertainty to create a posterior set of subsurface models that reflect injection performance consistent with that observed. Such posterior models can be used to represent uncertainty in the future migration of the CO₂ plume. Because only injection data is required, the method provides a very inexpensive method to map the migration of the plume and the associated uncertainty in migration paths. The model selection method developed as part of this project mainly consists of assessing the connectivity/dynamic characteristics of a large prior ensemble of models, grouping the models on the basis of their expected dynamic response, selecting the subgroup of models that most closely yield dynamic response closest to the observed dynamic data, and finally quantifying the uncertainty in plume migration using the selected subset of models. The main accomplishment of the project is the development of a software module within the SGEMS earth modeling software package that implements the model selection methodology. This software module was subsequently applied to analyze CO₂ plume migration in two field projects – the In Salah CO₂ Injection project in Algeria and CO₂ injection into the Utsira formation in Norway. These applications of the software revealed that the proxies developed in this project for quickly assessing the dynamic characteristics of the reservoir were highly efficient and yielded accurate grouping of reservoir models. The plume migration paths probabilistically assessed by the method were confirmed by field observations and auxiliary data. The report also documents the application of the software to answer practical questions such as the optimum location of monitoring wells to reliably assess the migration of CO₂ plume, the effect of CO₂-rock interactions on plume migration and the ability to detect the plume under those conditions and the effect of a slow, unresolved leak on the predictions of plume migration.

54 ENVIRONMENTAL SCIENCES↗

Replication Data for: Hydrogen migration at restructuring palladium-silver oxide boundaries dramatically enhances reduction rate of silver oxide

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Prestack reverse time migration for 3D marine reflection seismic data

Prestack reverse time migration (RTM) is a method for imaging the subsurface using the inner product of wavefield extrapolation in shot domain and in receiver domain. It is well known that RTM is better for preserving amplitudes and phases than other prestack migrations. Since 3D seismic data is huge data volume and it needs heavy computing works, it requires parallel computing in order to have a meaningful depth image of the 3D subsurface. We implemented a parallelized version of 3D RTM for prestack depth migration. The results of numerical example for 3D SEG/EAGE salt model showed good agreement with the original geological model. We applied RTM to offshore 3D seismic reflection data. The study area is 12 × 25 km with 120 survey lines. Shot and receiver spacing is 25 m and 12.5 m. The line spacing is 100 m. Shot gathers were preprocessed to enhance signal to noise ratio and velocity model was calculated from conventional stack velocity. Both of them were used to obtain 3D image using RTM. The results show reasonable subsurface image.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Microseismic Monitoring at the Farnsworth CO 2 -EOR Field

The Farnsworth Unit in northern Texas is a field site for studying geologic carbon storage during enhanced oil recovery (EOR) using CO 2 . Microseismic monitoring is essential for risk assessment by detecting fluid leakage and fractures. We analyzed borehole microseismic data acquired during CO 2 injection and migration, including data denoising, event detection, event location, magnitude estimation, moment tensor inversion, and stress field inversion. We detected and located two shallow clusters, which occurred during increasing injection pressure. The two shallow clusters were also featured by large b values and tensile cracking moment tensors that are obtained based on a newly developed moment tensor inversion method using single-borehole data. The inverted stress fields at the two clusters showed large deviations from the regional stress field. The results provide evidence for microseismic responses to CO 2 /fluid injection and migration.

02 PETROLEUM↗