Search NASA⌕ Search

SEARCH · Search NASA

Results for “data replication”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Data and scripts associated with "Coupled primary production and respiration in a large river contrasts with smaller rivers and streams."

This data package is associated with the publication "Coupled primary production and respiration in a large river contrasts with smaller rivers and streams." in review at Limnology and Oceanography (Roley et al. 2023). This study focuses on understanding ecosystem metabolism for the Hanford Reach of the Columbia River in Washington state, a free-flowing stretch with a substantial discharge. Large rivers have been overlooked compared to small and medium rivers due to the challenges associated with measurements. Our study presents novel ways to address these challenges and highlights that metabolism patterns in large rivers differ from those observed in small-medium rivers and requires the application of knowledge and tools beyond those implemented for smaller rivers.This data package includes the data and R scripts for the analyses described in Roley et al. 2023. It includes dissolved oxygen and temperature data from a dissolved oxygen HOBO sensor, light data collected from the National Solar Radiation Database (https://nsrdb.nrel.gov/) and hydrologic variables estimated from the MASS-1 model (Niehus et al.; 2014). It also includes metabolism estimates (gross primary production, ecosystem respiration, and net ecosystem production) estimated via streamMetabolizer (Appling et al.; 2018). All analyses in the paper can be replicated with these data and scripts.The data package is comprised of one main data folder. The folder includes (1) file-level metadata (flmd); (2) a data dictionary (dd) for each data file; (3) data files; and (4) R scripts for metabolism estimates and data analysis. All files are .R, .csv, or .pdf.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Coping with silent and fail-stop errors at scale by combining replication and checkpointing

This paper provides a model and an analytical study of replication as a technique to cope with silent errors, as well as a mixture of both silent and fail-stop errors on large-scale platforms. Compared with fail-stop errors that are immediately detected when they occur, silent errors require a detection mechanism. To detect silent errors, many application-specific techniques are available, either based on algorithms (e.g., ABFT), invariant preservation or data analytics, but replication remains the most transparent and least intrusive technique. We explore the right level (duplication, triplication or more) of replication for two frameworks: (i) when the platform is subject to only silent errors, and (ii) when the platform is subject to both silent and fail-stop errors. A higher level of replication is more expensive in terms of resource usage but enables to tolerate more errors and to even correct some errors, hence there is a trade-off to be found. Replication is combined with checkpointing and comes with two flavors: process replication and group replication. Process replication applies to message-passing applications with communicating processes. Each process is replicated, and the platform is composed of process pairs, or triplets. Group replication applies to black-box applications, whose parallel execution is replicated several times. The platform is partitioned into two halves (or three thirds). In both scenarios, results are compared before each checkpoint, which is taken only when both results (duplication) or two out of three results (triplication) coincide. Otherwise, one or more silent errors have been detected, and the application rolls back to the last checkpoint, as well as when fail-stop errors have struck. We provide a detailed analytical study for all of these scenarios, with formulas to decide, for each scenario, the optimal parameters as a function of the error rate, checkpoint cost, and platform size. We also report a set of extensive simulation results that nicely corroborates the analytical model.

Checkpointing↗
DOE OSTI2025

A New Vehicle-to-Vehicle Communication System: Visual-Enhanced Cooperative Traffic Operations

The advent of Connected and Autonomous Vehicles (CAVs) has highlighted the necessity for robust communication systems between vehicles and their environment. This study introduces a novel vehicle-to-vehicle (V2V) communication system, termed the Visual-Enhanced Cooperative Traffic Operations (VECTOR) system. The VECTOR system addresses the need for robust communication by converting dynamic data (including velocity and yaw angle data) into binary code, which is displayed on an LED panel mounted on the top of the vehicle. Following vehicles detect this panel and decode the information using a camera, implementing a visual-based communication method. VECTOR system employs a comprehensive five-module process. Initially, polynomial fitting techniques are applied to velocity data over fixed time intervals using third-degree polynomials, with validation via R² and MSE metrics. The second module converts velocity and yaw angle data into binary form, thereby enhancing detection and processing efficiency. The third module focuses on improving detection stability across various environmental conditions to enhance traffic safety. The fourth module decodes the binary data back into trajectory information, ensuring the fidelity of velocity and yaw angles. The final module integrates eco-control through the VECTOR system, employing advanced control algorithms to minimize energy consumption in CAVs. Experimental evaluations conducted using a modified CAV test platform based on the Lincoln MKZ demonstrate the feasibility and efficiency of the VECTOR system, achieving a 75% R-squared accuracy rate in replicating original velocity data. This methodology not only highlights potential applications but also underscores significant implications for advancing CAV technology.

Ma, Ke↗
DOE OSTI2020

Aligned FTICR-MS, Respiration, and Biochemical Transformation Data from Columbia River Sediment Incubations Associated with: “Carbon Limitation Leads to Thermodynamic Regulation of Aerobic Metabolism”

Columbia River hyporheic zone sediments from the Hanford Site 300 Area in eastern Washington were incubated in a full factorial design with different organic matter (OM) amendments. The aim of the experiment was to test the influence of OM thermodynamics on aerobic respiration across different organic carbon pools and concentrations. This dataset is comprised of (1) a csv with high resolution characterization of dissolved organic matter via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) analyzed through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory), (2) a csv with sample IDs, replicates, amendments, dissolved oxygen (DO) measurements, and sampling time points, (3) a csv with sample IDs, replicates, respiration rates, FTICR summary metrics, and relative abundance of chemical classes; and (4) a csv with the number of chemical transformations in each sample replicate (microcosm). The data are associated with the publication “Carbon Limitation Leads to Thermodynamic Regulation of Aerobic Metabolism” published in ES&T Letters (Garayburu-Caruso et al., 2020). Please use the data package’s DOI to cite the data package. We ask that you acknowledge the U.S. Department of Energy (DOE) Biological and Environmental Research (BER) Subsurface Biogeochemical Research (SBR) program when using the data. All data are free to be used for any purpose, such as for manuscripts, presentations, and grant proposals. There is no obligation to include data package authors as co-authors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Trace: a high-throughput tomographic reconstruction engine for large-scale datasets

Abstract Background Modern synchrotron light sources and detectors produce data at such scale and complexity that large-scale computation is required to unleash their full power. One of the widely used imaging techniques that generates data at tens of gigabytes per second is computed tomography (CT). Although CT experiments result in rapid data generation, the analysis and reconstruction of the collected data may require hours or even days of computation time with a medium-sized workstation, which hinders the scientific progress that relies on the results of analysis. Methods We present Trace, a data-intensive computing engine that we have developed to enable high-performance implementation of iterative tomographic reconstruction algorithms for parallel computers. Trace provides fine-grained reconstruction of tomography datasets using both (thread-level) shared memory and (process-level) distributed memory parallelization. Trace utilizes a special data structure called replicated reconstruction object to maximize application performance. We also present the optimizations that we apply to the replicated reconstruction objects and evaluate them using tomography datasets collected at the Advanced Photon Source. Results Our experimental evaluations show that our optimizations and parallelization techniques can provide 158× speedup using 32 compute nodes (384 cores) over a single-core configuration and decrease the end-to-end processing time of a large sinogram (with 4501 × 1 × 22,400 dimensions) from 12.5 h to <5 min per iteration. Conclusion The proposed tomographic reconstruction engine can efficiently process large-scale tomographic data using many compute nodes and minimize reconstruction times.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Late Holocene Cliff Retreat in Del Mar, CA, Revealed From Shore Platform 10 Be Concentrations and Numerical Modeling

Rocky coast cliff retreat presents a hazard to coastal communities and infrastructure that is potentially amplified under rising sea level conditions, among other factors. Unfortunately, constraints on retreat rates are typically limited to those derived from imagery and maps spanning the last ~100 years. Here, we use a newly developed coupled model of shore platform profile evolution and cosmogenic radionuclide production that considers the influence of relative sea level (RSL) rise, weathering, material resistance, and wave height decay to model cliff retreat over millennial timescales and its potential drivers in Del Mar, California. We demonstrate the ability to use topographic and bathymetric measurements from a narrow shore platform along with a limited data set of nine cosmogenic 10Be concentrations extending ~125 m from the cliff base to obtain modeled cliff retreat rates that steadily range from 5.0 to 12.5 cm yr -1 over the last two millennia until 100 years before present. These rates are consistent with modern retreat rates of about 2–19 cm yr -1 here. RSL rise in Southern California remained relatively constant during the late Holocene, potentially explaining the relatively stable modeled cliff retreat rate over this time. We also explore the relative influence of weathering, material resistance, and wave erosion efficacy and find that both weathering and wave-driven erosion are necessary to replicate the measured data at this location, with the latter exerting a stronger control on model acceptance, suggesting that waves may provide a possible mechanism by which RSL rise may influence coastal cliff erosion in southern California.

58 GEOSCIENCES↗
DOE OSTI2020

SISSO (Sure-independence-screening sparsifying-operator regressor)

Implementation of the SISSO regression algorithm in MATLAB. The SISSO regression algorithm iteratively selects model features from candidates, converging even when the number of possible features is much greater than the number of available data points. Includes a test script that validates the algorithm by replicating the results using data and procedure from https://analytics-toolkit.nomad-coe.eu/hub/user-redirect/notebooks/tutorials/compressed_sensing.ipynb. Python code from the SISSO regressor in 'sisso.py', from the link above, was used as the basis for developing the MATLAB implementation. The SISSO regression algorithm is detailed by the original authors in R. Ouyang, S. Curtarolo, E. Ahmetcik et al., Phys. Rev. Mater. 2, 083802 (2018), R. Ouyang, E. Ahmetcik, C. Carbogno, M. Scheffler, and L. M. Ghiringhelli, J. Phys.: Mater. 2, 024002 (2019).

Gasper, Paul↗
DOE OSTI2020

Depth-resolved soil data from DOE-LM Riverton Wyoming site, April-September 2017

Averaged (from 3 to 5 replicates) and QA/QC:d data for soil cores taken roughly every month in the period April 5 to September 13 in 2017 at a location close to DOE Legacy Management well 855 at the Riverton, Wyoming floodplain site. The groundwater at this site exhibits persistent U, Mo, and sulfate plumes and is one of the field sites in focus for the SLAC Groundwater Quality SFA program. Cores were separated into 5-20 cm segments based on soil horizonation and each segment was subsampled for microbial analyses (data available at the NCBI Single Read Archive (SRA) Database, https://www.ncbi.nlm.nih.gov/sra/, BioProject ID# PRJNA626616) in addition to the soil analyses included in this dataset. The soil analyses dataset includes aerobic and anaerobic respiration rate estimates (MicroResp method), water content estimates (on collected samples, not in situ), total C, N, S, Ca, K, Mg, Na, Fe, As, Mo, U, and organic-C concentrations, water extractable concentrations of the same elements, and HCl-extractable Fe(II) concentrations.There are four files included in this data package: metadataFile.csv, avgDataFile.csv, methodFile.csv, and RVT2017soilData.xlsx. The excel file contains the same information as the individual csv-files (in separate tabs).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A structural equation modeling approach to leveraging the power of extant sentiment analysis tools

Machine-derived sentiment analysis has become a pervasive and useful tool to address a wide array of issues in natural language processing. Leading technology companies such as Google now provide sentiment analysis tools (SATs) as readily accessible online products. Academic researchers develop and make available SATs to support the research enterprise. One of the major challenges with SATs is the inconsistencies in results among the various SATs. Consequently, the selection of a SAT for a specific purpose may significantly impact the application. This study addresses the foregoing problem by utilizing structural equation modeling to merge the outputs of SATs to develop a combined sentiment metric without the need for a labeled training dataset. This method is applicable to a wide range of text-based problems, is data-driven, and replicable. It was tested using three publicly available datasets and compared against seven different SATs. The results indicate that as a continous measure, the proposed method outperformed other SATs in the movie reviews and SemEval datasets, and achieved a tie for first place with IBM Watson on the Sentiment 140 dataset. Also, compared to the published major alternatives, the arithmetic mean solution, this approach performed better across these three datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Wild bees and natural enemies prefer similar flower species and respond to similar plant traits

Designing wildflower habitats to support beneficial insects providing pollination and pest control services is important for supporting sustainable crop production. It is often desirable to support both groups of insects, making the selection of resource plants for insect conservation programs more challenging. Moreover, the process of selecting resource plants is complicated by the array of possible options in each region, and the need to provide resources over the entire growing season. Identifying traits shared by resource plants that are attractive to both bees and natural enemies can reduce the need to evaluate new plants in each region, by providing a guide for the types of plants expected to be rewarding to these insects. Using insect visitation data collected from replicated common garden plantings of native wildflower and shrub species from the Great Lakes region of the United States, we found a high degree of correlation between the abundance of bees and natural enemies visiting native plant species. These results were used to identify a set of 15 plant species that can provide resources for these insects throughout the summer. Across all tested species, pollen quantity per flower and the week of bloom were positively correlated with some, but not all, taxonomic groupings of beneficial insects. In contrast, floral area was consistently positively associated with visitation of both natural enemies and wild bees. This trait is easy to document and can allow for efficient local testing of potential resource plants, providing a faster path to implementing insect conservation in working landscapes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Nature-based climate solutions can help mitigate the radiative forcing that follows deforestation

Widespread expansion of agriculture and forestry has altered the surface of the Earth, the composition of the atmosphere, and as a result, the climate. Here we quantify the radiative forcing caused by the historical deforestation of an ecoregion in the U.S. Upper Midwest and the adoption of eight nature-based climate solutions. We combined regional forest inventory data with over three decades of remote sensing and in situ data from a replicated land use change experiment. Deforestation of the region caused net global warming (1626 ± 44 µW m -2 ), mainly from the 76 % reduction of ecosystem carbon stocks, but also from the 84 % reduction of the soil methane sink and the 115 % increase in soil nitrous oxide emissions. The associated albedo increase offset 24 % of this greenhouse gas induced warming. For the adoption of nature-based climate solutions, we found that conservation agriculture can provide -39 to -76 ± 31 µW m -2 of climate mitigation over a 100-year time period while short/medium length forestry rotations can provide more at -296 to -881 ± 44 µW m -2 and natural forest regeneration can provide the most at -1555 ± 44 µW m -2 . As the impacts of climate change on nature and society intensify, consideration should be given to the climate mitigation, habitat, and ecosystem services that nature-based climate solutions can provide.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Modeling the evolution of the US opioid crisis for national policy development

The opioid crisis remains one of the greatest public health challenges in the United States. The crisis is complex, with long delays and feedbacks between policy actions and their effects, which creates a risk of unintended consequences and complicates policy decision-making. We present SOURCE (Simulation of Opioid Use, Response, Consequences, and Effects), an operationally detailed national-level model of the opioid crisis, intended to enhance understanding of the crisis and guide policy decisions. Drawing on multiple data sources, SOURCE replicates how risks of opioid misuse initiation and overdose have evolved over time in response to behavioral and other changes and suggests how those risks may evolve in the future, providing a basis for projecting and analyzing potential policy impacts and solutions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Dynamics of argon metastables in Ar–CH 4 radio frequency capacitively-coupled plasma: real-time monitoring with neural network-augmented broadband optical emission spectroscopy

In moderate-pressure radio frequency (RF) capacitively coupled plasmas generated in argon–methane mixtures, the density of argon metastable atoms (Ar 1 s 5 ) exhibits a non-monotonic dependence on methane (CH 4 ) concentration. Laser-induced fluorescence (LIF) was used to measure and compare local Ar 1 s 5 densities in Ar and Ar–CH 4 plasmas at 2.6 Torr and RF powers of 17–117 W. The addition of 1% CH 4 increases the metastable density, and 2% CH 4 triggers a strong depletion by an order of magnitude, compared to 1% CH 4 case. This non-monotonic behavior demonstrates the sensitivity of metastable populations to small gas admixtures, which is critical for processes where metastables drive precursor dissociation. For real-time monitoring of metastable population, broadband optical emission spectroscopy (OES) is augmented with a feedforward neural network (NN) to predict Ar s1 5 densities from spectral features. When trained on LIF data, the NN replicates the absolute densities and the dynamic trends of Ar 1 s 5 density variation. The NN-augmented broadband OES approach can be used as a simple and cost-effective tool for tracking Ar metastables in Ar-rich plasmas, facilitating industrial-scale optimization.

Yatom, Shurik [Princeton Plasma Physics Laboratory↗
DOE OSTI2023

Tailoring resonant magnetic perturbation to optimize fast-ion confinement during ELM control in KSTAR

Abstract 3D resonant magnetic perturbation (RMP) is one promising way to control edge localized modes that can cause excessive material erosion of tokamak first walls. However, RMP can lead to undesired degradation of plasma confinement, including fast-particle losses, which can impact the performance and safety of the reactor. This work investigates the optimization of the poloidal spectrum of the 3D field to optimize fast ion confinement during edge localized mode (ELM) suppression. In the initial step, the validity of the modeling framework is tested against experimental data. Simulations successfully replicate an increase in poloidal limiter temperature with different poloidal spectra. Then, the simulation shows improvement of fast ion confinement with a reduction of core resonant response, while edge resonant magnetic fields are maintained above the threshold to sustain the ELM suppression. Reduction of the core resonant fields keeps the Kolmogorov–Arnold–Moser surface and reduces the fast particle losses due to the stochastic magnetic field lines. The results highlight the potential of edge localization of the resonant fields to enhance the performance of fusion reactors, but further investigation is needed to improve the validation of this approach.

3D field↗
DOE OSTI2021

Peak radial growth of diffuse-porous species occurs during periods of lower water availability than for ring-porous and coniferous trees

Climate models project warmer summer temperatures will increase the frequency and heat severity of droughts in temperate forests of Eastern North America. Hotter droughts are increasingly documented to affect tree growth and forest dynamics, with critical impacts on tree mortality, carbon sequestration and timber provision. The growing acknowledgement of the dominant role of drought timing on tree vulnerability to water deficit raises the issue of our limited understanding of radial growth phenology for most temperate tree species. Here, we use well-replicated dendrometer band data sampled frequently during the growing season to assess the growth phenology of 610 trees from 15 temperate species over 6 years. Patterns of diameter growth follow a typical logistic shape, with growth rates reaching a maximum in June, and then decreasing until process termination. On average, we find that diffuse-porous species take 16–18 days less than other wood-structure types to put on 50% of their annual diameter growth. However, their peak growth rate occurs almost a full month later than ring-porous and conifer species (ca. 24 ± 4 days; mean ± 95% credible interval). Unlike other species, the growth phenology of diffuse-porous species in our dataset is highly correlated with their spring foliar phenology. We also find that the later window of growth in diffuse-porous species, coinciding with peak evapotranspiration and lower water availability, exposes them to a higher water deficit of 88 ± 19 mm (mean ± SE) during their peak growth than ring-porous and coniferous species (15 ± 35 mm and 30 ± 30 mm, respectively). Given the high climatic sensitivity of wood formation, our findings highlight the importance of wood porosity as one predictor of species climatic sensitivity to the projected intensification of the drought regime in the coming decades.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Fault-Tolerant and Elastic Streaming MapReduce with Decentralized Coordination

The MapReduce programming model, due to its simplicity and scalability, has become an essential tool for processing large data volumes in distributed environments. Recent Stream Processing Systems (SPS) extend this model to provide low-latency analysis of high-velocity continuous data streams. However, integrating MapReduce with streaming poses challenges: first, the runtime variations in data characteristics such as data-rates and key-distribution cause resource overload, that inturn leads to fluctuations in the Quality of the Service (QoS); and second, the stateful reducers, whose state depends on the complete tuple history, necessitates efficient fault-recovery mechanisms to maintain the desired QoS in the presence of resource failures. We propose an integrated streaming MapReduce architecture leveraging the concept of consistent hashing to support runtime elasticity along with locality-aware data and state replication to provide efficient load-balancing with low-overhead fault-tolerance and parallel fault-recovery from multiple simultaneous failures. Our evaluation on a private cloud shows up to 2:8 improvement in peak throughput compared to Apache Storm SPS, and a low recovery latency of 700 -1500 ms from multiple failures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Optimization for Peptide Sample Preparation for Urine Peptidomics

Analysis of native or endogenous peptides in biofluids can provide valuable insights into disease mechanisms. Furthermore, the detected peptides may also have utility as potential biomarkers for non-invasive monitoring of human diseases. The non-invasive nature of urine collection and the abundance of peptides in the urine makes analysis by high-throughput ‘peptidomics’ methods , an attractive approach for investigating the pathogenesis of renal disease. However, urine peptidomics methodologies can be problematic with regards to difficulties associated with sample preparation. The urine matrix can provide significant background interference in making the analytical measurements that it hampers both the identification of peptides and the depth of the peptidomics read when utilizing LC-MS based peptidome analysis. We report on a novel adaptation of the standard solid phase extraction (SPE) method to a modified SPE (mSPE) approach for improved peptide yield and analysis sensitivity with LC-MS based peptidomics in terms of time, cost, clogging of the LC-MS column, peptide yield, peptide quality, and number of peptides identified by each method. Expense and time requirements were comparable for both SPE and mSPE, but more interfering contaminants from the urine matrix were evident in the SPE preparations (e.g., clogging of the LC-MS columns, yellowish background coloration of prepared samples due to retained urobilin, lower peptide yields) when compared to the mSPE method. When we compared data from technical replicates of 4 runs, the mSPE method provided significantly improved efficiencies for the preparation of samples from urine (e.g., mSPE peptide identification 82% versus 18% with SPE; p = 8.92E-05). Additionally, peptide identifications, when applying the mSPE method, highlighted the biology of differential activation of urine peptidases during acute renal transplant rejection with distinct laddering of specific peptides, which was obscured for most proteins when utilizing the conventional SPE method. In conclusion, the mSPE method was found to be superior to the conventional, standard SPE method for urine peptide sample preparation when applying LC-MS peptidomics analysis due to the optimized sample clean up that provided improved experimental inference from the confidently identified peptides.

biomarker↗
DOE OSTI2025

BEPAM code and results for the publication 'Supplementing Biofuel Mandates with a Carbon Mitigation Policy Can Lead to Water Quality Co-benefits'

The dataset consists of: (1) The replication codes and data for the BEPAM model are contained in the "BEPAM_Supplementary Environment Policy Analysis.zip" (2) Simulation results from the BEPAM model are contained in "ModelOutputs.zip" under the "BEPAM_Supplementary Environment Policy Analysis.zip"

Fan, Xinxin [Center for Advanced Bioenergy and Bio↗