Search NASA⌕ Search

SEARCH · Search NASA

Results for “supporting data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Operational Evolution of FTS3: A DevOps Driven Approach to Elastic Operations

The File Transfer Service (FTS3) is a distributed data movement service developed at CERN and widely used to transfer data across the Worldwide LHC Computing Grid (WLCG). At Fermilab, FTS3 supports data transfers for multiple experiments, including Intensity Frontier experiments such as DUNE, enabling reliable data movement between WebDAV endpoints in Europe and the Americas.​ At CHEP 2021, we reported on the initial containerized deployment of FTS3 on OKD, the community Kubernetes distribution of Red Hat OpenShift. In this work, we present the subsequent evolution of this deployment, focusing on new operational capabilities introduced to improve scalability, robustness, and long-term maintainability.​ We describe the adoption of more secure and reproducible container build workflows, the integration of DevOps-driven operational practices, and enhancements in monitoring and automation. A key new result is the introduction of horizontal scaling and elastic resource management, allowing FTS3 components to dynamically adapt to workload variations while maintaining service reliability. We also discuss improvements in fault tolerance and operational procedures derived from production experience.​ Finally, we summarize lessons learned from operating FTS3 as a Kubernetes-native service and outline how these developments have improved the resilience and efficiency of data movement operations at Fermilab.

Munoz Flores, Victor Leopoldo [Fermilab]↗

Compiled TBS data from Oliktok Point from ICARUS, AVPOP, and POPEYE

The dataset encompasses QA/QC TBS data, including TBS altitude, atmospheric pressure, dew point, POPs number concentrations and mean aerosol size, relative humidity, temperature, equivalent potential temperature, equivalent temperature, and date and time. These data are provided per day for at least one TBS flight. Supporting data from the AMF3 aligned with the timestamps of the TBS data include cloud base distance from TBS, if the time corresponds to cloud base transit of the TBS, surface-based pressure, surface-based precipitation rate, surface-based UHSAS data, ceilometer cloud base height, KAZR cloud top height, and MWR liquid water content. Both POPS and UHSAS aerosol number concentrations are provided as: (1) absolute (i.e. concentrations for each instrument's total size range) and (2) the overlapping size range (i.e. the same size bins for both instruments).

54 ENVIRONMENTAL SCIENCES↗

Nuclear Power Fault Diagnostics and Preventative Maintenance Optimization

Operation and maintenance costs for nuclear power plants are very large. Reactors are starting to shut down even after their operating licenses have been extended, because they are not price competitive compared to other energy sources. The nuclear industry is witnessing early closure of nuclear power plants due to economic reasons despite excellent safety records. Therefore, it is imperative to reduce costs to prevent these early closures. This paper showcases recent research into advanced fault diagnostics techniques and preventative maintenance optimization to reduce these maintenance costs. This report focuses on the condensate and feedwater system for both pressurized and boiling water reactor systems. The computerized maintenance management system, which contains the plant’s digital record of all the corrective- and preventative-maintenance work orders, was used as a ground truth to locate potential faults and label the process data as healthy or faulty. Various feature extraction techniques were utilized to further differentiate the faults from the healthy data. Support vectors machines were used to categorize other test sets of process data as healthy or faulty through a cross validation procedure. Similar faults were not found within this system leading to preventative maintenance optimization. Unnecessary amounts of preventative maintenance lead to inflated maintenance costs. This paper summarizes the steps for preventative maintenance optimization from component health determination to recommendation for action. This optimization was completed for condensate pumps, condensate booster pumps, and the respective motors that drive them.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multiparameter Constraints on Empirical Infrasound Period-Yield Relations for Bolides and Implications for Planetary Defense

How effective are methods for estimating bolide energies from infrasound signal period-yield relationships? A single global period–energy relation can obscure significant variability introduced by parameters such as the atmospheric Doppler wind profile and the bolide’s energy deposition profile as a function of altitude. Bolide speed, entry angle, burst altitude, and multiepisode fragmentation may all play a role in defining the detected period of the shockwave. By leveraging bolide light-curve data from the Center for Near Earth Object Studies, we re-examined the period–energy relation as a function of these parameters. Through a bootstrap approach, we show that various event subsets can deviate from widely cited period–energy models and we identify which specific conditions most strongly reshape the period–energy scaling. The results define both the fidelity and reliability of period–energy relations when no additional data beyond the infrasound record is available and improve the outcome when supporting data from bolide trajectories and light curves are included. Ultimately, these findings expand the scope of earlier models, providing a nuanced and robust framework for infrasound-only yield estimation under a range of bolide scenarios.

Planetary science↗

Sensitivity Analysis of Drivers Water Shortage in the Los Angeles Region During Drought

The code and detailed step-by-step instructions for generating the model output data, processing results, and analysis and plotting are provided at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. The PyArtes model is a python adaptation of the Artes model. PyArtes uses many of the same input data and optimization model architecture as Artes. Documentation for the PyArtes model is provided in the Supplement to the paper. The primary data product are simulated monthly water shortages for indoor and outdoor demand under a large ensemble of drought scenarios (>13,000). The droughts are hypothetical and are not based on historical time series data of supply sources - though historical data did help inform ranges explored for supply parameters. Demands are informed by recent 2017-2021 water supply data. Demands used for the model can be accessed at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. Simulations resolve demand for over 90 water providers in the study region. The results report 36 months of water shortage data for each indoor and outdoor demand node. The study also developed a multilayer perceptron (MLP) neural network trained on a subset of the simulated shortage ensemble to emulate worst annual water shortage for a given set of parameter multipliers -- provided the parameter values fall within the ranges sampled in the ensemble. Emulated water shortages for synthetic ensembles are in the MLP-generated shortages folder. The MLP model was used to generate larger ensembles to support Sobol analysis that would have been extremely computationally expensive to simulate. Datasets provided in this repository*: Simulated shortages. These results are used for the analysis for Figures 5, 8, and 9 in the paper, and also to train the MLP emulator. .zip file containing outputs for the 13,312 scenario ensemble. Separate .csv files for indoor and outdoor shortage for each scenario. Rows = demand ids (~100), Columns = months (36) Units = acre-feet/month of shortage (shortage = monthly demand - supply). 1 acft = 1233.48 m^3 .csv files of aggregated shortages derived from the 13,312 ensemble Rows = scenarios (13,312), Columns = demand ids (~100) Units = acre-feet/year (either worst annual shortage or total shortage over the 3-year drought) .csv file of the parameter multipliers scenarios for the ensemble .csv file of the parameter ranges and baseline values the multipliers were applied to MLP-generated shortages. These results are used for Figures 4, 6, and 7 in the paper. mwd higher folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results Emulated shortages. Rows = scenarios, columns = demand ids, units acft Sobol results. Rows = demand ids, columns Sobol (S1, ST, or 95% confidence interval) value for each parameter mwd lower folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results same organization as mwd higher MLP performance: performance metrics (R^2, RMSE, BIAS, MAPE) for the testing subset (20% or 2,662 scenarios) and simulated vs emulated worst year shortage (acre-feet/year) for every demand node, MWD wholesale regions, and the entire study region (LAC). Supporting data for figures. Figure plotting scripts in the associated GitHub repo. These files support analysis and visualization. Geospatial Data used for plotting simulated water shortages and Sobol results. Dictionary of full names for demand nodes in the model and estimates of water supply by source type informed by Artes input files and California Urban Water Management Planning data: https://water.ca.gov/Programs/Water-Use-And-Efficiency/Urban-Water-Use-Efficiency/Urban-Water-Management-Plans *Readme files provided for each folder.

drought↗

Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks

This work develops new techniques within Horovod, a generic communication library supporting data parallel training across deep learning frameworks. In particular, we improve the Horovod control plane by implementing a new coordination scheme that takes advantage of the characteristics of the typical data parallel training paradigm, namely the repeated execution of collectives on the gradients of a fixed set of tensors. Using a caching strategy, we execute Horovod’s existing coordinator-worker logic only once during a typical training run, replacing it with a more efficient decentralized orchestration strategy using the cached data and a global intersection of a bitvector for the remaining training duration. Next, we introduce a feature for end users to explicitly group collective operations, enabling finer grained control over the communication buffer sizes. To evaluate our proposed strategies, we conduct experiments on a world-class supercomputer — Summit. We compare our proposals to Horovod’s original design and observe 2x performance improvement at a scale of 6000 GPUs; we also compare them against tf.distribute and torch.DDP and achieve 12% better and comparable performance, respectively, using up to 1536 GPUs; we compare our solution against BytePS in typical HPC settings and achieve about 20% better performance on a scale of 768 GPUs. Finally, we test our strategies on a scientific application (STEMDL) using up to 27,600 GPUs (the entire Summit) and show that we achieve a near-linear scaling of 0.93 with a sustained performance of 1.54 exaflops (with standard error +- 0.02) in FP16 precision.

Romero, Joshua↗

First Plant Cell Atlas symposium report

The Plant Cell Atlas (PCA) community hosted a virtual symposium on December 9 and 10, 2021 on single cell and spatial omics technologies. The conference gathered almost 500 academic, industry, and government leaders to identify the needs and directions of the PCA community and to explore how establishing a data synthesis center would address these needs and accelerate progress. This report details the presentations and discussions focused on the possibility of a data synthesis center for a PCA and the expected impacts of such a center on advancing science and technology globally. Community discussions focused on topics such as data analysis tools and annotation standards; computational expertise and cyber-infrastructure; modes of community organization and engagement; methods for ensuring a broad reach in the PCA community; recruitment, training, and nurturing of new talent; and the overall impact of the PCA initiative. These targeted discussions facilitated dialogue among the participants to gauge whether PCA might be a vehicle for formulating a data synthesis center. The conversations also explored how online tools can be leveraged to help broaden the reach of the PCA (i.e., online contests, virtual networking, and social media stakeholder engagement) and decrease costs of conducting research (e.g., virtual REU opportunities). Major recommendations for the future of the PCA included establishing standards, creating dashboards for easy and intuitive access to data, and engaging with a broad community of stakeholders. The discussions also identified the following as being essential to the PCA's success: identifying homologous cell-type markers and their biocuration, publishing datasets and computational pipelines, utilizing online tools for communication (such as Slack), and user-friendly data visualization and data sharing. In conclusion, the development of a data synthesis center will help the PCA community achieve these goals by providing a centralized repository for existing and new data, a platform for sharing tools, and new analytical approaches through collaborative, multidisciplinary efforts. A data synthesis center will help the PCA reach milestones, such as community-supported data evaluation metrics, accelerating plant research necessary for human and environmental health.

59 BASIC BIOLOGICAL SCIENCES↗

BASIN-3D: A brokering framework to integrate diverse environmental data

Diverse observational and simulation datasets are needed to understand and predict complex ecosystem behavior over seasonal to decadal and century time-scales. Integration of these datasets poses a major barrier towards advancing environmental science, particularly due to differences in the structure and formats of data provided by various sources. Here, we describe BASIN-3D (Broker for Assimilation, Synthesis and Integration of eNvironmental Diverse, Distributed Datasets), a data integration framework designed to dynamically retrieve and transform heterogeneous data from different sources into a common format to provide an integrated view. BASIN-3D enables users to adopt a standardized approach for data retrieval and avoid customizations for the data type or source. We demonstrate the value of BASIN-3D with two use cases that require integration of data from regional to watershed spatial scales. The first application uses the BASIN-3D Python library to integrate time-series hydrological and meteorological data to provide standardized inputs to analytical and machine learning codes in order to predict the impacts of hydrological disturbances on large river corridors of the United States. The second application uses the BASIN-3D Django framework to integrate diverse time-series data in a mountainous watershed in East River, Colorado, United States to enable scientific researchers to explore and download data through an interactive web portal. Thus, BASIN-3D can be used to support data integration for both web-based tools, as well as data analytics using Python scripting and extensions like Jupyter notebooks. The framework is expected to be transferable to and useful for many other field and modeling studies.

Varadharajan, C↗

Automatic Search of Cataclysmic Variables Based on LightGBM in LAMOST-DR7

The search for special and rare celestial objects has always played an important role in astronomy. Cataclysmic Variables (CVs) are special and rare binary systems with accretion disks. Most CVs are in the quiescent period, and their spectra have the emission lines of Balmer series, HeI, and HeII. A few CVs in the outburst period have the absorption lines of Balmer series. Owing to the scarcity of numbers, expanding the spectral data of CVs is of positive significance for studying the formation of accretion disks and the evolution of binary star system models. At present, the research for astronomical spectra has entered the era of Big Data. The Large Sky Area Multi-Object Fiber Spectroscopy Telescope (LAMOST) has produced more than tens of millions of spectral data. the latest released LAMOST-DR7 includes 10.6 million low-resolution spectral data in 4926 sky regions, providing ideal data support for searching CV candidates. To process and analyze the massive amounts of spectral data, this study employed the Light Gradient Boosting Machine (LightGBM) algorithm, which is based on the ensemble tree model to automatically conduct the search in LAMOST-DR7. Finally, 225 CV candidates were found and four new CV candidates were verified by SIMBAD and published catalogs. This study also built the Gradient Boosting Decision Tree (GBDT), Adaptive Boosting (AdaBoost), and eXtreme Gradient Boosting (XGBoost) models and used Accuracy, Precision, Recall, the F1-score, and the ROC curve to compare the four models comprehensively. Experimental results showed that LightGBM is more efficient. The search for CVs based on LightGBM not only enriches the existing CV spectral library, but also provides a reference for the data mining of other rare celestial objects in massive spectral data.

79 ASTRONOMY AND ASTROPHYSICS↗

LowFive v1.0

LowFive is a new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. Minimal and often no source-code modification is needed for programs that already use HDF5. LowFive maintains deep copies or shallow references of datasets, configurable by the user. More than one task can produce (write) data, and more than one task can consume (read) data, accommodating fan-in and fan-out in the workflow task graph. LowFive supports data redistribution from n producer processes to m consumer processes.

Morozov, Dmitriy↗

Dataset_for_Molecular_Motion_Below_the_Glass_Transition_A_Solid-State_NMR_Study_of_Siloxane_Polymer_Dynamics Study

This dataset contains solid-state 1H and 13C NMR relaxometry data, differential scanning calorimetry (DSC) data, and size exclusion chromatography (SEC/GPC) data supporting the study of sub-glass-transition (sub-Tg) molecular dynamics in a composition- and sequence-controlled series of diphenyl-substituted polysiloxanes (PDMS, 14Ph, 33Ph, 50Ph, 67Ph, and 100Ph; 0–100% diphenylsiloxane content by mole).All solid-state NMR data were acquired on a 200 MHz Bruker Avance III HD spectrometer using a static 7 mm HX probe or a 4 mm HX probe under 4 kHz magic-angle spinning. Raw Bruker TopSpin experiment folders are included for: (1) variable-temperature 1H lineshape measurements used to determine linewidth (FWHM) as a function of temperature across the glass transition; (2) 1H T1 (saturation recovery with solid-echo detection), probing nanosecond-scale dynamics near the 1H Larmor frequency; (3) 1H T1rho (direct spin-lock, 62.5 kHz), probing microsecond-scale segmental dynamics; (4) 13C-detected Lee–Goldburg cross-polarization 1H T1rho (LGCPH T1rho) for 33Ph and 50Ph, resolving aromatic and aliphatic proton environments; and (5) 13C T1 relaxation for 33Ph and 50Ph. Differential scanning calorimetry data (TA Instruments DSC 25, −150 to +120 °C, up to +300 °C for 100Ph, 10 °C/min) are included for all six compositions and support the glass-transition temperatures in Table 1 and Figure 1. Size exclusion chromatography data (Agilent 1200 Series, PL-Gel 300 mixed-C column, THF mobile phase, polystyrene calibration standards) are included for the three synthesized copolymers (33Ph, 50Ph, 67Ph) and support the number-average molecular weights in Table 1. Processed data include per-composition relaxation-time summaries (Excel), curve-fitting and Bloembergen-Purcell-Pound (BPP) model analysis notebooks (Jupyter/Python), and Igor Pro (.pxp) master files used to generate the manuscript's figures.

Bloembergen-Purcell-Pound theory↗

On-the-fly data set combinations with RNTuple

With the expected data volume increase for HL-LHC and the even more complex computing challenges set by future colliders, the need for efficient data storage and processing becomes more pressing. ROOT’s next-generation data format and I/O subsystem, RNTTuple, is designed to address these challenges. RNTTuple already demonstrates a clear improvement in storage and I/O efficiency, as well as overall stability and robustness with respect to its predecessor, TTTree. These improvements provide a solid baseline to introduce novel extensions to common high-energy and nuclear physics (HENP) workflows. Notably, many workflows could benefit from the ability to arbitrarily join and chain data set samples at runtime, which could reduce overall storage requirements and improve application runtime and ergonomics. In this paper, we present the RNTupleProcessor, which enables HENP data set combinations with RNTuple. We will discuss the main design considerations, present the interfaces to support data set combinations and show how they integrate in typical workflows.

de Geus, Florine Willemijn [CERN; Twente U., Ensch↗

Pushing the limits of NAND technology scaling with ferroelectrics

Artificial intelligence (AI) continues to drive transformative advancements across various industries. The data-intensive nature of AI training (and inferencing) has resulted in the generation of unprecedented volumes of data with machine-generated content surpassing human-generated data by more than 100-fold in 2025. Efficiently managing this data influx necessitates advanced digital storage technologies. However, traditional NAND flash memory, which is critical for supporting data flows in AI systems—alongside high-bandwidth memory, for AI training—faces fundamental scaling limitations as it approaches the 1000-layer milestone, encompassing more than 40 trillion transistors. This article delves into the potential of hafnia-based ferroelectric materials as a breakthrough solution to these challenges. Recent advancements indicate that the intrinsic limitations of ferroelectric field-effect transistors (FEFETs) can be mitigated through material and device-level engineering. These advancements enable FEFETs to meet the stringent density, reliability, and scalability requirements of future three-dimensional NAND technology. The role of ferroelectrics in addressing NAND scaling challenges and expanding storage capabilities presents a promising avenue for meeting the storage demands of the AI-driven era.

3D NAND↗

MSD CoP Webinar: Using Meta-Repositories To Facilitate Open Science in MSD Research

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: In this webinar, we will describe the use of a GitHub meta-repository, for documenting and disseminating the tools and data supporting MSD publications. The goal is to make it easier for others to understand the flow of data and code through your experiment and to be able to reproduce your results and figures with only the information you have provided for them. The webinar will cover the role of open science in the MSD community, the origins and purpose of meta-repositories, and step-by-step instructions and best practices for building a meta-repository starting from the GitHub template (https://github.com/IMMM-SFA/metarepo). We will also discuss how to leverage MSD-LIVE (https://msdlive.org/) in your meta-repository, provide links to numerous examples you can learn from, and discuss the role of meta-repositories in the IM3 project's open science mandates. Presenters : Chris R. Vernon, Casey D. Burleyson, Jennie Rice, and Mengqi Zhao Moderator: Pat M. Reed (MSD CoP Facilitation Team) This webinar was held on: February 22nd, 2024 from 2-3 PM ET

Open Science↗

DNA Methylation Patterns of Chronic Explosive Breaching in U.S. Military Warfighters

Background: Injuries from exposure to explosions rose dramatically during the Iraq and Afghanistan wars, which motivated investigation of blast-related neurotrauma. We have undertaken human studies involving military “breachers” —exposed to controlled, low-level blast during a 3-days explosive breaching course. Methods: We screened epigenetic profiles in peripheral blood samples from 59 subjects (in two separate U.S. Military training sessions) using Infinium MethylationEPIC BeadChips. Participants had varying numbers of exposures to blast over their military careers (empirically defined as high ≥ 40, and conversely, low < 39 breaching exposures). Daily self-reported physiological symptoms were recorded. Tinnitus, memory problems, headaches, and sleep disturbances are most frequently reported. Results: We identified 14 significantly differentially methylated regions (DMRs) within genes associated with cumulative blast exposure in participants with high relative to low cumulative blast exposure. Notably, NTSR1 and SPON1 were significantly differentially methylated in high relative to low blast exposed groups, suggesting that sleep dysregulation may be altered in response to chronic cumulative blast exposure. In comparing lifetime blast exposure at baseline (prior to exposure in current training), and top associated symptoms, we identified significant DMRs associated with tinnitus, sleep difficulties, and headache. Notably, we identified KCNN3, SOD3, MUC4, GALR1, and WDR45B, which are implicated in auditory function, as differentially methylated associated with self-reported tinnitus. These findings suggest neurobiological mechanisms behind auditory injuries in our military warfighters and are particularly relevant given tinnitus is not only a primary disability among veterans, but has also been demonstrated in active duty medical records for populations exposed to blast in training. Additionally, we found that differentially methylated regions associated with the genes CCDC68 and COMT track with sleep difficulties, and those within FMOD and TNXB track with pain and headache. Conclusion: Sleep disturbances, as well as tinnitus and chronic pain, are widely reported in U.S. military service members and veterans. As we have previously demonstrated, DNA methylation encapsulates lifetime exposure to blast. The current data support previous findings and recapitulate transcriptional regulatory alterations in genes involved in sleep, auditory function, and pain. These data uncovered novel epigenetic and transcriptional regulatory mechanism underlying the etiological basis of these symptoms.

60 APPLIED LIFE SCIENCES↗

Using Residential and Office Building Archetypes for Energy Efficiency Building Solutions in an Urban Scale: A China Case Study

Building energy consumption accounts for 36% of the overall energy end use worldwide and is growing rapidly as developing countries continue to urbanize. Understanding the energy use at urban scale will lay the foundation for identification of energy efficiency opportunities to be deployed at speed. China has almost half of global new constructions and plays an important role in building suitability. However, an open source national building energy consumption database is not available in China. To provide data support for building energy consumptions, this paper used a simulation method to develop an urban building energy consumption database for a pilot city in Wuhan, China. First, residential, small, and large office building archetype energy models were created in EnergyPlus to represent typical building energy consumption in Wuhan. The baseline reference model simulation results were further validated using survey data from the literature. Second, stochastic simulations were conducted to consider different design parameters and occupants’ energy usage intensity scenarios, such as thermal properties of the building envelope, lighting power density, equipment power density, HVAC (heating, ventilation and air conditioning) schedule, etc. A building energy consumption database was generated for typical building archetypes. Third, data-driven regression analysis was conducted to support quick building energy consumption prediction using key high- level building information inputs. Finally, a web-based urban energy platform and an interface were developed to support further third-party application development. The research is expected to provide fast energy efficiency building design solutions for urban planning, new constructions as well as building retrofits.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Requalification and Declaration of High-alpha Cemented TRU-waste from the Late 70's and Early 80's - 20499

KTE and Siemens launched a project to qualify a series of 391 waste drums and 115 concrete containers produced from 1979 to 1984. The waste is characterized by a high content of long-lived alpha-nuclides (TRU-waste - Pu, U, Am in the range of 1 E+11-1 E+12 Bq/ drum. This high radionuclide inventory requires a special packaging according to the waste acceptance criteria (WAC) of the repository Konrad [1] despite the fact, that the waste was treated manually. The raw waste originally was delivered in nitric acid solution and was solidified using ordinary Portland cement. The existing documentation comprises analyses, transfer documentation for the nuclear fuel nuclides and waste treatment documentation yielding information, which waste was treated together in a batch. Additionally all drums were subjected to non-destructive gamma-spectrometry assay. A small number of 7 drums were opened and sampled to support the existing declaration. For the entire series the waste products were attributed to defined batches using the accountancy data supported by the analyses and the gamma-spectrometry. Each batch was produced from a homogeneous stock of waste solution and can therefore be declared and documented together. The declaration concept is based on the gamma spectrometry results performed on the entire drums, which were corrected and extended for the uncertainty of the analyses. The declaration concept is verified by the regulator and its independent expert. The state of the project is in the documentation of the solidification campaigns followed by the planning of the container configuration. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Map reduce using coordination namespace hardware acceleration

A system and method for supporting data MapReduce operations in a tuple space/coordinated namespace (CNS) extended memory storage architecture. The system-wide CNS provides an efficient means for storing and communicating data generated by local processes running at the nodes, and coordinated to provide MapReduce operations in a multi-nodal system. A hardware accelerated mechanism supports map reduce sorting/shuffle operations and reduce operations according to an aggregate function. Local processes running at a node generate a tuple corresponding to data generated by a process, each tuple having a tuple name and tuple data value corresponding to the generated data. Each tuple is processed and stored at the node or another node, dependent upon its tuple name. Tuple records associated with a tuple name are accumulated at one or more nodes according to a linked list structure at each that is accessible via a hash table index pointer at the node.

Jacob, Philip↗