Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed data structures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

High-performance mass storage system for workstations

Reduced Instruction Set Computer (RISC) workstations and Personnel Computers (PC) are very popular tools for office automation, command and control, scientific analysis, database management, and many other applications. However, when using Input/Output (I/O) intensive applications, the RISC workstations and PC's are often overburdened with the tasks of collecting, staging, storing, and distributing data. Also, by using standard high-performance peripherals and storage devices, the I/O function can still be a common bottleneck process. Therefore, the high-performance mass storage system, developed by Loral AeroSys' Independent Research and Development (IR&D) engineers, can offload a RISC workstation of I/O related functions and provide high-performance I/O functions and external interfaces. The high-performance mass storage system has the capabilities to ingest high-speed real-time data, perform signal or image processing, and stage, archive, and distribute the data. This mass storage system uses a hierarchical storage structure, thus reducing the total data storage cost, while maintaining high-I/O performance. The high-performance mass storage system is a network of low-cost parallel processors and storage devices. The nodes in the network have special I/O functions such as: SCSI controller, Ethernet controller, gateway controller, RS232 controller, IEEE488 controller, and digital/analog converter. The nodes are interconnected through high-speed direct memory access links to form a network. The topology of the network is easily reconfigurable to maximize system throughput for various applications. This high-performance mass storage system takes advantage of a 'busless' architecture for maximum expandability. The mass storage system consists of magnetic disks, a WORM optical disk jukebox, and an 8mm helical scan tape to form a hierarchical storage structure. Commonly used files are kept in the magnetic disk for fast retrieval. The optical disks are used as archive media, and the tapes are used as backup media. The storage system is managed by the IEEE mass storage reference model-based UniTree software package. UniTree software will keep track of all files in the system, will automatically migrate the lesser used files to archive media, and will stage the files when needed by the system. The user can access the files without knowledge of their physical location. The high-performance mass storage system developed by Loral AeroSys will significantly boost the system I/O performance and reduce the overall data storage cost. This storage system provides a highly flexible and cost-effective architecture for a variety of applications (e.g., realtime data acquisition with a signal and image processing requirement, long-term data archiving and distribution, and image analysis and enhancement).

Chiang, T.↗
DOE OSTI2026

IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning

Heterogeneous Differential Privacy (HDP) in Federated Learning (FL) allows clients to select individual privacy budgets () according to institutional policies and data sensitivity. In practice, many HDP-FL systems employ -aware server aggregation to improve model utility by re-weighting client updates according to their declared privacy budgets. However, gradient updates in FL retain structural patterns induced by non-independent and identically-distributed (non-IID) data, and these additional signals exposed by -aware aggregation create new opportunities for inference by an honest-but-curious server. In this work, we first show that a server equipped with gradient denoising and surrogate modeling can mount a Privacy Inference Attack that infers distributional attributes of clients and links updates from the same client across training rounds, measured via surrogate inference accuracy and linkage success, under realistic knowledge constraints. The Shuffle-Model has been widely studied as a defense against such inference risks by anonymizing update sources, but it is fundamentally incompatible with HDP-FL -aware aggregation. To address this challenge, we propose IntraShuffler, a middleware defense framework designed for HDP-FL systems. IntraShuffler introduces a privacy-aware shuffling mechanism that groups clients into privacy-compatible buckets and performs parameter-level shuffling within each bucket to disrupt persistent gradient structure while preserving -aware aggregation. Experiments across four different datasets show that IntraShuffler reduces gradient recoverability by over 60% and decreases surrogate inference accuracy from 0.78 to 0.33 while maintaining comparable model utility across multiple FL aggregation rules.

Riya, Farhin Farhad [ORNL]↗
NASA NTRS2014

Bi-Metallic Composite Structures With Designed Internal Residual Stress Field

Shape memory alloys (SMA) have a unique ability to recover small amounts of plastic strain through a temperature induced phase change. For these materials, mechanical displacement can be accomplished by heating the structure to induce a phase change, through which some of the plastic strain previously introduced to the structure can be reversed. This paper introduces a concept whereby an SMA phase is incorporated into a conventional alloy matrix in a co-continuous reticulated arrangement forming a bi-metallic composite structure. Through memory activation of the mechanically constrained SMA phase, a controlled residual stress field is developed in the interior of the structure. The presented experimental data show that the memory activation of the SMA composite component significantly changes the residual stress distribution in the overall structure. Designing the structural arrangement of the two phases to produce a controlled residual stress field could be used to create structures that have much improved durability and damage tolerance properties.

Brice, Craig A.↗
DOE OSTI2020

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition

With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1985

The application of artificial intelligence techniques to large distributed networks

Data accessibility and transfer of information, including the land resources information system pilot, are structured as large computer information networks. These pilot efforts include the reduction of the difficulty to find and use data, reducing processing costs, and minimize incompatibility between data sources. Artificial Intelligence (AI) techniques were suggested to achieve these goals. The applicability of certain AI techniques are explored in the context of distributed problem solving systems and the pilot land data system (PLDS). The topics discussed include: PLDS and its data processing requirements, expert systems and PLDS, distributed problem solving systems, AI problem solving paradigms, query processing, and distributed data bases.

Dubyah, R.↗
NASA NTRS1978

Implications of liquid-liquid distribution coefficients to mineral-liquid partitioning

In order to evaluate the influence of a silicate liquid structure on mineral-liquid partitioning, element partitioning data is obtained for coexisting anhydrous immiscible granitic and ferrobasaltic magmas. It is found that: (1) mineral-liquid distribution coefficients indicate the competition of crystal and liquid for cation incorporation, (2) increased polymerization of the residual liquid during crystal-liquid fractionation increases the mineral-liquid distribution coefficients for high-charge-density cations, (3) incompatible element ratios of low- and high-charge-density cations may vary during crystal-liquid fractionation because of changes in the melt composition and structure, (4) relative solubilities of REE's in melts do not vary with melt polymerization, (5) the changes of Sm/Eu ratios during crystal-liquid fractionation depend on the melt composition, and (6) minor components and volatiles can significantly influence the silicate melt structure and the mineral-liquid distribution coefficients.

Ryerson, F. J.↗
NASA NTRS1991

Neotectonic studies of northern Baja California, Mexico, with LANDSAT thematic mapper and SPOT panchromatic imagery: Partitioning of dextral and extensional strain at the Pacific-North America plate boundary

Numerous studies of active faulting in southern California indicate that the San Jacinto, Elsinore, and adjacent faults west of the San Andreas fault accommodate a significant proportion of Pacific-North America relative plate motion. Because of the complex distribution of slip, little is known about the activities of these and similar structures in northern Baja California and the southward transition to the oceanic ridge transform-fault system in the Gulf of California. SPOT and LANDSAT Thematic Mapper imagery for northern Baja California was processed to optimize discrimination of lithologic and structural features. This data was used to suggest a preliminary kinematic framework for distribution of relative plate motion between 31 and 33 degrees north, in which continental borderland tectonics play an important role in partitioning of plate motion.

Miller, M. Meghan↗
NASA NTRS1991

Maintaining consistency in distributed systems

In systems designed as assemblies of independently developed components, concurrent access to data or data structures normally arises within individual programs, and is controlled using mutual exclusion constructs, such as semaphores and monitors. Where data is persistent and/or sets of operation are related to one another, transactions or linearizability may be more appropriate. Systems that incorporate cooperative styles of distributed execution often replicate or distribute data within groups of components. In these cases, group oriented consistency properties must be maintained, and tools based on the virtual synchrony execution model greatly simplify the task confronting an application developer. All three styles of distributed computing are likely to be seen in future systems - often, within the same application. This leads us to propose an integrated approach that permits applications that use virtual synchrony with concurrent objects that respect a linearizability constraint, and vice versa. Transactional subsystems are treated as a special case of linearizability.

Birman, Kenneth P.↗
NASA NTRS1975

Numerical solutions for inviscid supersonic corner flows

Analytical solutions for inviscid supersonic corner flows are virtually nonexistent due to the complexity of the interference geometry. In view of this, numerical solutions for compressive-compressive and expansive-compressive corner flows are obtained. The governing equations are written in strong conservation-law form and are solved iteratively in nonorthogonal conical coordinates by use of a second-order, shock-capturing, finite-difference technique. The computed wave structure and surface pressure distributions are compared with high Reynolds number (Re greater than 2,500,000 ft) experimental data. The results clearly show that the wave structure in the corner is dominated by the inviscid field.

Shankar, V. S. V.↗
DOE OSTI2021

A D-term Modeling Code (DMC) for Simultaneous Calibration and Full-Stokes Imaging of Very Long Baseline Interferometric Data

In this paper we present DMC, a model and associated tool for polarimetric imaging of very long baseline interferometry data sets that simultaneously reconstructs the full-Stokes emission structure along with the station-based gain and leakage calibration terms. DMC formulates the imaging problem in terms of posterior exploration, which is achieved using Hamiltonian Monte Carlo sampling. The resulting posterior distribution provides a natural quantification of uncertainty in both the image structure and the data calibration. We run DMC on both synthetic and real data sets, the results of which demonstrate its ability to accurately recover both the image structure and calibration quantities, as well as to assess their corresponding uncertainties. The framework underpinning DMC is flexible, and its specific implementation is under continued development.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Review of Current Software for Analyzing Total X-ray Scattering Data from Liquids

The popularity of the pair distribution function (PDF) analysis of X-ray total scattering data has steadily grown as access to ex situ synchrotron data has expanded. Due to the broadening of the PDF user community, there is a growing demand for software that can be used to extract PDFs and is accessible to non-expert users. While user-friendly options have been developed over the past decade for fast, streamlined data analysis, care must be taken in both processing the data and understanding any limitations, especially in the case of liquids. In this review, the same scattering data are analyzed using different total X-ray scattering software, in order to compare the accuracy of the extracted structure factors and associated pair distribution functions. The goal is to assess the best practices for extracting the most accurate liquid data for each software package. The importance of absolute normalization and the application of the most appropriate corrections are emphasized via quantitative comparisons between liquid sulfur and water. Additionally, an awareness of the competing conventions used to define the PDF in crystallography and liquids/glasses is crucial for both the downstream analyses of the data and a comparison with the previous results in the literature.

Gallington, Leighanne C. (ORCID:0000000203837522)↗
NASA NTRS1976

Joint aircraft loading/structure response statistics of time to service crack initiation

A reliability analysis for predicting the statistical distribution of time to fatigue crack initiation for aircraft structures in service is presented. The present analysis utilizes the statistical data of the specimen fatigue tests, the full-scale structure tests, and the statistical dispersion of aircraft service loads. The statistical distribution of the time to fatigue crack initiation of the full-scale structure under laboratory loading spectrum is assumed to be Weibull. The service loads for gust turbulences are modeled as Poisson processes for transport-type aircraft, while the maneuver loads are modeled as compound Poisson processes for fighter and training aircraft. It is found that the statistical distribution of time to fatigue crack initiation for aircraft structures in service is not Weibull and that the prediction on the basis of the Weibull distribution is unconservative, in particular in the early service time.

Yang, J.-N.↗
DOE OSTI2024

Development of Steady-State and Dynamic Mass and Energy Constrained Neural Networks for Distributed Chemical Systems Using Noisy Transient Data

The paper presents the development of algorithms for mass and energy constrained neural network models that can exactly conserve the overall mass and energy of distributed chemical process systems, even though the noisy transient data used for optimal model training violate the same. In contrast to approximately satisfying mass and energy balance constraints of a system by soft penalization of objective function, algorithms have been developed for solving equality-constrained nonlinear optimization problems, thus providing the guarantee of exactly satisfying the system mass and energy conservation laws. For developing dynamic mass-energy constrained network models for distributed systems, hybrid series and parallel dynamic-static neural networks have been leveraged. The developed algorithms for solving both the training and forward problems are validated using both steady-state and dynamic data in the presence of various noise characteristics. The developed data-driven algorithms are flexible to exactly satisfy mass and energy balance constraints for dynamic chemical processes if the system holdup information is available. The proposed network structures and algorithms are applied to the development of data-driven lumped and distributed models of an adiabatic superheater/reheater system, a nonisothermal continuous stirred tank reactor, as well as an electrically heated plug-flow reactor system where one form of energy gets transformed to another. It has been observed that the mass-energy constrained neural networks yield a root mean squared error of <1% with respect to the system truth for the case studies evaluated in this work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Probing lead acetate in solution using X-ray diffraction

Here, for the purpose of water purification involving toxic metal sensing and removal, high energy X-ray diffraction experiments have been performed on lead acetate Pb(Ac) 2 solutions, liquid and amorphous glutathione disulfide (GSSG), and their mixtures. The data have been interpreted using Empirical Potential Structure Refinement and pair distribution function analysis. At the highest concentration of 1 M Pb(Ac) 2 in water, the lead molecules are found to cluster and the second shell in the water structure becomes slightly more ordered as the water molecules become compressed. Liquid and amorphous GSSG are found to hydrogen bond primarily via OH-O interactions, while NH-O bonds are much more distorted. Aqueous solutions of Pb(Ac) 2 + GSSG show the closest Pb-O (carboxyl) and Pb-N (amine) bonds both at a distance of 2.5 ± 0.1 Å at a concentration of 1 M Pb(Ac) 2 in water. At 0.75 M Pb(Ac) 2 in water, strong Pb-S bonds are found at a distance of 2.8 ± 0.1 Å. The implications for lead removal using capacitive deionization are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Achievements and Prospects of Global Broadband Seismographic Networks After 30 Years of Continuous Geophysical Observations

Global seismographic networks (GSNs) emerged during the late nineteenth and early twentieth centuries, facilitated by seminal international developments in theory, technology, instrumentation, and data exchange. The mid- to late-twentieth century saw the creation of the World-Wide Standardized Seismographic Network (1961) and International Deployment of Accelerometers (1976), which advanced global geographic coverage as seismometer bandwidth increased greatly allowing for the recording of the Earth's principal seismic spectrum. The modern era of global observations and rapid data access began during the 1980s, and notably included the inception of the GEOSCOPE initiative (1982) and GSN (1988). Through continual improvements, GEOSCOPE and the GSN have realized near-real time recording of ground motion with state-of-art data quality, dynamic range, and timing precision to encompass 180 seismic stations, many in very remote locations. Data from GSNs are increasingly integrated with other geophysical data (e.g., space geodesy, infrasound and Interferometric Synthetic Aperture Radar). Globally distributed seismic data are critical to resolving crust, mantle, and core structure; illuminating features of the plate tectonic and mantle convection system; rapid characterization of earthquakes; identification of potential tsunamis; global nuclear test verification; and provide sensitive proxies for environmental changes. As the global geosciences community continues to advance our understanding of Earth structure and processes controlling elastic wave propagation, GSN infrastructure offers a springboard to realize increasingly multi-instrument geophysical observatories. Here, we review the historical, scientific, and monitoring heritage of GSNs, summarize key discoveries, and discuss future associated opportunities for Earth Science.

58 GEOSCIENCES↗
DOE OSTI2021

Generating synthetic occupants for use in building performance simulation

Occupant behaviour simulation frameworks can employ synthetic populations to characterize occupancy and behavioural patterns in buildings based on observed demographic data at a certain geographical location. For buildings, very few synthetic occupant populations have been generated. This paper uses a Bayesian Networks (BN) structural learning approach to synthesize populations of occupants in a multi-family housing case study. Two additional cases of office occupants and senior housing residents are considered as a cross-case comparison. Furthermore, we draw upon the extended version of drivers-needs-actions-systems (DNAS) framework to guide the selection of variables and data imputation. Our results show that the BN approach is powerful in learning the structure of data sets. The synthetic data sets successfully match the joint distributions of the underlying combined data sets. Experiments on the multi-family housing particularly show better performance than the office and senior housing cases.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Building a genome-based understanding of bacterial pH preferences

The environmental preferences of many microbes remain undetermined. This is the case for bacterial pH preferences, which can be difficult to predict a priori despite the importance of pH as a factor structuring bacterial communities in many systems. We compiled data on bacterial distributions from five datasets spanning pH gradients in soil and freshwater systems (1470 samples), quantified the pH preferences of bacterial taxa across these datasets, and compiled genomic data from representative bacterial taxa. While taxonomic and phylogenetic information were generally poor predictors of bacterial pH preferences, we identified genes consistently associated with pH preference across environments. We then developed and validated a machine learning model to estimate bacterial pH preferences from genomic information alone, a model that could aid in the selection of microbial inoculants, improve species distribution models, or help design effective cultivation strategies. More generally, we demonstrate the value of combining biogeographic and genomic data to infer and predict the environmental preferences of diverse bacterial taxa.

59 BASIC BIOLOGICAL SCIENCES↗