SEARCH · Search NASA

Results for “distributed processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2020

The geometry of signal space: a case study of direct mapping between seismic signals and event distribution

SUMMARY Under favourable circumstances, seismic waveforms corresponding to an ensemble of events related by a common, spatially distributed process collectively exhibit a regular, signal-space geometry. When events in the ensemble have a common, or nearly common, source mechanism, this geometry is a distorted image of the distribution of events in the source region. The signal-space image can be visualized using a relatively simple waveform alignment and projection operation. Ensemble waveform correlation measurements can be inverted to estimate the distribution of the events in the source region, up to an arbitrary rotation, reflection and scaling, with residual distortion. We demonstrate these concepts with synthetic waveforms and with observations of long-wall mining induced seismicity for which substantial ground truth information is available. Our experience with these data has implications for location, correlation detection and machine learning and possible application to studies of repeating events in induced, volcanic and glacial seismicity. Our results place limits on the widely held assumption that waveform correlation is a useful measure of event separation. We suggest that the constraints on event separation need to be evaluated in the context of a population of related events, whose waveforms sample the signal space image of the source region. A better indicator of event separation is the length of the shortest path in signal space along the image.

58 GEOSCIENCES↗

DOE OSTI2021

LL18-Signal Analysis-NDD2Ad (Final Report)

Under favorable circumstances, seismic waveforms corresponding to an ensemble of events related by a common, spatially-distributed process collectively exhibit a regular, signal-space geometry. When events in the ensemble have a common, or nearly common, source mechanism, this geometry is a distorted image of the distribution of events in the source region. The signal space image can be visualized using a relatively simple waveform alignment and projection operation. Ensemble waveform correlation measurements can be inverted to estimate the distribution of the events in the source region, up to an arbitrary rotation, reflection, and scaling with residual distortion. We demonstrate these concepts with synthetic waveforms and with observations of long-wall mining induced seismicity for which substantial ground truth information is available. Our experience with these data has implications for location, correlation detection and machine learning, and possible application to studies of repeating events in induced, volcanic, and glacial seismicity. Our results place limits on the widely-held assumption that waveform correlation is a useful measure of event separation. We suggest that the constraints on event separation need to be evaluated in the context of a population of related events, whose waveforms sample the signal space image of the source region. A better indicator of event separation is the length of the shortest path in signal space along the image.

58 GEOSCIENCES↗

DOE OSTI2017

Airborne measurements of isoprene and monoterpene emissions from southeastern U.S. forests

Isoprene and monoterpene emission rates are essential inputs for atmospheric chemistry models that simulate atmospheric oxidant and particle distributions. Process studies of the biochemical and physiological mechanisms controlling these emissions are advancing our understanding and the accuracy of model predictions but efforts to quantify regional emissions have been limited by a lack of constraints on regional distributions of ecosystem emission capacities. We used an airborne wavelet-based eddy covariance measurement technique to characterize isoprene and monoterpene fluxes with high spatial resolution during the 2013 SAS (Southeast Atmosphere Study) in the southeastern United States. The fluxes measured by direct eddy covariance were comparable to emissions independently estimated using an indirect inverse modeling approach. Isoprene emission factors based on the aircraft wavelet flux estimates for high isoprene chemotypes (e.g., oaks) were similar to the MEGAN2.1 biogenic emission model estimates for landscapes dominated by oaks. Aircraft flux measurement estimates for landscapes with fewer isoprene emitting trees (e.g., pine plantations), were about a factor of two lower than MEGAN2.1 model estimates. The tendency for high isoprene emitters in these landscapes to occur in the shaded understory, where light dependent isoprene emissions are diminished, may explain the lower than expected emissions. This result demonstrates the importance of accurately representing the vertical profile of isoprene emitting biomass in biogenic emission models. Airborne measurement-based emission factors for high monoterpene chemotypes agreed with MEGAN2.1 in landscapes dominated by pine (high monoterpene chemotype) trees but were more than a factor of three higher than model estimates for landscapes dominated by oak (relatively low monoterpene emitting) trees. This results suggests that unaccounted processes, such as floral emissions or light dependent monoterpene emissions, or vegetation other than high monoterpene emitting trees may be an important source of monoterpene emissions in those landscapes and should be identified and included in biogenic emission models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

A Blockchain-Based Decentralized Data Storage and Access Framework for PingER

The blockchain is an innovative technology which opened doors to new applications for solving numerous problems in distributed environments. In this study, we design a blockchain-based data storage and access framework for PingER (worldwide end-to-end Internet performance measurement project) to remove its total dependence on a centralized repository. We use the permissioned blockchain and Distributed Hash Tables (DHT) for this purpose. In the proposed framework, metadata of the files are stored on the blockchain whereas the actual files are stored off-chain through DHT at multiple locations using a peer-to-peer network of PingER Monitoring Agents. Lastly, this will provide decentralized storage, distributed processing, and efficient lookup capabilities to the PingER framework.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Frequency Domain Detection and Precoding for Massive MIMO With Single Carrier Modulation

Single carrier modulation (SCM) schemes are attractive for uplink (UL) transmissions due to improved power efficiency at the user equipment (UE) transmitter compared with multi-carrier modulation schemes. In a massive MIMO scenario with SCM, the UL detection must mitigate the effects of inter-symbol interference and multiuser interference. This processing is effectively performed in the frequency domain (FD) using a minimum mean squared error (MMSE) detector when the transmission is framed with a cyclic prefix. This paper presents a MMSEbased detector that is compatible with distributed processing in a time-division duplex (TDD) system. The matrix inverses computed for the UL detection are then reused to perform multi-user precoding for the downlink (DL). We find that this scheme yields a tremendous savings in computational complexity compared to commonly used zero-forcing (ZF) precoding without sacrificing any performance. Since MMSE processing introduces a bias to the estimates, we then derive the scalar coefficients necessary to cancel the MMSE bias. The impact of channel estimation errors are analyzed for both the UL and DL cases in conjunction with a power-efficient approach to SCM channel estimation. Moreover, extensive simulations are performed to confirm our theoretical findings.

42 ENGINEERING↗

DOE OSTI2020

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗

DOE OSTI2022

Mascon distribution techniques for asteroids and comets

The mass-concentration model is an approach that has been used to model the gravitational fields of irregularly shaped bodies such as asteroids and comets. By this approach, the body is treated as a collection of point masses. The method is conceptually simple, easy to program, valid down to the surface, and capable of modeling arbitrary density heterogeneities. How the mass concentrations are distributed as well as how mass is assigned to these concentrations is, however, nontrivial. These aspects significantly affect the accuracy and efficiency of the gravitational model. In this paper, we frame the distribution process in terms of numerical integration applied to finite volume meshes. We describe a new method using unstructured, curvilinear, finite volume meshes to significantly improve the accuracy of the mass-concentration model. We then compare the accuracy and efficiency of several variations of our distribution technique to those from literature using Asteroid Eros and Bennu as example bodies. Our results show that the mascon model can be as accurate as the analytic polyhedral model at the surface using an equivalent number of computational elements—i.e., mascon to surface facets. We report the improvement in the model’s performance can be mainly attributed to the volume mesh topology while mesh curving can provide modest case-dependent improvements.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Data-driven predictive probability density function control of fiber length stochastic distribution shaping in refining process

Pulp is the most important raw material in paper in paper industries, whose Fiber Length Stochastic Distribution (FLSD) shaping directly determines the energy consumption and paper quality of the subsequent papermaking processes. However, the mean and variance are insufficient to describe the output FLSD shaping, which display non-Gaussian distribution properties. Therefore, the traditional control, method based on the mean and variance of fiber length is difficult to control the FLSD shaping effectively. In this paper, a novel data-driven predictive probability density function (PDF) control method is proposed for output FLSD shaping in refining process. Primarily, in order to improve the approximation accuracy of the PDF employing RBF neural network, the parameters (center value and width) of each RBF basis functions are tuned via utilizing iterative learning control (ILC) law, and the corresponding estimations of weights law can be obtained. Secondly, considering that the conventional linear model of weights vector has drawbacks of low accuracy and weak generalization ability, random vector functional link networks (RVFLNs) based data driven nonlinear modelling method is employed to characterize the prediction model between the input variables and weights vector. Finally, in order to reduce the randomness of the output FLSD, a minimum entropy control method under mean constraint is employed to design the predictive PDF controller for the output FLSD shaping with the help of the established nonlinear stochastic distribution model. Both simulations and experiments are given to illustrate the effectiveness and practicability of the proposed method.

Probability debsity function, Fiber length distrib↗

DOE OSTI2024

Modeling Framework for the Assessment of a Sustainable Hydrogen Production and Supply Chain Network in California

The cost-effective and sustainable deployment of hydrogen supply and demand networks, especially in large economic regions like California, can be challenging considering the spatial-temporal availability and variability of the different actors across the network such as production processes, distribution modes, and end-users. In this presentation, we will provide an overview and demonstration of a modeling framework used to assess the environmental, economic, and human health impacts of plausible hydrogen production and supply chain networks in California. Scenarios focus on green hydrogen production pathways using water electrolysis and biomass gasification. End-use applications included in the model are transit, medium and heavy-duty trucking, port authorities, and power and aviation companies that currently consume natural gas, diesel, and aviation fuel for their day-to-day operation. Representative locations for hydrogen production and end-use are based on recent projections of the hydrogen economy in California. All mass and energy flows, as well as estimated emissions, are based on H2A process model designs and projections of technology performance, literature review, and LBNL process, economic and life cycle modeling, and not on company data for the sake of this presentation. Human health impacts are included following methodologies developed for the University of California Irvine HyDeal project. Life cycle phases associated with hydrogen production include feedstock preparation (water and biomass), energy production and consumption (renewable, grid, and combination of renewable and grid electricity), maintenance (chemical utilization in electrolysis and natural gas combustion in gasification), carbon sequestration, hydrogen storage (compression and liquefaction), and distribution (truck and pipeline). We apply the framework utilizing California specific emission factors, financial data, and human health damages and explore the impact of network characteristics on results. Example variations include: the inclusion of policy incentives or not, different representations of the electricity grid and source, electrolysis versus gasification versus combinations of both for production, liquefaction versus compression based on producer capacity cutoffs, transportation truck versus pipeline based on existing infrastructure, and ultimate end use. Comparison of these different scenarios can help inform future projects by demonstrating the trade-offs among environmental, economic, and human health impacts. This model, automated in R, is a starting platform upon which new analysis, modeling capabilities, locations, and emission factors can be rapidly tested and integrated.

Zaki, Mohammed Tamim↗

DOE OSTI2019

FY 18 Status Report on the Computing Systems for the Yucca Mountain Project TSPA-LA Models and Inventory of Software used for Process Models

Sandia National Laboratories (SNL) continued evaluation of total system performance assessment (TSPA) computing systems for the previously considered Yucca Mountain Project (YMP). This was done to maintain the operational readiness of the computing infrastructure (computer hardware and software) and knowledge capability for total system performance assessment (TSPA) type analysis, as directed by the National Nuclear Security Administration (NNSA), DOE 2010. This work is a continuation of the ongoing readiness evaluation reported in Lee and Hadgu (2014), Hadgu et al. (2015) and Hadgu and Appel (2016), and Hadgu et al. (2017). The TSPA computing hardware (2014 server cluster -CL2014) and storage system described in Hadgu et al. (2015) were used for the current analysis. One floating license of Gold Sim with Versions 9.60.300, 10.5, 11.1 and 12.0 was installed on the cluster head node, and its distributed processing capability was mapped on the cluster processors. Other supporting software were tested and installed to support the TSPA-type analysis on the server cluster. The FY18 task included developing an inventory of software used for the Yucca Mountain Project process models and preliminary assessment of status of the software; enhancing security of the cluster and setting a backup system. The 2014 server cluster and supporting software systems are fully operational to support TSPA-LA type analysis.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

Analysis of contact conditions and microstructure evolution in shear assisted processing and extrusion using smoothed particle hydrodynamics method

Shear assisted processing and extrusion (ShAPE) is a solid-phase processing technique that adds an additional shear force as compared with a conventional extrusion approach. Recently, ShAPE has demonstrated the capability of extruding high-performance aluminum alloy 7075 (AA7075) tubes at speeds up to 12.2 m/min without surface tearing. However, the relationship among the ShAPE processing parameters, thermomechanical conditions, contact conditions, heat generation, and microstructure evolution remains primarily empirical because an insightful understanding of the associated physics is still lacking. To help elucidate these relationships, this work proposes a thermomechanical meshfree model for the first time for ShAPE processing of AA7075 using the smoothed particle hydrodynamics (SPH) method. The meshfree model is first validated thoroughly by experimental data in terms of material flow, die face temperature, and extrusion force with various processing parameters. The validated model is then used to analyze the steady-state contact conditions and heat generation rates during ShAPE processing. Distributions of the average grain size of AA7075 being extruded are calculated using the SPH model output. The meshfree model results reveal that extrusions conducted at lower temperatures and higher strain rates yield more refined grains and possibly higher material strength, which is also consistent with the experimental observations.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Possibility to Identify the Contributions from Collapsars, Supernovae, and Neutron Star Mergers from the Evolution of the r-process Mass Abundance Distribution

We study the evolution of rapid neutron-capture process (r-process) isotopes in the galaxy. We analyze relative contributions from core-collapse supernovae (CCSNe), neutron star mergers, and collapsars under a range of astrophysical conditions and nuclear input data. Here we show that, although the r-process in each of these sites can lead to a similar (universal) elemental distribution, the detailed isotopic abundances can differ from one site to another. These differences may allow for the identification of which sources contributed to the early evolution of r-process material in the galaxy. Our simulations suggest that the early evolution was dominated by CCSNe and collapsar r-process nucleosynthesis. This conclusion may be testable if the next generation of observatories can deduce isotopic r-process abundances.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2019

A spark‐based big data analysis framework for real‐time sentiment prediction on streaming data

Summary There are many data sources that produce large volumes of data. The Big Data nature requires new distributed processing approaches to extract the valuable information. Real‐time sentiment analysis is one of the most demanding research areas that requires powerful Big Data analytics tools such as Spark. Prior literature survey work has shown that, though there are many conventional sentiment analysis researches, there are only few works realizing sentiment analysis in real time. One major point that affects the quality of real‐time sentiment analysis is the confidence of the generated data. In more clear terms, it is a valuable research question to determine whether the owner that generates sentiment is genuine or not. Since data generated by fake personalities may decrease accuracy of the outcome, a smart/intelligent service that can identify the source of data is one of the key points in the analysis. In this context, we include a fake account detection service to the proposed framework. Both sentiment analysis and fake account detection systems are trained and tested using Naïve Bayes model from Apache Spark's machine learning library. The developed system consists of four integrated software components, ie, (i) machine learning and streaming service for sentiment prediction, (ii) a Twitter streaming service to retrieve tweets, (iii) a Twitter fake account detection service to assess the owner of the retrieved tweet, and (iv) a real‐time reporting and dashboard component to visualize the results of sentiment analysis. The sentiment classification performances of the system for offline and real‐time modes are 86.77% and 80.93%, respectively.

Kılınç, Deniz↗

DOE OSTI2018

An automatic performance model-based scheduling tool for coupled climate system models

The prediction of the climate system is highly depended on the efficient integration of observations and simulations of the Earth. This is regarded as a canonical example of the cyber-physical system. The climate system model, the simulation engine in this cyber-physical system, is one of most challenging applications in scientific computing. It utilizes the multi-physics simulation that couples multiple components, conducts decadal to millennium simulations, and has long been an important application on supercomputers. However, current climate system models suffer from the inefficient task scheduling methods resulting in an intolerable simulation time. Take the Community Earth System Model (CESM), the most widely used climate system model, as an example, one major reason that CESM suffers from bad performances is the huge overhead to rationally distribute processes among the coupled heterogeneous components. According to the report of NCAR, every percent improvement in CESM performance frees up to the equivalent of $250,000 in computing resources in their scientific experiments. To address such challenge, our paper firstly constructs a lightweight and accurate performance model for effectively capturing and predicting the heterogeneous time-to-solution performance of end-to-end CESM components with a given simulation configuration. Then, based on the performance model, we further propose an efficient scheduling strategy based on rectangular packing method to determine the best process layout among different components, and the process numbers assigned to each component. Our evaluations show that we can achieve 58% average run time reductions on CESM comparing to the widely used sequential process layout for a scale of 144 to 480 cores on typical CPU clusters. And we can save 4 million CPU hours when we conduct one standard scientific experiment (a 2870-year simulation), which equals to save $40,089 with a charge of $0.01 per CPU hour. Meanwhile, 26% extra performance improvements could also be gained in our methods comparing to the heuristic branch and bound algorithm with the guidance of the known curve-fitting performance model.

58 GEOSCIENCES↗

DOE OSTI2026

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration

We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications – AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique contribution to the DOE Integrated Research Infrastructure (IRI) landscape. By creating a flexible, API-driven data request service, we address a significant need for high-speed data streaming sources for the X-ray science data analysis community. With the combination of data request API, mutual authentication web security framework, job queue system, high-rate data buffer, and complementary nature to facility infrastructure, the LCLStreamer framework has prototyped and implemented several new paradigms critical for future generation experiments.

Rogers, David [ORNL] (ORCID:0000000251871768)↗

DOE OSTI2022

HPS-RL: Hyperparameter tuning for deep RL applications (HPS-RL) v1

Genetic Algorithms meets Deep RL for Hyperparameters Hyperparameter optimization and architecture search can easily become cumbersome and finding the right hyperparameters can seriously impact the robustness of the deep RL application being developed. We use genetic algorithms to evolve optimum deep RL architectures in a scalable manner. HPS-RL is designed to work with multiple gym enviornments, allow users to test their own optimization functions and tune multi-objective parameters in multiple deep RL algorithms. HPS-RL uses multi-threading and is being extended with mpipy for distributed processing on HPC. https://arxiv.org/abs/2201.11182

Kiran, Mariam↗

DOE OSTI2023

Simulation of the dynamics of gas mixtures during plasma processing in the C75 Cavity

Plasma processing using a mixture of noble gas and oxygen is a technique that is currently being used to reduce field emission and multipacting in accelerating cavities. Plasma is created inside the cavity when the gas mixture is exposed to an electromagnetic field that is generated by applying RF power through the fundamental power or higher-order mode couplers. Oxygen ions and atomic oxygen are created in the plasma which breaks down the hydrocarbons on the surface of the cavity and the residuals from this process are removed as part of the process gas flow. Removal of hydrocarbons from the surface increases the work function and reduces the secondary emission coefficient. This work describes the initial results of plasma simulation, which provides insight into the ignition process, distribution of different species, and interactions of free oxygen and oxygen ions with the cavity surfaces. The simulations have been done with an Ar/?2 plasma using COMSOL® multiphysics. These simulations help in understanding the dynamics and control of plasma inside the cavity and the exploration of different gas mixtures.

Dhakal, Pashupati↗

DOE OSTI2020

Optimizing the Accelerated Recursive Doubling Algorithm for Block Tridiagonal Systems of Equations

The need to solve block tridiagonal systems with hundreds or thousands of right-hand sides for the same block tridiagonal matrix is common in a variety of disciplines. To meet this need, the Accelerated Recursive Doubling Algorithm was developed. After a right-hand side independent phase, the algorithm allows for the quick, online calculation of solutions for different right-hand sides. In this work, we present methods to optimize the Accelerated Recursive Doubling Algorithm in memory usage and computation time in a hybrid parallelization model. The right-hand side independent phase of the naïve implementation takes ≥ 11/3 the amount of memory required to store the tridiagonal matrix, while our implementation reduces the fraction to ≈ 5/3 . The right-hand side dependent phase of the naïve implementation takes ≥ 6 times the amount of memory required to store the right-hand side, while our implementation reduces the fraction to ≈ 3. The computation time for the independent phase is reduced to ≈ 2/3 times that of the naïve implementation, while the computation time for the dependent phase is reduced to ≈ 5/9 . With increasing numbers of shared-memory threads q on every distributed processing element, we have O(q) theoretical speedup.

97 MATHEMATICS AND COMPUTING↗