Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed data generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Experimental and Computational Examination of the Coandă Effect on the Space Launch System at Liftoff Conditions

During development of an aerodynamic database to cover ground wind loads, uncertainty quantification to account for the Coandă effect forced a closer look into how this phenomenon manifests on the Space Launch System. Aerodynamic data collected across the life of the pro-gram is explored to look for trends and the ability to characterize not just the bounds of forces and moments but also better understand their distributions. Experimental data collected in the NASA Langley 14- by 22-Foot Subsonic Tunnel is used to explore integrated forces and moments. This is followed up by a similar exploration using computational data generated using the Kestrel flow solver. After a survey of the data at large which confirms the existence of the Coandă states throughout the history of the program, a few highlighted cases are used to characterize the flow physics. This characterization is used to summarize how each Coandă state is predicted to load the vehicle.

Coandă Effect↗
DOE OSTI2018

Time-Dependent Reliability Analysis of Nuclear Hybrid Energy Systems

This paper focuses on developing a framework for comprehensive time-dependent reliability analysis of a nuclear hybrid energy system (NHES) design. Subsystem interactions of this complex integrated system under stochastic electricity demand and load-following operation capabilities requires dynamic reliability assessment of the NHES in component, subsystem and system level. In order to capture the dynamic operational behavior of critical systems and components, a detailed thermal hydraulic model of the NHES is generated using Modelica and tested under different electricity demand histories generated using RAVEN. The physical data (e.g., valve position, flow rates, inlet outlet water temperatures) gathered from Modelica used to calculate time-dependent failure rates through fitting data into the piecewise Weibull distribution. Optimum maintenance interval is calculated, and maintenance cost estimates based on the calculated reliability metric is presented for the selected component. Component time-dependent failure rates fed into the subsystem reliability model built with non-Markovian Stochastic Petri Nets. The component and subsystem failure rates are calculated and updated in every hour to characterize the system behavior appropriately and to understand operational reliability of the NHES design in a given time.

Guler Yigitoglu, Askin↗
DOE OSTI2022

Estimating Cosmological Constraints from Galaxy Cluster Abundance using Simulation-Based Inference

Inferring the values and uncertainties of cosmological parameters in a cosmology model is of paramount importance for modern cosmic observations. In this paper, we use the simulation-based inference (SBI) approach to estimate cosmological constraints from a simplified galaxy cluster observation analysis. Using data generated from the Quijote simulation suite and analytical models, we train a machine learning algorithm to learn the probability function between cosmological parameters and the possible galaxy cluster observables. The posterior distribution of the cosmological parameters at a given observation is then obtained by sampling the predictions from the trained algorithm. Our results show that the SBI method can successfully recover the truth values of the cosmological parameters within the 2σ limit for this simplified galaxy cluster analysis, and acquires similar posterior constraints obtained with a likelihood-based Markov Chain Monte Carlo method, the current state-of the-art method used in similar cosmological studies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Zero-truncated Poisson regression for sparse multiway count data corrupted by false zeros

Abstract We propose a novel statistical inference methodology for multiway count data that is corrupted by false zeros that are indistinguishable from true zero counts. Our approach consists of zero-truncating the Poisson distribution to neglect all zero values. This simple truncated approach dispenses with the need to distinguish between true and false zero counts and reduces the amount of data to be processed. Inference is accomplished via tensor completion that imposes low-rank tensor structure on the Poisson parameter space. Our main result shows that an $N$-way rank-$R$ parametric tensor $\boldsymbol{\mathscr{M}}\in (0,\infty )^{I\times \cdots \times I}$ generating Poisson observations can be accurately estimated by zero-truncated Poisson regression from approximately $IR^2\log _2^2(I)$ non-zero counts under the nonnegative canonical polyadic decomposition. Our result also quantifies the error made by zero-truncating the Poisson distribution when the parameter is uniformly bounded from below. Therefore, under a low-rank multiparameter model, we propose an implementable approach guaranteed to achieve accurate regression in under-determined scenarios with substantial corruption by false zeros. Several numerical experiments are presented to explore the theoretical results.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2004

Global Aerosol Profiling by Orbital Lidar, GLAS Results and Validation

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. GLAS is approaching six months of on orbit data operation. These data from thousands of orbits illustrate the ability of space lidar to accurately and dramatically measure the height distribution of global aerosol to an unprecedented degree. There were many intended science applications of the GLAS data and significant results have already been realized, profiling is a fundamentally new measurement from space with multiple applications. A most important aerosol application is providing input to global aerosol generation transport models. Another is improved measurement of aerosol optical depth. A main approach to verify the aerosol optical depth retrieval is comparison to surface measurements by Aeronet. A special feature of the GLAS satellite bus is to rapidly point the lidar instrument at off nadir targets with less than 100 m accuracy. About a dozen selected Aeronet sites were pointed at whenever the GLAS lidar came within 5 degrees of zenith. These plus a more general comparison to nearby sites support the GLAS data product values. In addition the GLAS data can be used to add vertical distribution information to Aeronet aerosol measurements. As an EOS project instrument, GLAS data products are openly available to the science community. First year results from GLAS are summarized.

Spinhirne, J. D.↗
NASA NTRS1988

The evolution of AAOE observed constituents with the polar vortex

One of the difficulties in determining constituent trends from the ER-2 flight data is the large amount of day to day variability generated by the motion of the polar vortex. To reduce this variability, the observations have been transformed into the conservative (Lagrangian) reference frames consisting of the coordinate pairs, potential temperature (PT) and potential vorticity (PV), or PT and N2O. The requirement of only two independent coordinates rests on the assumption that constituent distributions and their chemical processes are nearly zonal in that coordinate system. Flight data is used everywhere for these transformation except for potential vorticity. Potential vorticity is determined from level flight segments, and NMC PV values during flight dives and takeoffs are combined with flight data in a smooth fashion.

Schoeberl, Mark R.↗
DOE OSTI2021

Dark Energy Survey Y3 results: blending shear and redshift biases in image simulations

ABSTRACT As the statistical power of galaxy weak lensing reaches per cent level precision, large, realistic, and robust simulations are required to calibrate observational systematics, especially given the increased importance of object blending as survey depths increase. To capture the coupled effects of blending in both shear and photometric redshift calibration, we define the effective redshift distribution for lensing, nγ(z), and describe how to estimate it using image simulations. We use an extensive suite of tailored image simulations to characterize the performance of the shear estimation pipeline applied to the Dark Energy Survey (DES) Year 3 data set. We describe the multiband, multi-epoch simulations, and demonstrate their high level of realism through comparisons to the real DES data. We isolate the effects that generate shear calibration biases by running variations on our fiducial simulation, and find that blending-related effects are the dominant contribution to the mean multiplicative bias of approximately $-2{{\ \rm per\ cent}}$. By generating simulations with input shear signals that vary with redshift, we calibrate biases in our estimation of the effective redshift distribution, and demonstrate the importance of this approach when blending is present. We provide corrected effective redshift distributions that incorporate statistical and systematic uncertainties, ready for use in DES Year 3 weak lensing analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1994

A stochastic precipitation disaggregation scheme for GCM applications

In the surface hydrologic parameterization of general circulation models (GCMs), it is commonly assumed that the precipitation processes are homogeneous over a GCM grid square and that the precipitation intensity is uniformly distributed. Based on evidence that the spatial distribution of precipitation within a GCM grid square is crucial for the land surface hydrology parameterization, a few researchers have explored the impacts of assuming that the precipitation is exponentially distributed. This paper explores the suitability of the aforementioned assumptions. First, a statistical analysis is conducted of historical precipitation data for three GCM grids in different regions of the United States. The analysis suggests that neither the uniform nor the exponential distribution assumption may be suitable at the GCM grid scale and, that instead, the spatial variability in precipitation is characterized by statistical patterns that are inhomogeneous. These patterns vary from grid to grid and are induced by the interaction between atmospheric conditions and various land surface characteristics, such as topographical features, surface properties, etc. Within the same grid square, however, the statistical patterns are generally constant from year to year. Based on this analysis, a computationally viable (i.e., usable with GCMs) stochastic precipitation disaggregation scheme that utilizes these stable statistical patterns is proposed. The method was used to generate spatially distributed hourly rainfall for a summer season in the southwestern region of the continental United States. Analysis of the results shows that the methodology preserves the seasonal characteristics of spatial variability in precipitation that is observed in the long-term historical data.

Gao, Xiaogang↗
NASA NTRS2004

Global Aerosol Profiling by Orbital Lidar, GLAS Results and Validation

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. GLAS is approaching six months of on orbit data operation. These data from thousands of orbits illustrate the ability of space lidar to accurately and dramatically measure the height distribution of global aerosol to an unprecedented degree. There were many intended science applications of the GLAS data and significant results have already been realized. profiling is a fundamentally new measurement from space with multiple applications. A most important aerosol application is providing input to global aerosol generation and transport models. Another is improved measurement of aerosol optical depth. A main approach to verify the aerosol optical depth retrieval is comparison to surface measurements by Aeronet. A special feature of the GLAS satellite bus is to rapidly point the lidar instrument at off nadir targets with less than 100 m accuracy. About a dozen selected Aeronet sites were pointed at whenever the G U S lidar came within 5 degrees of zenith. These plus a more general comparison to nearby sites support the G U S data product values. In addition the GUS data can be used to add vertical distribution information to Aeronet aerosol measurements.. As an EOS project instrument, GLAS data products are openly available to the science community. First year results from G U S are summarized.

Spinhirne, J. D.↗
DOE OSTI2021

Quasi-brittle porous material: Simulated effect of stochastic air void structure on compressive strength

Highlights: • A simulation procedure to study the effect of porosity on the compressive strength of a quasi-brittle material is introduced • Based on the simulated results, the relationship between compressive strength and air void fraction (porosity) is presented. • A linear relationship was achieved between the cubic root of porosity and the simulated compressive strength. The effect of porosity comprised of spherical air voids on the compressive strength of quasi-brittle material was studied via simulations. The simulated porous structures were based on pore size distributions of two mortar samples measured by X-ray microtomography. While the simulation method set practical limits on the size of sample, the base of the statistics was established by simulating 128 small structures generated by sampling from pore structures of two mortars. By studying the application of the classical strength-porosity formulas to the simulated data, a new simple model was formed. A linear relationship was achieved between the cubic root of air void fraction (porosity) and the simulated compressive strength. The reasons for scattering of simulated strength around fitted trend remained unresolved in this study; no clear dependence on pore number or other distribution properties was observed. With the presented simulation approach, the dependence of compressive strength on porosity is achieved independently of disturbances that occur in experimental studies creating understanding of compressional behavior of low porosity materials.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A multi-agent approach to distribution system fault section estimation in smart grid environment

We report that Multi-Agent Systems (MAS) are seen from different areas as one of the paramount trends for the next generation of power systems. Numerous published studies about MAS discuss its utilization in power distribution networks but none focuses on the prior step to restoration and self-healing that is fault section estimation. This paper aims to show how MAS can improve the utilities’ reliability indexes and consumer satisfaction by overcoming the multiple fault section estimation problem. In order to do this, the authors considered using MAS as a means of communication between smart meters. The purpose of smart meters usage is to employ devices that are already present in smart grids, mainly because of their reading and saving data capacity. The proposed method was tested on a radial feeder generated by the authors. The network was built on HYPERSIM, a software platform of OPAL-RT Technologies. The simulation results show that this MAS provides speed, efficiency, and automation for the process of fault section estimation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

A Quantitative Study of Deep Learning Training on Heterogeneous Supercomputers

Deep learning (DL) has become a key technique for solving complex problems in scientific research and discovery. DL training for science is substantially challenging because it has to deal with massive quantities of multi-dimensional data. High- performance computing (HPC) supercomputers are increasingly being employed for meeting the exponentially growing demand for DL. Multiple GPUs and high-speed interconnect network are needed for supporting DL on HPC systems. However, the excessive use of GPUs without considering effective benefits leads to inefficient resource utilization of these expensive setups. In this paper, we conduct a quantitative analysis to gauge the efficacy of DL workloads on the latest HPC system and identify viability of next-generation DL-optimized heterogeneous supercomputers for enabling researchers to develop more efficient resource management and distributed DL middleware. We evaluate well- known DL models with large-scale datasets using the popular TensorFlow framework, and provide a thorough evaluation in- cluding scalability, accuracy, variability, storage resource, GPU- GPU/GPU-CPU data transfer, and GPU utilization. Our analysis reveals that the latest heterogeneous supercomputing cluster shows varying performance trend as compared to the existing literature for single- and multi-node training. To the best of our knowledge, this is the first work to conduct such a quantitative and comprehensive study of DL training on a supercomputing system with multiple GPUs.

Han, Jingoo↗
DOE OSTI2022

Enhanced deep neural networks with transfer learning for distribution LMP considering load and PV uncertainties

As the flexibility of generation and demand increases in distribution systems, the residential loads are emerging as a promising means to participate in demand response and the transactive energy market. Market pricing is an instrumental mechanism for the distribution system operator to exploit the full potential of the flexible resources. The distribution locational marginal price (DLMP) can be used to guide the residential load consumption. This type of market signal helps the distribution system operator to optimize the scheduling of all resources while satisfying related network constraints through a day-ahead market. However, solving the optimization problem for large-scale systems can be computationally expensive. To address the scalability and practicability limitations of the DLMP framework, a learning-based approach is proposed in this paper to complement the day-ahead distribution market framework. Here, the proposed approach combines long short-term memory and transfer learning to develop deep neural network that can capture the spatial–temporal correlation of the input data. The model can determine the optimal DLMP for each node in a distribution system without the system parameters required to formulate the optimization problem. Testing results on IEEE 33-bus and 123-bus systems show that the proposed approach can generate a comparable DLMP against the optimization solutions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1990

Distributed simulation of network protocols

Simulations of high speed network protocols are very CPU intensive operations requiring very long run times. Very high speed network protocols (Gigabit/sec rates) require longer simulation runs in order to reach a steady state, while at the same time requiring additional CPU processing for each unit of time because of the data rates for the traffic being simulated. As protocol development proceeds and simulations provide insights into any problems associated with the protocol, the simulation model often must be changed to generate additional or finer statistical performance information. Iterating on this process is very time consuming due to the required run times for the simulation models. The results of the efforts to distribute a high speed ring network protocol, Carrier Sensed Multiple Access/Ring Network (CSMA/RN), are presented.

Paterra, Frank↗
DOE OSTI2020

Three-dimensional microstructure-explicit and void-explicit mesoscale simulations of detonation of HMX at millimeter sample size scale

Fully three-dimensional (3D) microstructure-explicit and void-explicit mesoscale simulations of the shock-to-detonation (SDT) process of pressed granular HMX (octahydro-1,3,5,7-tetranitro-1,3,5,7-tetrazocine) are performed. The overall size scale of the models is up to 3 × 3 × 15 mm3, with ∼30 000 grains and 206 265 voids. The models account for the heterogeneous material microstructure, constituent distribution, constituent morphology, and voids. Loading conditions considered involve piston velocities in the range of 600–1200 m/s or pressures in the range of 4–8 GPa. The focus is on analyzing the SDT process and the effects of microstructure and voids on the run-to-detonation distance (RDD). Companion two-dimensional (2D) simulations are also carried out to assess the differences between 2D and 3D. Statistically equivalent microstructure sample sets (SEMSSs) are generated and used for both 2D and 3D, allowing the prediction of the statistical and probabilistic Pop plots (PPs). The predictions are in general agreement with trends in available experimental data in the literature. It is found that both the microstructure (heterogeneous grain size, morphology, and size distribution) and voids significantly affect the RDD and the PPs. These effects are systematically delineated and quantified via the use of SEMSSs with different combinations of attributes. A recently developed probabilistic formulation for the PPs is used to characterize the results, allowing uncertainties in the relations between the shock pressure and RDD arising from material heterogeneities to be quantified. The probabilistic formulation is further used to quantify the confidence levels in the ranked order of influences of different combinations of microstructure and voids on the PPs.

Miller, Christopher (ORCID:0000000206844381)↗
DOE OSTI2021

Benchmarking blockchain-based gene-drug interaction data sharing methods: A case study from the iDASH 2019 secure genome analysis competition blockchain track

Blockchain distributed ledger technology is just starting to be adopted in genomics and healthcare applications. Despite its increased prevalence in biomedical research applications, skepticism regarding the practicality of blockchain technology for real-world problems is still strong and there are few implementations beyond proof-of-concept. We focus on benchmarking blockchain strategies applied to distributed methods for sharing records of gene-drug interactions. We expect this type of sharing will expedite personalized medicine. We generated gene-drug interaction test datasets using the Clinical Pharmacogenetics Implementation Consortium (CPIC) resource. We developed three blockchain-based methods to share patient records on gene-drug interactions: Query Index, Index Everything, and Dual-Scenario Indexing. We achieved a runtime of about 60 s for importing 4,000 gene-drug interaction records from four sites, and about 0.5 s for a data retrieval query. Our results demonstrated that it is feasible to leverage blockchain as a new platform to share data among institutions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

A Privacy-Preserving Distributed Control of Optimal Power Flow

Here, we consider a distributed optimal power flow formulated as an optimization problem that maximizes a nondifferentiable concave function. Solving such a problem by the existing distributed algorithms can lead to data privacy issues because the solution information exchanged within the algorithms can be utilized by an adversary to infer the data. To preserve data privacy, in this paper we propose a differentially private projected subgradient (DP-PS) algorithm that includes a solution encryption step. We show that a sequence generated by DP-PS converges in expectation, in probability, and with probability 1. Moreover, we show that the rate of convergence in expectation is affected by a target privacy level of DP-PS chosen by the user. We conduct numerical experiments that demonstrate the convergence and data privacy preservation of DP-PS.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Stable parallel training of Wasserstein conditional generative adversarial neural networks

In this work, we propose a stable, parallel approach to train Wasserstein conditional generative adversarial neural networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques, our approach avoids inter-process communications, reduces the risk of mode collapse and enhances scalability by using multiple generators, each one of them concurrently trained on a single data label. The use of the Wasserstein metric also reduces the risk of cycling by stabilizing the training of each generator. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets, three standard benchmark image datasets, maintaining the original resolution of the images for each dataset. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources. To measure accuracy, we use the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks as well as an improvement of image quality of the new images created by the GANs approach. Weak scaling is attained on both datasets using up to 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗