Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed data generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

An Application Programming Interface for Synthetic Snowflake Particle Structure and Scattering Data

The work by Kuo and colleagues on growing synthetic snowflakes and calculating their single-scattering properties has demonstrated great potential to improve the retrievals of snowfall. To grant colleagues flexible and targeted access to their large collection of sizes and shapes at fifteen (15) microwave frequencies, we have developed a web-based Application Programming Interface (API) integrated with NASA Goddard's Precipitation Processing System (PPS) Group. It is our hope that the API will enable convenient programmatic utilization of the database. To help users better understand the API's capabilities, we have developed an interactive web interface called the OpenSSP API Query Builder, which implements an intuitive system of mechanisms for selecting shapes, sizes, and frequencies to generate queries, with which the API can then extract and return data from the database. The Query Builder also allows for the specification of normalized particle size distributions by setting pertinent parameters, with which the API can also return mean geometric and scattering properties for each size bin. Additionally, the Query Builder interface enables downloading of raw scattering and particle structure data packages. This presentation will describe some of the challenges and successes associated with developing such an API. Examples of its usage will be shown both through downloading output and pulling it into a spreadsheet, as well as querying the API programmatically and working with the output in code.

reflectivity properties of snowflakes↗
NASA NTRS2020

Characterization of the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel Supersonic Test Section (2020 Test)

Recent customer requirements for improved Mach number stability for sonic boom signature measurements has piqued interest in the use of the solid-wall supersonic test section in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel. To supply customers with understanding of the operating conditions and flow quality in this region of the tunnel, characterization tests were performed in the solid-wall supersonic test section in January 2020. The test entry covered the operating range of the facility for three-drive-motor operation. Calibration models were generated along with an improved understanding of operational considerations for this region of the tunnel. The data set acquired included centerline axial and planar flow-field distributions to quantify test section flow quality. The collected data provided an improved understanding of operational considerations for this region of the tunnel as well as allowed for the development of detailed calibration models for the solid-wall supersonic test section.

Supersonic↗
NASA NTRS1997

ARTSN: An Automated Real-Time Spacecraft Navigation System

ARTSN, the Automated Real-Time Spacecraft Navigation system is a real time system for the automated navigation of interplanetary spacecraft. The system processes the real time DSN radio metric data flow and generates updated spacecraft solutions and the associated covariance. ARTSN is designed modularly with the user interface input and output separated from the data analysis modules. Designed for distributed application, the system provided, for the first time, an automated method of processing radio metric navigation data for interplanetary spacecraft.

ARTSN↗
NASA NTRS2010

Public Risk Assessment Program

The Public Entry Risk Assessment (PERA) program addresses risk to the public from shuttle or other spacecraft re-entry trajectories. Managing public risk to acceptable levels is a major component of safe spacecraft operation. PERA is given scenario inputs of vehicle trajectory, probability of failure along that trajectory, the resulting debris characteristics, and field size and distribution, and returns risk metrics that quantify the individual and collective risk posed by that scenario. Due to the large volume of data required to perform such a risk analysis, PERA was designed to streamline the analysis process by using innovative mathematical analysis of the risk assessment equations. Real-time analysis in the event of a shuttle contingency operation, such as damage to the Orbiter, is possible because PERA allows for a change to the probability of failure models, therefore providing a much quicker estimation of public risk. PERA also provides the ability to generate movie files showing how the entry risk changes as the entry develops. PERA was designed to streamline the computation of the enormous amounts of data needed for this type of risk assessment by using an average distribution of debris on the ground, rather than pinpointing the impact point of every piece of debris. This has reduced the amount of computational time significantly without reducing the accuracy of the results. PERA was written in MATLAB; a compiled version can run from a DOS or UNIX prompt.

Mendeck, Gavin↗
DOE OSTI2021

DNTTD (Distributed Non-Negative Tensor Train Decomposition)

The era of exascale computing opens new venues for innovations and discoveries in many scientific, engineering, and commercial fields. However, with the exa flops also come the extra-large high-dimensional data generated by high performance computing. High-dimensional data is presented as multidimensional arrays, aka tensors. The presence of latent (not directly observable) structures in the tensor allows a unique representation and compression of the data by classical tensor factorization techniques. However, the classical tensor methods are not always stable or they can be exponential in their memory requirements, which makes them not suitable for high-dimensional tensors. Tensor train (TT) is a state-of-the-art tensor network introduced for factorization of high-dimensional tensors. TT transforms the initial high-dimensional tensor in a network of three-dimensional tensors that requires only a linear storage. Many real-world data, such as, density, temperature, population, probability, etc., are non-negative and for an easy interpretation, the algorithms preserving non-negativity are preferred. Here, we introduce a distributed non-negative tensor-train and demonstrate its scalability and the compression on synthetic and real world big datasets.

Bhattarai, Manish↗
DOE OSTI2023

Distributed Energy Resource Management Systems: Preserving Customer Privacy through K-Anonymity

The smart grid represents the next generation of electricity distribution systems that utilizes recent technological innovations. It uses digital communication between its components and entities to attain more automation, self-sufficiency, and reliability. One of the many concerns in smart grid digital communication discussions is the possibility of violating customers’ privacy. Violating customers’ privacy imposes a significant barrier as smart grid desirable attributes are tightly tied to customers’ participation. Employing privacy models can address concerns regarding information privacy in smart grid digital communication. In this work, we provide an approach to utilizing K-anonymity to ensure data within the system excludes Personally Identifiable Information. Results suggest that a dynamically generated generalization hierarchy minimizes information loss incurred by the anonymization process.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Open-Source High-Fidelity Aggregate Composite Load Models of Emerging Load Behaviors for Large-Sale Analysis

The goal of this project is to accurately model the dynamic loads for power system planning and operation and to address the challenges inherent in such modeling. Existing load models are inadequate to handle the increasing proliferation of residential air conditioner loads and distributed energy resources, the emerging trends of price-responsive demand, and the growing importance of protective devices in equipment and buildings. A need has emerged to develop a fundamentally new class of load models and next-generation data tools. This work proposes to develop a set of regional–level, scalable open source load models and tools, including large-scale aggregate load protection, concept of price responsive demand, advanced load composition data, next-generation load model data tools, and advanced composite load model calibration and validation frameworks to address new challenges in the representation of next-generation load models.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Towards an Introspective Dynamic Model of Globally Distributed Computing Infrastructures

Large-scale scientific collaborations like ATLAS, Belle II, CMS, DUNE, and others involve hundreds of research institutes and thousands of researchers spread across the globe. These experiments generate petabytes of data, with volumes soon expected to reach exabytes. Consequently, there is a growing need for computation, including structured data processing from raw data to consumer-ready derived data, extensive Monte Carlo simulation campaigns, and a wide range of end-user analysis. To manage these computational and storage demands, centralized workflow and data management systems are implemented. However, decisions regarding data placement and payload allocation are often made disjointly and via heuristic means. A significant obstacle in adopting more effective heuristic or AI-driven solutions is the absence of a quick and reliable introspective dynamic model to evaluate and refine alternative approaches. In this study, we aim to develop such an interactive system using real-world data. By examining job execution records from the PanDA workflow management system, we have pinpointed key performance indicators such as queuing time, error rate, and the extent of remote data access. The dataset includes five months of activity. Additionally, we are creating a generative AI model to simulate time series of payloads, which incorporate visible features like category, event count, and submitting group, as well as hidden features like the total computational load—derived from existing PanDA records and computing site capabilities. These hidden features, which are not visible to job allocators, whether heuristic or AI-driven, influence factors such as queuing times and data movement.

kilic, Ozgur Ozan [Brookhaven National Laboratory ↗
DOE OSTI2025

Multiple Changepoint Detection for Non‐Gaussian Time Series

ABSTRACT This article combines methods from existing techniques to identify multiple changepoints in non‐Gaussian autocorrelated time series. A transformation is used to convert a Gaussian series into a non‐Gaussian series, enabling penalized likelihood methods to handle non‐Gaussian scenarios. When the marginal distribution of the data is continuous, the methods essentially reduce to the change of variables formula for probability densities. When the marginal distribution is count‐oriented, Hermite expansions and particle filtering techniques are used to quantify the scenario. Simulations demonstrating the efficacy of the methods are given and two data sets are analyzed: 1) the proportion of home runs hit by Major League Baseball batters from 1920 to 2023 and 2) a six‐dimensional series of tropical cyclone counts from the Earth's basins of generation from 1980 to 2023. In the first series, beta marginal distributions are used to describe the proportions; in the second, Poisson marginal distributions seem appropriate.

Lund, Robert [Department of Statistics University ↗
NASA NTRS1987

Spacecraft particulate contaminant redistribution

This paper describes analyses that were performed in support of the Hubble Space Telescope (HST)) particulate contamination control effort. The specific problems addressed include extension of available particle removal data to launch acoustic and random vibration conditions, development of an engineering model for transport of suspended particulates by airflow and in the presence of vehicle acceleration, turbulent diffusion, and migration of particulates over vibrating surfaces, and integration of the various models into a code that could be used to generate contamination level estimates for the HST primary mirror and other critical surfaces for the HST mission phases. The overall redistribution calculations were made assuming a specified initial contaminant distribution in terms of MIL STD 1246A levels, and using predicted vibration data for the various HST surfaces and mission phases. As expected, the effects of airflow were found to be significant, particularly for the larger particles. Particles smaller than about 20 microns did not participate appreciably in the redistribution.

Klavins, A.↗
NASA NTRS1985

The composition of cosmic rays near the Bend (10 to the 15th power eV) from a study of muons in air showers at sea level

The distribution of muons near shower cores was studied at sea level at Fermilab using the E594 neutrino detector to sample the muon with E testing 3 GeV. These data are compared with detailed Monte Carlo simulations to derive conclusions about the composition of cosmic rays near the bend in the all particle spectrum. Monte Carlo simulations generating extensive air showers (EAS) with primary energy in excess of 50 TeV are described. Each shower record contains details of the electron lateral distribution and the muon and hadron lateral distributions as a function of energy, at the observation level of 100g/cm. The number of detected electrons and muons in each case was determined by a Poisson fluctuation of the number incident. The resultant predicted distribution of muons, electrons, the rate events are compared to those observed. Preliminary results on the rate favor a heavy primary dominated cosmic ray spectrum in energy range 50 to 1000 TeV.

Goodman, J. A.↗
DOE OSTI2025

pyTCR: A tropical cyclone rainfall model for python

pyTCR is a climatology software package developed in the Python programming language. It integrates the capabilities of several legacy physical models and increases computational efficiency to allow rapid estimation of tropical cyclone (TC) rainfall consistent with the large-scale environment. Specifically, pyTCR implements a horizontally distributed and vertically integrated model [Zhu et al., 2013] for simulating rainfall driven by TCs. Along storm tracks, rainfall is estimated by computing the cross-boundary-layer, upward water vapor transport caused by different mechanisms including frictional convergence, vortex stretching, large-scale baroclinic effect (i.e., wind shear), topographic forcing, and radiative cooling [Lu et al., 2018]. The package provides essential functionalities for modeling and interpreting spatio-temporal TC rainfall data. pyTCR requires a limited number of model input parameters, making it a convenient and useful tool for analyzing rainfall mechanisms driven by TCs. To sample rare (most intense) rainfall events that are often of great societal interest, pyTCR adapts and leverages outputs from a statistical-dynamical TC downscaling model [Lin et al., 2023] capable of rapidly generating a large number of synthetic TCs given a certain climate. As a result, pyTCR significantly reduces computational effort and improves the efficiency in capturing extreme TC rainfall events at the tail of the distributions from limited datasets. Furthermore, the TC downscaling model is forced entirely by large-scale environmental conditions from reanalysis data or coupled General Circulation Models (GCMs), simplifying the projection of TC-induced rainfall and wind speed under future climate using pyTCR. Finally, pyTCR can be coupled with hydrological and wind models to assess risks associated with independent and compound events (e.g., storm surges and freshwater flooding).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. Furthermore, we observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2022

Bayesian Rules of Thumb: Robust Uncertainty Quantification in Early Project Cost Estimation

Systems engineers often make use of cost Rules ofThumb in order to estimate cost during early phases of projectformulation. These Rules of Thumb typically take the form ofa sequence of percentages over which a total cost is allocatedacross NASA WBS elements. Rules of Thumb can then be usedto extrapolate cost from one or more known WBS elements tothe remaining unknown WBS elements, assisting early projectformulation architecture studies (such as those in JPL’s Team Xand A Team).A number of issues can arise when generating and using costRules of Thumb. For example, many records of project costsconsist of incomplete data. Typical methods of dealing withincomplete cost allocation data include (a) ignoring missionswith incomplete data, or (b) taking averages of the non-zero percentagesacross missions, but both of these methods can result inbiased estimates if the existence of incomplete data correlateswith total mission cost or any particular WBS element. Anothercommon example is cost reported in one or more incorrect WBSelements. This is especially prevalent in smaller missions whereit is more common for engineers to perform tasks that fall underthe purview of multiple WBS elements.Furthermore, a Rule of Thumb estimate is typically reported asa point estimate; there is no reported uncertainty around thepercentages used to generate an allocation. Even in the rarecase in which confidence intervals around mean percentages areprovided, there may be positive or negative correlations betweenWBS elements which can skew estimates.Here we attempt to address these problems by formulatingprobabilistic Rules of Thumb in which a distribution of allocationschemes, rather than a single allocation scheme, is generated.We use a bootstrap imputation method to simultaneouslyaccount for uncertainty in the missing data while using allavailable information contained in the dataset. The imputeddatasets are then input into a multivariate Bayesian modelwhich accounts for correlations between WBS elements andproperly accounts for uncertainty in the final Rule of Thumbpercentages and predictions. We describe the mathematicalmodel and provides snippets of R code utilizing the brms(Bayesian Regression Models using Stan) package. To illustratethis model, we generate a Bayesian Level 2 WBS Cost Rule ofThumb for MIDEX (Medium-Class Explorers) missions withdata extracted from NASA’s CADRe. We then compare thismethod’s performance with the classical Rule of Thumb method.

Hooke, Melissa A↗
DOE OSTI2021

Contributions to the BeEST sterile neutrino search

Sterile neutrinos are hypothetical right-handed leptons that have been postulated as extensions to the Standard Model to help explain the origin of neutrino masses and the matter-antimatter asymmetry in the Universe. Sterile neutrinos with keV-scale masses are also a promising candidate for dark matter. LLNL and the Colorado School of Mines are developing an experiment to search for sterile neutrinos by measuring the \Beryllium-7 Electron capture in Superconducting Tunnel junctions (STJs)" (the \BeEST" Experiment). When 7 Be implanted into STJ radiation detectors decays by electron capture, the neutrino escapes and the energy of the recoiling 7 Li nucleus can be measured with high accuracy. Using conservation of energy and momentum, the mass of the emitted neutrino can then be found. Sterile keV neutrinos would generate additional peaks in the spectrum, and the experiment uses high-resolution STJs to observe such a potential signal. During my internship, I contributed to different aspects of the BeEST experiment. I designed a UHV setup for X-ray spectroscopy analysis with STJs. It will allow high-resolution X-ray spectroscopy of different materials to examine the broadening in the BeEST spectra, the origins of which are unknown but may be related to material effects inside the STJ detectors. The design accounts for the specific demands of the BeEST project, but provides a degree of flexibility that makes it useful for other potential STJ projects. Additionally, to test the accuracy of the electronics and data analysis routine, an arbitrary waveform generator (AWG) will be used to generate simulated spectra that contain sterile neutrino signals of a specified mass and admixture. For this I programmed an AWG to output random STJ signals whose amplitudes follow the appropriate user-de ned probability distribution. The AWG signals can be input into the 32-channel preamplifier to simulate any spectrum of interest and test the uniformity of the amplifier chain, as well as the sensitivity of the data analysis.

42 ENGINEERING↗
DOE OSTI2023

Mapping gas around massive galaxies: cross-correlation of DES Y3 galaxies and Compton- y maps from SPT and Planck

ABSTRACT We cross-correlate positions of galaxies measured in data from the first three years of the Dark Energy Survey with Compton-y maps generated using data from the South Pole Telescope (SPT) and the Planck mission. We model this cross-correlation measurement together with the galaxy autocorrelation to constrain the distribution of gas in the Universe. We measure the hydrostatic mass bias or, equivalently, the mean halo bias-weighted electron pressure 〈bhPe 〉, using large-scale information. We find 〈bhPe 〉 to be $[0.16^{+0.03}_{-0.04},0.28^{+0.04}_{-0.05},0.45^{+0.06}_{-0.10},0.54^{+0.08}_{-0.07},0.61^{+0.08}_{-0.06},0.63^{+0.07}_{-0.08}]$ meV cm−3 at redshifts z ∼ [0.30, 0.46, 0.62, 0.77, 0.89, 0.97]. These values are consistent with previous work where measurements exist in the redshift range. We also constrain the mean gas profile using small-scale information, enabled by the high-resolution of the SPT data. We compare our measurements to different parametrized profiles based on the cosmo-OWLS hydrodynamical simulations. We find that our data are consistent with the simulation that assumes an AGN heating temperature of 108.5 K but are incompatible with the model that assumes an AGN heating temperature of 108.0 K. These comparisons indicate that the data prefer a higher value of electron pressure than the simulations within r500c of the galaxies’ haloes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Observation of Skewed Electromagnetic Wakefields in an Asymmetric Structure Driven by Flat Electron Bunches

Relativistic charged -particle beams that generate intense longitudinal fields in accelerating structures also inherently couple to transverse modes. The effects of this coupling may lead to beam breakup instability and thus must be countered to preserve beam quality in applications such as linear colliders. Beams with highly asymmetric transverse sizes (flat beams) have been shown to suppress the initial instability in slab -symmetric structures. However, as the coupling to transverse modes remains, this solution serves only to delay instability. In order to understand the hazards of transverse coupling in such a case, we describe here an experiment characterizing the transverse effects on a flat beam, traversing near a planar dielectric lined structure. Further, the measurements reveal the emergence of a previously unobserved skew-quadrupolelike interaction when the beam is canted transversely, which is not present when the flat beam travels parallel to the dielectric surface. We deploy a multipole field fitting algorithm to reconstruct the projected transverse wakefields from the data. We generate the effective kick vector map using a simple two -particle theoretical model, with particle -in -cell simulations used to provide further insight for realistic particle distributions.

43 PARTICLE ACCELERATORS↗