Search NASA⌕ Search

SEARCH · Search NASA

Results for “data distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Earthquake Magnitude With DAS: A Transferable Data–Based Scaling Relation

Distributed Acoustic Sensing (DAS) is a promising technique to improve the rapid detection and characterization of earthquakes. Previous DAS studies mainly focus on the phase information but less on the amplitude information. In this study, we compile earthquake data from two DAS arrays in California, USA, and one submarine array in Sanriku, Japan. We develop a data-driven method to obtain the first scaling relation between DAS amplitude and earthquake magnitude. Our results reveal that the earthquake amplitudes recorded by DAS in different regions follow a similar scaling relation. The scaling relation can provide a rapid earthquake magnitude estimation and effectively avoid uncertainties caused by the conversion to ground motions. Our results show that the scaling relation appears transferable to new regions with calibrations. The scaling relation highlights the great potential of DAS in earthquake source characterization and early warning.

58 GEOSCIENCES↗
DOE OSTI2022

BASIN-3D: A brokering framework to integrate diverse environmental data

Diverse observational and simulation datasets are needed to understand and predict complex ecosystem behavior over seasonal to decadal and century time-scales. Integration of these datasets poses a major barrier towards advancing environmental science, particularly due to differences in the structure and formats of data provided by various sources. Here, we describe BASIN-3D (Broker for Assimilation, Synthesis and Integration of eNvironmental Diverse, Distributed Datasets), a data integration framework designed to dynamically retrieve and transform heterogeneous data from different sources into a common format to provide an integrated view. BASIN-3D enables users to adopt a standardized approach for data retrieval and avoid customizations for the data type or source. We demonstrate the value of BASIN-3D with two use cases that require integration of data from regional to watershed spatial scales. The first application uses the BASIN-3D Python library to integrate time-series hydrological and meteorological data to provide standardized inputs to analytical and machine learning codes in order to predict the impacts of hydrological disturbances on large river corridors of the United States. The second application uses the BASIN-3D Django framework to integrate diverse time-series data in a mountainous watershed in East River, Colorado, United States to enable scientific researchers to explore and download data through an interactive web portal. Thus, BASIN-3D can be used to support data integration for both web-based tools, as well as data analytics using Python scripting and extensions like Jupyter notebooks. The framework is expected to be transferable to and useful for many other field and modeling studies.

Varadharajan, C↗
DOE OSTI2020

Real-World Distribution System Modeling Framework for Transmission-and-Distribution Cosimulation: Preprint

This paper presents a modeling methodology for realistic distribution system simulation and analysis. The methodology involves three major approaches: utility model conversion, feeder load modeling, and feeder model validation. The feeder models obtained from the utility are converted to the format that is more flexible for analysis and algorithm development. The load profiles down to each node are modeled in detail using advanced metering infrastructure data and supervisory control and data acquisition (SCADA) system measured load data. Then the distribution system models are validated by comparing the simulated feeder-head voltage results and SCADA measured voltage data. To better understand the bulk system operations and the interactions between transmission and distribution systems, the modeled realistic distribution systems are integrated into a transmission-and-distribution cosimulation framework to perform the system simulation from the bulk system down to each node in the distribution system.

load modeling↗
DOE OSTI2025

Derivation of at-birth neutron energy distribution of americium-beryllium source based on ISO8529 spectral data

In many practical applications, the accuracy of neutron transport calculations depends on an estimate of the energy distribution provided in the source definition. While the energy distribution of neutrons emitted by spontaneous fission sources is well-defined, the spectra of neutrons produced in (α,n) reactions in compound mixtures, such as americium-beryllium (AmBe), depend on the microstructural properties of the source material, which may vary. Although the energy of neutrons produced in nuclear reactions can be calculated from first principles, such computations require detailed knowledge of the key characteristics of the source material, which are often unknown. Here, this study focuses on deriving the at-birth neutron energy distribution for an AmBe source by applying reverse transport calculations to the externally measured high-precision spectrum recommended in the latest revision of the international standard. The derived at-birth spectrum was validated through indirect energy-sensitive neutron emission rate measurements of AmBe sources calibrated at national primary metrology institutions. The resulting at-birth neutron energy distribution serves as essential input data for radiation transport modeling, providing a validated spectrum for broader experimental and computational applications.

AmBe↗
DOE OSTI2025

Search for neutron decay into an antineutrino and a neutral kaon in 0.401 megaton-years exposure of Super-Kamiokande

We searched for bound neutron decay via 𝑛 → $\bar{𝜈}$ +𝐾 0 predicted by the grand unified theories in 0.401 Mton·years exposure of all pure water phases in the Super-Kamiokande detector. About 4.4 times more data than in the previous search have been analyzed by a new method including a spectrum fit to kaon invariant mass distributions. No significant data excess has been observed in the signal regions. As a result of this analysis, we set a lower limit of 7.8 × 10 32 years on the neutron lifetime at a 90% confidence level.

Cherenkov detectors↗
DOE OSTI2025

Describing hadronization via histories and observables for Monte-Carlo event reweighting

We introduce a novel method for extracting a fragmentation model directly from experimental data without requiring an explicit parametric form, called Histories and Observables for Monte-Carlo Event Reweighting (HOMER), consisting of three steps: the training of a classifier between simulation and data, the inference of single fragmentation weights, and the calculation of the weight for the full hadronization chain. We illustrate the use of HOMER on a simplified hadronization problem, a q\bar{q} q q ‾ string fragmenting into pions, and extract a modified Lund string fragmentation function f(z) f ( z ) . We then demonstrate the use of HOMER on three types of experimental data: (i) binned distributions of high-level observables, (ii) unbinned event-by-event distributions of these observables, and (iii) full particle cloud information. After demonstrating that f(z) f ( z ) can be extracted from data (the inverse of hadronization), we also show that, at least in this limited setup, the fidelity of the extracted f(z) f ( z ) suffers only limited loss when moving from (i) to (ii) to (iii). Public code is available at https://gitlab.com/uchep/mlhad.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Data Privacy for the Grid: Toward a Data Privacy Standard for Inverter-Based and Distributed Energy Resources

The traditional approach to planning the distribution grid has focused on reliability in the context of gradual and reasonably predictable load growth. Forecasts of load growth, combined with asset management practices, were used by system planners to identify upgrades to the system to maintain or improve reliability. The decisions, typically based within load flow analysis tools, included considerations about contingency scenarios and corporate forecasts (i.e., top-down predictions at a summary level of what would happen in a particular area that could impact load growth and behavior). As a result, today, this traditional approach no longer fits all purposes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Generating realistic building electrical load profiles through the Generative Adversarial Network (GAN)

Building electrical load profiles can improve understanding of building energy efficiency, demand flexibility, and building-grid interactions. Current approaches to generating load profiles are time-consuming and not capable of reflecting the dynamic and stochastic behaviors of real buildings; some approaches also trigger data privacy concerns. In this study, we proposed a novel approach for generating realistic electrical load profiles of buildings through the Generative Adversarial Network (GAN), a machine learning technique that is capable of revealing an unknown probability distribution purely from data. The proposed approach has three main steps: (1) normalizing the daily 24-hour load profiles, (2) clustering the daily load profiles with the k-means algorithm, and (3) using GAN to generate daily load profiles for each cluster. The approach was tested with an open-source database – the Building Data Genome Project. We validated the proposed method by comparing the mean, standard deviation, and distribution of key parameters of the generated load profiles with those of the real ones. The KL divergence of the generated and real load profiles are within 0.3 for majority of parameters and clusters. Additionally, results showed the load profiles generated by GAN can capture not only the general trend but also the random variations of the actual electrical loads in buildings. We report the proposed GAN approach can be used to generate building electrical load profiles, verify other load profile generation models, detect changes to load profiles, and more importantly, anonymize smart meter data for sharing, to support research and applications of grid-interactive efficient buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Data transfer for STAR grid jobs

The Solenoidal Tracker at RHIC (STAR) is a multipurpose experiment at the Relativistic Heavy Ion Collider (RHIC) with the primary goal to study the formation and properties of the quark-gluon plasma. STAR is an international collaboration of member institutions and laboratories from around the world. Yearly data-taking period produces PBytes of raw data collected by the experiment. STAR primarily uses its dedicated facility at BNL to process this data, but has routinely leveraged distributed systems, both high throughput (HTC) and high performance (HPC) computing clusters, to significantly augment the processing capacity available to the experiment. The ability to automate the efficient transfer of large data sets on reliable, scalable, and secure infrastructure is critical for any large-scale distributed processing campaign. For more than a decade, STAR computing has relied upon GridFTP with its x509-based authentication to build such data transfer systems and integrate them into its larger production workflow. The end of support by the community for both GridFTP and the x509 standard requires STAR to investigate other approaches to meet its distributed processing needs. In this study we investigate two multi-purpose data distribution systems, Globus.org and XRootD, as alternatives to GridFTP. We compare both their performance and the ease by which each service is integrated into the type of secure and automated data transfer systems STAR has previously built using GridFTP. The presented approach and study may be applicable to other distributed data processing use cases beyond STAR.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Conditional diffusion machine-learning framework for mapping valence electron distribution from convergent beam electron diffraction

Quantitative convergent beam electron diffraction (CBED) enables determination of aspherical valence electron distributions through refinement of low-order structure factors, which are highly sensitive to chemical bonding and charge density variations. However, conventional quantitative CBED (QCBED) requires solving a highly nonlinear inverse problem with many coupled parameters, and computationally intensive dynamical diffraction calculations, making it time-consuming and difficult to apply to complex systems. More broadly, reconstructing charge density and orbital electron distribution from diffraction data has long been a central challenge in both x-ray and electron crystallography. Here, in this study, we introduce an artificial-intelligence (AI)-based framework that replaces traditional refinement with a data-driven inverse solver. Using a large synthetic CBED dataset generated by Bloch-wave simulations, we train a conditional diffusion model to directly infer crystal structural parameters and multipole density formalism parameters, and hence valence electron distributions, from CBED patterns alone. By learning from forward simulations across realistic parameter space, the model effectively solves the inverse problem. Compared with direct regression approaches, the diffusion-based framework provides posterior parameter distributions for rigorous uncertainty quantification while preserving quantitative fidelity and reducing analysis time by orders of magnitude. By eliminating the need for external single-crystal x-ray diffraction data and complex nonlinear refinement, this approach enables practical, high-throughput, and in situ quantitative CBED, enabling real-time mapping of valence electron distributions and their correlation with functional responses in quantum and energy materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Elliptically-Contoured Tensor-variate Distributions with Application to Image Learning

Statistical analysis of tensor-valued data has largely used the tensor-variate normal (TVN) distribution that may be inadequate for data arising from distributions with heavier or lighter tails. We study a general family of elliptically contoured (EC) TV distributions and derive its characterizations, moments, marginal, and conditional distributions. We describe procedures for maximum likelihood estimation from data that are (1) uncorrelated draws from an EC distribution, (2) from a scale mixture of the TVN distribution, and (3) from an underlying but unknown EC distribution, for which we extend Tyler’s robust estimator. A detailed simulation study highlights the benefits of choosing an EC distribution over the TVN for heavier-tailed data. We develop TV classification rules using discriminant analysis and EC errors and show that they better predict cats and dogs from images in the Animal Faces-HQ dataset than the TVN-based rules. A novel tensor-on-tensor regression and TV analysis of variance (TANOVA) framework under EC errors is also demonstrated to better characterize gender, age, and ethnic origin than the usual TVN-based TANOVA in the celebrated labeled faces of the wild dataset.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Explainable multi-fidelity Bayesian neural network for distribution system state estimation

Distribution System State Estimation (DSSE) is frequently constrained by limited real-time measurements, the uncertainties introduced by distributed energy resources, and the presence of bad data. To address them, this paper proposes an enhanced Multi-Fidelity Bayesian Neural Network (MFBNN) DSSE approach. A low-fidelity layer based on a Deep Neural Network (DNN) is first pre-trained on pseudo-measurement data to learn fundamental state features. Subsequently, a high-fidelity Bayesian Neural Network (BNN) layer leverages limited but high-quality real-time measurements to refine these features, thereby achieving accurate DSSE. Additionally, the deep SHapley Additive exPlanation (SHAP) is developed to quantify the influence of measurement data on DSSE through dual perspectives of global feature importance and local nodal contributions, establishing a hierarchical explainability framework for machine learning-based DSSE. Comparative studies conducted on the IEEE 13-bus system and a real-world 2135-node system from Dominion Energy demonstrate that the proposed method excels in estimation accuracy, even under situations of high noise levels, bad data, and missing data. Further comparisons with Weighted Least Squares (WLS) and other machine learning-based DSSE approaches verify that the proposed framework offers higher accuracy, improved interpretability, and enhanced robustness.

Bad data↗
DOE OSTI2026

Constellation: The autonomous control and data acquisition system for dynamic experimental setups

The operation of instruments and detectors in laboratory or beamline environments presents a complex challenge, requiring stable operation of multiple concurrent devices, often controlled by separate hardware and software solutions. These environments frequently undergo modifications, such as the inclusion of different auxiliary devices depending on the experiment or facility, adding further complexity. The successful management of such dynamic configurations demands a flexible and robust system capable of controlling data acquisition, monitoring experimental setups, enabling seamless reconfiguration, and integrating new devices with limited effort. This paper presents Constellation, a flexible and network-distributed control and data acquisition software framework tailored to laboratory and beamline environments, that addresses the limitations of existing solutions. The framework is designed with a focus on extensibility, providing a streamlined interface for instrument integration. It supports efficient system setup via network discovery mechanisms, promotes stability through autonomous operational features, and provides comprehensive documentation and supporting tools for operators and application developers such as controllers and logging interfaces. At the core of the architectural design is the autonomy of the individual components, called satellites, which can make independent decisions about their operation and communicate these decisions to other components. This paper introduces the design principles and framework architecture of Constellation, presents the available graphical user interfaces, shares insights from initial successful deployments, and provides an outlook on future developments and applications.

Autonomy↗
DOE OSTI2020

Wind Technology Data and Trends: Land-Based Focus (Update 2020) [Slides]

The purpose of this presentation is to summarize publicly available data on key trends in U.S. wind power sector. In scope, the presentation focuses on land-based wind turbines over 100 kW in size, separates DOE-funded data collection efforts on distributed and offshore wind, and focuses on historical data, with some emphasis on the previous year.

17 WIND ENERGY↗
DOE OSTI2025

Probabilistic Hazard Assessment for Tornadoes, Straight-Line Wind, and Extreme Precipitation at the Savannah River Site

Recent data sets for three meteorological phenomena with the potential to inflict damage on SRS facilities – tornadoes, straight-line winds, and heavy precipitation – are analyzed using appropriate statistical techniques to estimate the occurrence probabilities for these events in the future. Summaries of the results for DOE-mandated return periods and comparisons to similar calculations performed in 2013 by Werth et al. (W2013) are given. Using tornado statistics for i) the combined states of Georgia and South Carolina, and ii) a 2⁰ square area surrounding SRS, we calculated the probability per year of any location at SRS being struck by a tornado (the ‘strike’ probability) and the probability that any point will experience winds above set thresholds. The strike probability was calculated to be 7.04E-4 (1 chance in 1420) per year and tornadic wind speeds for DOE mandated return periods of 50,000 years (corresponding to wind design category 3 (WDC-3), and 125,000 years (meeting WDC-4) (USDOE, 2016) were estimated to be 132 mph and 147 mph, respectively. By contrast, default tornado wind speeds taken from ANSI/ANS-2.3-2011 are somewhat higher: 161 mph for return periods of 50,000 years and 173 mph every 125,000 years (ANS, 2011). Although the ANS and the SRS evaluation used the same basic model (Ramsdell and Rishel, 2007), the region defined in ANS 2.3 that encompasses the SRS also includes areas of the Great Plains and lower Midwest, regions with much higher occurrence frequencies of strong tornadoes. The SRS straight-line wind values associated with various return periods were calculated by fitting existing wind data to a GEV1 distribution and extrapolating the values for any return period from the tail of that function. For the DOE mandated return periods, we expect straight-line winds of 117 mph every 2500 years (the required WDC-3 standard) and 125 mph every 6250 years (WDC-4) at any point within the SRS. These values are similar to those from the ANS-2.3-2011 report, which has wind speeds of 125mph and 133 mph for return periods of 2500 years and 6250 years, respectively. For extreme precipitation, we compared the fits of two different theoretical extreme-value distributions and applied the one that fit the data best for each of several accumulation periods. The DOE mandated 6-hr accumulated rainfall for return periods of 10,000 years (corresponding to precipitation design category 3 (PDC-3) and 25,000 years (PDC-4) were estimated as 9.1 inches and 10.1 inches, respectively. For the 24-hr rainfall return periods of 10,000 years and 25,000 years, total rainfall estimates were 12.02 inches and 13.17 inches, respectively, higher than comparable values provided in the W2013 report.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

ModuleOT: A Hardware Security Module for Operational Technology: Preprint

With increasing penetration levels of distributed energy resources (DERs) on the distribution grid, as well as new technological advancements in the cyber space, new cyberattack vectors are being introduced, and the available attack surface is constantly increasing. Despite this increasing risk, the standard IEEE 1547-2018 does not yet recommend cybersecurity measures for DERs. To address this and to better protect data on the distribution grid - from the standpoints information security as well as operational security - ModuleOT has been developed. The module aims to significantly reduce cyberattack vectors by improving data privacy for user applications. This is accomplished by performing the core functions of encryption, authentication, authorization, certificate management, and user access control. The module integrates a custom security application with hardware cryptographic acceleration. The application secures all communications using Transmission Control Protocol over Internet Protocol (TCP/IP). These include the three most commonly used communications protocols for power systems information exchange: Modbus, Distributed Network Protocol 3 (DNP3), and Smart Energy Profile 2.0 (SEP2.0). These three protocols are also supported by IEEE 1547-2018 for all DER devices. This paper tests the data encryption/decryption feature on a physical networking test bed with emulated Modbus devices reporting grid data and presents the results.

24 POWER TRANSMISSION AND DISTRIBUTION↗