Search NASA⌕ Search

SEARCH · Search NASA

Results for “data distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Hardening DOE R&D Software Tools for Web-based Visualization SBIR Phase I Final Report

Ubiquitous web-based visualization is essential to delivering large-scale data visualization to various stakeholders, from the scientist to the board member. These stakeholders will not tolerate a stalled application or a pop-up window asking them to wait for the processing to complete. They require a responsive and interactive visualization environment with high-quality imagery suitable for detailed analysis and boardroom presentations. At Kitware, Inc., we have accomplished web visualization to this point, leveraging state-of-the-art tools like HTML5, CSS3, SVG, Canvas, and WebGL. Solutions that leverage a combination of these technologies are necessary to handle workloads that vary significantly in data size efficiently. However, it is not always practical to move large data to the web client for visualization. Kitware's ParaView as a Service combines client-side visualization using both distributed processing and remote rendering on big data impractical to move. Existing distributed processing and remote rendering solution's interactivity is below the expectations of web-based applications. Our project examined proposed solutions to the areas outlined above in ParaView as a Service. We have investigated concurrent pipelines, streaming images, progressive rendering, and optimization of algorithms and data movement to address these concerns. For the Phase I project, we completed the proposed work plan. As a result, the project produced three prototypes of essential importance for web visualization and the ParaView as a Service community. We created a simple desktop application for an interactive streamline placement prototype, a web-based interactive streamline placement prototype, and a web-based progressive rendering utilizing raytracing prototype. These prototypes relied on the hardening of emerging software toolkits funded by the Department of Energy (DOE) Advanced Scientific Computing Research (ASCR) program (such as ParaView, VTK-m, and Mochi). We blended these components into web-based visualization prototypes that meet the industry's expectations for interactivity and responsiveness. The Phase I project had four essential focus areas: 1. Develop prototype ParaView as a Service backend server using asynchronous, non-blocking design principles. 2. Develop a prototype web application that uses the ParaView as a Service backend server for remote data visualization. 3. Implement image streaming with encoding/compression and progressive rendering capabilities in the proposed platform. 4. Evaluate the prototype developed and summarize observations, including the challenges and pitfalls of our approach. After our successful completion of Phase I, we are strongly positioned to propose a successful Phase II project.

Geveci, Berk↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Event‐Based Training in Label‐Limited Regimes

Abstract The distribution of attributes assigned using data on independent sensors for a specific source, for example, magnitude, can be richly descriptive for final event characterization and associated uncertainty. Attribute distributions can also provide powerful context for event characterization in the absence of comprehensive annotation. This work develops a way to leverage distributional information across a set of sensors in the absence of comprehensive annotation as a domain‐informed regularization term applied during gradient‐based learning. The regularization term is the basis of event‐based training which I show can be a powerful semi‐supervised learning (SSL) approach. I first use a simple feed forward neural network and a toy data set to outline how data set structure interacts with the assumptions inherent to many semi‐supervised learning approaches. I then demonstrate the effectiveness of event‐based training using a deep convolutional neural network for seismic event classification in Utah, which increases SSL accuracy from 92% to 97% on event classification with a limited number of training labels.

Linville, Lisa M.↗
DOE OSTI2023

Novel machine-learning method for spin classification of neutron resonances

The performance of nuclear reactors and other nuclear systems depends on a precise understanding of the neutron interaction cross sections for materials used in these systems. These cross sections exhibit resonant structure whose shape is determined in part by the angular-momentum quantum numbers of the resonances. The correct assignment of the quantum numbers of neutron resonances is, therefore, paramount. In this project, we apply machine learning to automate the quantum number assignments using only the resonances' energies and widths and not relying on detailed transmission or capture measurements. The classifier used for quantum number assignment is trained using stochastically generated resonance sequences whose distributions mimic those of real data. Here we explore the use of several physics-motivated features for training our classifier. These features amount to out-of-distribution tests of a given resonance's widths and resonance-pair spacings. We pay special attention to situations where either capture widths cannot be trusted for classification purposes or where there is insufficient information to classify resonances by the total spin J. We demonstrate the efficacy of our classification approach using simulated and actual 52 Cr resonance data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Dark energy survey year 3 results: likelihood-free, simulation-based w CDM inference with neural compression of weak-lensing map statistics

We present simulation-based cosmological wcold dark matter (wCDM) inference using dark energy survey year 3 weak-lensing maps, via neural data compression of weak-lensing map summary statistics: power spectra, peak counts, and direct map-level compression/inference with convolutional neural networks (CNN). Using simulation-based inference, also known as likelihood-free or implicit inference, we use forward-modelled mock data to estimate posterior probability distributions of unknown parameters. This approach allows all statistical assumptions and uncertainties to be propagated through the forward-modelled mock data; these include sky masks, non-Gaussian shape noise, shape measurement bias, source galaxy clustering, photometric redshift uncertainty, intrinsic galaxy alignments, non-Gaussian density fields, neutrinos, and non-linear summary statistics. We include a series of tests to validate our inference results. This paper also describes the Gower Street simulation suite: 791 full-sky pkdgrav3 dark matter simulations, with cosmological model parameters sampled with a mixed active-learning strategy, from which we construct over 3000 mock dark energy survey lensing data sets. For wCDM inference, for which we allow –1 < w < –$\frac{1}{3}$⁠, our most constraining result uses power spectra combined with map-level (CNN) inference. Using gravitational lensing data only, this map-level combination gives Ω m = 0.283$^{+0.020}_{–0.027}$⁠, S 8 = 0.804$^{+0.025}_{–0.017⁠}$, and w < –0.80 (with a 68 per cent credible interval); compared to the power spectrum inference, this is more than a factor of two improvement in dark energy parameter (Ω⁠ DE , w⁠) precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Hosting downscaled decision-relevant community data products in ESGF2-US

As regionally-relevant high-resolution Earth system data is increasingly relied upon across scientific, policy, and practitioner communities, there is an urgent need for coordinated and federated infrastructure to store, manage, standardize, and distribute decision-relevant community data products. Substantial effort is required to ensure that these products, which are often critical for regional impact assessments and decision-making, are findable, accessible, interoperable, and reusable. The Earth System Grid Federation US project (ESGF2-US) is addressing this challenge by expanding its open-source, distributed platform to support the hosting and dissemination of downscaled Earth system datasets. This expansion includes aligning new downscaled datasets with developing community standards for metadata and file structure, consistent with existing ESGF archives. This includes ensuring CF-compliance, applying CMORization where appropriate, and developing tools to streamline user access. In this paper, we highlight the technical and coordination work required to bring downscaled data into ESGF2-US and aim to inform the broader Earth system data user community about the growing availability and utility of these curated resources.

ESGF↗
DOE OSTI2026

Interconnection Timelines and Costs for Distributed Energy Projects in the United States (2000-2025)

These slides summarize and explain empirical data on interconnection timelines and costs for distributed energy projects connected to U.S. utility distribution systems. The study explores how interconnection metrics vary across states, project sizes, technology types, and over time to indicate progress toward simple, fast, and affordable interconnection. Data encompasses 188 utilities in 24 states. Project types include biomass/biofuels, coal, hydropower, natural gas/oil, solar, storage, wind, hybrid, and

Chelminski, Kathryn↗
DOE OSTI2025

Strangeness in the proton from $W+$ charm production and SIDIS data

We perform a global QCD analysis of unpolarized parton distribution functions (PDFs) in the proton, including new 𝑊+⁢ charm production data from 𝑝⁢𝑝 collisions at the LHC and semi-inclusive pion and kaon production data in lepton-nucleon deep-inelastic scattering, both of which have been suggested for constraining the strange quark PDF. Compared with a baseline global fit that does not include these datasets, the new analysis reduces the uncertainty on the strange quark distribution over the range 0.01 < 𝑥 < 0.3, and provides a consistent description of processes sensitive to strangeness in the proton. Including the new datasets, the ratio of strange to nonstrange sea quark distributions is $R_s = (s + \bar{s})/(\bar{u} +\bar{d})$ $=$ {$0.7⁢2^{+0.52}_{−0.34}, 0.4⁢6^{+0.30}_{−0.20}, 0.3⁢2^{+0.23}_{−0.15}$} for 𝑥 ={$0.01, 0.04, 0.1$} at 𝑄 2 $=$ 4 GeV 2 . The data place more stringent constraints on the strange asymmetry $(s - \bar{s})$, which is found to be consistent with zero in this range.

Anderson, Trey [College of William and Mary, Willi↗
DOE OSTI2021

A Privacy-Preserving Distributed Control of Optimal Power Flow

Here, we consider a distributed optimal power flow formulated as an optimization problem that maximizes a nondifferentiable concave function. Solving such a problem by the existing distributed algorithms can lead to data privacy issues because the solution information exchanged within the algorithms can be utilized by an adversary to infer the data. To preserve data privacy, in this paper we propose a differentially private projected subgradient (DP-PS) algorithm that includes a solution encryption step. We show that a sequence generated by DP-PS converges in expectation, in probability, and with probability 1. Moreover, we show that the rate of convergence in expectation is affected by a target privacy level of DP-PS chosen by the user. We conduct numerical experiments that demonstrate the convergence and data privacy preservation of DP-PS.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Tallo: A global tree allometry and crown architecture database

Abstract Data capturing multiple axes of tree size and shape, such as a tree's stem diameter, height and crown size, underpin a wide range of ecological research—from developing and testing theory on forest structure and dynamics, to estimating forest carbon stocks and their uncertainties, and integrating remote sensing imagery into forest monitoring programmes. However, these data can be surprisingly hard to come by, particularly for certain regions of the world and for specific taxonomic groups, posing a real barrier to progress in these fields. To overcome this challenge, we developed the Tallo database, a collection of 498,838 georeferenced and taxonomically standardized records of individual trees for which stem diameter, height and/or crown radius have been measured. These data were collected at 61,856 globally distributed sites, spanning all major forested and non‐forested biomes. The majority of trees in the database are identified to species (88%), and collectively Tallo includes data for 5163 species distributed across 1453 genera and 187 plant families. The database is publicly archived under a CC‐BY 4.0 licence and can be access from: https://doi.org/10.5281/zenodo.6637599 . To demonstrate its value, here we present three case studies that highlight how the Tallo database can be used to address a range of theoretical and applied questions in ecology—from testing the predictions of metabolic scaling theory, to exploring the limits of tree allometric plasticity along environmental gradients and modelling global variation in maximum attainable tree height. In doing so, we provide a key resource for field ecologists, remote sensing researchers and the modelling community working together to better understand the role that trees play in regulating the terrestrial carbon cycle.

Jucker, Tommaso↗
DOE OSTI2020

Incorporating new evaluation on angular distributions and energy spectra of neutron-induced charged particle reactions into the next ENDF library release (Technical Progress Report)

This project aims to provide the improved Evaluated Nuclear Data File (ENDF) using the newly measured data as well as the latest nuclear reaction model for calculating angular distributions and energy spectra on neutron-induced charged particle reactions through the collaboration of Korea Atomic Energy Research Institute (KAERI) and Los Alamos National Laboratory (LANL). The LANL group will provide the experimental data for angular distributions and spectra of (n,p) and (n,α) on several structural materials such as Fe, Ni and Zn isotopes using the Low Energy Neutron-induced Charged-particle (Z) Chamber (LENZ) instrument at Los Alamos Neutron Science Center (LANSCE). The KAERI group will provide the improved evaluated nuclear library which is based on the LANL experimental data, and further will predict angular distributions and spectra of (n,p) and (n,α) reactions on unmeasured nuclides, such as Cr, Mn, Co, Cu and so on. For the first year of this project, we planned to analyze (n,p) and (n,α) reactions for 54,56 Fe and perform new measurements on those reactions for 58,60 Ni isotopes with the LENZ instrument at LANSCE. For improving our evaluation quality, we have studied reaction models to reproduce LANL’s experimental angular distributions and energy spectra using the full Hauser-Feshbach model code, CoH3 with no approximations used. As the first year’s deliverables, we provided the experimental (n,p) and (n,α) reaction cross sections for 54,56 Fe and incorporate new evaluation on angular distributions and energy spectra of neutron-induced charged particle reactions into the current ENDF/B-VIII.0.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Moving small files in a networked environment

Globally distributed computing infrastructures, such as clouds and supercomputers, are currently used to manage data that is generated with an unprecedented speed from a variety of resources. Coping with this trend, the volume of data exchanged across distant sites increases substantially. To accelerate data transfer, high-speed networks are provided to connect remote sites. Most existing data movement solutions are optimized for moving large files. However, it is still challenging to transfer a large number of small files across networks. This disadvantage not only lowers data transfer performance, but also decreases overall system utilization. Here, we identify that moving small files is mainly constrained by degraded file system throughput, not just network performance as might be suspected. We have built a data transfer pipeline model to analyze the impact of small network I/O and storage I/O on data movement. Extending one of the widely used open source data movement solutions, GridFTP, we demonstrate several appropriate engineering approaches that mitigate the bottleneck and increase data transfer efficiency. We show optimizations that improve data transfer performance more than 5 times. In comparison to existing solutions, our approaches can save a significant amount of system resources for moving lots of small files.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Distributed electric field sensing using fibre optics in borehole environments

In the past decade, rapid advances in distributed optical fibre sensing technologies have made it possible to record various geophysical data (e.g. strain, temperature and pressure) continuously in both time and space along the fibre, providing an unprecedented quantity and spatial density of data compared to traditional geophysical measurements as well as reducing data acquisition cost. To date, no distributed fibre-based electromagnetic field sensing system has been implemented although electromagnetic sensing could have a broad range of applications to geophysical imaging and monitoring in borehole environments. The goal of this paper is to provide a theoretical feasibility study regarding the design and use of an electromagnetic sensing optical fibre for geophysical applications. First, we present the sensitivity analysis of a ‘hypothetical’ optical fibre coated with polyvinylidene fluoride, a polymer that provides relatively high piezoelectric properties, yet unlike ceramics, is flexible. Next, using a two-dimensional electromagnetic modelling algorithm, we simulate the earth electric-field-to-fibre-strain transfer function and estimate the theoretical sensitivity of the optical fibre to electric fields. Given the state-of-the-art distributed acoustic sensing strain sensitivities in the picometres strain range, our numerical modelling analysis suggests that a perfectly coupled polyvinylidene fluoride–coated optical fibre can measure electric field values in the mV/m to V/m amplitude range. We then apply a cylindrically symmetric modelling algorithm to simulate numerical models demonstrating the applicability of such a fibre in an oilfield environment. Scenarios investigated employ an electric field source and suggest that the measurements can be used to distinguish the oil versus water ratio with a fibre mounted inside a producing steel cased oil well as well as distinguishing between brine and hydrocarbon filled reservoir zones with a fibre located outside of the casing.

58 GEOSCIENCES↗
DOE OSTI2026

Strategies for Flood Resilience and Grid Investment Among Iowa's Electric Distribution Utilities

Flooding poses a growing threat to Iowa's electric distribution system, yet utilities face significant data and modeling challenges in planning effective resilience investments. This report provides a foundational assessment of how distribution utilities in Iowa, investor-owned, municipal, and cooperative, approach resilience planning, with a focus on flood risk. It combines hazard characterization, review of state and utility practices, and application of NLR's Energy Resilience Analysis for Distribution Systems (ERAD) and Capacity Expansion Decision Support for Distribution Networks (CADET) tools. Using FEMA floodplains, Iowa Flood Center depth grids, and utility infrastructure data, the analysis quantifies asset exposure, simulates outage risks, and evaluates resilience strategies such as pole hardening, undergrounding, and substation protection. Results indicate that while feeder-level upgrades provide incremental benefits, the most significant reductions in outage risk are achieved through targeted substation interventions. The report highlights key data gaps, such as limited elevation data and fragility functions, and underscores the need for probability-weighted investment frameworks to address both frequent and catastrophic flood events. These insights aim to support utilities, state agencies, and federal partners in prioritizing resilience investments that safeguard Iowa's electric grid against future flooding.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

A study on the statistical significance of mutual information between morphology of a galaxy and its large-scale environment

ABSTRACT A non-zero mutual information between morphology of a galaxy and its large-scale environment is known to exist in Sloan Digital Sky Survey (SDSS) upto a few tens of Mpc. It is important to test the statistical significance of these mutual information if any. We propose three different methods to test the statistical significance of these non-zero mutual information and apply them to SDSS and Millennium run simulation. We randomize the morphological information of SDSS galaxies without affecting their spatial distribution and compare the mutual information in the original and randomized data sets. We also divide the galaxy distribution into smaller subcubes and randomly shuffle them many times keeping the morphological information of galaxies intact. We compare the mutual information in the original SDSS data and its shuffled realizations for different shuffling lengths. Using a t-test, we find that a small but statistically significant (at $99.9{{\ \rm per\ cent}}$ confidence level) mutual information between morphology and environment exists upto the entire length-scale probed. We also conduct another experiment using mock data sets from a semi-analytic galaxy catalogue where we assign morphology to galaxies in a controlled manner based on the density at their locations. The experiment clearly demonstrates that mutual information can effectively capture the physical correlations between morphology and environment. Our analysis suggests that physical association between morphology and environment may extend to much larger length-scales than currently believed, and the information theoretic framework presented here can serve as a sensitive and useful probe of the assembly bias and large-scale environmental dependence of galaxy properties.

Sarkar, Suman↗
DOE OSTI2020

Constraining the destruction rate of K 40 in stellar nucleosynthesis through the study of the Ar 40 ( p , n ) K 40 reaction

Background: We present that K 40 plays a significant role in the radiogenic heating of Earth-like exoplanets, which can affect the development of a habitable environment on their surfaces. The initial amount of K 40 in the interior of these planets depends on the composition of the interstellar clouds from which they formed. Within this context, nuclear reactions that regulate the production of K 40 during stellar evolution can play a critical role. Purpose: In this study, we constrain for the first time the astrophysical reaction rate of K 40 ( n , p ) Ar 40 , which is responsible for the destruction of K 40 during stellar nucleosynthesis. We provide to the nuclear physics community high-resolution data on the cross section and angular distribution of the Ar 40 ( p , n ) K 40 reaction. These are important to various applications involving Ar 40 . The associated reaction rate of the Ar 40 ( p , n ) K 40 process addresses a reaction rate gap in the Joint Institute for Nuclear Astrophysics REACLIB database in the region of intermediate-mass isotopes. Methods: We performed differential cross-section measurements on the Ar 40 ( p , n ) K 40 reaction, for six energies in the center-of-mass system between 3.2 and 4.0 MeV and various angles between 0 ° and 135 ° . The experiment took place at the Edwards Accelerator Laboratory at Ohio University using the beam swinger target location and a standard neutron time-of-flight technique. We extracted total and partial cross sections by integrating the double differential cross sections we measured. Results: The total and partial cross sections varied with energy due to the contribution from isobaric analog states and Ericson type fluctuations. The energy-averaged neutron angular distributions were symmetrical relative to 90 ° . Based on the experimental data, local transmission coefficients were extracted and were used to calculate the astrophysical reaction rates of Ar 40 ( p , n ) K 40 and K 40 ( n , p ) Ar 40 reactions. The new rates were found to vary significantly from the theoretical rates in the REACLIB library. We implemented the new rates in network calculations to study nucleosynthesis via the slow neutron capture process, and we found that the produced abundance of K 40 is reduced by up to 10% compared to calculations with the library rates. At the same time, the above result removes a significant portion of the previous theoretical uncertainty on the K 40 yields from stellar evolution calculations. Conclusions: Our results support a destruction rate of K 40 in massive stars via the K 40 ( n , p ) Ar 40 reaction that is larger compared to previous estimates. The rate of K 40 destruction via the K 40 ( n , p ) Ar 40 reaction now has a dramatically reduced uncertainty based on our measurement. Lastly, this result directly affects the predicted stellar yields of K 40 from nucleosynthesis, which is a critical input parameter for the galactic chemical evolution models that are currently employed for the study of significant properties of exoplanets.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Identifications and classifications of human locomotion using Rayleigh-enhanced distributed fiber acoustic sensors with deep neural networks

Abstract This paper reports on the use of machine learning to delineate data harnessed by fiber-optic distributed acoustic sensors (DAS) using fiber with enhanced Rayleigh backscattering to recognize vibration events induced by human locomotion. The DAS used in this work is based on homodyne phase-sensitive optical time-domain reflectometry (φ-OTDR). The signal-to-noise ratio (SNR) of the DAS was enhanced using femtosecond laser-induced artificial Rayleigh scattering centers in single-mode fiber cores. Both supervised and unsupervised machine-learning algorithms were explored to identify people and specific events that produce acoustic signals. Using convolutional deep neural networks, the supervised machine learning scheme achieved over 76.25% accuracy in recognizing human identities. Conversely, the unsupervised machine learning scheme achieved over 77.65% accuracy in recognizing events and human identities through acoustic signals. Through integrated efforts on both sensor device innovation and machine learning data analytics, this paper shows that the DAS technique can be an effective security technology to detect and to identify highly similar acoustic events with high spatial resolution and high accuracies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗