Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Nonconvex regularization for sparse neural networks

Convex ℓ 1 regularization using an infinite dictionary of neurons has been suggested for constructing neural networks with desired approximation guarantees, but can be affected by an arbitrary amount of over-parametrization. This can lead to a loss of sparsity and result in networks with too many active neurons for the given data, in particular if the number of data samples is large. As a remedy, in this paper, a nonconvex regularization method is investigated in the context of shallow ReLU networks: We prove that in contrast to the convex approach, any resulting (locally optimal) network is finite even in the presence of infinite data (i.e., if the data distribution is known and the limiting case of infinite samples is considered). Moreover, here we show that approximation guarantees and existing bounds on the network size for finite data are maintained.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Validation of non-negative matrix factorization for rapid assessment of large sets of atomic pair distribution function data

The use of the non-negative matrix factorization (NMF) technique is validated for automatically extracting physically relevant components from atomic pair distribution function (PDF) data from time-series data such as in situ experiments. The use of two matrix-factorization techniques, principal component analysis and NMF, on PDF data is compared in the context of a chemical synthesis reaction taking place in a synchrotron beam, applying the approach to synthetic data where the correct composition is known and on measured PDFs from previously published experimental data. The NMF approach yields mathematical components that are very close to the PDFs of the chemical components of the system and a time evolution of the weights that closely follows the ground truth. Lastly, it is discussed how this would appear in a streaming context if the analysis were being carried out at the beamline as the experiment progressed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Investigating the contribution of grown new particles to cloud condensation nuclei with largely varying preexisting particles – Part 1: Observational data analysis

This study employed multiple techniques to investigate the contribution of grown new particles to the number concentration of cloud condensation nuclei (CCN) at various supersaturation (SS) levels at a rural mountain site in the North China Plain from 29 June to 14 July 2019. On 8 new particle formation (NPF) days, the total particle number concentrations (N cn ) were 8.4 ± 6.1×10 3 cm -3 , which was substantially higher compared to 4.7 ± 2.6×10 3 cm -3 on non-NPF days. However, the CCN concentration (Nccn) at 0.2 % SS and 0.4 % SS on the NPF days was significantly lower than those observed on non-NPF days (p<0.05). This was due to the lower cloud activation efficiency of preexisting particles resulting from organic vapor condensation and smaller number concentrations of preexisting particles on NPF days. A case-by-case examination showed that the grown new particles only yielded a detectable contribution to N ccn at 0.4 % SS and 1.0 % SS during the NPF event on 1 July 2019, accounting for 12 % ± 11 % and 23 % ± 12 % of N ccn , respectively. The increased N ccn during two other NPF events and at 0.2 % SS on 1 July 2019 were detectable but determined mainly by varying preexisting particles rather than grown new particles. In addition, the hygroscopicity parameter values, concentrations of inorganic and organic particulate components, and surface chemical composition of different sized particles were analyzed in terms of chemical drivers to grow new particles. The results showed that the grown new particles via organic vapor condensation generally had no detectable contribution to N ccn but incidentally did. However, this conclusion was drawn from a small size of observational data, leaving more observations, particularly long-term observations and the growth of preexisting particles to the CCN required size, needed for further investigation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Time-delayed gamma-ray signatures of heavy axions from core-collapse supernovae

Heavy axions that couple to both quantum electrodynamics and quantum chromodynamics with masses on the order of MeV–GeV and high-scale decay constants in excess of ∼ 10 8 GeV may arise generically in, e.g., axiverse constructions. In this work we provide the most sensitive search to date for the existence of such heavy axions using Fermi-LAT data toward four recent supernovae (SN): Cassiopea A, SN1987A, SN2023ixf, and SN2024ggi. We account for heavy axion production in the proto-neutron-star cores through nuclear and electromagnetic processes and then the subsequent decay of the axions into photons. While previous works have searched for gamma rays from SN1987A using the Solar Maximum Mission that observed SN1987A during the SN itself, we show that using Fermi Large Area Telescope data provides an approximately 5 orders of magnitude improvement in flux sensitivity for axions with lifetimes larger than around 10 yrs. We find no evidence for heavy axions and exclude large regions of previously unexplored parameter space.

Axions↗
DOE OSTI2020

Online Event Detection in Synchrophasor Data with Graph Signal Processing

Online detection of anomalies is crucial to enhancing the reliability and resiliency of power systems. We propose a novel data-driven online event detection algorithm with synchrophasor data using graph signal processing. In addition to being extremely scalable, our proposed algorithm can accurately capture and leverage the spatio-temporal correlations of the streaming PMU data. This paper also develops a general technique to decouple spatial and temporal correlations in multiple time series. Finally, we develop a unique framework to construct a weighted adjacency matrix and graph Laplacian for product graph. Case studies with real-world, large-scale synchrophasor data demonstrate the scalability and accuracy of our proposed event detection algorithm. Compared to the state-of-the-art benchmark, the proposed method not only achieves higher detection accuracy but also yields higher computational efficiency.

Event detection↗
DOE OSTI2020

Online Event Detection in Synchrophasor Data with Graph Signal Processing

Online detection of anomalies is crucial to enhancing the reliability and resiliency of power systems. We propose a novel data-driven online event detection algorithm with synchrophasor data using graph signal processing. In addition to being extremely scalable, our proposed algorithm can accurately capture and leverage the spatio-temporal correlations of the streaming PMU data. This paper also develops a general technique to decouple spatial and temporal correlations in multiple time series. Finally, we develop a unique framework to construct a weighted adjacency matrix and graph Laplacian for product graph. Case studies with real-world, large-scale synchrophasor data demonstrate the scalability and accuracy of our proposed event detection algorithm. Compared to the state-of-the-art benchmark, the proposed method not only achieves higher detection accuracy but also yields higher computational efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Revival of the Dark Matter Hypothesis for the Galactic Center Gamma-Ray Excess

Statistical evidence has previously implied that the galactic center GeV excess (GCE) originates largely from point sources, and not from annihilating dark matter. Here, we examine the impact of unmodeled source populations on identifying the true origin of the GCE using non-Poissonian template fitting (NPTF) methods. In a proof-of-principle example with simulated data, we discover that unmodeled sources in the Fermi bubbles can lead to a dark matter signal being misattributed to point sources by the NPTF. We discover striking behavior consistent with a mismodeling effect in the real Fermi data, finding that large artificial injected dark matter signals are completely misattributed to point sources. Consequently, we conclude that dark matter may provide a dominant contribution to the GCE after all.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Autonomous Radiation Mapping and Quantification using an Unmanned Ground Vehicle. Part II - Autonomous Navigation

Nuclear sites across the Unites States and other nations in the world, are prone to extreme radiation effects. To understand the radiation hazards, plan the cleanup efforts; and to meet the quality standards and guidelines, it is important to accurately characterize any nuclear facility. One of the current methods in characterizing facilities is the use of advanced autonomous systems. These are safe, efficient, and cost-effective tools, which can safely deploy state-of-the-art instrumentation without exposing workers to radiation risks. Conventional methods of taking radiation measurements by hand within or around the containment areas, and analyzing the collected data to obtain the result are: Ineffective, Puts scientists at risk of Radiation, Not cost-effective. The platform uses the Robotic Operating Systems (ROS) to integrate multiple sensors seamlessly. It can operate near real time by using a distributed processing system to handle large amounts of data: Surrounding cameras, A multi-channel 3D Lidar, Manipulator arm, High-performance gamma-ray spectrometer.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Integration of Computational Docking into Anti-Cancer Drug Response Prediction Models

Cancer is a heterogeneous disease in that tumors of the same histology type can respond differently to a treatment. Anti-cancer drug response prediction is of paramount importance for both drug development and patient treatment design. Although various computational methods and data have been used to develop drug response prediction models, it remains a challenging problem due to the complexities of cancer mechanisms and cancer-drug interactions. To better characterize the interaction between cancer and drugs, we investigate the feasibility of integrating computationally derived features of molecular mechanisms of action into prediction models. Specifically, we add docking scores of drug molecules and target proteins in combination with cancer gene expressions and molecular drug descriptors for building response models. The results demonstrate a marginal improvement in drug response prediction performance when adding docking scores as additional features, through tests on large drug screening data. We discuss the limitations of the current approach and provide the research community with a baseline dataset of the large-scale computational docking for anti-cancer drugs.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

ENDFtk: A robust tool for reading and writing ENDF-formatted nuclear data

ENDFtk is a recently developed C++ and Python interface to interact with ENDF-6 formatted nuclear data files. It provides a robust and complete interface, allowing the reading and writing of all formats currently part of the ENDF-6 formats manual, as well as some non-ENDF formats used by the NJOY processing code. It provides an interface that mimics the names in the ENDF-6 formats manual as well as an equivalent interface using human-readable attribute names. It is robust and powerful enogh for nuclear data experts to develop complex applications, while also simple enough to be used non-experts to retrieve and manipulate evaluated nuclear data. ENDFtk offers the ability to easily interrogate and manipulate data either in large-scale code projects or in simple Python scripts. Here, in this paper, a brief overview of the interface is given, as well as more substantial examples demonstrating plotting simple data, interacting with more complex data, and writing new data to files. ENDFtk is open source and available for download via GitHub (https://github.com/njoy/ENDFtk).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Cosmological constraints from higher redshift gamma-ray burst, H ii starburst galaxy, and quasar (and other) data

ABSTRACT We use higher redshift gamma-ray burst (GRB), H ii starburst galaxy (H iiG), and quasar angular size (QSO-AS) measurements to constrain six spatially flat and non-flat cosmological models. These three sets of cosmological constraints are mutually consistent. Cosmological constraints from a joint analysis of these data sets are largely consistent with currently accelerating cosmological expansion and with cosmological constraints derived from a combined analysis of Hubble parameter (H(z)) and baryon acoustic oscillation (BAO, with Planck-determined baryonic matter density) measurements. A joint analysis of the H(z) + BAO + QSO-AS + H iiG + GRB data provides fairly model-independent determinations of the non-relativistic matter density parameter $\Omega _{\rm m_0}=0.313\pm 0.013$ and the Hubble constant $H_0=69.3\pm 1.2\, \rm {km \, s^{-1} \, Mpc^{-1}}$. These data are consistent with the dark energy being a cosmological constant and with spatial hypersurfaces being flat, but they do not rule out mild dark energy dynamics or a little spatial curvature. We also investigate the effect of including quasar flux measurements in the mix and find no novel conclusions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

High-throughput, dynamic, multi-dimensional: an expanding repertoire of plant respiration measurements

A recent burst of technological innovation and adaptation has greatly improved our ability to capture respiration rate data from plant sources. At the tissue level, several independent respiration measurement options are now available, each with distinct advantages and suitability, including high-throughput sampling capacity. These advancements facilitate the inclusion of respiration rate data into large-scale biological studies such as genetic screens, ecological surveys, crop breeding trials, and multi-omics molecular studies. As a result, our understanding of the correlations of respiration with other biological and biochemical measurements is rapidly increasing. Difficult questions persist concerning the interpretation and utilization of respiration data; concepts such as allocation of respiration to growth versus maintenance, the unnecessary or inefficient use of carbon and energy by respiration, and predictions of future respiration rates in response to environmental change are all insufficiently grounded in empirical data. However, we emphasize that new experimental designs involving novel combinations of respiration rate data with other measurements will flesh-out our current theories of respiration. Furthermore, dynamic recordings of respiration rate, which have long been used at the scale of mitochondria, are increasingly being used at larger scales of size and time to reflect processes of cellular signal transduction and physiological response to the environment. Herein, we also highlight how respiratory methods are being better adapted to different plant tissues including roots and seeds, which have been somewhat neglected historically.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Traveler: Navigating Task Parallel Traces for Performance Analysis

Understanding the behavior of software in execution is a key step in identifying and fixing performance issues. This is especially important in high performance computing contexts where even minor performance tweaks can translate into large savings in terms of computational resource use. To aid performance analysis, developers may collect an execution trace —a chronological log of program activity during execution. As traces represent the full history, developers can discover a wide array of possibly previously unknown performance issues, making them an important artifact for exploratory performance analysis. However, interactive trace visualization is difficult due to issues of data size and complexity of meaning. Traces represent nanosecond-level events across many parallel processes, meaning the collected data is often large and difficult to explore. The rise of asynchronous task parallel programming paradigms complicates the relation between events and their probable cause. Here, to address these challenges, we conduct a continuing design study in collaboration with high performance computing researchers. We develop diverse and hierarchical ways to navigate and represent execution trace data in support of their trace analysis tasks. Through an iterative design process, we developed Traveler , an integrated visualization platform for task parallel traces. Traveler provides multiple linked interfaces to help navigate trace data from multiple contexts. We evaluate the utility of Traveler through feedback from users and a case study, finding that integrating multiple modes of navigation in our design supported performance analysis tasks and led to the discovery of previously unknown behavior in a distributed array library.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Recent advances and applications of deep learning methods in materials science

Deep learning (DL) is one of the fastest-growing topics in materials data science, with rapidly emerging applications spanning atomistic, image-based, spectral, and textual data modalities. DL allows analysis of unstructured data and automated identification of features. The recent development of large materials databases has fueled the application of DL methods in atomistic prediction in particular. In contrast, advances in image and spectral data have largely leveraged synthetic data enabled by high-quality forward models as well as by generative unsupervised DL methods. In this article, we present a high-level overview of deep learning methods followed by a detailed discussion of recent developments of deep learning in atomistic simulation, materials imaging, spectral analysis, and natural language processing. For each modality we discuss applications involving both theoretical and experimental data, typical modeling approaches with their strengths and limitations, and relevant publicly available software and datasets. We conclude the review with a discussion of recent cross-cutting work related to uncertainty quantification in this field and a brief perspective on limitations, challenges, and potential growth areas for DL methods in materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Large-scale Cosmic-ray Anisotropies with 19 yr of Data from the Pierre Auger Observatory

Results are presented for the measurement of large-scale anisotropies in the arrival directions of ultra–high-energy cosmic rays detected at the Pierre Auger Observatory during 19 yr of operation, prior to AugerPrime, the upgrade of the observatory. The 3D dipole amplitude and direction are reconstructed above 4 EeV in four energy bins. Besides the established dipolar anisotropy in R.A. above 8 EeV, the Fourier amplitude of the 8–16 EeV energy bin is now also above the 5σ discovery level. No time variation of the dipole moment above 8 EeV is found, setting an upper limit to the rate of change of such variations of 0.3% yr$^{−1}$ at the 95% confidence level. Additionally, the results for the angular power spectrum are shown, demonstrating no other statistically significant multipoles. The results for the equatorial dipole component down to 0.03 EeV are presented, using for the first time a data set obtained with a trigger that has been optimized for lower energies. Finally, model predictions are discussed and compared with observations, based on two source emission scenarios obtained in the combined fit of spectrum and composition above 0.6 EeV.

79 ASTRONOMY AND ASTROPHYSICS↗