Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Constraints on redshifts of blazars from extragalactic background light attenuation using Fermi - LAT data

ABSTRACT The extragalactic high-energy γ-ray sky is dominated by blazars, which are active galactic nuclei with their jets pointing towards us. Distance measurements are of fundamental importance yet for some of these sources are challenging because any spectral signature from the host galaxy may be outshone by the non-thermal emission from the jet. In this paper, we present a method to constrain redshifts for these sources that relies only on data from the Large Area Telescope on board the Fermi Gamma-ray Space Telescope. This method takes advantage of the signatures that the pair-production interaction between photons with energies larger than approximately 10 GeV and the extragalactic background light leaves on γ-ray spectra. We find upper limits for the distances of 303 γ-ray blazars, classified as 157 BL Lacertae objects, 145 of uncertain class, and 1 flat-spectrum-radio quasar, whose redshifts are otherwise unknown. These derivations can be useful for planning observations with imaging atmospheric Cherenkov telescopes and also for testing theories of supermassive black hole evolution. Our results are applied to estimate the detectability of these blazars with the future Cherenkov Telescope Array, finding that at least 21 of them could be studied in a reasonable exposure of 20 h.

Astronomy & Astrophysics↗
DOE OSTI2023

Weakly supervised anomaly detection in the Milky Way

ABSTRACT Large-scale astrophysics data sets present an opportunity for new machine learning techniques to identify regions of interest that might otherwise be overlooked by traditional searches. To this end, we demonstrate how Classification Without Labels (CWoLa), a weakly supervised anomaly detection method, can help identify cold stellar streams within the more than one billion Milky Way stars observed by the Gaia satellite. CWoLa operates without the use of labelled streams or knowledge of astrophysical principles. Instead, it uses a classifier to distinguish between mixed samples for which the proportions of signal and background samples are unknown. As a proof of concept, we demonstrate that this computationally lightweight strategy is able to detect both simulated streams and the known stream GD-1 in data. Originally designed for high-energy collider physics, this technique may have broad applicability within astrophysics as well as other domains interested in identifying localized anomalies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Atmospheric parameters and chemical abundances within 100 pc: a sample of G, K, and M main-sequence stars

ABSTRACT To date, we have access to enormous inventories of stellar spectra that allow the extraction of atmospheric parameters and chemical abundances essential in stellar studies. However, characterizing such a large amount of data is complex and requires a good understanding of the studied object to ensure reliable and homogeneous results. In this study, we present a methodology to measure homogenously the basic atmospheric parameters and detailed chemical abundances of over 1600 thin disc main-sequence stars in the 100 pc solar neighbourhood, using APOGEE-2 infrared spectra. We employed the code tonalli to determine the atmospheric parameters using a prior on $\log {g}$. The $\log {g}$ prior in tonalli implies an understanding of the treated population and helps to find physically coherent answers. Our atmospheric parameters agree within the typical uncertainties (100 K in $\mathrm{T_{eff}}$, 0.15 dex in $\log {g}$ and [M/H]) with previous estimations of ASPCAP and Gaia DR3. We use our temperatures to determine a new infrared colour–temperature sequence, in good agreement with previous works, that can be used for any main-sequence star. Additionally, we used the bacchus code to determine the abundances of Mg, Al, Si, Ca, and Fe in our sample. The five elements (Mg, Al, Si, Ca, Fe) studied have an abundance distribution centred around slightly subsolar values in agreement with previous results for the solar neighbourhood. The over 1600 main-sequence stars’ atmospheric parameters and chemical abundances presented here are useful in follow-up studies of the solar neighbourhood or as a training set for data-driven methods.

López-Valdivia, Ricardo (ORCID:0000000277950018)↗
DOE OSTI2025

Magnetic polaron formation in EuZn2P2

Colossal magnetoresistance (CMR) has been observed across many Eu2+-based materials; however, its origin is not completely understood. Here we investigate the antiferromagnetic insulator EuZn2⁢P2 through single crystal x-ray diffraction, transmission electron microscopy, electrical transport, magnetization, dilatometry, and electron spin resonance measurements complemented by density functional theory calculations. Our electrical resistivity data reveal a large negative magnetoresistance, MR=[𝑅⁡(𝐻)−𝑅⁡(0)]/𝑅⁡(0), that reaches MR=−99.7% at 9 T near the antiferromagnetic ordering temperature 𝑇𝑁=23K. Dilatometry measurements show an accompanying field-induced lattice strain. Additionally, Eu2+ electron spin resonance reveals a strong ferromagnetic exchange interaction between Eu2+ and conduction electrons. Our experimental results in EuZn2⁢P2 are consistent with a magnetic polaron scenario and suggest magnetic polaron formation as a prevailing explanation of CMR in Eu2+-based compounds.

Cook, Matt [ORNL] (ORCID:0000000288777505)↗
DOE OSTI2021

Investigation of secondary γ -ray angular distributions using the N 15 ( p , α 1 γ ) C * 12 reaction

The observation of secondary γ-rays provides an alternative method of measuring cross sections that populate excited final states in nuclear reactions. The angular distributions of these γ-rays also provide information on the underlying reaction mechanism. Despite a large amount of data of this type in the literature, publicly available R-matrix codes do not have the ability to calculate these types of angular distributions. In this report, the mathematical formalism derived in Brune and deBoer is implemented in the R-matrix code AZURE2 and calculations are compared with previous data from the literature for the 15 N( p, α1γ ) 12 C* reaction. In addition, new measurements, made at the University of Notre Dame Nuclear Science Laboratory using the Hybrid Array of Gamma Ray Detectors (HAGRiD), are reported that span an energy range from E p = 0.88 to 4.0 MeV. Excellent agreement between data and the phenomenological fit is obtained up to the limit of the previous fit at E p = 2.0 MeV and the R-matrix fit is extended from E x ≈ 13.5 up to E x ≈ 15.3 MeV, where 15 N+p and 12 C+α reactions are fit simultaneously for the first time. An excellent reproduction of the 15 N( p, α1γ ) 12 C* and 12 C(α, α) 12 C data is achieved, but inconsistencies and difficulty in fitting other data is encountered and discussed.

6 ≤ A ≤ 19↗
DOE OSTI2022

Machine learning approach to pattern recognition in nuclear dynamics from the ab initio symmetry-adapted no-core shell model

A novel machine learning approach is used to provide further insight into atomic nuclei and to detect orderly patterns amid a vast data of large-scale calculations. The method utilizes a neural network that is trained on ab initio results from the symmetry-adapted no-core shell model (SA-NCSM) for light nuclei. We show that the SA-NCSM, which expands ab initio applications up to medium-mass nuclei by using dominant symmetries of nuclear dynamics, can reach heavier nuclei when coupled with the machine learning approach. In particular, we find that a neural network trained on probability amplitudes for s- and p-shell nuclear wave functions not only predicts dominant configurations for heavier nuclei but in addition, when tested for the 20 Ne ground state, accurately reproduces the probability distribution. The non-negligible configurations predicted by the network provide an important input to the SA-NCSM for reducing ultralarge model spaces to manageable sizes that can be, in turn, utilized in SA-NCSM calculations to obtain accurate observables. The neural network is capable of describing nuclear deformation and is used to track the shape evolution along the 20-42 Mg isotopic chain, suggesting a shape coexistence that is more pronounced toward the very neutron-rich isotopes. We provide first descriptions of the structure and deformation of 24 Si and 40 Mg of interest to x-ray burst nucleosynthesis, and even of the extremely heavy nuclei such as 166,168 Er and 236 U, that build on first-principles considerations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Exploiting dissipative reactions to perform in-beam γ-ray spectroscopy of the neutron-deficient isotopes 38,39 Ca

The neutron-deficient Ca isotopes continue to attract attention due to their importance for testing isospin symmetry and their relevance in capture reactions of interest for nova nucleosynthesis and the shape of light curves in Type I x-ray bursts. To date, spectroscopic information on 38,39 Ca is largely limited to data on lower-spin excited states. Here, we report in-beam γ-ray spectroscopy of complementary higher-spin, complex-structure states in 39 Ca populated in fast-beam-induced, momentum-dissipative processes leading to neutron pickup onto excited configurations of the projectile, 9 Be( 38 Ca*, 39 Ca + γ)X. Such a dissipative reaction was recently characterized for the case of inelastic scattering of 38 Ca off 9 Be, 9 Be( 38 Ca, 38 Ca + γ)X. Additional data and discussion on the nuclear structure of 38 Ca is also presented. Furthermore, an explanation for the more-complex-structure states, populated with small cross sections in one-nucleon knockout reactions, and observed in the tails of their longitudinal momentum distributions, is also offered.

20 ≤ A ≤ 38↗
DOE OSTI2022

Marginal unbiased score expansion and application to CMB lensing

Here, we present the marginal unbiased score expansion (MUSE) method, an algorithm for generic high-dimensional hierarchical Bayesian inference. MUSE performs approximate marginalization over arbitrary non-Gaussian latent parameter spaces, yielding Gaussianized asymptotically unbiased and near-optimal constraints on global parameters of interest. It is computationally much cheaper than exact alternatives like Hamiltonian Monte Carlo (HMC), excelling on funnel problems which challenge HMC, and does not require any problem-specific user supervision like other approximate methods such as variational inference or many simulation-based inference methods. MUSE makes possible the first joint Bayesian estimation of the delensed Cosmic Microwave Background (CMB) power spectrum and gravitational lensing potential power spectrum, demonstrated here on a simulated data set as large as the upcoming South Pole Telescope 3G 1500 deg 2 survey, corresponding to a latent dimensionality of ~6 million and of order 100 global bandpower parameters. On a subset of the problem where an exact but more expensive HMC solution is feasible, we verify that MUSE yields nearly optimal results. We also demonstrate that existing spectrum-based forecasting tools which ignore pixel-masking underestimate predicted error bars by only ~10%. This method is a promising path forward for fast lensing and delensing analyses which will be necessary for future CMB experiments such as SPT-3G, Simons Observatory, or CMB-S4, and can complement or supersede existing HMC approaches. The success of MUSE on this challenging problem strengthens its case as a generic procedure for a broad class of high-dimensional inference problems.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Promise of Future Searches for Cosmic Topology

The shortest distance around the Universe through us is unlikely to be much larger than the horizon diameter if microwave background anomalies are due to cosmic topology. We show that observational constraints from the lack of matched temperature circles in the microwave background leave many possibilities for such topologies. We evaluate the detectability of microwave background multipole correlations for sample cases. Searches for topology signatures in observational data over the large space of possible topologies pose a formidable computational challenge. Published by the American Physical Society 2024

Physics↗
DOE OSTI2021

Upscaling X-ray nanoimaging to macroscopic specimens

Upscaling X-ray nanoimaging to macroscopic specimens has the potential for providing insights across multiple length scales, but its feasibility has long been an open question. By combining the imaging requirements and existing proof-of-principle examples in large-specimen preparation, data acquisition and reconstruction algorithms, the authors provide imaging time estimates for howX-ray nanoimaging can be scaled to macroscopic specimens. To arrive at this estimate, a phase contrast imaging model that includes plural scattering effects is used to calculate the required exposure and corresponding radiation dose. The coherent X-ray flux anticipated from upcoming diffraction-limited light sources is then considered. This imaging time estimation is in particular applied to the case of the connectomes of whole mouse brains. To image the connectome of the whole mouse brain, electron microscopy connectomics might require years, whereas optimized X-ray microscopy connectomics could reduce this to one week. Furthermore, this analysis points to challenges that need to be overcome (such as increased X-ray detector frame rate) and opportunities that advances in artificial-intelligence-based `smart' scanning might provide. While the technical advances required are daunting, it is shown that X-ray microscopy is indeed potentially applicable to nanoimaging of millimetre- or even centimetre-size specimens.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

PyXAS – an open-source package for 2D X-ray near-edge spectroscopy analysis

In the synchrotron X-ray community, X-ray absorption near-edge spectroscopy (XANES) is a widely used technique to probe the local coordination environment and the oxidation states of specific elements within a sample. Although this technique is usually applied to bulk samples, the advent of new synchrotron sources has enabled spatially resolved versions of this technique (2D XANES). This development has been extremely powerful for the study of heterogeneous systems, which is the case for nearly all real applications. However, associated with the development of 2D XANES comes the challenge of analyzing very large volumes of data. As an example, a single 2D XANES measurement at a synchrotron can easily produce ~106 spatially resolved XANES spectra. Conventional manual analysis of an individual XANES spectrum is no longer feasible. Here, a software package is described that has been developed for high-throughput 2D XANES analysis. A detailed description of the software as well as example applications are provided.

25 ENERGY STORAGE↗
DOE OSTI2024

A Hybrid Anomaly Detection Approach for Obfuscated Malware

With the rapid evolution of malicious software, cyber threats have become increasingly sophisticated, employing advanced obfuscation techniques to evade traditional detection methods. This study presents a hybrid anomaly detection approach applied to obfuscated malware. Even though there is a large body of research in this field, existing malware detection techniques have some drawbacks, such as requiring large amounts of data, trustworthiness (imprecise results) of algorithms, and advanced obfuscation. To overcome these challenges, there is a need to employ solid and efficient techniques for malware detection. This paper proposes a hybrid approach, combining an autoencoder with traditional machine-learning methods to create an efficient malware detection framework. We used the malware memory dataset (MalMemAnalysis-2022) to evaluate this framework. The results indicate that our proposed approach can detect obfuscated malware when a deep autoencoder used for feature learning is combined with logistic regression, and it is extremely fast with an Accuracy, Detection Rate (DR), Matthew Correlation Coefficient(MCC), and Statistical Parity Difference

malware detection, Hybrid Anomly Detection, Obfusc↗
DOE OSTI2021

Mitigating Catastrophic Forgetting in Deep Learning in a Streaming Setting Using Historical Summary

Recent advancements in scientific equipment and the adaptation of electronics and the Internet of Things (IoT) in our everyday lives resulted in large and complex data production at a high rate. Making meaningful and timely knowledge discovery at a modest cost from this big data is difficult for computing power and storage limitations. Training deep learning models incrementally in a streaming setting can help us with overcoming these limitations. However, in a well-known phenomenon named catastrophic forgetting, incrementally trained models increasingly perform poorly on the past data. To mitigate catastrophic forgetting in training in a streaming setting, we propose constructing a historical summary over time and use the summary with newly arrived data during incremental training. We propose various data summarization techniques such as random sampling, micro clustering, coreset computation, and Auto Encoders to counteract catastrophic forgetting. We built a pipeline for incremental training with a historical summary for training deep learning models for streaming data. We demonstrate the effectiveness of historical summary in mitigating catastrophic forgetting using three case studies involving three different deep learning applications: an Artificial Neural Network (ANN) for classification task on MNIST dataset, a language model (RNN-LM) on the WikiText2 dataset, and a Convolutional Neural Network (CNN), ResNet50 to classify the ImageNet dataset. Through the training of the models, we observe that catastrophic forgetting is evident in ANN and CNN but not in an RNN. For the first task, our method recovers up to 47.9% lost accuracy due to catastrophic forgetting. For the third task, the historical summary recovers classification accuracy by up to 25%. For the second task, though there is not proof of catastrophic forgetting, the training performance (PPL) improves by up to 26% with historical summary.

Dash, Sajal↗
DOE OSTI2023

Accelerating Scientific Simulations with Bi-Fidelity Weighted Transfer Learning

High-fidelity modeling is an essential design tool for many engineering applications. However, for complex systems, computational cost can be a limiting factor. Analyzing parameter sensitivity, uncertainty quantification, and design optimization require many model evaluations. Surrogate models are often used to develop the relationship between model parameters and quantities of interest. However, in the case of complex systems, surrogate models require several degrees of freedom and, thus, a large number of data points to determine the correct dependencies. For many applications, this may be prohibitively expensive. The reduction of computational requirements can be achieved by leveraging low-fidelity models. Low-fidelity models represent the system at a coarser resolution with the advantage of computational efficiency. Therefore, a bi-fidelity modeling paradigm, which augments the accuracy of a low-fidelity model in a computationally efficient manner by invoking limited runs of a high-fidelity model, can be leveraged to sufficiently balance the accuracy and computational requirements. In this work, a bi-fidelity weighted transfer learning method using neural networks was applied to a computational fluid dynamics heat transfer modeling problem. The transfer learning advantage was investigated as a function of hyperparameters. Our main finding is that the use of a bi-fidelity modeling paradigm achieves accuracy close to that of a high-fidelity Gaussian process model while significantly reducing computational cost. The bi-fidelity model achieves comparable performance with 90 high-fidelity samples-that is, 60% less than the samples needed to achieve similar accuracy without the use of bi-fidelity modeling,

Borowiec, Katarzyna↗
DOE OSTI2024

A Novel Framework to Quantify Power Grid Resilience

The quantification of an operating power grid’s resilience is highly significant today, given its criticality as an enabler of other infrastructures, complexity, and the threat it faces due to a wide range of detrimental events, from extreme climate to cyber attacks. Currently, there exist no standardized definitions and metrics for measuring the resilience of an operating grid. In this paper, we introduce a novel resilience quantification framework and demonstrate a method to measure the flexibility towards topological/structural changes due to potential failures in the power grid to assess operational resilience. We start with the state estimation data from a large utility and use the graph analysis methods and power flow simulation tools to compute the identified resilience parameters.

Yoginath, Srikanth↗
DOE OSTI2020

Recursive Dynamic Compressive Sensing in Smart Distribution Systems

With a transition to a smarter grid, we are witnessing a significant growth in smart metering infrastructure and sensor deployment in the distribution system. The underlying communication infrastructure is stressed due to the large volume of data that is generated by the smart meters/sensors. Furthermore, real time operations such as state estimation and control are impaired due to the lack of reliable aggregation of the data. In this paper, we exploit the underlying sparsity in grid data to implement two recursive dynamic compressive sensing (CS) approaches-streaming modified weighted-`1 CS and Kalman filtered CS. These approaches aim to reconstruct the sparse signal using the current underdetermined measurements and the prior information about the sparse signal and its support set. Slow signal and support change is in distribution grid data is validated using Pecan Street data. Both the IEEE 34 node test feeder system and PecanStreet data are considered as two examples to validate the superior performance of the two recursive CS techniques relative to classic CS.

Karimi, Hazhar Sufi↗
DOE OSTI2023

Measurement and applications: Exploring the challenges and opportunities of hierarchical federated learning in sensor applications

Sensor applications have become ubiquitous in modern society as the digital age continues to advance. AI-based techniques (e.g., machine learning) are effective at extracting actionable information from large amounts of data. An example would be an automated water irrigation system that uses AI-based techniques on soil quality data to decide how to best distribute water. However, these AI-based techniques are costly in terms of hardware resources, and Internet-of-Things (IoT) sensors are resource-constrained with respect to processing power, energy, and storage capacity. These limitations can compromise the security, performance, and reliability of sensor-driven applications. To address these concerns, cloud computing services can be used by sensor applications for data storage and processing. Unfortunately, cloud-based sensor applications that require real-time processing, such as medical applications (e.g., fall detection and stroke prediction), are vulnerable to issues such as network latency due to the sparse and unreliable networks between the sensor nodes and the cloud server [1]. As users approach the edge of the communications network, latency issues become more severe and frequent. A promising alternative is edge computing, which provides cloud-like capabilities at the edge of the network by pushing storage and processing capabilities from centralized nodes to edge devices that are closer to where the data are gathered, resulting in reduced network delays [2], [3].

Po-Leen Ooi, Melanie↗
DOE OSTI2022

Investigation of Timing Properties for an Event Driven with Access and Reset Decoder Readout Architecture for a Pixel Array

The large number of data generating sources (data channels) on a single chip requires appropriate techniques to manage a readout from these channels. One of the main methods is sharing a medium of transmission, which requires arbitration to avoid collisions or deadlocks. Existing solutions face several problems such as a dead time, unintended prioritization or metastability. That is why we decided to create a new readout architecture named EDWARD i.e., Event Driven with Access and Reset Decoder. The EDWARD architecture gets rid of the earlier mentioned problems and mitigates the other ones. However, due to the use of logic circuits outside a standard cell library, which are hard to characterize, we were challenged to perform an additional transient analysis to validate the architecture. Here we show a methodology and the results of the simulations. Based on the results obtained we can confirm the functional correctness of the system and plan the optimization of operating conditions in order to achieve better performance. Our goal is to use the EDWARD architecture in the future radiation detectors to be built at Brookhaven National Laboratory.

47 OTHER INSTRUMENTATION↗