Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A novel CMB component separation method: hierarchical generalized morphological component analysis

ABSTRACT We present a novel technique for cosmic microwave background (CMB) foreground subtraction based on the framework of blind source separation. Inspired by previous work incorporating local variation to generalized morphological component analysis (GMCA), we introduce hierarchical GMCA (HGMCA), a Bayesian hierarchical graphical model for source separation. We test our method on Nside = 256 simulated sky maps that include dust, synchrotron, free–free, and anomalous microwave emission, and show that HGMCA reduces foreground contamination by $25{{\ \rm per\ cent}}$ over GMCA in both the regions included and excluded by the Planck UT78 mask, decreases the error in the measurement of the CMB temperature power spectrum to the 0.02–0.03 per cent level at ℓ > 200 (and $\lt 0.26{{\ \rm per\ cent}}$ for all ℓ), and reduces correlation to all the foregrounds. We find equivalent or improved performance when compared to state-of-the-art internal linear combination type algorithms on these simulations, suggesting that HGMCA may be a competitive alternative to foreground separation techniques previously applied to observed CMB data. Additionally, we show that our performance does not suffer when we perturb model parameters or alter the CMB realization, which suggests that our algorithm generalizes well beyond our simplified simulations. Our results open a new avenue for constructing CMB maps through Bayesian hierarchical analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

A General Framework for Progressive Data Compression and Retrieval

In scientific simulations, observations, and experiments, the transfer of data to and from disk and across networks has become a major bottleneck for data analysis and visualization. Compression techniques have been employed to tackle this challenge, but traditional lossy methods often demand conservative error tolerances to meet the numerical accuracy requirements of both anticipated and unknown data analysis tasks. Progressive data compression and retrieval has emerged as a promising solution, where each analysis task dictates its own accuracy needs. However, few analysis algorithms inherently support progressive data processing, and adapting compression techniques, file formats, client/server frameworks, and APIs to support progressivity can be challenging. Here, this paper presents a framework that enables progressive-precision data queries for any data compressor or numerical representation. Our strategy hinges on a multi-component representation that successively reduces the error between the original and compressed field, allowing each field in the progressive sequence to be expressed as a partial sum of components. We have implemented this approach with four established scientific data compressors and assessed its effectiveness using real-world data sets from the SDRBench collection. The results show that our framework competes in accuracy with the standalone compressors it is based upon. Additionally, (de)compression time is proportional to the number of components requested by the user. Finally, our framework allows for fully lossless compression using lossy compressors when a sufficient number of components are employed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Halo-independent analysis of direct dark matter detection through electron scattering

Sub-GeV mass dark matter particles whose collisions with nuclei would not deposit sufficient energy to be detected, could instead be revealed through their interaction with electrons. Analyses of data from direct detection experiments usually require assuming a local dark matter halo velocity distribution. In the halo-independent analysis method, properties of this distribution are instead inferred from direct dark matter detection data, which allows then to compare different data without making any assumption on the uncertain local dark halo characteristics. Furthermore, this method has so far been developed for and applied to dark matter scattering off nuclei. Here we demonstrate how this analysis can be applied to scattering off electrons.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Plant metacaspase: A case study of microcrystal structure determination and analysis

Metacaspases are highly conserved in plants and play essential roles in mediating programmed cell death, biotic and abiotic stress responses, and damage-induced innate immunity. Ca 2+ signaling induced by plant damage leads to activation of metacaspase from Arabidopsis thaliana (AtMC4), which subsequently processes a plant elicitor peptide to trigger downstream immuno-response. To understand the structural basis of AtMC4 activation by Ca 2+ , we previously determined its crystal structure and performed in-crystal Ca 2+ treatment to probe activation-associated conformational changes. To enable structure determination and in-crystal Ca 2+ activation analysis, we used microcrystals and related methods which were essential for our successful approach. Here, in this paper, we describe in detail the methods that we used for determination of AtMC4 structure using single-wavelength isomorphous replacement with anomalous signals assembled from 22 microcrystals. We also describe the method for in-crystal Ca 2+ soaking, microcrystal data collection, data assembly and analysis to obtain the activated structure of AtMC4 from 91 micro-sized crystals. The described methods may be useful to study other plant metacaspases and more broadly other plant enzymes for their structure determination and in-crystal functional characterization.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback--Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety of statistically motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. Furthermore, we demonstrate the flexibility of the GCP decomposition on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Dimensionality reduction using elastic measures

With the recent surge in big data analytics for hyperdimensional data, there is a renewed interest in dimensionality reduction techniques. In order for these methods to improve performance gains and understanding of the underlying data, a proper metric needs to be identified. This step is often overlooked, and metrics are typically chosen without consideration of the underlying geometry of the data. Here, in this paper, we present a method for incorporating elastic metrics into the t-distributed stochastic neighbour embedding (t-SNE) and Uniform Manifold Approximation and Projection (UMAP). We apply our method to functional data, which is uniquely characterized by rotations, parameterization and scale. If these properties are ignored, they can lead to incorrect analysis and poor classification performance. Through our method, we demonstrate improved performance on shape identification tasks for three benchmark data sets (MPEG-7, Car data set and Plane data set of Thankoor), where we achieve 0.77, 0.95 and 1.00 F1 score, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Numerical Validation of an Algorithm for Combined Soiling and Degradation Analysis of Photovoltaic Systems

We describe and demonstrate an open-source algorithm for simultaneously quantifying degradation and soiling of photovoltaic (PV) systems from energy-production time series data. The new analysis is based on year-on-year degradation rate analysis combined with stochastic rate and recovery soiling analysis. The algorithm is designed to fit into the workflow provided by RdTools, a Python module maintained by NREL and collaboratively developed with the community, which provides a framework and functions for degradation and loss-factor analysis of PV field data. We demonstrate the method on numerically simulated PV data sets and show that it reduces the root-mean-square error of the P50 degradation rate estimate when soiling is present.

14 SOLAR ENERGY↗
DOE OSTI2024

Rapid Detection of Anomalies in Battery Energy Storage System Data

Data analytics is pivotal in assessing the technical characteristics and performance of Battery Energy Storage Systems (BESS), underpinning BESS modeling, optimization, and control. However, raw datasets frequently harbor anomalies from measurement errors and equipment malfunctions, impacting BESS reliability and analysis accuracy To address the challenge, this paper presents a novel methodology for the rapid detection of anomalous charge or discharge cycles within BESS operational data, expediting the cleaning process while ensuring data integrity. We’ve collected diverse and comprehensive real-world BESS operational datasets in collaboration with the Electric Power Research Institute and multiple Washington State utilities. These datasets serve dual roles: enabling comprehensive data exploration and analysis for understanding underlying challenges and method development, while also acting as a vital validation resource, demonstrating practical effectiveness. The proposed method detects anomalies and aids in their resolution, improving system performance characterization precision. It also reveals recurring data anomaly sources, offering insights for data collection and handling enhancement. Practitioners can gain valuable insights from the identified anomalous cycles in the real-world datasets along with the investigative process for root cause analyses and essential data cleaning steps.

Crawford, Aladsair J.↗
DOE OSTI2023

R-Matrix Analysis of the Neutron-Induced Cross Sections on 143 Nd and 147,149 Sm Measured at LANSCE [Slides]

This presentation covers how an established used of R-Matrix codes is being implemented at LANSCE. This presentation displays how there are unique features accessible with detectors at LANSCE that can be used to perform more complete R-Matrix analysis. Additionally discussed is how spin separation is a powerful technique that can be applied in DANCE measurements. Unique method to measure transmission with DICER are discussed. Finally, transmission and capture data are being analyzed in this work. The study can be extended to other channels. The ongoing analysis of the 143 Nd data is presented in this work. The same method is being applied to analyze the 147,149 Sm data. The 143 Nd and 147,149 Sm work started in FY-23 funded by NCSP.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

COVID-19 Evidence Accelerator: A parallel analysis to describe the use of Hydroxychloroquine with or without Azithromycin among hospitalized COVID-19 patients

Background: The COVID-19 pandemic remains a significant global threat. However, despite urgent need, there remains uncertainty surrounding best practices for pharmaceutical interventions to treat COVID-19. In particular, conflicting evidence has emerged surrounding the use of hydroxychloroquine and azithromycin, alone or in combination, for COVID-19. The COVID-19 Evidence Accelerator convened by the Reagan-Udall Foundation for the FDA, in collaboration with Friends of Cancer Research, assembled experts from the health systems research, regulatory science, data science, and epidemiology to participate in a large parallel analysis of different data sets to further explore the effectiveness of these treatments. Methods: Electronic health record (EHR) and claims data were extracted from seven separate databases. Parallel analyses were undertaken on data extracted from each source. Each analysis examined time to mortality in hospitalized patients treated with hydroxychloroquine, azithromycin, and the two in combination as compared to patients not treated with either drug. Cox proportional hazards models were used, and propensity score methods were undertaken to adjust for confounding. Frequencies of adverse events in each treatment group were also examined. Results: Neither hydroxychloroquine nor azithromycin, alone or in combination, were significantly associated with time to mortality among hospitalized COVID-19 patients. No treatment groups appeared to have an elevated risk of adverse events. Conclusion: Administration of hydroxychloroquine, azithromycin, and their combination appeared to have no effect on time to mortality in hospitalized COVID-19 patients. Continued research is needed to clarify best practices surrounding treatment of COVID-19.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

A multi-dimensional search for new heavy resonances decaying to boosted $\text{W}$ $\text{W}$, $\text{W}$ $\text{Z}$, or $\text{Z}$ $\text{Z}$ boson pairs in the dijet final state at 13 $\text {Te}\text{V}$

A search in an all-jet final state for new massive resonances decaying to $\text{ W }{}{}\text{ W }{}{}$, $\text{ W }{}{}\text{ Z }{}{}$, or $\text{ Z }{}{}\text{ Z }{}{}$ boson pairs using a novel analysis method is presented. The analysis is performed on data corresponding to an integrated luminosity of 77.3 $\,\text {fb}^{-1}$ recorded with the CMS experiment at the LHC at a centre-of-mass energy of 13 $\text {Te}\text {V}$. The search is focussed on potential narrow-width resonances with masses above 1.2 $\text {Te}\text {V}$, where the decay products of each $\text{ W }{}{}$ or $\text{ Z }{}{}$ boson are expected to be collimated into a single, large-radius jet. The signal is extracted using a three-dimensional maximum likelihood fit of the two jet masses and the dijet invariant mass, yielding an improvement in sensitivity of up to 30% relative to previous search methods. No excess is observed above the estimated standard model background. In a heavy vector triplet model, spin-1 ${\text {Z}}^{\prime }$ and ${\text {W}}^{\prime }$ resonances with masses below 3.5 and 3.8 $\text {Te}\text {V}$, respectively, are excluded at 95% confidence level. In a bulk graviton model, upper limits on cross sections are set between 27 and 0.2 $\,\text {fb}$ for resonance masses between 1.2 and 5.2 $\text {Te}\text {V}$, respectively. The limits presented in this paper are the best to date in the dijet final state.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

TopFusion: Using Topological Feature Space for Fusion and Imputation in Multi-Modal Data

We present a novel multi-modal data fusion technique using topological features. The method, TopFusion, leverages the flexibility of topological data analysis tools (namely persistent homology and persistence images) to map multi-modal datasets into a common feature space by forming a new multi-channel persistence image. Each channel in the image is representative of a view of the data from a modality-dependent filtration. We demonstrate that the topological perspective we take allows for more effective data reconstruction, i.e. imputation. In particular, by performing imputation in topological feature space we are able to outperform the same imputation techniques applied to raw data or alternatively derived features. We show that TopFusion representations can be used as input to downstream deep learning-based computer vision models and doing so achieves comparable performance to other fusion methods for classification on two multi-modal datasets.

Myers, Audun D.↗
DOE OSTI2021

Characterizing Signatures of Geothermal Exploration Data with Machine Learning Techniques: An Application to the Nevada Play Fairway Analysis

We are introducing machine learning methods to the play fairway analysis to generate geothermal potential maps to support the evaluation of geothermal resource potential and the exploration for undiscovered blind geothermal systems in the Nevada Great Basin region. Our project aims to identify new ways to combine the play fairway data and empirically organize relationships between feature weights and labels in an improved workflow. As a means of doing this, we introduce machine learning methods to evaluate the influence of certain geological and geophysical features/feature sets in predicting geothermal favorability. This report highlights promising approaches based on supervised and unsupervised learning methods. First, we demonstrate a filter method applied to supervised classification modeling. The supervised filter method is based on permutation analysis to evaluate every possible feature combination/drop out scenario and rank feature influence based on the performance variance of supervised classification models. Additionally, we present an unsupervised factor analysis based on principal component analysis coupled with a semi-supervised kmeans clustering algorithm. This analysis allows us to identify the optimal number of groups/clusters for training sites and structural settings to identify feature patterns including correlation, variance, and latent and dominant feature relationships. The results from these methods offer a promising avenue for identifying favorable sources of predictive information to identify the locations of blind geothermal systems and furthering our understanding of complex geothermal feature and label relationships in the Great Basin region and beyond.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Data from: Comparing traditional and Bayesian approaches to ecological meta-analysis

Despite the wide application of meta-analysis in ecology, some of the traditional methods used for meta-analysis may not perform well given the type of data characteristic of ecological meta-analyses. We reviewed published meta-analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies (ni) and the number of studies or records (k) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta-analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that ni and k were highly variable, distributions were right-skewed, and were generally small (median ni =5, median k=44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval based on the t-distribution that uses an adjusted standard error (the Hartung-Knapp-Sidik-Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z-distribution confidence intervals had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta-analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random-effects meta-analysis, the performance of the best frequentist and Bayesian methods were similar for the same combinations of factors (k and mean replication), though the Bayesian approaches had higher than nominal (>95%) coverage for the mean effect when k was very low (k<15). Our literature review suggests that many meta-analyses that used z-distribution or bootstrapping confidence intervals may have over-estimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta-analyses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

classLog: Logistic regression for the classification of genetic sequences

Introduction Sequencing and phylogenetic classification have become a common task in human and animal diagnostic laboratories. It is routine to sequence pathogens to identify genetic variations of diagnostic significance and to use these data in realtime genomic contact tracing and surveillance. Under this paradigm, unprecedented volumes of data are generated that require rapid analysis to provide meaningful inference. Methods We present a machine learning logistic regression pipeline that can assign classifications to genetic sequence data. The pipeline implements an intuitive and customizable approach to developing a trained prediction model that runs in linear time complexity, generating accurate output rapidly, even with incomplete data. Our approach was benchmarked against porcine respiratory and reproductive syndrome virus (PRRSv) and swine H1 influenza A virus (IAV) datasets. Trained classifiers were tested against sequences and simulated datasets that artificially degraded sequence quality at 0, 10, 20, 30, and 40%. Results When applied to a poor-quality sequence data, the classifier achieved between >85% to 95% accuracy for the PRRSv and the swine H1 IAV HA dataset and this increased to near perfect accuracy when using the full dataset. The model also identifies amino acid positions used to determine genetic clade identity through a feature selection ranking within the model. These positions can be mapped onto a maximum-likelihood phylogenetic tree, allowing for the inference of clade defining mutations. Discussion Our approach is implemented as a python package with code available at https://github.com/flu-crew/classLog .

Zeller, Michael A.↗
DOE OSTI2023

Machine learning in analytical spectroscopy for nuclear diagnostics [Invited]

Analytical spectroscopy methods have shown many possible uses for nuclear material diagnostics and measurements in recent studies. In particular, the application potential for various atomic spectroscopy techniques is uniquely diverse and generates interest across a wide range of nuclear science areas. Over the last decade, techniques such as laser-induced breakdown spectroscopy, Raman spectroscopy, and x-ray fluorescence spectroscopy have yielded considerable improvements in the diagnostic analysis of nuclear materials, especially with machine learning implementations. These techniques have been applied for analytical solutions to problems concerning nuclear forensics, nuclear fuel manufacturing, nuclear fuel quality control, and general diagnostic analysis of nuclear materials. The data yielded from atomic spectroscopy methods provide innovative solutions to problems surrounding the characterization of nuclear materials, particularly for compounds with complex chemistry. Implementing these optical spectroscopy techniques can provide comprehensive new insights into the chemical analysis of nuclear materials. In particular, recent advances coupling machine learning methods to the processing of atomic emission spectra have yielded novel, robust solutions for nuclear material characterization. This review paper will provide a summation of several of these recent advances and will discuss key experimental studies that have advanced the use of analytical atomic spectroscopy techniques as active tools for nuclear diagnostic measurements.

Rao, Ashwin P. (ORCID:0000000319312568)↗