Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A General Framework for Progressive Data Compression and Retrieval

In scientific simulations, observations, and experiments, the transfer of data to and from disk and across networks has become a major bottleneck for data analysis and visualization. Compression techniques have been employed to tackle this challenge, but traditional lossy methods often demand conservative error tolerances to meet the numerical accuracy requirements of both anticipated and unknown data analysis tasks. Progressive data compression and retrieval has emerged as a promising solution, where each analysis task dictates its own accuracy needs. However, few analysis algorithms inherently support progressive data processing, and adapting compression techniques, file formats, client/server frameworks, and APIs to support progressivity can be challenging. Here, this paper presents a framework that enables progressive-precision data queries for any data compressor or numerical representation. Our strategy hinges on a multi-component representation that successively reduces the error between the original and compressed field, allowing each field in the progressive sequence to be expressed as a partial sum of components. We have implemented this approach with four established scientific data compressors and assessed its effectiveness using real-world data sets from the SDRBench collection. The results show that our framework competes in accuracy with the standalone compressors it is based upon. Additionally, (de)compression time is proportional to the number of components requested by the user. Finally, our framework allows for fully lossless compression using lossy compressors when a sufficient number of components are employed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Automated defect analysis in electron microscopic images

Electron microscopy and defect analysis are a cornerstone of materials science, as they offer detailed insights on the microstructure and performance of a wide range of materials and material systems. Building a robust and flexible platform for automated defect recognition and classification in electron microscopy will result in the completion of analysis orders of magnitude faster after images are recorded, or even online during image acquisition. Automated analysis has the potential to be significantly more efficient, accurate, and repeatable than human analysis, and it can scale with the increasingly important methods of automated data generation. Herein, an automated recognition tool is developed based on a computer vison–based approach; it sequentially applies a cascade object detector, convolutional neural network, and local image analysis methods. We demonstrate that the automated tool performs as well as or better than manual human detection in terms of recall and precision and achieves quantitative image/defect analysis metrics close to the human average. The proposed approach works for images of varying contrast, brightness, and magnification. Furthermore, these promising results suggest that this and similar approaches are worth exploring for detecting multiple defect types and have the potential to locate, classify, and measure quantitative features for a range of defect types, materials, and electron microscopic techniques.

47 OTHER INSTRUMENTATION↗
DOE OSTI2015

A Measurement of Gravitational Lensing of the Cosmic Microwave Background by Galaxy Clusters Using Data from the South Pole Telescope

Clusters of galaxies are expected to gravitationally lens the cosmic microwave background (CMB) and thereby generate a distinct signal in the CMB on arcminute scales. Measurements of this effect can be used to constrain the masses of galaxy clusters with CMB data alone. Here we present a measurement of lensing of the CMB by galaxy clusters using data from the South Pole Telescope (SPT). We also develop a maximum likelihood approach to extract the CMB cluster lensing signal and validate the method on mock data. We quantify the effects on our analysis of several potential sources of systematic error and find that they generally act to reduce the best-fit cluster mass. It is estimated that this bias to lower cluster mass is roughly 0.85σ in units of the statistical error bar, although this estimate should be viewed as an upper limit. Furthermore, we apply our maximum likelihood technique to 513 clusters selected via their Sunyaev–Zeldovich (SZ) signatures in SPT data, and rule out the null hypothesis of no lensing at 3.1σ. The lensing-derived mass estimate for the full cluster sample is consistent with that inferred from the SZ flux: M 200,lens = 0.83 +0.38 -0.37 M 200,SZ (68% C.L., statistical error only).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

BASTet (Berkeley Analysis and Storage Toolkit)

BASTet is an advanced software library written in Python. BASTet serves as the analysis and storage library for the OpenMSI project. BASTet is an integrate framework for: i) storage of spectral imaging data, ii) storage of derived analysis data, iii) provenance of analyses, iv) integration and execution of analyses via complex workflows. BASTet implements the API for the HDF5 storage format used by OpenMSI. Analyses that are developed using BASTet benefit from direct integration with storage format, automatic tracking of provenance, and direct integration with command-line and workflow execution tools. BASTet also defines interfaces to enable developers to directly integrate their analysis with OpenMSI's web-based viewing infrastruture without having to know OpenMSI. BASTet also provides numerous helper classes and tools to assist with the conversion of data files, ease parallel implementation of analysis algorithms, ease interaction with web-based functions, description methods for data reduction. BASTet also includes detailed developer documentation, user tutorials, iPython notebooks, and other supporting documents.

Bowen, Benjamin↗
DOE OSTI2015

Passive neutron coincidence counting with plastic scintillators for the characterization of radioactive waste drums

The quantification of radioactive material is essential in the fields of safeguards, criticality control of nuclear processes, dismantling of nuclear facilities and components, or radioactive waste characterization. The Nuclear Measurement Laboratory (LMN) of CEA is involved in the development of time-correlated neutron detection techniques using plastic scintillators. Usually, 3He proportional counters are used for passive neutron coincidence counting owing to their high thermal neutron capture efficiency and gamma insensitivity. However, the global {sup 3}He shortage in the past few years has made these detectors extremely expensive. In addition, contrary to {sup 3}He counters for which a few tens of microseconds are needed to thermalize fast neutrons, in view to maximize the {sup 3}He(n,p){sup 3}H capture cross section, plastic scintillators are based on elastic scattering and therefore the light signal is formed within a few nanoseconds, correlated pulses being detected within a few dozen- or hundred nanoseconds. This time span reflects fission particles time of flight, which allows reducing accordingly the duration of the coincidence gate and thus the rate of random coincidences, which may totally blind fission coincidences when using {sup 3}He counters in case of a high (α,n) reaction rate. However, plastic scintillators are very sensitive to gamma rays, requiring the use of a thick metallic shield to reduce the corresponding background. Cross talk between detectors is also a major issue, which consists on the detection of one particle by several detectors due to elastic or inelastic scattering, leading to true but undesired coincidences. Data analysis algorithms are tested to minimize cross-talk in simultaneously activated detectors. The distinction between useful fission coincidences and the correlated background due to cross-talk, (α,n) and induced (n,2n) or (n,n'γ) reactions, is achieved by measuring 3-fold coincidences. The performances of a passive neutron coincidence counting system for radioactive waste drums using plastic scintillators have been studied using the Monte Carlo radiation transport code MCNPX-PoliMi v2.0 coupled to data processing algorithms developed with ROOT data analysis software. In addition to the correlated background, accidental coincidences are taken into account in the simulation by randomly merging pulses from different calculations with fission and (α,n) sources. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Halo-independent analysis of direct dark matter detection through electron scattering

Sub-GeV mass dark matter particles whose collisions with nuclei would not deposit sufficient energy to be detected, could instead be revealed through their interaction with electrons. Analyses of data from direct detection experiments usually require assuming a local dark matter halo velocity distribution. In the halo-independent analysis method, properties of this distribution are instead inferred from direct dark matter detection data, which allows then to compare different data without making any assumption on the uncertain local dark halo characteristics. Furthermore, this method has so far been developed for and applied to dark matter scattering off nuclei. Here we demonstrate how this analysis can be applied to scattering off electrons.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Plant metacaspase: A case study of microcrystal structure determination and analysis

Metacaspases are highly conserved in plants and play essential roles in mediating programmed cell death, biotic and abiotic stress responses, and damage-induced innate immunity. Ca 2+ signaling induced by plant damage leads to activation of metacaspase from Arabidopsis thaliana (AtMC4), which subsequently processes a plant elicitor peptide to trigger downstream immuno-response. To understand the structural basis of AtMC4 activation by Ca 2+ , we previously determined its crystal structure and performed in-crystal Ca 2+ treatment to probe activation-associated conformational changes. To enable structure determination and in-crystal Ca 2+ activation analysis, we used microcrystals and related methods which were essential for our successful approach. Here, in this paper, we describe in detail the methods that we used for determination of AtMC4 structure using single-wavelength isomorphous replacement with anomalous signals assembled from 22 microcrystals. We also describe the method for in-crystal Ca 2+ soaking, microcrystal data collection, data assembly and analysis to obtain the activated structure of AtMC4 from 91 micro-sized crystals. The described methods may be useful to study other plant metacaspases and more broadly other plant enzymes for their structure determination and in-crystal functional characterization.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback--Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety of statistically motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. Furthermore, we demonstrate the flexibility of the GCP decomposition on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

New ORNL Method Could Unleash Solar Power Potential

Measurement and data analysis techniques developed at the Department of Energy’s Oak Ridge National Laboratory could provide new insight into performance-robbing flaws in crystalline structures, ultimately improving the performance of solar cells.

14 SOLAR ENERGY↗
DOE OSTI2016

Technical Note: Introduction of variance component analysis to setup error analysis in radiotherapy

Purpose: The purpose of this technical note is to introduce variance component analysis to the estimation of systematic and random components in setup error of radiotherapy. Methods: Balanced data according to the one-factor random effect model were assumed. Results: Analysis-of-variance (ANOVA)-based computation was applied to estimate the values and their confidence intervals (CIs) for systematic and random errors and the population mean of setup errors. The conventional method overestimates systematic error, especially in hypofractionated settings. The CI for systematic error becomes much wider than that for random error. The ANOVA-based estimation can be extended to a multifactor model considering multiple causes of setup errors (e.g., interpatient, interfraction, and intrafraction). Conclusions: Variance component analysis may lead to novel applications to setup error analysis in radiotherapy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Inventory Uncertainty Quantification using TENDL Covariance Data in Fispact-II

The new inventory code Fispact-II provides predictions of inventory, radiological quantities and their uncertainties using nuclear data covariance information. Central to the method is a novel fast pathways search algorithm using directed graphs. The pathways output provides (1) an aid to identifying important reactions, (2) fast estimates of uncertainties, (3) reduced models that retain important nuclides and reactions for use in the code's Monte Carlo sensitivity analysis module. Described are the methods that are being implemented for improving uncertainty predictions, quantification and propagation using the covariance data that the recent nuclear data libraries contain. In the TENDL library, above the upper energy of the resolved resonance range, a Monte Carlo method in which the covariance data come from uncertainties of the nuclear model calculations is used. The nuclear data files are read directly by FISPACT-II without any further intermediate processing. Variance and covariance data are processed and used by FISPACT-II to compute uncertainties in collapsed cross sections, and these are in turn used to predict uncertainties in inventories and all derived radiological data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2018

Preliminary Results on Applying Nonparametric Clustering and Bayesian Consensus Clustering Methods to Multimodal Data

In this report, we present preliminary research into nonparametric clustering methods for multi-source imagery data and quantifying the performance of these models. In many domain areas, data sets do not necessarily follow well-defined and well-known probability distributions, such as the normal, gamma, and exponential. This is especially true when combining data from multiple sources describing a common set of objects (which we call multimodal analysis), where the data in each source can follow different distributions and need to be analyzed in conjunction with one another. This necessitates nonparametric density estimation methods, which allow the data to better dictate the distribution of the data. One prominent example of multimodal analysis is multimodal image analysis, when we analyze multiple images taken using different radar systems of the same scene of interest. We develop uncertainty analysis methods, which are inherent in the use of probabilistic models but often not taken advance of, to assess the performance of probabilistic clustering methods used for analyzing multimodal images. This added information helps assess model performance and how much trust decision-makers should have in the obtained analysis results. The developed methods illustrate some ways in which uncertainty can inform decisions that arise when designing and using machine learning models.

42 ENGINEERING↗
DOE OSTI2015

Federal policy documentation and geothermal water consumption: Policy gaps and needs

With U.S. geothermal power production expected to more than triple by 2040, and the majority of this growth expected to occur in arid and water-constrained areas, it is imperative that decision-makers understand the potential long-term limitations to and tradeoffs of geothermal development due to water availability. To this end, water consumption data, including documentation triggered by the National Environmental Policy Act (NEPA) of 1969, production and injection data, and water permit data, were collected from state and federal environmental policy sources in an effort to determine water consumption across the lifecycle of geothermal power plants. Values extracted from these sources were analyzed to estimate water usage during well drilling; to identify sourcing of water for well drilling, well stimulation, and plant operations; and to estimate operational water usage at the plant level. Nevada data were also compared on a facility-by-facility basis with other publicly available water consumption data, to create a complete picture of water usage and consumption at these facilities. This analysis represents a unique method of capturing project-level water data for geothermal projects; however, a lack of statutory and legal requirements for such data and data quality result in significant data gaps, which are also explored

Schroeder, J. N.↗
DOE OSTI2016

The Regional Test Center Data Transfer System

The Regional Test Centers are a group of several sites around the US for testing photovoltaic systems and components related to photovoltaic systems. The RTCs are managed by Sandia National Laboratories. The data collected by the RTCs must be transmitted to Sandia for storage, analysis, and reporting. This document describes the methods that transfer the data between remote sites and Sandia as well as data movement within Sandia’s network. The methods described are in force as of September, 2016.

14 SOLAR ENERGY↗
DOE OSTI2023

Dimensionality reduction using elastic measures

With the recent surge in big data analytics for hyperdimensional data, there is a renewed interest in dimensionality reduction techniques. In order for these methods to improve performance gains and understanding of the underlying data, a proper metric needs to be identified. This step is often overlooked, and metrics are typically chosen without consideration of the underlying geometry of the data. Here, in this paper, we present a method for incorporating elastic metrics into the t-distributed stochastic neighbour embedding (t-SNE) and Uniform Manifold Approximation and Projection (UMAP). We apply our method to functional data, which is uniquely characterized by rotations, parameterization and scale. If these properties are ignored, they can lead to incorrect analysis and poor classification performance. Through our method, we demonstrate improved performance on shape identification tasks for three benchmark data sets (MPEG-7, Car data set and Plane data set of Thankoor), where we achieve 0.77, 0.95 and 1.00 F1 score, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

A NEW METHOD FOR FINDING POINT SOURCES IN HIGH-ENERGY NEUTRINO DATA

The IceCube collaboration has reported the first detection of high-energy astrophysical neutrinos, including ∼50 high-energy starting events, but no individual sources have been identified. It is therefore important to develop the most sensitive and efficient possible algorithms to identify the point sources of these neutrinos. The most popular current method works by exploring a dense grid of possible directions to individual sources, and identifying the single direction with the maximum probability of having produced multiple detected neutrinos. This method has numerous strengths, but it is computationally intensive and because it focuses on the single best location for a point source, additional point sources are not included in the evidence. We propose a new maximum likelihood method that uses the angular separations between all pairs of neutrinos in the data. Unlike existing autocorrelation methods for this type of analysis, which also use angular separations between neutrino pairs, our method incorporates information about the point-spread function and can identify individual point sources. We find that if the angular resolution is a few degrees or better, then this approach reduces both false positive and false negative errors compared to the current method, and is also more computationally efficient up to, potentially, hundreds of thousands of detected neutrinos.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Light Water Reactor Sustainability Program Industry Application External Hazard Analyses Problem Statement

Risk-Informed Margin Management Industry Application on External Events. More specifically, combined events, seismically induced external flooding analyses for a generic nuclear power plant with a generic site soil, and generic power plant system and structure. The focus of this report is to define the problem above, set up the analysis, describe the methods to be used, tools to be applied to each problem, and data analysis and validation associated with the above.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2013

Predicting Esophagitis After Chemoradiation Therapy for Non-Small Cell Lung Cancer: An Individual Patient Data Meta-Analysis

Purpose: Concurrent chemoradiation therapy (CCRT) improves survival compared with sequential treatment for locally advanced non-small cell lung cancer, but it increases toxicity, particularly radiation esophagitis (RE). Validated predictors of RE for clinical use are lacking. We performed an individual-patient-data meta-analysis to determine factors predictive of clinically significant RE. Methods and Materials: After a systematic review of the literature, data were obtained on 1082 patients who underwent CCRT, including patients from Europe, North America, Asia, and Australia. Patients were randomly divided into training and validation sets (2/3 vs 1/3 of patients). Factors predictive of RE (grade ≥2 and grade ≥3) were assessed using logistic modeling, with the concordance statistic (c statistic) used to evaluate the performance of each model. Results: The median radiation therapy dose delivered was 65 Gy, and the median follow-up time was 2.1 years. Most patients (91%) received platinum-containing CCRT regimens. The development of RE was common, scored as grade 2 in 348 patients (32.2%), grade 3 in 185 (17.1%), and grade 4 in 10 (0.9%). There were no RE-related deaths. On univariable analysis using the training set, several baseline factors were statistically predictive of RE (P<.05), but only dosimetric factors had good discrimination scores (c > .60). On multivariable analysis, the esophageal volume receiving ≥60 Gy (V60) alone emerged as the best predictor of grade ≥2 and grade ≥3 RE, with good calibration and discrimination. Recursive partitioning identified 3 risk groups: low (V60 <0.07%), intermediate (V60 0.07% to 16.99%), and high (V60 ≥17%). With use of the validation set, the predictive model performed inferiorly for the grade ≥2 endpoint (c = .58) but performed well for the grade ≥3 endpoint (c = .66). Conclusions: Clinically significant RE is common, but life-threatening complications occur in <1% of patients. Although several factors are statistically predictive of RE, the V60 alone provides the best predictive ability. Efforts to reduce the V60 should be prioritized, with further research needed to identify and validate new predictive factors.

62 RADIOLOGY AND NUCLEAR MEDICINE↗