Search NASA⌕ Search

SEARCH · Search NASA

Results for “Methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Defining a Metric Space of Host Logs and Operational Use Cases

Host logs, in particular, Windows Event Logs, are a valuable source of information often collected by security operation centers (SOCs). The semi-structured nature of host logs inhibits automated analytics, and while manual analysis is common, the sheer volume makes manual inspection of all logs impossible. Although many powerful algorithms for analyzing time-series and sequential data exist, utilization of such algorithms for most cyber security applications is either infeasible or requires tailored, research-intensive preparations. In particular, basic mathematic and algorithmic developments for providing a generalized, meaningful similarity metric on system logs is needed to bridge the gap between many existing sequential data mining methods and this currently available but under-utilized data source. In this paper, we provide a rigorous definition of a metric product space on Windows Event Logs, providing an embedding that allows for the application of established machine learning and time-series analysis methods. We then demonstrate the utility and flexibility of this embedding with multiple use-cases on real data: (1) comparing known infected to new host log streams for attack detection and forensics, (2) collapsing similar streams of logs into semantically-meaningful groups (by user, by role), thereby reducing the quantity of data but not the content, (3) clustering logs as well as short sequences of logs to identify and visualize user behaviors and background processes over time. Overall, we provide a metric space framework for general host logs and log sequences that respects semantic similarity and facilitates a wide variety of data science analytics to these logs without data-specific preparations for each.

Verma, Miki↗
DOE OSTI2025

Using feature importance as an exploratory data analysis tool on Earth system models

Abstract. Machine learning (ML) models are commonly used to generate predictions, but these models can also support the discovery of new science. Generating accurate predictions necessitates that a model captures the structure of the underlying data. If the structure is properly extracted, ML could be a useful exploratory and evidential tool. In this paper, we present a case study that demonstrates the use of ML for exploratory data analysis (EDA) in the climate space. We apply the ML explainability method of spatiotemporal zeroed feature importance (stZFI) to understand how climate-variable associations evolve over space and time. Our analyses focus on data from ensembles of Earth system models (ESMs) which provide data on different climate states and conditions. We elect to work with ESM ensembles since they allow us to compare feature importance across alternative scenarios not available with observed data. The ensembles also account for natural variability so that we can distinguish between signal and noise due to natural climate variability when computing feature importance. The use of perturbed initial condition ensembles introduces variability mimicking the natural variability in the atmosphere; thus the signals emerging using feature importance (FI) can be evaluated against the natural variability in the climate system. For our analyses, we consider the 1991 volcanic eruption of Mount Pinatubo, which was a large stratospheric aerosol injection. We explore the climate pathway associated with the eruption from aerosols to radiation to temperature at both the near-surface and stratospheric levels. In addition to applying the method to data generated from two different ESMs, we apply stZFI to reanalysis data to compare the associations identified by stZFI. We show how stZFI tracks the importance of aerosol optical depth over time on forecasting temperatures. This case study illustrates usefulness of an ML tool (stZFI) for EDA on a well-studied climate exemplar.

Ries, Daniel (ORCID:0000000250294647)↗
DOE OSTI2015

Identification of Chemical Attribution Signatures of Fentanyl Syntheses Using Multivariate Statistical Analysis of Orthogonal Analytical Data

Attribution of the origin of an illicit drug relies on identification of compounds indicative of its clandestine production and is a key component of many modern forensic investigations. The results of these studies can yield detailed information on method of manufacture, starting material source, and final product - all critical forensic evidence. In the present work, chemical attribution signatures (CAS) associated with the synthesis of the analgesic fentanyl, N-(1-phenylethylpiperidin-4-yl)-N-phenylpropanamide, were investigated. Six synthesis methods, all previously published fentanyl synthetic routes or hybrid versions thereof, were studied in an effort to identify and classify route-specific signatures. 160 distinct compounds and inorganic species were identified using gas and liquid chromatographies combined with mass spectrometric methods (GC-MS and LCMS/ MS-TOF) in conjunction with inductively coupled plasma mass spectrometry (ICPMS). The complexity of the resultant data matrix urged the use of multivariate statistical analysis. Using partial least squares discriminant analysis (PLS-DA), 87 route-specific CAS were classified and a statistical model capable of predicting the method of fentanyl synthesis was validated and tested against CAS profiles from crude fentanyl products deposited and later extracted from two operationally relevant surfaces: stainless steel and vinyl tile. This work provides the most detailed fentanyl CAS investigation to date by using orthogonal mass spectral data to identify CAS of forensic significance for illicit drug detection, profiling, and attribution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

An adjoint-based optimization method for jointly inverting heterogeneous material properties and fault slip from earthquake surface deformation data

SUMMARY Analysis of tectonic and earthquake-cycle associated deformation of the crust can provide valuable insights into the underlying deformation processes including fault slip. How those processes are expressed at the surface depends on the lateral and depth variations of rock properties. The effect of such variations is often tested by forward models based on a priori geological or geophysical information. Here, we first develop a novel technique based on an open-source finite-element computational framework to invert geodetic constraints directly for heterogeneous media properties. We focus on the elastic, coseismic problem and seek to constrain variations in shear modulus and Poisson’s ratio, proxies for the effects of lithology and/or temperature and porous flow, respectively. The corresponding nonlinear inversion is implemented using adjoint-based optimization that efficiently reduces the cost function that includes the misfit between the calculated and observed displacements and a penalty term. We then extend our theoretical and numerical framework to simultaneously infer both heterogeneous Earth’s structure and fault slip from surface deformation. Based on a range of 2-D synthetic cases, we find that both model parameters can be satisfactorily estimated for the megathrust setting-inspired test problems considered. Within limits, this is the case even in the presence of noise and if the fault geometry is not perfectly known. Our method lays the foundation for a future reassessment of the information contained in increasingly data-rich settings, for example, geodetic GNSS constraints for large earthquakes such as the 2011 Tohoku-oki M9 event, or distributed deformation along plate boundaries as constrained from InSAR.

Geochemistry & Geophysics↗
DOE OSTI2018

On the scattering correction of fast-ion D-alpha signals on NSTX-U

Analysis of fast-ion D-alpha (FIDA) data on National Spherical Torus Experiment-Upgrade (NSTX-U) shows that the cold Dα line contaminates the FIDA baseline. The scattered light is comparable to the FIDA emission. A scattering correction is required to extract the FIDA signal. Two methods that relate the scattered light contamination to the intensity of the cold Dα line are employed. Here, one method uses laboratory measurements with a calibration lamp; the other method uses data acquired during plasma operation and singular value decomposition analysis. Finally, after correction, both the FIDA spectra and spatial profile are in better agreement with theoretical predictions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2018

On the scattering correction of fast-ion D-alpha signal on NSTX-U

Analysis of fast-ion D-alpha (FIDA) data on National Spherical Torus Experiment-Upgrade (NSTX-U) shows that the cold Dα line contaminates the FIDA baseline. The scattered light is comparable to the FIDA emission. A scattering correction is required to extract the FIDA signal. Two methods that relate the scattered light contamination to the intensity of the cold Dα line are employed. One method uses laboratory measurements with a calibration lamp; the other method uses data acquired during plasma operation and singular value decomposition analysis. After correction, both the FIDA spectra and spatial profile are in better agreement with theoretical predictions.

Single value decomposition (SVD)↗
DOE OSTI2024

Blueprints for Training Information Bottlenecks for Collider Analyses

Dimensionality reduction is a crucial aspect of data analysis in high energy physics, even if accompanied by information loss. Several methods, including histogram- and kernel-based analyses, are only computationally feasible for low-dimensional data. Furthermore, simulation models used in HEP can often only be validated for low-dimensional data. We provide several blueprints for using machine learning to create low-dimensional data representations (continuous event variables and discrete classification labels) for use in signal discovery and parameter estimation tasks. We also describe how to design the learned representation to facilitate a) searches with unknown model parameters and b) validation of simulation models in data control regions.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Decision Science for Machine Learning (DeSciML)

The increasing use of machine learning (ML) models to support high-consequence decision making drives a need to increase the rigor of ML-based decision making. Critical problems ranging from climate change to nonproliferation monitoring rely on machine learning for aspects of their analyses. Likewise, future technologies, such as incorporation of data-driven methods into the stockpile surveillance and predictive failure analysis for weapons components, will all rely on decision-making that incorporates the output of machine learning models. In this project, our main focus was the development of decision scientific methods that combine uncertainty estimates for machine learning predictions, with a domain-specific model of error costs. Other focus areas include uncertainty measurement in ML predictions, designing decision rules using multiobjecive optimization, the value of uncertainty reduction, and decision-tailored uncertainty quantification for probability estimates. By laying foundations for rigorous decision making based on the predictions of machine learning models, these approaches are directly relevant to every national security mission that applies, or will apply, machine learning to data, most of which entail some decision context.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

The DECADE cosmic shear project III: validation of analysis pipeline using spatially inhomogeneous data

We present the pipeline for the cosmic shear analysis of the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog consisting of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The catalog derives from a large number of disparate observing programs and is therefore more inhomogeneous across the sky compared to existing lensing surveys. First, we use simulated data-vectors to show the sensitivity of our constraints to different analysis choices in our inference pipeline, including sensitivity to residual systematics. Next we use simulations to validate our covariance modeling for inhomogeneous datasets. Finally, we show that our choices in the end-to-end cosmic shear pipeline are robust against inhomogeneities in the survey, by extracting relative shifts in the cosmology constraints across different subsets of the footprint/catalog and showing they are all consistent within 1σ to 2σ. This is done for forty-six subsets of the data and is carried out in a fully consistent manner: for each subset of the data, we re-derive the photometric redshift estimates, shear calibrations, survey transfer functions, the data vector, measurement covariance, and finally, the cosmological constraints. Our results show that existing analysis methods for weak lensing cosmology can be fairly resilient towards inhomogeneous datasets. This also motivates exploring a wider range of image data for pursuing such cosmological constraints.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

An introduction to the significance of sample size in particle analyses for nuclear forensics and radiological investigations

Particulate isotopic analysis in nuclear forensics has developed rapidly during the past two decades due to technical advances in determining the isotopic composition of individual particles. This paper introduces basic statistical concepts that can be applied by analysts to understand the importance of statistical adequacy when interpretating particle data. While these basic statistical methods provide a useful point-of-entry to particle data analysis, more sophisticated statistical and modeling approaches are needed to extract maximal information from such datasets in the future.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2017

Preliminary Analysis of FFTF Loss-of-Flow Tests with SAS4A/SASSYS-1

The Fast Flux Test Facility (FFTF) was the most recent Sodium-cooled Fast Reactor (SFR) built in the United States. The Passive Safety Test (PST) program was carried out on FFTF between 1984 and 1986 to demonstrate the capability of passive reactor shutdown and decay heat removal in response to protected and unprotected transients. In order to recover the information and knowledge that has been gained from FFTF, a research project was initiated focusing on the simulation of Unprotected Loss of Flow Without Scram (LOFWOS) tests similar to the knowledge preservation activities conducted for EBR-II by Argonne National Laboratory in earlier years. These knowledge preservation activities are intended to support the validation of computational tools and methods in the area of SFR passive safety. Comparisons with experimental data and other safety codes provide opportunities to improve SFR design and safety analysis codes and methods.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2014

Analysis of multicrystal pump–probe data sets. I. Expressions for the RATIO model

The RATIO method in time-resolved crystallography [Coppens et al. (2009). J. Synchrotron Rad. 16 , 226–230] was developed for use with Laue pump–probe diffraction data to avoid complex corrections due to wavelength dependence of the intensities. The application of the RATIO method in processing/analysis prior to structure refinement requires an appropriate ratio model for modeling the light response. The assessment of the accuracy of pump–probe time-resolved structure refinements based on the observed ratios was discussed in a previous paper. In the current paper, a detailed ratio model is discussed, taking into account both geometric and thermal light-induced changes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

WE-AB-207A-04: Random Undersampled Cone Beam CT: Theoretical Analysis and a Novel Reconstruction Method

Purpose: Reducing x-ray exposure and speeding up data acquisition motived studies on projection data undersampling. It is an important question that for a given undersampling ratio, what the optimal undersampling approach is. In this study, we propose a new undersampling scheme: random-ray undersampling. We will mathematically analyze its projection matrix properties and demonstrate its advantages. We will also propose a new reconstruction method that simultaneously performs CT image reconstruction and projection domain data restoration. Methods: By representing projection operator under the basis of singular vectors of full projection operator, matrix representations for an undersampling case can be generated and numerical singular value decomposition can be performed. We compared properties of matrices among three undersampling approaches: regular-view undersampling, regular-ray undersampling, and the proposed random-ray undersampling. To accomplish CT reconstruction for random undersampling, we developed a novel method that iteratively performs CT reconstruction and missing projection data restoration via regularization approaches. Results: For a given undersampling ratio, random-ray undersampling preserved mathematical properties of full projection operator better than the other two approaches. This translates to advantages of reconstructing CT images at lower errors. Different types of image artifacts were observed depending on undersampling strategies, which were ascribed to the unique singular vectors of the sampling operators in the image domain. We tested the proposed reconstruction algorithm on a Forbid phantom with only 30% of the projection data randomly acquired. Reconstructed image error was reduced from 9.4% in a TV method to 7.6% in the proposed method. Conclusion: The proposed random-ray undersampling is mathematically advantageous over other typical undersampling approaches. It may permit better image reconstruction at the same undersampling ratio. The novel algorithm suitable for this random-ray undersampling was able to reconstruct high-quality images.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

A novel analysis method for paired-sample microbial ecology experiments

Many microbial ecology experiments use sequencing data to measure a community s response to an experimental treatment. In a common experimental design, two units, one control and one experimental, are sampled before and after the treatment is applied to the experimental unit. The four resulting samples contain information about the dynamics of organisms that respond to the treatment, but there are no analytical methods designed to extract exactly this type of information from this configuration of samples. Here we present an analytical method specifically designed to visualize and generate hypotheses about microbial community dynamics in experiments that have paired samples and few or no replicates. The method is based on the Poisson lognormal distribution, long studied in macroecology, which we found accurately models the abundance distribution of taxa counts from 16S rRNA surveys. To demonstrate the method s validity and potential, we analyzed an experiment that measured the effect of crude oil on ocean microbial communities in microcosm. Our method identified known oil degraders as well as two clades, Maricurvus and Rhodobacteraceae, that responded to amendment with oil but do not include known oil degraders. Furthermore, our approach is sensitive to organisms that increased in abundance only in the experimental unit but less sensitive to organisms that increased in both control and experimental units, thus mitigating the role of bottle effects .

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Particle transport constraints via Bayesian spectral fitting of multiple atomic lines

Optimized operation of fusion devices demands detailed understanding of plasma transport, a problem that must be addressed with advances in both measurement and data analysis techniques. In this work, we adopt Bayesian inference methods to determine experimental particle transport, leveraging opportunities from high-resolution He-like ion spectra in a tokamak plasma. The Bayesian spectral fitting code is used to analyze resonance (w), forbidden (z), intercombination (x, y), and satellite (k, j) lines of He-like Ca following laser blow-off injections on Alcator C-Mod. This offers powerful transport constraints since these lines depend differently on electron temperature and density, but also differ in their relation to Li-like, He-like, and H-like ion densities, often the dominant Ca charge states over most of the C-Mod plasma radius. Using synthetic diagnostics based on the AURORA package, we demonstrate improved effectiveness of impurity transport inferences when spectroscopic data from a progressively larger number of lines are included.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Particle transport constraints via Bayesian spectral fitting of multiple atomic lines

Optimized operation of fusion devices demands detailed understanding of plasma transport, a problem that must be addressed with advances in both measurement and data analysis techniques. In this work, we adopt Bayesian inference methods to determine experimental particle transport, leveraging opportunities from high-resolution He-like ion spectra in a tokamak plasma. The Bayesian spectral fitting code is used to analyze resonance (w), forbidden (z), intercombination (x, y), and satellite (k, j) lines of He-like Ca following laser blow-off injections on Alcator C-Mod. This offers powerful transport constraints since these lines depend differently on electron temperature and density, but also differ in their relation to Li-like, He-like, and H-like ion densities, often the dominant Ca charge states over most of the C-Mod plasma radius. Using synthetic diagnostics based on the AURORA package, we demonstrate improved effectiveness of impurity transport inferences when spectroscopic data from a progressively larger number of lines are included.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Probing cellulose structures with vibrational spectroscopy

This paper reviews principles, data interpretations, and applications of vibrational spectroscopic methods used for analysis of cellulose in the isolated state and in plant cell walls or lignocellulose biomass. The paper begins with reviewing the crystalline structures of crystalline cellulose polymorphs and the principles of three different vibrational spectroscopy methods—infrared (IR), Raman, and sum frequency generation (SFG)—complemented with density functional theory calculations. Then, it discusses the vibrational modes of crystalline celluloses, how the chain orientation in crystalline domain is analyzed in each method, and how the concentration and spatial distribution of crystalline cellulose domains interspersed in amorphous matrices are manifested or analyzed differently in these three methods. Finally, the paper discusses examples of analyzing crystalline cellulose in plant cell walls or lignocellulose biomass with IR, Raman, and SFG including spectroscopic imaging. One review cannot cover all vibrational spectroscopy literatures on cellulose; this review aims at providing tutorial information, using selected literatures and experimental data, needed to interpret nano-, meso-, and micro-scale structures of cellulose in plant cell walls and lignocellulose biomass.

59 BASIC BIOLOGICAL SCIENCES↗