Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Statistical characterization of experimental magnetized liner inertial fusion stagnation images using deep-learning-based fuel–background segmentation

Significant variety is observed in spherical crystal x-ray imager (SCXI) data for the stagnated fuel–liner system created in Magnetized Liner Inertial Fusion (MagLIF) experiments conducted at the Sandia National Laboratories Z-facility. As a result, image analysis tasks involving, e.g., region-of-interest selection (i.e. segmentation), background subtraction and image registration have generally required tedious manual treatment leading to increased risk of irreproducibility, lack of uncertainty quantification and smaller-scale studies using only a fraction of available data. We present a convolutional neural network (CNN)-based pipeline to automate much of the image processing workflow. This tool enabled batch preprocessing of an ensemble of N scans = 139 SCXI images across N exp = 67 different experiments for subsequent study. The pipeline begins by segmenting images into the stagnated fuel and background using a CNN trained on synthetic images generated from a geometric model of a physical three-dimensional plasma. The resulting segmentation allows for a rules-based registration. Our approach flexibly handles rarely occurring artifacts through minimal user input and avoids the need for extensive hand labelling and augmentation of our experimental dataset that would be needed to train an end-to-end pipeline. Here we also fit background pixels using low-degree polynomials, and perform a statistical assessment of the background and noise properties over the entire image database. Our results provide a guide for choices made in statistical inference models using stagnation image data and can be applied in the generation of synthetic datasets with realistic choices of noise statistics and background models used for machine learning tasks in MagLIF data analysis. We anticipate that the method may be readily extended to automate other MagLIF stagnation imaging applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Machine learning of high dimensional data on a noisy quantum processor

Abstract Quantum kernel methods show promise for accelerating data analysis by efficiently learning relationships between input data points that have been encoded into an exponentially large Hilbert space. While this technique has been used successfully in small-scale experiments on synthetic datasets, the practical challenges of scaling to large circuits on noisy hardware have not been thoroughly addressed. Here, we present our findings from experimentally implementing a quantum kernel classifier on real high-dimensional data taken from the domain of cosmology using Google’s universal quantum processor, Sycamore. We construct a circuit ansatz that preserves kernel magnitudes that typically otherwise vanish due to an exponentially growing Hilbert space, and implement error mitigation specific to the task of computing quantum kernels on near-term hardware. Our experiment utilizes 17 qubits to classify uncompressed 67 dimensional data resulting in classification accuracy on a test set that is comparable to noiseless simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Distributed Acoustic Sensing (DAS) on Opportunistic Networks_ A Feasibility Study Utilizing Fiber Optic Infrastructure at NEON Sites for DAS

This study demonstrates the feasibility of using Distributed Acoustic Sensing (DAS) on the opportunistic optical fiber infrastructure presented by NEON (National Ecological Observatory Network) sites. The test took place at the NEON Terrestrial Site designated D10 CPER. Unlit portions of the local fiber network were successfully spliced together and optimized for length and a Silixa iDAS sensor was installed. The resulting array (composed of 12 spliced fiber runs) totaled 875m in length. Over a period of 2 weeks, we gathered a high spatial and temporal resolution data set to characterize discernable signals and understand background noise. The data set was reviewed to extract wave signatures of identifiable origin, both anthropogenic and otherwise. Continent wide distribution of these sites makes them an interesting candidate for DAS and identifying measurable signal sources informs future DAS application on opportunistic fiber networks. These observations validate the utility of both the NEON and similarly small fiber networks (<1km) for geoscience, environmental, and security DAS applications and indicate possibilities for further inquiry in methods for DAS data collection and analysis.

42 ENGINEERING↗
DOE OSTI2021

Critical Infrastructure Decision-Making under Long-Term Climate Hazard Uncertainty: The Need for an Integrated, Multidisciplinary Approach

U.S. critical infrastructure assets are often designed to operate for decades, and yet long-term planning practices have historically ignored climate change. With the current pace of changing operational conditions and severe weather hazards, research is needed to improve our ability to translate complex, uncertain risk assessment data into actionable inputs to improve decision-making for infrastructure planning. Decisions made today need to explicitly account for climate change – the chronic stressors, the evolution of severe weather events, and the wide-ranging uncertainties. If done well, decision making with climate in mind will result in increased resilience and decreased impacts to our lives, economies, and national security. We present a three-tier approach to create the research products needed in this space: bringing together climate projection data, severe weather event modeling, asset-level impacts, and contextspecific decision constraints and requirements. At each step, it is crucial to capture uncertainties and to communicate those uncertainties to decision-makers. While many components of the necessary research are mature (i.e., climate projection data), there has been little effort to develop proven tools for long-term planning in this space. The combination of chronic and acute stressors, spatial and temporal uncertainties, and interdependencies among infrastructure sectors coalesce into a complex decision space. By applying known methods from decision science and data analysis, we can work to demonstrate the value of an interdisciplinary approach to climate-hazard decision making for longterm infrastructure planning.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Comprehensive Chemical Fingerprinting by Multidimensional GC and Supervised Machine Learning

This project leveraged advances in machine learning based data analysis techniques and untargeted analytical methods for organic analysis to progress nuclear nonproliferation technologies beyond current capabilities. The developed approaches can be used to detect and identify complex chemical fingerprints of facilities of interest. These techniques have been developed for fields such as metabolomics and genomics but have not been applied to nuclear nonproliferation applications. Adaptation of these techniques for volatile organic compound analysis has far reaching application within the scientific community including environmental chemistry, atmospheric physics, and climate sciences.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

First Experimental Test of the Ratio Method

The ratio is a new reaction observable suggested to extract accurately structure information on halo nuclei. It corresponds to the ratio of differential cross sections for scattering and breakup, which is predicted to remove the uncertainty related to the reaction dynamics. We present here the first experimental test of the method for the 11 Be + 12 C collision at E Lab = 20A MeV performed at Texas A&M University. Differential cross sections for scattering and inclusive one-neutron breakup have been measured with the new detector array BlueSTEAl. The ratio of cross sections is very smooth and independent of the projectile-target interaction, which demonstrates the validity of the ratio method. We extend our analysis to existing 11 Be + 208 Pb data, confirming that the method works well on any target.

11Be↗
DOE OSTI2026

Final DOE-ASR Report for the Project “Using LASSO to bridge the gap between model and observations and to learn about atmospheric convection”

Atmospheric convection spans a wide range of spatial and temporal scales and involves complex interactions with the surrounding dynamic and thermodynamic environment, particularly over tropical continental regions. These processes remain a major source of uncertainty in weather and climate models, including persistent biases in the diurnal cycle of convective precipitation that directly affect estimates of climate sensitivity. Addressing these challenges requires the combined use of high-resolution observations and cloud-resolving modeling frameworks. In this context, the DOE Atmospheric Radiation Measurement (ARM) program’s Large-Eddy Simulation ARM Symbiotic Simulation and Observation (LASSO) activity provides a powerful platform that pairs comprehensive observations with numerical simulations to enable process-level understanding of atmospheric convection. Within this context, this Research and Development Partnership Pilot (RDPP) project was designed to initiate and expand DOE ARM/ASR research capacity at minority-serving institutions, while advancing scientific understanding of convective processes over the Amazon rainforest. Consistent with the RDPP mission, the project emphasized partnership development, training, and workforce capacity building alongside exploratory research activities. On the scientific side, the project produced two peer-reviewed journal articles, and one manuscript currently under review (see list in section 3.1). Together, these studies combine long-term ARM observations and cloud-resolving and convection-permitting modeling to investigate the environmental controls on the shallow-to-deep convective transition during the Amazon wet season. The results demonstrate the central role of early-day moisture preconditioning and large-scale dynamical forcing in regulating isolated deep convection, provide mechanistic insight into convective evolution, and establish physically informed modeling frameworks for future sensitivity experiments. These scientific outcomes are described in sections 2.1 to 2.3 and were disseminated in 8 conference presentations (see section 3.2) and 5 invited talks (see section 3.3), reflecting broad engagement with our community. Equally important, the project achieved its RDPP capacity-building objectives (see section 2.4). A sustained research partnership was established among the University of Maryland, Baltimore County (UMBC), Morgan State University (MSU), and Howard University (HU), and extended to include collaboration with Pacific Northwest National Laboratory (PNNL). The project organized multiple multi-day training events focused on ARM data, LASSO simulations, and quantitative analysis methods, directly engaging students, postdoctoral researchers, and faculty across institutions. These activities broadened participation in ASR research and led to independent adoption of LASSO workflows by students beyond the immediate project team. Finally, the project successfully positioned the participating institutions to pursue future DOE research. Preliminary scientific results, coupled with strengthened partnerships and technical capacity, enabled the submission of follow-on proposals to DOE ASR funding opportunities. In this way, the project fulfilled the RDPP goal of seeding durable research capacity and laying the foundation for larger-scale, sustained engagement with DOE ARM and ASR programs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

FX Hg Fogging Fixative Deployment for Mercury Vapor Suppression

Idaho National Laboratory’s (INL) FX Hg fixative solution was deployed at the Y-12 Complex in Oak Ridge, Tennessee to support disposal of mercury-contaminated metal debris. The fixative was dispensed via fogging. Fogging infiltrates non-line-of-sight areas improving fixative coating on complex geometries such as debris piles. FX Hg is the mercury vapor controlling derivative of INL’s FX2 fixative. FX2 was jointly developed with the National Nuclear Laboratory of the United Kingdom, and INL developed the FX Hg derivative to suppress mercury vapor generation. The Y-12 deployment was performed in concert with cleanup contractor UCOR. A dumpster filled with debris was fogged with FX Hg. The material was acceptable as municipal landfill waste, save for the mercury vapor levels measured. If the mercury vapor generation rate could be sufficiently reduced, disposal costs for this waste would be dramatically reduced. FX Hg had previously proven effective at significantly reducing mercury vapor generation rates in bench scale testing at INL. This deployment was the first field scale deployment of the method. Efficacy results were underwhelming, but interpretation of the outcome is complicated by a paucity of hard data. Methods for improving data capture and analysis are analyzed. Operational difficulties associated with scaling the process up and process improvements for future deployments are discussed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

FX Hg Fogging Fixative Deployment for Mercury Vapor Suppression - 20410

Idaho National Laboratory's (INL) FX Hg fixative solution was deployed at the Y-12 National Security Complex in Oak Ridge, Tennessee to support disposal of mercury-contaminated metal debris. The fixative was dispensed via fogging. Fogging infiltrates non-line-of-sight areas improving fixative coating on complex geometries such as debris piles. FX Hg is the mercury vapor controlling derivative of INL's FX2 fixative. FX2 was jointly developed with the National Nuclear Laboratory of the United Kingdom, and INL developed the FX Hg derivative to suppress mercury vapor generation. The Y-12 deployment was performed in concert with UCOR (URS CH2M Oak Ridge), the cleanup contractor for Y-12. A dumpster filled with debris was fogged with FX Hg. The debris was acceptable as municipal landfill waste, save for the mercury vapor levels measured. If the mercury vapor generation rate could be sufficiently reduced, disposal costs for this waste would be dramatically reduced. FX Hg had previously proven effective at significantly reducing mercury vapor generation rates in bench scale testing at INL. This deployment was the first field-scale deployment of the method. Efficacy results were underwhelming, but interpretation of the outcome is complicated by a paucity of hard data. Methods for improving data capture and analysis are analyzed. Operational difficulties associated with scaling up the process and process improvements for future deployments are discussed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Commercial, industrial, and institutional discount rate estimation for efficiency standards analysis: Sector-level data 1998–2022

Underlying each of the U.S. Department of Energy’s (DOE’s) federal appliance and equipment energy conservation standards are a set of complex analyses of the projected costs and benefits of regulation. Any new or amended standard must be designed to achieve significant additional energy conservation, provided that it is technologically feasible and economically justified (42 U.S.C. 6295(o)(2)(A)). DOE determines economic justification based on whether the benefits exceed the burdens, considering a variety of factors, including the economic impact of the standard on consumers of the product and the savings in lifetime operating cost compared to any increase in price or maintenance expenses (42 U.S.C. 6295(o)(2)(B)). As part of this determination, DOE conducts a life-cycle cost (LCC) analysis, which models the combined impact of appliance first cost and operating cost changes on a representative commercial building sample to identify the fraction of customers achieving LCC savings or incurring net cost at the considered efficiency levels. Thus, the commercial discount rate value(s) used to calculate the present value of energy cost savings within the LCC model implicitly plays a role in estimating the economic impact of potential standard levels. This report provides an in-depth discussion of the commercial discount rate estimation process. It is an update to previous reports on estimating commercial discount rates from firm-level and sector-level financial data (e.g., Fujita, 2021, 2016). Major topics covered in this report include the following: -Discount rate estimation methods and rationale -Data sources used and data limitations -Discount rate distributions for use in standards analysis -Discount rate estimation methods and distributions specific to the small business subgroup analysis A version of this analysis was most recently released in 2022. Going forward, this report will be updated as data allow and analyses necessitate.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Statistical data analysis of x-ray spectroscopy data enabled by neural network accelerated Bayesian inference

Bayesian inference applied to x-ray spectroscopy data analysis enables uncertainty quantification necessary to rigorously test theoretical models. However, when comparing to data, detailed atomic physics and radiation transfer calculations of x-ray emission from non-uniform plasma conditions are typically too slow to be performed in line with statistical sampling methods, such as Markov Chain Monte Carlo sampling. Furthermore, differences in transition energies and x-ray opacities often make direct comparisons between simulated and measured spectra unreliable. Here, we present a spectral decomposition method that allows for corrections to line positions and bound–bound opacities to best fit experimental data, with the goal of providing quantitative feedback to improve the underlying theoretical models and guide future experiments. In this work, we use a neural network (NN) surrogate model to replace spectral calculations of isobaric hot-spots created in Kr-doped implosions at the National Ignition Facility. The NN was trained on calculations of x-ray spectra using an isobaric hot-spot model post-processed with Cretin, a multi-species atomic kinetics and radiation code. The speedup provided by the NN model to generate x-ray emission spectra enables statistical analysis of parameterized models with sufficient detail to accurately represent the physical system and extract the plasma parameters of interest.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Quantifying Dynamic Signal Spread in Real-Time High-Energy X-ray Diffraction

Abstract Measured intensity in high-energy monochromatic X-ray diffraction (HEXD) experiments provides information regarding the microstructure of the crystalline material under study. The location of intensity on an areal detector is determined by the lattice spacing and orientation of crystals so that changes in the heterogeneity of these quantities are reflected in the spreading of diffraction peaks over time. High temporal resolution of such dynamics can now be experimentally observed using technologies such as the mixed-mode pixel array detector (MM-PAD) which facilitates in situ dynamic HEXD experiments to study plasticity and its underlying mechanisms. In this paper, we define and demonstrate a feature computed directly from such diffraction time series data quantifying signal spread in a manner that is correlated with plastic deformation of the sample. A distinguishing characteristic of the analysis is the capability to describe the evolution from the distinct diffraction peaks of an undeformed alloy sample through to the non-uniform Debye–Scherrer rings developed upon significant plastic deformation. We build on our previous work modeling data using an overcomplete dictionary by treating temporal measurements jointly to improve signal spread recovery. We demonstrate our approach in simulations and on experimental HEXD measurements captured using the MM-PAD. Our method for characterizing the temporal evolution of signal spread is shown to provide an informative means of data analysis that adds to the capabilities of existing methods. Our work draws on ideas from convolutional sparse coding and requires solving a coupled convex optimization problem based on the alternating direction method of multipliers.

Engineering↗
DOE OSTI2022

A high-resolution single-molecule sequencing-based Arabidopsis transcriptome using novel methods of Iso-seq analysis

Accurate and comprehensive annotation of transcript sequences is essential for transcript quantification and differential gene and transcript expression analysis. Single-molecule long-read sequencing technologies provide improved integrity of transcript structures including alternative splicing, and transcription start and polyadenylation sites. However, accuracy is significantly affected by sequencing errors, mRNA degradation, or incomplete cDNA synthesis. We present a new and comprehensive Arabidopsis thaliana Reference Transcript Dataset 3 (AtRTD3). AtRTD3 contains over 169,000 transcripts—twice that of the best current Arabidopsis transcriptome and including over 1500 novel genes. Seventy-eight percent of transcripts are from Iso-seq with accurately defined splice junctions and transcription start and end sites. We develop novel methods to determine splice junctions and transcription start and end sites accurately. Mismatch profiles around splice junctions provide a powerful feature to distinguish correct splice junctions and remove false splice junctions. Stratified approaches identify high-confidence transcription start and end sites and remove fragmentary transcripts due to degradation. AtRTD3 is a major improvement over existing transcriptomes as demonstrated by analysis of an Arabidopsis cold response RNA-seq time-series. AtRTD3 provides higher resolution of transcript expression profiling and identifies cold-induced differential transcription start and polyadenylation site usage. AtRTD3 is the most comprehensive Arabidopsis transcriptome currently. It improves the precision of differential gene and transcript expression, differential alternative splicing, and transcription start/end site usage analysis from RNA-seq data. The novel methods for identifying accurate splice junctions and transcription start/end sites are widely applicable and will improve single-molecule sequencing analysis from any species.

transcription start and end sites↗
DOE OSTI2023

Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks

Automated fault management is at the forefront of next-generation optical communication networks. The increase in complexity of modern networks has triggered the need for programmable and software-driven architectures to support the operation of agile and self-managed systems. In these scenarios, the European Telecommunications Standards Institute zero-touch network and service management approach is imperative. The need for machine learning algorithms to process the large volume of telemetry data brings safety concerns as distributed cloud-computing solutions become the preferred approach for deploying reliable communication network automation. This paper’s contribution is twofold. First, we propose a simple yet effective method to guarantee the confidentiality of the telemetry data based on feature scrambling. The method allows the operation of third-party computational services without direct access to the full content of the collected data. Additionally, the effectiveness of four unsupervised machine learning algorithms for soft-failure detection is evaluated when applied to the scrambled telemetry data. The methods are based on factor analysis, principal component analysis, nonlinear principal component analysis, and singular value decomposition. Most dimensionality reduction algorithms have the common property that they can maintain similar levels of fault classification performance while hiding the data structure from unauthorized access. Evaluations of the proposed algorithms demonstrate this capability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

SERS-based ssDNA composition analysis with inhomogeneous peak broadening and reservoir computing

Surface-enhanced Raman spectroscopy employed in conjunction with post-processing machine learning methods is a promising technique for effective data analysis, allowing one to enhance the molecular and chemical composition analysis of information rich DNA molecules. In this work, we report on a room temperature inhomogeneous broadening as a function of the increased adenine concentration and employ this feature to develop one-dimensional and two dimensional chemical composition classification models of 200 long single stranded DNA sequences. Afterwards, we develop a reservoir computing chemical composition classification scheme of the same molecules and demonstrate enhanced performance that does not rely on manual feature identification.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Inverting infrasound data for the seismoacoustic source time functions and surface spall at the Source Physics Experiments Phase II: Dry Alluvium Geology

This report presents the infrasound data recorded as part of the Source Physics Experiment - Phase 2, Dry Alluvium Geology. This experiment, also known colloquially as DAG, consisted of four underground chemical explosions at the Nevada National Security Site. We focus our analysis on only the fourth explosion (DAG-4) as we determined that this was the only event that produced clear source-generated infrasound energy as recorded by the DAG sensors. We analyze the data using two inversion methods. The first method is designed to estimate the point-source seismoacoustic source time functions, and the second inversion method is designed to estimate the first-order characteristics (e.g. horizontal dimensions and maximum amplitude) of the actual spall surface. For both analysis methods, we are able to fit the data reasonably well, with various assumptions of the source model. The estimated seismoacoustic source appears to be a combination of a buried, isotropic explosion with a maximum amplitude of ~2 x 10 9 Nm and a vertically oriented force, applied to the Earth's surface with a maximum amplitude of 4 x 10 7 N. We use the vertically oriented force to simulate surface spall. The estimated spall surface has an approximate radius of ~40 m with a maximum acceleration magnitude in the range of 0.8 to 1.5 m/s/s. These estimates are approximately similar to the measured surface acceleration at the site.

58 GEOSCIENCES↗
DOE OSTI2025

SEAFORML (Smart Exploration and Analysis For Optimal and Robust Machine Learning)

The poster discusses data analysis of the WAVgraph database and applied machine learning methods for it. The database is a long-term project that seeks to be a comprehensive repository of information on cyber threats and is updated regularly. It was previously unanalyzed and unexplored. The goal was to learn more about it and its contents in order to have a better understanding and enable better use. The data analysis and discovery enabled further exploration through natural language processing, similarity, and clustering methods. The poster shows some of the insights from the analysis and explains the methods used for the machine learning applications.

24 - POWER TRANSMISSION AND DISTRIBUTION↗