Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Rapid and flexible segmentation of electron microscopy data using few-shot machine learning

Abstract Automatic segmentation of key microstructural features in atomic-scale electron microscope images is critical to improved understanding of structure–property relationships in many important materials and chemical systems. However, the present paradigm involves time-intensive manual analysis that is inherently biased, error-prone, and unable to accommodate the large volumes of data produced by modern instrumentation. While more automated approaches have been proposed, many are not robust to a high variety of data, and do not generalize well to diverse microstructural features and material systems. Here, we present a flexible, semi-supervised few-shot machine learning approach for segmentation of scanning transmission electron microscopy images of three oxide material systems: (1) epitaxial heterostructures of SrTiO 3 /Ge, (2) La 0.8 Sr 0.2 FeO 3 thin films, and (3) MoO 3 nanoparticles. We demonstrate that the few-shot learning method is more robust against noise, more reconfigurable, and requires less data than conventional image analysis methods. This approach can enable rapid image classification and microstructural feature mapping needed for emerging high-throughput characterization and autonomous microscope platforms.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Detecting population-environmental interactions with mismatched time series data

Time series analysis is an essential method for decomposing the influences of density and exogenous factors such as weather and climate on population regulation. However, there has not been much work focused on understanding how well commonly collected data can reconstruct the effects of environmental factors on population dynamics. We show that, analogous to similar scale issues in spatial data analysis, coarsely sampled temporal data can fail to detect covariate effects when interactions occur on timescales that are fast relative to the survey period. We propose a method for modeling mismatched time series data that couples high-resolution environmental data to low-resolution abundance data. We illustrate our approach with simulations and by applying it to Florida's southern Snail kite population. Our simulation results show that our method can reliably detect linear environmental effects and that detecting nonlinear effects requires high-resolution covariate data even when the population turnover rate is slow. In the Snail kite analysis, our approach performed among the best in a suite of previously used environmental covariates explaining Snail kite dynamics and was able to detect a potential phenological shift in the environmental dependence of Snail kites. Our work provides a statistical framework for reliably detecting population–environment interactions from coarsely surveyed time series. An important implication of this work is that the low predictability of animal population growth by weather variables found in previous studies may be due, in part, to how these data are utilized as covariates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Advances in targeted proteomics and applications to biomedical research

Targeted proteomics technique has emerged as a powerful protein quantification tool in systems biology, biomedical research, and increasing for clinical applications. The most widely used targeted proteomics approach, selected reaction monitoring (SRM), also known as multiple reaction monitoring (MRM), can be used for quantification of cellular signaling networks and preclinical verification of candidate protein biomarkers. As an extension to our previous review on advances in SRM sensitivity (Shi et al., Proteomics , 12, 1074–1092, 2012) herein we review recent advances in the method and technology for further enhancing SRM sensitivity (from 2012 to present), and highlighting its broad biomedical applications in human bodily fluids, tissue and cell lines. Furthermore, we also review two recently introduced targeted proteomics approaches, parallel reaction monitoring (PRM) and data‐independent acquisition (DIA) with targeted data extraction on fast scanning high‐resolution accurate‐mass (HR/AM) instruments. Such HR/AM targeted quantification with monitoring all target product ions addresses SRM limitations effectively in specificity and multiplexing; whereas when compared to SRM, PRM and DIA are still in the infancy with a limited number of applications. Thus, for HR/AM targeted quantification we focus our discussion on method development, data processing and analysis, and its advantages and limitations in targeted proteomics. Finally, general perspectives on the potential of achieving both high sensitivity and high sample throughput for large‐scale quantification of hundreds of target proteins are discussed.

Shi, Tujin↗
DOE OSTI2025

Common Column Identification for Table Similarity Detection in Electrified Transportation Data Lakes

Electrified transportation often requires researchers and operators to interact with datasets from a wide range of sources and disciplines, such as transportation, power systems, public health, policies, and regulations. These datasets vary in quality and format, making it difficult to understand, preprocess, and identify key columns representing real-world entities or values for indexing and joining, which can negatively impact downstream analysis and operation. Existing solutions are limited, requiring extensive manual customization or data expertise to utilize. In this article, we propose a multi-layered approach to automatically identify key columns to expedite preprocessing and aid in analysis of electrified transportation data. Our method leverages a dynamic ontology to identify common fields and an information theory-based strategy for edge cases that are difficult to generalize. Evaluations on a number of datasets from data.gov and kaggle.com show improved performance of our methods over several baseline techniques, and our ablation analyses illustrate the efficacy of individual components of our method. Our case studies also demonstrate that our methods have the potential to improve analysis of electrified transportation data and aid in automatic integration of such datasets.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Investigation of Molecular Diffusion at Block Copolymer Thin Films Using Maximum Entropy Method-Based Fluorescence Correlation Spectroscopy and Single Molecule Tracking

Fluorescence correlation spectroscopy (FCS) has been widely used to investigate molecular diffusion behavior in various samples. The use of the maximum entropy method (MEM) for FCS data analysis provides a unique means to determine multiple distinct diffusion coefficients without a priori assumption of their number. Comparison of the MEM-based FCS method (MEM-FCS) with another method will reveal its utility and advantage as an analytical tool to investigate diffusion dynamics. Herein, we measured diffusion of fluorescent probes doped into nanostructured thin films using MEM-FCS, and validated the results with single molecule tracking (SMT) data. The efficacy of the MEM code employed was first demonstrated by analyzing simulated FCS data for systems incorporating one and two diffusion modes with broadly distributed diffusion coefficients. The MEM analysis accurately afforded the number of distinct diffusion modes and their mean diffusion coefficients. These results contrasted with those obtained by fitting the simulated data to conventional two-component and anomalous diffusion models, which yielded inaccurate estimates of the diffusion coefficients. Subsequently, the MEM analysis was applied to FCS data acquired from hydrophilic dye molecules incorporated into microphase-separated polystyrene-block-poly(ethylene oxide) (PS-b-PEO) thin films characterized under a water-saturated nitrogen atmosphere. The MEM analysis revealed distinct fast and slow diffusion components attributable to molecules diffusing on the film surface and inside the film, respectively. SMT studies of the same materials yielded trajectories for mobile molecules that appear to follow the curved PEO microdomains. Diffusion coefficients obtained from the SMT data were consistent with those obtained for the slow diffusion component detected by MEM-FCS. Furthermore, these results highlight the utility of MEM-FCS and SMT for gaining complementary information on molecular diffusion processes in heterogeneous material systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A mathematical assessment of the isolation random forest method for anomaly detection in big data

We present the mathematical analysis of the Isolation Random Forest Method (IRF Method) for anomaly detection, proposed by Liu F.T., Ting K.M. and Zhou Z. H. in their seminal work as a heuristic method for anomaly detection in Big Data. We prove that the IRF space can be endowed with a probability induced by the Isolation Tree algorithm (iTree). In this setting, the convergence of the IRF method is proved, using the Law of Large Numbers. Here, a couple of counterexamples are presented to show that the method is inconclusive and no certificate of quality can be given, when using it as a means to detect anomalies. Hence, an alternative version of the method is proposed whose mathematical foundation is fully justified. Furthermore, a criterion for choosing the number of sampled trees needed to guarantee confidence intervals of the numerical results is presented. Finally, numerical experiments are presented to compare the performance of the classic method with the proposed one.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Assessing pore network heterogeneity across multiple scales to inform CO2 injection models

Geologic heterogeneity is a key feature that must be considered when translations of scaled data are performed. This paper presents the assessment of geologic heterogeneity using a multiscale workflow that includes image analysis-based methods coupled with well log analysis to provide data in which fractals and machine learning methods estimate the carbon dioxide (CO 2 ) storage resource potential of a reservoir. The heterogeneity of rock properties of the complex Bell Creek reservoir in Montana, USA, was explored at the pore scale (~nm to mm), core scale (~mm to m), and well scale (~cm to m). The data used in this study included advanced image analysis of micro-CT (computed tomography) images (pore scale), thin sections (pore scale), plugs and core images (core scale) and well logs (well scale). The micro-CT images were segmented using a U-net segmentation approach into objects of pores and grains. Further, the segmented images were reconstructed into subvolumes of different sizes. Physical properties (porosity and permeability) and fractal dimensions were calculated for the various subvolumes, and Lorenz coefficient (Lc) values, a single parameter to describe the degree of heterogeneity within a pay zone section, were calculated from thin-section images and well logs. Porosity and fractal dimension values were used to estimate the 188-µm threshold of representative elementary volume (REV) in this study. Both the Lc and fractal dimension values were found to be negatively correlated. When these two parameters are combined, it is possible to discern differences in the complex porous networks of the samples analyzed in this study.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Developing Data-Driven Synthetic Infrastructure Models for Resilience Analysis

Research on infrastructure resilience has produced promising methods to simulate and optimize complex networks to improve performance. However, restrictions on sharing infrastructure models and the steep cost of developing and maintaining infrastructure models presents a roadblock to adoption. To overcome this limitation, this research focuses on methods to create data-driven infrastructure models that will help improve infrastructure resilience and security. The analysis couples incomplete utility data, geospatial data, machine learning, and synthetic network generation methods to rapidly develop and update infrastructure models. The methods are validated using realistic utility models and site-specific data, with a focus on Puerto Rico due to its unique infrastructure challenges and available data. This research highlights promising opportunities for the use of synthetic network generation and machine learning to create infrastructure models when very little data is available. Results demonstrate that hybrid methods, which combine sparse utility data with synthetic models, can enhance model accuracy, and machine learning can predict model attributes using training data from other models. However, the complexity of infrastructure systems means that even minor changes in network connectivity can significantly impact simulation results. Resilience analysis using synthetic infrastructure models shows that while some system behaviors are preserved, the magnitude of disruptions may not be accurately represented, indicating the need for more research and validation before using synthetic models for critical infrastructure investment decisions. The framework outlined in this report represents a significant advance to infrastructure model development and could be applied to additional domains and sites. Future research will continue to streamline and validate methods to help reduce roadblocks to resilience analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2017

Constraining DALECv2 using multiple data streams and ecological constraints: analysis and application

We use a variational method to assimilate multiple data streams into the terrestrial ecosystem carbon cycle model DALECv2 (Data Assimilation Linked Ecosystem Carbon). Ecological and dynamical constraints have recently been introduced to constrain unresolved components of this otherwise ill-posed problem. We recast these constraints as a multivariate Gaussian distribution to incorporate them into the variational framework and we demonstrate their advantage through a linear analysis. By using an adjoint method we study a linear approximation of the inverse problem: firstly we perform a sensitivity analysis of the different outputs under consideration, and secondly we use the concept of resolution matrices to diagnose the nature of the ill-posedness and evaluate regularisation strategies. We then study the non-linear problem with an application to real data. Finally, we propose a modification to the model: introducing a spin-up period provides us with a built-in formulation of some ecological constraints which facilitates the variational approach.

58 GEOSCIENCES↗
DOE OSTI2016

Global Sensitivity and Data-Worth Analyses in iTOUGH2: User's Guide

This manual explains the use of local sensitivity analysis, the global Morris OAT and Sobol’ methods, and a related data-worth analysis as implemented in iTOUGH2. In addition to input specification and output formats, it includes some examples to show how to interpret results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Critical analysis of velocimetry methods for particulate flows from synthetic data

Particle tracking methods that extract high-fidelity particle velocity data from high speed video of particle laden flows is a common experimental technique applied to chemical processes. These measurements are used to better understand the motion of particles and fluids in complex systems and create data against which computational models are validated. However, the methods, codes, and experimental setups all have limitations. It is imperative that practitioners verify the methods and their implementation as well as understand the limitations of experimental setups. This work focuses on quantifying the visible depth of field in a high particle concentration fluidized bed. Following a precedent set by the particle imaging velocimetry community, a particle velocity field is manufactured using a computational fluid dynamics and discrete element method simulation. Photo realistic high-speed videos are rendered based on the simulated data using the three-dimensional creation software Blender. Particle velocities are extracted from the synthetic high-speed videos using three variants of Particle Tracking Velocimetry and Optical Flow Velocimetry methodologies. Here, the tracked results are then compared to the known solution, quantifying the error associated with the assumed visible depth. The results indicate that at depth of one particle diameter, all three particle tracking codes give accurate measurements, largely within 5%. However, the error increases when the full bed video measurements are compared to the known solution at one particle diameter, i.e., mimicking a validation study. Finally, for some statistics the constant depth assumption only increases the error slightly, for others significantly.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A Short-Term Solar Forecasting Platform Using a Physics-Based Smart Persistence Model and Data Imputation Method

Electrical energy plays vital role in our socio-economic activity and therefore ensuring the reliability of the electric grid, from the generation, transmission and distribution level is critical. In order to maintain the power system parameter viz., frequency, voltage, etc., optimally, balancing of generation and consumption is very much essential. However, solar energy is infirm power by nature this is due to cloud cover / other local phenomena. Hence, Photovoltaic (PV) power generation brings a significant challenge to the grid operator due to the variability of the solar energy. The complexity of this challenge in terms of planning and dispatch ability of PV resources, aggravates with the high penetration of solar energy into the electric grid. In this setting, reliable solar radiation forecasting models based on accurate and quality input data become essential. In order to develop a suitable model for predicting solar radiation, quality historical / real time measurement is also needed. Under this study NIWE and NREL jointly developed / tested short-term solar forecasting frameworks using a smart persistence and physics-based smart persistence models for intra-hour forecasting of solar radiation (PSPI) and benchmarked 9 different data imputation techniques in 15 Solar Radiation Resource Assessment (SRRA) stations, located at different parts of India. During any measurement campaign, due to various technical reasons, we may miss few observations. However, the missing observation often reduce the performance of any forecasting model. Therefore, suitable data imputation method would assist us to obtain continuous observation of solar radiation. A station-by-station and method-by-method analysis was carried out to understand the performance of each model. Based on our analysis, among all the data imputation methods, the Kalman data imputation method is better for Indian Weather condition. In addition, Kalman StructTS, Linear, Stine and Arima methods yield slightly inferior accuracy compared to Kalman, but outperform the other methods. The extended solar radiation data are used by solar forecasting models to provide the prediction of solar radiation at 15 SRRA stations. As far as short term forecasting model is concerned, the PSPI model outperforms the Smart Persistence model. However, the forecast error is increases with the forecasting horizon.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

MODELING AND PARAMETRIC STUDY OF END-GAS AUTOIGNITION TO ALLOW THE REALIZATION OF ULTRA-LOW EMISSIONS, HIGH-EFFICIENCY HEAVY-DUTY SPARK-IGNITED NATURAL GAS ENGINES

Engine knock and misfire are barriers to pathways leading to high-efficiency Spark-Ignited (SI) Natural Gas (NG) engines. The general tendency to knock is highly dependent on engine operating conditions and the fuel reactivity. The problem is further complicated by the low emission limits and the wide range of chemical reactivity in pipeline-quality natural gas. Depending on the region and the source of the natural gas, its reactivity, described by its Methane Number (MN), which is analogous to the Octane Number for liquid SI fuels, can span from 65 to 95. In order to realize diesel-like efficiencies, SI NG engines must be designed to operate at high Brake Mean Effective Pressures (BMEP), near or beyond knock limits, over a wide range of fuel reactivity. This requires a deep understanding of the combustion-engine interactions pertaining to flame propagation and End-Gas Autoignition (EGAI), i.e., the autoignition of the unburned gas (end gas) ahead of the flame front. However, EGAI, if controlled, provides an opportunity to increase SI NG engine efficiency by increasing the combustion rate and the total fraction of burned fuel, mitigating the effects of the slow flame speeds characteristic of natural gas fuels, which generally reduce BMEP and increase unburned hydrocarbon emissions. For this reason, to realize diesel-like efficiencies and ultra-low emissions on SI NG engines, this work proposes the study of the main parameters influencing the modeling and prediction of NG EGAI to allow for its control. In this work, a novel EGAI detection and onset determination method was developed to reliably quantify EGAI for data analysis and engine control. The new method allowed the prediction of EGAI on SI NG engines without the need to use engine- and operating-condition-dependent thresholds and reduced the error in quantifying the fraction of the total energy released by the EGAI event by up to 40%pts. One- and three-dimensional engine models were then developed to study the engine/fuel interactions that lead to NG EGAI and its performance benefits. These models, although having decent agreement with experimental data, showed the need to account for NOx chemistry when predicting NG EGAI due to a consistently later prediction of the EGAI onset (~1.65 crank-angle degrees) and thus, a new reduced chemical mechanism for real NG fuels was developed containing NOx chemistry. The new reduced mechanism improved the EGAI onset prediction agreement to within ±0.5 crank-angle degrees and decreased simulation time during combustion by nearly 50% when using the further reduced AREIS50NOx chemical mechanism. These models were then used to study the role of NG composition on EGAI, evaluate the engine/fuel interactions leading to NG EGAI, and perform engine optimization while leveraging EGAI to increase thermal efficiency. Piston design optimization combined with a Controlled EGAI (C-EGAI) combustion mode allowed a Heavy-Duty (HD) SI NG engine to operate at diesel-like efficiencies, i.e., Brake Thermal Efficiency (BTE) ≥44%. Experimental and modeling data analysis revealed that earlier and faster heat release increases combustion efficiency by an average of 1%pts, increases work transferred to the piston resulting in a decrease in exhaust losses by 50% depending on the engine operating condition while slightly increasing heat losses. Finally, the simulation results revealed an opportunity to further enhance the BTE (up to 50%) by enabling C-EGAI combustion at leaner conditions, λ=1.4-1.6.

Bestel, Diego Bernardi↗
DOE OSTI2017

Chapter 15: Reliability of Wind Turbines

The global wind industry has witnessed exciting developments in recent years. The future will be even brighter with further reductions in capital and operation and maintenance costs, which can be accomplished with improved turbine reliability, especially when turbines are installed offshore. One opportunity for the industry to improve wind turbine reliability is through the exploration of reliability engineering life data analysis based on readily available data or maintenance records collected at typical wind plants. If adopted and conducted appropriately, these analyses can quickly save operation and maintenance costs in a potentially impactful manner. This chapter discusses wind turbine reliability by highlighting the methodology of reliability engineering life data analysis. It first briefly discusses fundamentals for wind turbine reliability and the current industry status. Then, the reliability engineering method for life analysis, including data collection, model development, and forecasting, is presented in detail and illustrated through two case studies. The chapter concludes with some remarks on potential opportunities to improve wind turbine reliability. An owner and operator's perspective is taken and mechanical components are used to exemplify the potential benefits of reliability engineering analysis to improve wind turbine reliability and availability.

17 WIND ENERGY↗
DOE OSTI2020

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

High definition large area mapping of geological samples using a Maia detector array in the Nuclear Microprobe

A Maia detector array has been utilized and installed on the CSIRO-MARC Nuclear Microprobe. Maia uses an annular array of 384 silicon detectors to provide a solid-angle of 1.3 sr to improve the collection of X-rays induced by Particle Induced X-ray Emission (PIXE) using a micron focussed MeV proton beam. It features event-by-event data acquisition with dead-time correction and pileup rejection and a total count-rate capacity above 10 M/s, versatile stage and beam scanning modes (coupled to the DAQ-36 system described previously) to cater for a variety of sample configuration and experimental needs, precise measurement of transit time and integration of beam fluence per pixel, and spectral deconvolution of event data in real-time using the Dynamic Analysis method to provide element images during data collection. In this work we demonstrate the system on thin sections made from geological samples extracted from active seafloor hydrothermal vents in the PACMANUS hydrothermal field in Papua New Guinea.

36 MATERIALS SCIENCE↗
DOE OSTI2014

High-Performance Computation of Distributed-Memory Parallel 3D Voronoi and Delaunay Tessellation

Computing a Voronoi or Delaunay tessellation from a set of points is a core part of the analysis of many simulated and measured datasets: N-body simulations, molecular dynamics codes, and LIDAR point clouds are just a few examples. Such computational geometry methods are common in data analysis and visualization; but as the scale of simulations and observations surpasses billions of particles, the existing serial and shared-memory algorithms no longer suffice. A distributed-memory scalable parallel algorithm is the only feasible approach. The primary contribution of this paper is a new parallel Delaunay and Voronoi tessellation algorithm that automatically determines which neighbor points need to be exchanged among the subdomains of a spatial decomposition. Other contributions include periodic and wall boundary conditions, comparison of our method using two popular serial libraries, and application to numerous science datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Probabilistic neural networks for improved analyses with phenomenological R -matrix

Here we present a method for measurement analyses based on probabilistic deep neural networks that provide several advantages over conventional analyses with phenomenological models. These include predicting physical quantities directly from data, the rapid generation of statistically robust uncertainties, and the ability to bypass some parameters that may induce ambiguities and complications in data analysis. As deep learning methods make predictions through “black boxes,” the uncertainty quantification is typically challenging. We use a probabilistic framework that provides thorough uncertainty quantification and is straightforward to follow in practice. With the network architecture based on the Transformer, we demonstrate the current method for predicting nuclear resonance parameters from scattering data using the phenomenological R-matrix model.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗