Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Common risk segment mapping: Streamlining exploration for carbon storage sites, with application to coastal Texas and Louisiana

Large-scale deployment of Carbon Capture and Storage (CCS) will require a commensurately large number of sites. Efficient screening methods are needed to create investment assurance and focus efforts on the most promising sites. The problem is similar to petroleum exploration, for which there are well-developed (though seldom published) workflows, including Common Risk Segment (CRS) mapping. In brief, the process requires 1) defining the key play elements; 2) identifying candidate geologic intervals for each; 3) creating fact-based maps for those intervals; 4) determining minimum criteria for the success of each element; 5) reinterpreting the fact-based maps in terms of chance of success; and 6) combining the individual maps to form a composite, basin-scale view of prospectivity. We adapt the CRS process to screening for CO 2 storage sites. Critically, we redefine the process in terms of cost of characterization and development, rather than chance of success. For illustration, we apply the process to the example of the Lower Miocene on the Texas and Louisiana Gulf Coast. We show that the predictions are consistent with historic hydrocarbon production volumes and rates. The power of the CRS method is that it creates a systematic approach to geologic evaluation and translates complex, multidimensional analysis into clear, graphical and easily comprehended business inputs. The results highlight sweet spots and identifies critical risks, suggesting a focus for further data collection and analysis. Furthermore, the method developed here can be applied to both surface and subsurface factors anywhere that there is interest in geologic storage of CO 2 .

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Using the Monte Carlo Method to Evaluate the Reliability of Screening Multifamily Housing for Radon

When screening for radon in a multifamily housing complex using a fixed sample density (e.g., testing 1 in 10 (10%) or 1 in 4 units (25%)), the statistical confidence is dependent upon the assumed elevated radon frequency. For example, testing 25% of units in a complex estimated to have eight units with elevated radon levels will provide 90% confidence. However, if it is assumed that, in the same complex, there are only three units with elevated radon levels, the confidence drops to around 58% for the same sample density. Furthermore, in the previous example, if elevated radon levels are not found during the screening, all that can be stated is that the screening provides 90% confidence that there are no more than seven units in the complex with elevated radon levels. To more fully illustrate this uncertainty, ten separate multifamily housing radon data sets with 1 to 10 units with radon levels ≥4 pCi/L (Table 1) were selected for analysis using the Monte Carlo statistical method. Unlike other mathematically based statistical approaches, the Monte Carlo statistical method relies on repeated analysis of randomly selected data. from a 100% sampled complex at various sample densities. Success for each simulation is defined as finding at least one unit with elevated radon levels. In this statistical method, confidence in the overarching conclusion can be greatly enhanced by repeating the simulated screening hundreds or even thousands of times. For this study, each of the ten data sets was simulated 1,000 times. For each simulation, the data set was randomized three times before the fixed percentage of data was selected.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗
DOE OSTI2018

Advanced Gate Dielectric Materials for Next-Generation Integrated Circuits

The growth of Sr on n-type Si(001) was studied in detail for coverages between 0 and 1 monolayer (ML) using core level photoemission spectroscopy. In a similar manner, the Sr saturation coverage was studied in the 600–925°C temperature range. Data analysis was carried out by a method that allows accurate determination of the band-bending shifts. Using this method it is possible to pinpoint the formation and destruction of chemical species from bungled core level photoemission data without needing to know details of the chemical composition of the spectra. Through this analysis it was established that the interaction between Sr and Si breaks down the binding energy difference between upward and downward Si dimer atoms. In addition, it was found that the saturation coverage exhibits a clear plateau at 1 ML around 650°C, and a slope change at 1/3 ML around 850°C. The surface band bending suffers a discontinuous increase as the Sr coverage surpasses 1 ML and as the low energy electron diffraction symmetry changes from [2x3] to [2x1].

36 MATERIALS SCIENCE↗
DOE OSTI2018

Cost benefit analysis for smart grid projects

The U.S. is unusual in that a definition of the term “smart grid” was written into legislation, appearing in the Energy Independence and Security Act (2007). When the recession called for stimulus spending and the American Recovery and Reinvestment Act (ARRA, 2009) was passed, a framework already existed for identification of smart grid projects. About $4.5B of the U.S. Department of Energy’s (U.S. DOE’s) $37B allocation from ARRA was directed to smart grid projects of two types, investment grants and demonstrations. Matching funds from other sources more than doubled the total value of ARRA-funded smart grid projects. The Smart Grid Investment Grant Program (SGIG) consumed all but $620M of the ARRA funds, which was available for the 32 projects in the Smart Grid Demonstration Program (SGDP, or demonstrations). Given the economic potential of these projects and the substantial investments required, there was keen interest in estimating the benefits of the projects (i.e., quantifying and monetizing the performance of smart grid technologies). Common method development and application, data collection, and analysis to calculate and publicize the benefits were central objectives of the program. For this purpose standard methods and a software tool, the Smart Grid Computational Tool (SGCT), were developed by U.S. DOE and a spreadsheet model was made freely available to grantees and other analysts. The methodology was intended to define smart grid technologies or assets, the mechanisms by which they generate functions, their impacts and, ultimately, their benefits. The SGCT and its application to the Demonstration Projects are described, and actual projects in Southern California and in China are selected to test and illustrate the tool. The usefulness of the methodology and tool for international analyses is then assessed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

libIS: a lightweight library for flexible in transit visualization

As simulations grow in scale, the need for in situ analysis methods to handle the large data produced grows correspondingly. One desirable approach to in situ visualization is in transit visualization. By decoupling the simulation and visualization code, in transit approaches alleviate common difficulties with regard to the scalability of the analysis, ease of integration, usability, and impact on the simulation. We present libIS, a lightweight, flexible library which lowers the bar for using in transit visualization. Our library works on the concept of abstract regions of space containing data, which are transferred from the simulation to the visualization clients upon request, using a client-server model. We also provide a SENSEI analysis adaptor, which allows for transparent deployment of in transit visualization. We demonstrate the flexibility of our approach on batch analysis and interactive visualization use cases on different HPC resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

ADAPTIVE ANNEALED IMPORTANCE SAMPLING FOR MULTIMODAL POSTERIOR EXPLORATION AND MODEL SELECTION WITH APPLICATION TO EXTRASOLAR PLANET DETECTION

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior. To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Verification of Sulfate Attack Penetration Rates for Saltstone Disposal Unit Modeling

Recent Special Analysis modeling of Saltstone Disposal Units consider sulfate attack on concrete and utilize degradation rates estimated from Cementitious Barriers Partnership software simulations. This study provides an independent verification of those simulation results using an alternative analysis method and an independent characterization data source. The sulfate penetration depths estimated herein are similar to the best-estimate values in SRNL-STI-2013-00118 Rev. 2 and well below the nominal values subsequently used to define Saltstone Special Analysis base cases.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2015

DrSPINE - New approach to data reduction and analysis for neutron spin echo experiments from pulsed and reactor sources

Neutron spin echo (NSE) method at a pulsed neutron source presents new challenges to the data reduction and analysis as compared to the instruments installed at reactor sources. The main advantage of the pulsed source NSE is the ability to resolve the neutron wavelength and collect neutrons over a wider bandwidth. This allows us to more precisely determine the symmetry phase and measure the data for several Q-values at the same time. Based on the experience gained at the SNS NSE - the first, and to date the only one, NSE instrument installed at a pulsed spallation source, we propose a novel and unified approach to the NSE data processing.

Monkenbusch, Michael↗
DOE OSTI2022

A Combined Computer Vision and Deep Learning Approach for Rapid Drone-Based Optical Characterization of Parabolic Troughs

Optical accuracy is a primary driver of parabolic trough concentrating solar power (CSP) plant performance, but can be damaged by wind loads, gravity, error during installation, and regular plant operation. Collecting and analyzing optical measurements over an entire operating parabolic trough plant is difficult, given the large scale of typical installations. Distant Observer, a software tool developed at the National Renewable Energy Laboratory, uses images of the absorber tube reflected in the collector mirror to measure both surface slope in the parabolic mirror and offset of the absorber tube from the ideal focal point. This technology has been adapted for fast data collection using low-cost commercial drones, but until recently still required substantial human labor to process large amounts of data. A new method leveraging advanced deep learning and computer vision tools can drastically reduce the time required to process images. This new method addresses the primary analysis bottleneck, identifying featureless, reflective mirror corner points to a high degree of accuracy. Recent work has shown promising results using computer vision methods. The combined deep learning and computer vision approach presented here proved highly effective and has the potential to further automate data collection and analysis, making the tool more robust. The method presented in this paper automatically identified 74.3% of mirror corners within 2 pixels of their manually marked counterparts and 91.9% within 3 pixels. This level of accuracy is sufficient for practical Distant Observer analysis within a target uncertainty. A commercial drone collected video of over 100 parabolic trough modules at an operating CSP plant to demonstrate the deep learning and computer vision method's usefulness in processing large amounts of data. These troughs were successfully analyzed using Distant Observer, paired with the new deep learning and computer vision algorithm, and can provide plant operators and trough designers with valuable insight about plant performance, operating strategies, and plant-wide optical error trends.

computer vision↗
DOE OSTI2024

Accelerating Multivariate Functional Approximation Computation with Domain Decomposition Techniques⋆

Modeling large datasets through Multivariate Functional Approximations (MFA) provide an elegant way to handle many visualization and scientific analysis workflows. The process necessitates scalable data partitioning methods to compute MFA representations efficiently without compromising the accuracy or continuity of the reconstructed solution. We propose a domain -decomposed method for computing the MFA with B -spline bases, which reduces the total work per task and uses a restricted Additive Schwarz (RAS) method to converge the control point data degrees -of -freedom along subdomain boundaries. We provide an in-depth analysis of the parallel approach with domain decomposition solvers, aiming to minimize local subdomain error residuals and recover high -order continuity at subdomain interfaces with appropriate choices of knot overlaps. The communication cost, determined by the overlap regions in the RAS implementation, is optimized to recover the numerical error profile of the single subdomain case. Our proposed method stands in contrast to previous methods, which typically only recover either C 0 or at best C 1 continuity for arbitrary B -spline degree expansions, or those that require post -processing to blend discontinuities in the reconstructed data. We demonstrate the effectiveness of our approach using analytical and real -world datasets in 1D, 2D, and 3D through both strong and weak scaling studies. The performance results indicate that the overall cost of computing the approximation is directly proportional to the underlying nearest -neighbor communication implementation, and is only weakly dependent on the overlap region size that determines the size of the messages. This finding underscores the efficiency and scalability of our proposed method, making it a promising solution for handling large datasets in scientific workflows.

additive Schwarz solvers↗
DOE OSTI2022

Mitigate: An Adaptive Network Data Anonymization Tool Using Condensation-Based Differential Privacy

Modern network devices collect a large amount of data that can be analyzed to identify bottlenecks, anomalies, cyber-attacks, etc. Therefore, there is often a need to analyze such collections of network data quite often by an external expert or by the research community. However, these collections of data contain sensitive, proprietary information. In order for the network data to be shared, it must first be anonymized. The overall objective of this project is to develop an innovative privacy management tool to anonymize network data and achieve sufficient privacy, acceptable data utility, and efficient data analysis at the same time. No existing anonymization methods can achieve all of these at the same time. The core of this technology is a differential private clustering algorithm that provides strong privacy protection, preserves data properties important for subsequent analysis, and allows the party receiving the anonymized data to conduct analysis directly on anonymized data without the need of decryption or any extra processing. The research carried out was to design, implement and verify a solution to this problem by completing the following tasks: 1) developing the core technology; 2) developing a context based method that automatically recommends fields that must be anonymized; 3) conducted experiments showing superior results using our approach compared to existing tools, and 4) developed an intuitive but basic user interface. The research that was conducted generated novel algorithmic techniques that utilize state-of-the-art methods such as condensation, differential privacy preservation, clustering, automated tuning based on contextual awareness, and recommendation techniques to specify columns to users for anonymization leading to optimal privacy that allows research analysis on the dataset. Experiments were conducted to evaluate the efficacy of these novel algorithmic techniques by performing analysis on original non-anonymized datasets, then conducting analysis on the same yet anonymized datasets and comparing the results of the analyses. Overall, the anonymized analysis results were within 1% of the original results, verifying that the generated technology not only guarantees a high level of privacy but also enables research analysis as if it were conducted on the original dataset. Potential applications of this technology include anonymization of any type of structured network datasets that contain sensitive identifiers, such as IP addresses, that can be used in multiple applications. For example, to create an AI or machine learning model for cyber security, e.g., to detect attacks, or for performance analysis, e.g., identify bottlenecks or predict performance. In addition, a market analysis that was conducted for potential applications of this technology identified a broader range of applications of our anonymization technology beyond the network sector that includes healthcare, banking, insurance, securities, finance (FISB), data brokering, cloud services, ad sales, and government.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Topological data analysis and machine learning for recognizing atmospheric river patterns in large climate datasets

Identifying weather patterns that frequently lead to extreme weather events is a crucial first step in understanding how they may vary under different climate change scenarios. Here, we propose an automated method for recognizing atmospheric rivers (ARs) in climate data using topological data analysis and machine learning. The method provides useful information about topological features (shape characteristics) and statistics of ARs. We illustrate this method by applying it to outputs of version 5.1 of the Community Atmosphere Model version 5.1 (CAM5.1) and the reanalysis product of the second Modern-Era Retrospective Analysis for Research and Applications (MERRA-2). An advantage of the proposed method is that it is threshold-free – there is no need to determine any threshold criteria for the detection method – when the spatial resolution of the climate model changes. Hence, this method may be useful in evaluating model biases in calculating AR statistics. Further, the method can be applied to different climate scenarios without tuning since it does not rely on threshold conditions. We show that the method is suitable for rapidly analyzing large amounts of climate model and reanalysis output data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Data Analysis Approaches for the Risk-Informed Safety Margins Characterization Toolkit

In the past decades, several numerical simulation codes have been employed to simulate accident dynamics (e.g., RELAP5-3D, RELAP-7, MELCOR, MAAP). In order to evaluate the impact of uncertainties into accident dynamics, several stochastic methodologies have been coupled with these codes. These stochastic methods range from classical Monte-Carlo and Latin Hypercube sampling to stochastic polynomial methods. Similar approaches have been introduced into the risk and safety community where stochastic methods (such as RAVEN, ADAPT, MCDET, ADS) have been coupled with safety analysis codes in order to evaluate the safety impact of timing and sequencing of events. These approaches are usually called Dynamic PRA or simulation-based PRA methods. These uncertainties and safety methods usually generate a large number of simulation runs (database storage may be on the order of gigabytes or higher). The scope of this paper is to present a broad overview of methods and algorithms that can be used to analyze and extract information from large data sets containing time dependent data. In this context, “extracting information” means constructing input-output correlations, finding commonalities, and identifying outliers. Some of the algorithms presented here have been developed or are under development within the RAVEN statistical framework.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Modeling and Analysis Methods for an On-line Enrichment Monitor

The International Atomic Energy Agency (IAEA) has developed an On-Line Enrichment Monitor (OLEM) as one possible component in a new generation of safeguards measures for uranium enrichment plants. The OLEM measures 235U emissions from the UF6 gas flowing through a unit header pipe using NaI(Tl) spectrometers, and corrects for gas density changes using pressure and temperature sensors in order to determine the enrichment of the gas as a function of time. In parallel with the OLEM instrument development, a Virtual OLEM (VOLEM) software tool has been developed that is capable of producing synthetic gamma-ray, pressure, and temperature data representative of a wide range of enrichment plant operating conditions. VOLEM complements instrument development activities and allows the study of OLEM for scenarios that will be difficult or impossible to evaluate empirically. Uses of VOLEM include: investigation of hardware design options; inter-comparison of candidate gamma-ray spectral analysis and enrichment estimation algorithms; uncertainty budget analysis and performance prediction for typical and atypical operational scenarios; and testing of the OLEM data acquisition, analysis and reporting software. This paper describes the technical foundations of VOLEM and illustrates how it can be used. An overview of the nominal instrument design and deployment scenario for OLEM is provided, with emphasis on the key online-assay measurement challenge: accurately determining the portion of the total 235U signal that comes from a background that includes solid uranium deposits on the piping walls. Monte Carlo modeling tools, data analysis algorithms and uncertainty quantification methods are described. VOLEM is then used to quantitatively explore the uncertainty budgets and predicted instrument performance for a plausible range of typical plant operating parameters, and one set of candidate analysis algorithms. Additionally, a series of VOLEM case studies illustrates how an online enrichment monitor might respond in scenarios expected to be atypical, for example weak pressure transients or significant changes in background levels.

Smith, Leon E.↗
DOE OSTI2019

Timestamp Shift Detection for Synchrophasor Data Based on Similarity Analysis between Relative Phase Angle and Frequency

Timestamp Shift (TS) in synchrophasor data can lead to false operation of synchrophasor-based wide-area monitoring, protection and control applications. The letter presents a method to detect TS of synchrophasor data based on similarity analysis between its own relative phase angle and frequency. Here, a linear correlation component, caused by TS, between relative phase angle and measured frequency is discovered via theoretical derivation. Then a detection method is developed utilizing this linear component for TS diagnosis. Firstly, system phase angle is leveraged as angle reference and then relative phase angle is calculated. Secondly, the correlation coefficient between relative phase angle and frequency is calculated for similarity analysis. Thirdly, the TS is detected via threshold criterion and corresponding time error is estimated. The effectiveness of this method is validated via experiments with actual synchrophasor data in FNET/Grideye.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Automated Classification and Analysis of Non-metallic Inclusion Data Sets

The aim of this study is to utilize principal component analysis (PCA), clustering methods, and correlation analysis to condense and examine large, multivariate data sets produced from automated analysis of non-metallic inclusions. Non-metallic inclusions play a major role in defining the properties of steel and their examination has been greatly aided by automated analysis in scanning electron microscopes equipped with energy dispersive X-ray spectroscopy. The methods were applied to analyze inclusions on two sets of samples: two laboratory-scale samples and four industrial samples from a near-finished 4140 alloy steel components with varying machinability. The laboratory samples had well-defined inclusions chemistries, composed of MgO-Al{sub 2}O{sub 3}-CaO, spinel (MgO-Al{sub 2}O{sub 3}), and calcium aluminate inclusions. The industrial samples contained MnS inclusions as well as (Ca,Mn)S + calcium aluminate oxide inclusions. PCA could be used to reduce inclusion chemistry variables to a 2D plot, which revealed inclusion chemistry groupings in the samples. Clustering methods were used to automatically classify inclusion chemistry measurements into groups, i.e., no user-defined rules were required.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Commercial, industrial, and institutional discount rate estimation for efficiency standards analysis: Sector-level data 1998–2021

Underlying each of the Department of Energy’s (DOE’s) federal appliance and equipment energy conservation standards are a set of complex analyses of the projected costs and benefits of regulation. Any new or amended standard must be designed to achieve significant additional energy conservation, provided that it is technologically feasible and economically justified (42 U.S.C. 6295(o)(2)(A)). DOE determines economic justification based on whether the benefits exceed the burdens, considering a variety of factors, including the economic impact of the standard on consumers of the product and the savings in lifetime operating cost compared to any increase in price or maintenance expenses (42 U.S.C. 6295(o)(2)(B)). As part of this determination, DOE conducts a Life-Cycle Cost (LCC) analysis, which models the combined impact of appliance first cost and operating cost changes on a representative commercial building sample in order to identify the fraction of customers achieving LCC savings or incurring net cost at the considered efficiency levels. Thus, the commercial discount rate value(s) used to calculate the present value of energy cost savings within the LCC model implicitly plays a role in estimating the economic impact of potential standard levels. This report provides an in-depth discussion of the commercial discount rate estimation process. It is an update to previous reports on estimating commercial discount rates from firm-level financial data (Fujita, 2016). Major topics covered in this report include: Discount rate estimation methods and rationale; -Data sources used and data limitations; -Discount rate distributions for use in standards analysis; -Discount rate estimation methods and distributions specific to the small business subgroup analysis. Going forward, this report will be updated as data allow and analyses necessitate.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗