Search NASA⌕ Search

SEARCH · Search NASA

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

System and Method for Providing a Climate Data Analytic Services Application Programming Interface

A system, method and computer-readable storage devices for providing a climate data analytic services application programming interface. The system includes a programming library that enables client device software to invoke the capabilities of a climate data analytics system through requests to various services supported by the climate data analytics system, and also includes a client-side communications interface that enables the programming library's methods to interact with a climate data analytics system's server interface to obtain access to the capabilities of the system. In one implementation, the programming library is implemented in the Python programming language. The programming library can include basic utilities that call a single, server-side method implemented by one of the various services supported by the climate data analytics system, and extended utilities that call a series of basic utilities and/or other extended utilities that have been placed under programmatic control in order to create client-side convenience methods and workflows.

Schnase, John L.↗
NASA NTRS2018

Future of Big Earth Data Analytics

The state of the art of Big Earth Data Analytics can be expected to evolve rapidly in the coming years. The forces driving evolution come from both growth in the data and advancement in the field of data analytics. In the data area, advances in sensor instrumentation and platform miniaturization are increasing both data resolution and coverage, resulting in enormous growth in data Volume. Increases in temporal resolution in particular also generate demands for higher data Velocity. At the same time, the proliferation of instruments and the platforms on which they reside is increasing the Variety of datasets. The Variety increase in turn leads to questions about the Veracity of the data. In the algorithm area, powerful machine learning methods are coming to the fore, particularly Deep Neural Networks. These are powerful at detecting interesting features in the data, integrating many different measurements (i.e., data fusion), and classification problems. However, they are still challenging when seeking explanations of how natural or socio-economic phenomena work using Earth Observations. Thus, classical analysis techniques will remain relevant when the emphasis is on forming or testing explanations, as well as to support interactive data exploration.

Lynnes, Christopher↗
NASA NTRS2016

System and Method for Providing a Climate Data Analytic Services Application Programming Interface Distribution Package

A system, method and computer-readable storage devices for providing a climate data analytic services application programming interface distribution package. The example system can provide various components. The system provides a climate data analytic services application programming interface library that enables software applications running on a client device to invoke the capabilities of a climate data analytic service. The system provides a command-line interface that provides a means of interacting with a climate data analytic service by issuing commands directly to the system's server interface. The system provides sample programs that call on the capabilities of the application programming interface library and can be used as templates for the construction of new client applications. The system can also provide test utilities, build utilities, service integration utilities, and documentation.

Schnase, John L.↗
NASA NTRS2019

A Web of Data Analytics Services

Cloud Computing has become the ubiquitous approach to our Big Data challenge. However, one will quickly discover that moving (a.k.a. forklifting) existing on-premise data analytics solutions to the Cloud doesn’t always translate to costing saving and performance boost. The Cloud’s elasticity, its availability, and its wide selection of computing options and selections of costing models making Cloud an attractive environment to tackle our Big Data challenge. The fact is Cloud, on its own, is not the silver bullet to our daunting challenge need for analyze and derive scientific inferences through vast collections of multi-sensor measurements. We would like to have all scientific data in one easy to access environment, but getting the world of scientific data in one analytic system is immensely difficult to achieve. This paper describes the data analytics web architecture NASA is developing by infusing instances of Integrated Data Analytics systems next to the data. The goal is to minimize unnecessary data movement through collection of data access and analytics webservices for researchers to interact with and analyze measurements without have to download data to their local computer. These services are RESTful and provisioned by the data centers with the help from subject matter and science experts. These services encapsulate the physical computing infrastructure, which could local computing cluster, on-premise or public Cloud environment.

Huang, Thomas↗
DOE OSTI2023

High-dimensional data analytics in civil engineering: A review on matrix and tensor decomposition

Recent developments in sensing and monitoring techniques have led to the generation of high-dimensional data in the field of civil engineering. High-dimensional data analytics methods have thus been developed to interpret such complex data. Among the different high-dimensional data analytics techniques, matrix and tensor decomposition methods have acquired a notable interest in the civil engineering community over the past decade. Due to their unique ability to deal with highly redundant and correlated data, these methods are establishing themselves as promising and efficient tools to analyze high-dimensional data in the civil engineering arena. In this paper, high-dimensional data is referred to as a data set in which the number of features is comparable or larger than the number of observations. This review paper aims to summarize the applications of matrix and tensor decomposition methods in civil engineering over the last decade. The survey begins with a general overview of matrix and tensor decomposition followed by highlighting their significance in the field. Afterward, various applications of these high-dimensional data analytics methods in civil engineering are presented, while the advantages offered by these methods are discussed. Lastly, challenges and potential research avenues for employing matrix and tensor decomposition and future emerging trends for their novel use are highlighted.

42 ENGINEERING↗
DOE OSTI2018

Integrated Multi Scale Data Analytics and Machine Learning for the Grid; Benchmarking Algorithms and Data Quality Analysis

Machine Learning and Data Analytics are terms which are utilized now ubiquitously throughout grid analytics forums, as a potential solution to the growing big data challenges for the distribution grid. As sensors become inexpensive and common, and communication networks grow, the analytics themselves must adapt and enable consumers and providers to visualize and utilize the data provided effectively. Machine learning is one of the techniques proposed in order to manage this data deluge. This report is a subset of the work in this activity, funded through the DOE Grid Modernization Initiative, to summarize the benchmarking and review of data quality impact on the algorithm sets being developed within each use case area.

42 ENGINEERING↗
DOE OSTI2021

COTS Data Analytics Software User Manual: Version 1.0

Large volumes of data are being collected by Sandia National Laboratories as part of an active commercial-off-the-shelf (COTS) part testing and surveillance program. This user manual documents Python-based COTS Data Analytics software that has been developed for standardizing, displaying, visualizing, and analyzing the resulting COTS part testing and surveillance data. It is the objective of these software tools to streamline the analysis of COTS testing and surveillance data and improve the efficiency with which test engineers and data analytics experts can pinpoint possible performance and reliability problems in COTS parts.

42 ENGINEERING↗
DOE OSTI2020

Application of Systems Engineering Principles and Techniques in Biological Big Data Analytics: A Review

In the past few decades, we have witnessed tremendous advancements in biology, life sciences and healthcare. These advancements are due in no small part to the big data made available by various high-throughput technologies, the ever-advancing computing power, and the algorithmic advancements in machine learning. Specifically, big data analytics such as statistical and machine learning has become an essential tool in these rapidly developing fields. As a result, the subject has drawn increased attention and many review papers have been published in just the past few years on the subject. Different from all existing reviews, this work focuses on the application of systems, engineering principles and techniques in addressing some of the common challenges in big data analytics for biological, biomedical and healthcare applications. Specifically, this review focuses on the following three key areas in biological big data analytics where systems engineering principles and techniques have been playing important roles: the principle of parsimony in addressing overfitting, the dynamic analysis of biological data, and the role of domain knowledge in biological data analytics.

dynamic analysis↗
NASA NTRS2018

Climatespark: an In-Memory Distributed Computing Framework for Big Climate Data Analytics

The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple- dimensional, array-based datasets in various geoscience domains.

Hu, Fei↗
DOE OSTI2024

Materials Characterization, Prediction and Control Project: Summary Report on Data Analytics Framework

This report summarizes the activities performed under the data analytics Vertex in the Materials Characterization, Prediction and Control Project funded under laboratory directed research and development at Pacific Northwest National Laboratory. The data analytics Vertex developed models for associating global or local process parameters, microstructural features, and performance properties of friction-stir-processed 316L stainless steel plates. Statistical, machine learning, and deep learning models, as well as generative artificial intelligence approaches, were used to develop the associations between the process-structure-property data streams. These associations formed the basis for predicting global properties of parts manufactured under different process envelopes, providing a basis for predicting performance using data driven as well as physics-informed and physics-constrained approaches. Additionally, the associations were used to predict local process parameters and microstructural features of the product, predictive relationships that have the potential to form the basis of a control framework that could eventually modulate a friction-stir process to maintain product quality.

316L stainless steel↗
DOE OSTI2020

Analysis of Air-Purifying Respirator (APR) and Powered Air-Purifying Respirator (PAPR) Cartridge Performance Testing on a Hanford AP Tank Farm Exhauster Slipstream: Volume 2 Raw Analytical Data

As the Tank Operations Contractor for U.S. Department of Energy operations at the Hanford site in Washington State, Washington River Protection Solutions (WRPS) is responsible for managing highly radioactive wastes stored in tanks at Hanford. WRPS tests air-purifying respirator (APR) and powered air-purifying respirator (PAPR) chemical cartridges commonly used at Hanford Tank Farms to determine the period of time that the cartridges would provide adequate performance for APRs and PAPRs used to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPC) from any vapors exiting headspaces in the storage tanks. The Occupational Safety and Health Administration (OSHA) Standard promulgated in Title 29 of the Code of the Federal Regulations (CFR) 1910.134(d)(3)(iii)(b)(2) specifies that for protection against gases and vapors, employers shall implement a schedule for cartridges to ensure that change-outs occur before the end of service life. The change schedule can be based on objective information or data that ensures cartridge change-outs occur before the end of their service life.[2-5] The primary function of the WRPS Cartridge Test Program is to obtain objective data to determine service lives for the APR and PAPR cartridges used at Hanford Tank Farms. WRPS contracted with Pacific Northwest National Laboratory to analyze the test data and offer an independent analysis and any recommendations. Volume 1 of this report summarizes data analysis of APR and PAPR cartridge testing on vapors from the AP tank farm exhauster. Previous testing of APR cartridges was conducted on the AP exhauster in June 2016. However, an AP exhauster upgrade was completed in September 2016. Two different APR cartridges from SCOTT Safety (Monroe, North Carolina) were assessed for the new AP exhauster source, along with two different PAPR cartridges—one from MSA Safety Inc. (Pittsburgh, Pennsylvania) and another from 3M (Maplewood, Minnesota). Volume 2 provides an introduction to the raw data, including analytical laboratory analysis results that supported the analysis and conclusions documented in Volume 1.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Analysis of Air-Purifying Respirator (APR) Cartridge Performance Testing on Hanford Tanks SX-101 and SX-104: Volume 2 - Raw Analytical Data

As the Tank Operations Contractor for U.S. Department of Energy operations at the Hanford site in Washington State, Washington River Protection Solutions (WRPS) is responsible for managing highly radioactive wastes stored in tanks at Hanford. To protect workers at Hanford Tank Farms, WRPS tests air-purifying respirator (APR) and powered air-purifying respirator (PAPR) chemical cartridges commonly used at the tank farms. The tests were conducted to determine the period of time the cartridges would provide adequate performance for APRs and PAPRs when workers are exposed to a mixture of Chemicals of Potential Concern (COPC) from any vapors exiting headspaces in the storage tanks. Occupational Safety and Health Administration (OSHA) Standard 29 Code of the Federal Regulations (CFR) 1910.134(d)(3)(iii)(b)(2) specifies that for protection against gases and vapors, employers shall implement a schedule for cartridges to ensure that change-outs occur before the end of service life. The change schedule can be based on objective information or data that ensures cartridge change-outs occur before the end of their service life. The primary function of the WRPS Cartridge Test Program is to obtain objective data to determine service lives for the APR and PAPR cartridges used at Hanford Tank Farms. WRPS contracted with Pacific Northwest National Laboratory to analyze the test data and offer an independent analysis and any recommendations. This report summarizes data analysis of APR cartridge testing on headspace vapors from Hanford SX-101 and SX-104 single-shell tanks. Volume 1 of this report documents the testing, data analysis, results, conclusions, and recommendations resulting from the APR testing on SX-101 and SX-104 headspace vapors. Volume 2 provides an introduction to the raw data, including analytical laboratory analysis results that supported the analysis and conclusions documented in Volume 1.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Analysis of Air-Purifying Respirator (APR) and Powered Air-Purifying Respirator (PAPR) Cartridge Performance Testing on Hanford Tanks BY-108 and BY-110 Volume 2: Raw Analytical Data

As the Tank Operations Contractor for U.S. Department of Energy operations at the Hanford site in Washington State, Washington River Protection Solutions (WRPS) is responsible for managing highly radioactive wastes stored in tanks at Hanford. WRPS tests air-purifying respirator (APR) and powered air-purifying respirator (PAPR) chemical cartridges commonly used by workers at Hanford Tank Farms to determine the period of time that the cartridges would provide adequate performance for APRs and PAPRs used to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPC) from any vapors exiting headspaces in the storage tanks. The Occupational Safety and Health Administration (OSHA) Standard promulgated in Title 29 of the Code of the Federal Regulations (CFR) 1910.134(d)(3)(iii)(b)(2) specifies that for protection against gases and vapors, employers shall implement a schedule for cartridges to ensure that change-outs occur before the end of service life. The change schedule can be based on objective information or data that ensures cartridge change-outs occur before the end of their service life. The primary function of the WRPS Cartridge Test Program is to obtain objective data to determine service lives for the APR and PAPR cartridges used at Hanford Tank Farms. WRPS contracted with Pacific Northwest National Laboratory to analyze the test data and offer an independent analysis and any recommendations. This report summarizes data analysis of APR and PAPR cartridge testing on BY-110 and BY-108 headspace vapors, respectively. Two different APR cartridges from SCOTT Safety (Monroe, North Carolina) were assessed for the BY-110 headspace vapors, and two different PAPR cartridges—one from MSA Safety Inc. (Pittsburgh, Pennsylvania) and another from 3M (Maplewood, Minnesota)—were assessed for the BY-108 headspace vapors. Volume 1 of this report documents the testing, data analysis, results, conclusions, and recommendations resulting from the cartridge testing of vapors from the BY-110 and BY-108 headspaces. Volume 2 provides an introduction to the raw data, including analytical laboratory analysis results that supported the analysis and conclusions documented in Volume 1.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Analysis of Air-Purifying Respirator (APR) and Powered Air-Purifying Respirator (PAPR) Cartridge Performance Testing on a Hanford AX Tank Farm Exhauster Slipstream Volume 2: Raw Analytical Data

As the Tank Operations Contractor for U.S. Department of Energy operations at the Hanford site in Washington State, Washington River Protection Solutions (WRPS) is responsible for managing highly radioactive wastes stored in tanks at Hanford. To protect workers at Hanford Tank Farms, WRPS tests air-purifying respirator (APR) and powered air-purifying respirator (PAPR) chemical cartridges commonly used at the tank farms. The tests were conducted to determine the period of time the cartridges would provide adequate performance for APRs and PAPRs when workers are exposed to a mixture of Chemicals of Potential Concern (COPC) from any vapors exiting headspaces in the storage tanks. Occupational Safety and Health Administration (OSHA) Standard 29 Code of the Federal Regulations (CFR) 1910.134(d)(3)(iii)(b)(2) specifies that for protection against gases and vapors, employers shall implement a schedule for cartridges to ensure that change-outs occur before the end of service life. The change schedule can be based on objective information or data that ensures cartridge change-outs occur before the end of their service life. The primary function of the WRPS Cartridge Test Program is to obtain objective data to determine service lives for the APR and PAPR cartridges used at Hanford Tank Farms. WRPS contracted with Pacific Northwest National Laboratory to analyze the test data and offer an independent analysis and any recommendations. This report summarizes data analysis of APR and PAPR cartridge testing on a vapor slipstream from the Hanford AX tank farm exhauster. Volume 1 of this report documents the testing, data analysis, results, conclusions, and recommendations resulting from the cartridge testing on AX exhauster slipstream vapors. Volume 2 provides an introduction to the raw data, including analytical laboratory analysis results that supported the analysis and conclusions documented in Volume 1.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Analysis of Powered Air-Purifying Respirator (PAPR) Cartridge Performance Testing on Hanford Tanks SX-101 and SX-104: Volume 2 Raw Analytical Data

As the Tank Operations Contractor for U.S. Department of Energy operations at the Hanford site in Washington State, Washington River Protection Solutions (WRPS) is responsible for managing highly radioactive wastes stored in tanks at Hanford. WRPS tests of cartridges used in air-purifying respirators (APR) and powered air-purifying respirators (PAPR) commonly used at Hanford Tank Farms. The tests are conducted to determine the period of time the cartridges would provide adequate performance for APRs and PAPRs used to protect workers when exposed to a mixture of Chemicals of Potential Concern (COPC) from any vapors exiting headspaces in the storage tanks. Occupational Safety and Health Administration (OSHA) Standard 29 Code of the Federal Regulations (CFR) 1910.134(d)(3)(iii)(b)(2) specifies that for protection against gases and vapors, employers shall implement a schedule for cartridges to ensure that change-outs occur before the end of service life. The change schedule can be based on objective information or data that ensures cartridge change-outs occur before the end of their service life. The primary function of the WRPS Cartridge Test Program is to obtain objective data to determine service lives for the APR and PAPR cartridges used at Hanford Tank Farms. WRPS contracted with Pacific Northwest National Laboratory to analyze the test data and offer an independent analysis and any recommendations. This report summarizes data analysis of PAPR cartridge testing on headspace vapors from Hanford SX-101 and SX-104 single-shell tanks. Two different PAPR cartridges—one from MSA Safety Inc. (Pittsburgh, Pennsylvania) and another from 3M (Maplewood, Minnesota)—were assessed on each tank headspace source on separate days. These data represent the first PAPR cartridge testing under the recent WRPS program, as testing to date had been focused on APR cartridges. Volume 1 of this report documents the testing, data analysis, results, conclusions, and recommendations resulting from the PAPR testing on SX-101 and SX-104 headspace vapors. Volume 2 provides an introduction to the raw data, including analytical laboratory analysis results that supported the analysis and conclusions documented in Volume 1.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Big-Data Analytics for Electric Grid and Demand-Side Management

This report describes research to characterize the status of, and trends in, big-data analytics for the electricity grid. The research focused on 1) identifying power-grid big-data sources, types, and characteristics; and 2) characterizing big-data architecture, analytic methods, technology applications, and challenges. The first part of this report describes the main sources and characteristics of big data for the smart grid and comprehensively reviews big-data architecture, technologies, and applications in the power sector. The second part of this report presents case studies of big data applications in the power industry: (1) a smart-meter data and predictive analytics method for demand response (DR), (2) synchrophasor data analytics for the distribution grid, and (3) utility data for peak-demand management. For the predictive analytics case study, smart-meter-data-driven and physical models were developed to predict the potential kilowatt (kW) capacity reduction from DR. The DR estimation framework that was developed works for both small and large-scale customers. The synchrophasor case study demonstrates use of an algorithm applied to time-series data to detect events that appear as significant changes, known as “edges,” in voltage magnitude measurements. The synchrophasor case study also introduces an approach for clustering sets of events to reveal unique features that distinguish them (e.g., distinguishing capacitor bank switching from transformer tap changes). The peak-demand management case study describes the use of the data analytics to enable DR programs to limit forecasted peak demand, resulting in cost savings to the utility. The findings from the research described in this report support identification of opportunities and technologies for big-data and analytics applications for demand-side management in the power sector as well as other approaches to modernizing the electricity grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Data analytics approach for melt-pool geometries in metal additive manufacturing

Modern data analytics was employed to understand and predict physics-based melt-pool formation by fabricating Ni alloy single tracks using powder bed fusion. An extensive database of melt-pool geometries was created, including processing parameters and material characteristics as input features. Correlation analysis provided insight for relationships between process parameters and melt-pools, and enabled the development of meaningful machine learning models via the use of highly correlated features. We successfully demonstrated that data analytics facilitates understanding of the inherent physics and reliable prediction of melt-pool geometries. This approach can serve as a basis for the melt-pool control and process optimization.

36 MATERIALS SCIENCE↗
NASA NTRS2016

Earth Science Data Analytics: Bridging Tools and Techniques with the Co-Analysis of Large, Heterogeneous Datasets

The continuum of ever-evolving data management systems affords great opportunities to the enhancement of knowledge and facilitation of science research. To take advantage of these opportunities, it is essential to understand and develop methods that enable data relationships to be examined and the information to be manipulated. This presentation describes the efforts of the Earth Science Information Partners (ESIP) Federation Earth Science Data Analytics (ESDA) Cluster to understand, define, and facilitate the implementation of ESDA to advance science research. As a result of the void of Earth science data analytics publication material, the cluster has defined ESDA along with 10 goals to set the framework for a common understanding of tools and techniques that are available and still needed to support ESDA.

science data analysis↗