Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

FY 2024 Multidimensional Data Correlation Platform Data Management Infrastructure Progress: Materials Laboratory

This report provides an inventory of the equipment available at the ORNL Manufacturing Demonstration Facility (MDF) for sample preparation and material characterization, including both destructive and non-destructive techniques that generate critical data to support the development of the Multi-Dimensional Data Correlation (MDDC) framework. The success of the MDDC framework depends heavily on the quality and completeness of the data it can access. Therefore, it is essential to establish a comprehensive inventory of the technologies available to the Advanced Materials and Manufacturing Technologies (AMMT) multi-laboratory team. This starts by gathering information about the types of data they produce, the data collection and transfer protocols used, file formats, and data storage requirements for experiments. This information is then carefully evaluated to create the operations and trackables elements of the Damara Tern platform, which is the foundation of the MDDC framework.

36 MATERIALS SCIENCE↗

Geospatial Data Platform for All

Spatiotemporal data has evolved in scale due to augmented use in cross-domain applications. Simultaneously, there is substantial growth in the availability of Geographic Information Systems (GIS) data provided by the United States Geological Survey (USGS) along with other federal, state, county, or local agencies through open-data portals and public access APIs. However, data availability does not equate with accessibility. Large-scale analyses and applications require robust, performant data management with co-location of data storage and computing. The insufficiency of data management infrastructure compels researchers to adopt ad hoc project- specific GIS data storage solutions (e.g., copying data to High-Performance computer file systems). As an ad hoc storage strategy does not scale, it hampers cross-domain analyses causing difficulty in data reuse and utilizing existing code bases. Furthermore, GIS data is complex and requires expertise to analyze and manipulate due to its intricate data structures and data-specific projection transformations. Despite the challenges, we recognize that derived GIS data products, e.g., satellite or LIDAR-based images, can be used in downstream applications such as AI by domain, but non-GIS experts. To address the data needs and overcome the challenges, we are working towards a GIS Data Platform focused on efficient data storage, data discovery and access, and an API to enable common workflows. We propose a knowledge-graph (KG) approach for data discovery, whereby datasets are semantically linked to higher- level constructs such as projects and research areas. The semantic data links enable researchers to explore datasets in a top-down approach by specifying relevant and meaningful terms (assists in finding hidden data). An advantage is that the nodes and edges in a knowledge graph create built-in semantic documentation. Deeper spatiotemporal connections between data sources can be encoded via Graph Neural Networks (GNN) (Zhang et al., 2021). The KG approach can be extended to integrate the data itself in a Virtual KG (VKG). Our work will derive inspiration from large-scale VKG efforts that have been undertaken or are currently underway as part of the OpenStreetMap project (Ding et al., 2021). For DOE Data Days, we share the proposed geospatial data platform hybrid (cloud/on-prem) architecture, our work-to-date on storing, retrieving, and transforming LiDAR and raster data relevant to two important NREL use-cases, including the Renewable Energy Potential (reV) Model, and present our proposal for a KG based data discovery engine.

data platform↗

Livewire Data Platform: A Catalog of Transportation and Mobility Data

A two-page fact sheet on the capabilities and core services of the Livewire Data Platform, a growing catalog of transportation and mobility-related data that empowers researchers and community planners to easily and securely share and preserve data that support projects and decision making.

47 OTHER INSTRUMENTATION↗

Livewire Data Platform - A Solution for Energy Efficient Mobility Systems (EEMS) Data Sharing

The Livewire Data Platform is a data storage and exchange platform. It provides: a platform, allowing data sharing and discovery by linking disparate data sources to a single website via application programming interfaces (APIs); a community, building partnerships and collaboration rather than competition; a system, allowing shared data to increase in size and complexity as EEMS evolves.

47 OTHER INSTRUMENTATION↗

Livewire Data Platform: A Catalog of Transportation and Mobility Data

A two-page fact sheet on the capabilities and core services of the Livewire Data Platform, a growing catalog of transportation and mobility-related data that empowers researchers and community planners to easily and securely share and preserve data that support projects and decision making.

Livewire, EEMS, energy-efficient mobility systems,↗

Livewire Data Platform: File Standards Version 1.0

This technical document is a user guide to help users of the Livewire Data Platform understand the standards and requirements for storing and sharing data on the Livewire Data Platform.

97 MATHEMATICS AND COMPUTING↗

Development of a Data Platform for High-Temperature Gas-cooled Reactor (HTGR) Nuclear Energy University Program (NEUP) Thermal-Fluid Experiments

Since the U.S. Department of Energy (DOE)’s Office of Nuclear Energy (NE) initiated the Nuclear Energy University Program (NEUP) in 2009, a total of 30 NEUP projects focused on High-Temperature Gas-cooled Reactor (HTGR) thermal-fluid experiments were funded up to fiscal year (FY) 2021. This represents a total DOE investment of approximately $23M over the 12-year period, covering thermal fluid phenomena important to both pebble bed and prismatic HTGR designs. The NEUP projects have produced a large amount of high-quality experimental and computational data that were published in final project reports, journal articles, dissertations, and conference proceedings, but in most cases the actual data sets and supporting information such as facility and instrumentation descriptions were not publicly disseminated to the HTGR community. To the authors’ best knowledge, a data platform that organizes and summarizes these NEUP-funded projects for HTGR research does not currently exist. To improve access to this HTGR validation data and optimize the return on the significant investment made by DOE, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program started a survey of completed and ongoing HTGR NEUP projects with the aim of developing a public-access data platform that can be used to retrieve computational fluid dynamics (CFD) and system code validation data and guide future NEUP investments. This paper summarizes the status of the current ART-GCR database, provides an overview of the NEUP-funded HTGR-related research projects from FY2009 to FY2021 and identify validation knowledge gaps still existing in HTGR thermal-fluid research.

42 ENGINEERING↗

Livewire Data Platform File Standards Version 1.0

This living document describes required and recommended standards for data additions to the Livewire Data Platform (https://livewire.energy.gov/). Adherence to the standards described enables development of automated analysis and discovery tools for Livewire data and will facilitate development of future capabilities for delivering data that can be tailored to meet user needs.

33 - ADVANCED PROPULSION SYSTEMS↗

Ongoing Data Platform Development for High-Temperature Gas-cooled Reactor (HTGR) Thermal-Fluid Experiments Supported by Nuclear Energy University Program (NEUP) [Presentation Slides]

There are in total 30NEUP projects focusing on the thermal-fluid experiments related with High-Temperature Gas-cooled Reactor (HTGR) from FY2009 to FY2021, producing a large amount of high-quality validation data, however, these valuable data has been scattering everywhere and not been disseminated to the community well, and final reports are available only from OSTI webpage. This could potentially be a huge waste, not only for government budget but also for the HTGR research community. To improve access to this HTGR validation data and optimize the return on the significant investment made by DOE and supported by the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program, we conducted a survey to assess completed and ongoing HTGR NEUP projects with the aim to develop a public-access data platform that can be used to retrieve code validation data and guide future NEUP investments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Big Data Analysis of Massive PMU Datasets: A Data Platform Perspective

The discovery of `event signatures' and useful insights from very large historical Phasor Measurement Unit (PMU) datasets is predicated on offline Big Data analysis approaches that rely on the generation of predictive features on a massive scale. This paper presents lessons learned from a data platform perspective towards reducing barriers to adoption of Big Data analytics against a real dataset of almost half a trillion data points drawn from over 400 PMUs distributed across the North American power grid. We demonstrate software abstractions and targeted performance optimizations that can lead to significant productivity gains for power systems researchers seeking to perform offline exploratory temporal analysis and modeling tasks, with a focus on feature generation. We describe how our optimized approach goes beyond a naive application of mainstream Big Data technologies, enabling feature generation tasks, that previously took days or even weeks, to now be completed in just a few hours.

Kumar, Vijay S.↗

High-Temperature Gas-Cooled Reactor Research Survey and Overview: Preliminary Data Platform Construction for the Nuclear Energy University Program

Since the U.S. Department of Energy Office of Nuclear Energy initiated the Nuclear Energy University Program (NEUP) in 2009, there are 29 NEUP projects focusing on high-temperature gas-cooled reactor (HTGR) research up to July 2022. The resultant research product, either experimental or computational, were published as final NEUP reports, journal articles and conference proceedings. However, these federally funded products have been scattered and sometimes cannot be easily accessed. To improve access to this valuable HTGR validation data and optimize the return on the significant investment made by the Department of Energy, the Advanced Reactor Technologies (ART) Gas-Cooled Reactor (GCR) program started a survey of completed and ongoing HTGR NEUP projects to develop a public-access database specific for HTGRs applications that can be used to retrieve computational fluid dynamics and system code validation data. This effort will help guide future NEUP-funded research, define new state of the ART Phenomena Identification and Ranking Table (PIRT), and promote the usage of this data in the codes validation matrices. This report provides an overview of the NEUP-funded HTGR-related research projects from Fiscal Year (FY) 2009–2021 and identifies validation knowledge gaps still existing in HTGR thermal-fluid research. A preliminary data platform has been developed for the 29 NEUP projects investigating HTGR thermal hydraulics, including their final reports as well as the available scientific publications. As an ultimate goal for this work, the ART-GCR program will create a central database at Idaho National Laboratory to identify, organize, and store these datasets generated by experimental investigations or computational models, experimental facility descriptions, and publicly-available academic products from the HTGR-related NEUP projects and provide future guidance for the storage and transmission of important project documentations for later NEUP projects as well.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management platform↗

A Data Deposition Platform for Sharing Nuclear Magnetic Resonance Data

Nuclear magnetic resonance (NMR) data are rarely deposited in open databases, leading to loss of critical scientific knowledge. Existing data reporting methods (images, tables, lists of values) contain less information than raw data, and are poorly standardized. Together, these issues limit FAIR (findable, accessible, interoperable, reusable) access to these data, which in turn creates barriers for compound dereplication and the development of new data-driven discovery tools. Existing NMR databases are either not designed for natural products data, or employ complex deposition interfaces that disincentivize deposition. Journals, including the Journal of Natural Products (JNP), are now requiring data submission as part of the publication process, creating the need for a streamlined, user-friendly mechanism to deposit and distribute NMR data. Recently, our team reported the development of the Natural Products Magnetic Resonance Database (NP-MRD; www.np-mrd.org). Here in this paper we present a new data deposition platform for the NP-MRD project that is designed to enable users to deposit NMR data for published or submitted manuscripts in under five minutes. This platform includes a suite of automated data extraction and standardization tools, together with a simple-to-use web-based interface and detailed error reporting to simplify the data deposition process and is available at www.np-mrd.org/submissions.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗