Ecosystem discovery: Measuring clean energy innovation ecosystems through knowledge discovery and mapping techniques
Not Available
Lin, Jessica (ORCID:0000000280407251)↗
SEARCH · Search NASA
Results for “knowledge discovery”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Bioenergy Knowledge Discovery Framework Fact Sheet
The Bioenergy Knowledge Discovery Framework (KDF) supports the development of a sustainable bioenergy industry by providing access to a variety of data sets, publications, and collaboration and mapping tools that support bioenergy research, analysis, and decision making. In the KDF, users can search for information, contribute data, and use the tools and map interface to synthesize, analyze, and visualize information in a spatially integrated manner.
bioenergy, bioenergy kdf, Bioenergy knowledge disc↗
FNETVision: A WAMS Big Data Knowledge Discovery System
With the growing awareness of the power system stability, wide area measurement system (WAMS) has been widely studied and deployed. In WAMS, a phasor data concentrator (PDC) collects and persists the GPS-time-synchronized phasor data from hundreds of phasor measurement units (PMU). Due to the size and complexity of the modern power systems, the number of deployed PMUs has been increasing and their data size becomes increasingly large. The large data volume challenges the analysis, and the knowledge discovery of the measurement data. This paper takes the pioneering distribution level WAMS- the frequency monitoring network FNET/GridEye as an example. It develops an adaptive visualization system- FNETVision to visualize the large-volume WAMS data by interconnection. The case studies suggest, based on the FNETVision system, the system administrator can quickly dig out issues of the FNET system and accordingly pinpoint the cause of these issues.
Wang, Weikang↗
Technical Track on Biomass Carbon Removal and Storage (BiCRS): Mapping bioresources, phase 1 - Consistency check comparing Mission Innovation’s Data Visualization Tool for Bioresources and the Clean Energy Ministerial Biofuture Initiative Global Biomass data accessible via the US Department of Energy’s Bioenergy Knowledge Discovery Framework (KDF)
The Mission Innovation (MI) Carbon Dioxide Removal (CDR) Mission, Technical Track on Biomass Carbon Dioxide Removal and Storage (BiCRS), has produced a biomass resource database for its members. In parallel, Oak Ridge National Laboratory (ORNL) developed the International Feedstock Reporting data portal—herein referred to as the CEM Biofuture-KDF data—on behalf of the Clean Energy Ministerial Biofuture Initiative (CEM Biofuture), as a specific task under Biofuture’s 2024–25 Action Plan. This work was conducted at the request of CEM Biofuture and funded by the U.S. Department of Energy in support of that initiative, and it is hosted within DOE’s Knowledge Discovery Framework (KDF).
09 BIOMASS FUELS↗
Energy-Water Nexus Knowledge Discovery Framework, Experts' Meeting
Energy and water generation and delivery systems are inherently interconnected. With demand for energy growing, the energy sector is experiencing increasing competition for water. With increasing populationand changing environmental, socioeconomic, and demographic scenarios, new technology and investmentdecisions must be made for optimized and sustainable energy-water resource management. These decisionsrequire novel scientific insights into the complex interdependencies of energy-water infrastructures acrossmultiple space and time scales.On June 13, 2017 an Experts’ Meeting was convened for the purpose of informing the design of an integrateddata driven modeling, analysis, and visualization capability that can enable ecient local and regional decisionmakingregarding present and future energy-water infrastructure. This first multi-institute collaborativeEnergy-Water Nexus Knowledge Discovery Framework (EWN-KDF) will be informed by fundamentalscience and guided with strategic (federal) policy decisions in the service of ensuring national energyresilience.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Constellation: A science graph network for scalable data and knowledge discovery in extreme-scale scientific collaborations
Constellation's overarching goal is the federation of information from resources within an extreme-scale scientific collaboration to enable the scalable discovery of data and new knowledge pathways. The resource fabric is comprised of petascale supercomputers and storage systems, users, jobs, datasets and lifecycle artifacts. For an extreme-scale supercomputing center, normal operations can generate hundreds of millions of data products and metadata entries describing the resource fabric. Constellation federates the information extracted from the resources using a custom, transformative science graph network; constructs rich metadata indexes and higher-order derived metadata from the extracted information; and conducts scalable graph analytics to unravel hidden data pathways. Our implementation and deployment for a production, supercomputing facility shows that the graph can scale to more than 750 million vertices, its domain agnostic indexing can answer interesting science queries, and its analytics can aid in structural, topological and temporal analysis to identify usage hotspots.
Vazhkudai, Sudharshan S.↗
Knowledge Discovery for Smart Grid Operation, Control, and Situation Awareness -- A Big Data Visualization Platform
In this paper, a big data visualization platform is designed to discover the hidden useful knowledge for smart grid (SG) operation, control and situation awareness. The spawn of smart sensors at both grid side and customer side can provide large volume of heterogeneous data that collect information in all time spectrums. Extracting useful knowledge from this big-data poll is still challenging. In this paper, the Apache Spark, an open source cluster computing framework, is used to process the big-data to effectively discover the hidden knowledge. A high-speed communication architecture utilizing the Open System Interconnection (OSI) model is designed to transmit the data to a visualization platform. This visualization platform uses Google Earth, a global geographic information system (GIS) to link the geological information with the SG knowledge and visualize the information in user defined fashion. The University of Denver's campus grid is used as a SG test bench and several demonstrations are presented for the proposed platform.
24 POWER TRANSMISSION AND DISTRIBUTION↗
GeoAI: spatially explicit artificial intelligence techniques for geographic knowledge discovery and beyond
Recent progress in Artificial Intelligence (AI) techniques, the large-scale availability of high-quality data, as well as advances in both hardware and software to efficiently process these data, are transforming a range of fields from computer vision and natural language processing to autonomous driving and healthcare. For example, the availability of high-resolution geographic data and high-performance computing techniques together with deep learning fuel progress in fast and accurate object detection. Recent examples of GeoAI work include the detections of terrain features and densely-distributed building footprints, information extraction from scanned historical maps, semantic classification (e.g. LiDAR point clouds), novel methods for spatial interpolation, and advances in traffic forecasting. Similarly, machine learning and natural language processing are facilitating the extraction of geographic information from unstructured (textual) data, such as news articles and Wikipedia as well as the matching of natural features in multiple gazetteers.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
Final Report Scalable Analysis Methods and In Situ Infrastructure for Extreme Scale Knowledge Discovery
The primary challenge motivating this project is the widening gap between the ability to compute information and to store it for subsequent analysis. This gap adversely impacts science code teams, who can perform analysis only on a small fraction of the data they calculate, resulting in the substantial likelihood of lost or missed science, when results are computed but not analyzed. Our approach is to perform as much analysis or visualization processing on data while it is still resident in memory, which is known as in situ processing. The idea in situ processing was not new at the time of the start of this effort in 2014, but efforts in that space were largely ad hoc, and there was no concerted effort within the research community that aimed to foster production-quality software tools suitable for use by Department of Energy (DOE) science projects. Our objective was to produce and enable the use of production-quality in situ methods and infrastructure, at scale, on DOE high-performance computing (HPC) facilities, though we expected to have an impact beyond DOE due to the widespread nature of the challenges, which affect virtually all large-scale computational science efforts. To achieve this objective, we engaged in software technology research and development (R&D), in close partnerships with DOE science code teams, to produce software technologies that were shown to run efficiently at scale on DOE HPC platforms.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
An integrated approach for the knowledge discovery in computer simulation models with a multi-dimensional parameter space
In production industries, parameter identification, sensitivity analysis and multi-dimensional visualization are vital steps in the planning process for achieving optimal designs and gaining valuable information. Sensitivity analysis and visualization can help in identifying the most-influential parameters and quantify their contribution to the model output, reduce the model complexity, and enhance the understanding of the model behavior. Typically, this requires a large number of simulations, which can be both very expensive and time consuming when the simulation models are numerically complex and the number of parameter inputs increases. There are three main constituent parts in this work. The first part is to substitute the numerical, physical model by an accurate surrogate model, the so-called metamodel. The second part includes a multi-dimensional visualization approach for the visual exploration of metamodels. In the third part, the metamodel is used to provide the two global sensitivity measures: i) the Elementary Effect for screening the parameters, and ii) the variance decomposition method for calculating the Sobol indices that quantify both the main and interaction effects. The application of the proposed approach is illustrated with an industrial application with the goal of optimizing a drilling process using a Gaussian laser beam.
97 MATHEMATICS AND COMPUTING↗
A survey of analytical methods for inclusion in a new energy-water nexus knowledge discovery framework
Not Available
97 MATHEMATICS AND COMPUTING↗
Scalable Analysis Methods and In Situ Infrastructure for Extreme Scale Knowledge Discovery
The primary challenge motivating this team’s work is the widening gap between the ability to compute information and to store it for subsequent analysis. This gap adversely impacts science code teams, who are able to perform analysis only on a small fraction of the data they compute, resulting in the very real likelihood of lost or missed science, when results are computed but not analyzed. Our approach is to perform as much analysis or visualization processing on data while it is still resident in memory, an approach that is known as in situ processing. The idea in situ processing was not new at the time of the start of this effort in 2014, but efforts in that space were largely ad hoc, and there was no concerted effort within the research community that aimed to foster production-quality software tools suitable for use by DOE science projects. In large, our objective was produce and enable use of production-quality in situ methods and infrastructure, at scale, on DOE HPC facilities, though we expected to have impact beyond DOE due to the widespread nature of the challenges, which affect virtually all large-scale computational science efforts. To achieve that objective, we assembled a unique team of researchers consisting of representatives from DOE national laboratories, academia, and industry, and engaged in software technology R&D, as well as engaged in close partnerships with DOE science code teams, to produce software technologies that were shown to run effectively at scale on DOE HPC platforms.
97 MATHEMATICS AND COMPUTING↗
Scalable Analysis Methods and In Situ Infrastructure for Extreme Scale Knowledge Discovery
High performance computers have for many years been on a trajectory that gives them extraordinary compute power with the addition of more and more compute cores. At the same time, other system parameters such as the amount of memory per core and bandwidth to storage have remained constant or have barely increased. This creates an imbalance in the computer, giving it the ability to compute a lot of data that it cannot reasonably save out due to time and storage constraints. While technologies have been invented to mitigate this problem (burst buffers, etc.), software has been adapting to employ in situ libraries which perform data analysis and visualization on simulation data while it is still resident in memory. This avoids the need to ever have to pay the costs of writing many terabytes of data files. Instead, in situ enables the creation of more concentrated data products such as statistics, plots, and data extracts, which are all far smaller than the full-sized volume data. With the increasing popularity of in situ, multiple in situ infrastructures have been created, each with its own mechanism for integrating with a simulation. To make it easier to instrument a simulation with multiple in situ infrastructures and include custom analysis algorithms, this project created the SENSEI framework.
97 MATHEMATICS AND COMPUTING↗
Energy-Water Nexus Knowledge Discovery Framework, Experts’ Meeting Report
Energy and water generation and delivery systems are inherently interconnected. With worldwide demandfor energy growing, the energy sector is experiencing increasing competition for water. With increasingpopulation and changing environmental, socioeconomic, and demographic scenarios, new technology andinvestment decisions must be made for optimized and sustainable energy-water resource management. These decisions require novel scientific insights into the complex interdependencies of energy-water infrastructures across multiple space and time scales.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
MuSIKAL: Multiphysics Simulations and Knowledge Discovery Through AI/ML Technologies (Final Technical Report)
Under the MuSiKAL project, we developed a framework for a coastal digital twin (DT) platform capable of integrating diverse data resources, configuring multiscale model simulations, performing SciML‐accelerated predictions, with applications primarily driven by storm surge and heavily rainfall events impacting the Gulf Coast of the U.S.
54 ENVIRONMENTAL SCIENCES↗
MuSIKAL: Multiphysics Simulations and Knowledge Discovery Through AI/ML Technologies (Final Technical Report)
Under the MuSiKAL project, we developed a framework for a coastal digital twin (DT) platform capable of integrating diverse data resources, configuring multiscale model simulations, performing SciML‐accelerated predictions, with applications primarily driven by storm surge and heavily rainfall events impacting the Gulf Coast of the U.S.
54 ENVIRONMENTAL SCIENCES↗
MuSIKAL: Multiphysics Simulations and Knowledge Discovery through AI/ML Technologies
Under the MuSiKAL project, we developed a framework for a coastal digital twin (DT) platform capable of integrating diverse data resources, configuring multiscale model simulations, performing SciML‐accelerated predictions, with applications primarily driven by storm surge and heavily rainfall events impacting the Gulf Coast of the U.S.
54 ENVIRONMENTAL SCIENCES↗