SEARCH · Search NASA
Results for “Data Platform”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Environmental Testing of SolarSCADA's SSI Data Acquisition System
In April of 2022, SolarSCADA, Inc., was awarded voucher funding to conduct research and analysis at the National Renewable Energy Laboratory (NREL) per the American-Made Solar Prize. SolarSCADA produces a fully integrated data acquisition system that is designed specifically for PV fields and includes a data monitoring platform. SolarSCADA is focused providing the SSI unit with all sensors/measurements per requirements in IEC-61724-1 [1] and with utility scale bankability. The objective of the SolarSCADA voucher funding was established as follows: Leverage NREL's existing calibration and environmental testing capabilities to evaluate the stability of the SSI channels and overall systeme in response to extreme environmental conditions associated with fielded PV.
2024 NMDC Ambassador Training Materials [Slides]
The NMDC is a sustainable data discovery platform that promotes open science and shared-ownership across a broad and diverse community of researchers, funders, publishers, societies, and other collaborators. The NMDC aims to enable multi-omic microbiome research to accelerate scientific discovery. The NMDC is a Department of Energy funded program that is a collaboration between 3 National Laboratories: Lawrence Berkeley National Laboratory (LBNL), Los Alamos National Laboratory (LANL), and Pacific Northwest National Laboratory (PNNL).
A Framework for Addressing Hydropower Modeling Gaps in Electric Grid Planning and Operational Studies [Slides]
Realistic representation of hydropower in power system planning and operation studies is extremely important as it helps in avoiding under/over-estimation of the services the hydro power units can provide. A framework and tools have been developed to account for hydrological conditions and modify power system models accordingly. For example, HyDat – data and AI driven platform, that provides that data required for editing the power system model files Collaborative effort with V&R Energy. Also, development of POM based tools have been performed, a) Tool1: editing .raw files with realistic current and maximum hydrogeneration and redispatch of other units, and b) Tool2: Editing .dyr files to represent water head, current and maximum generation. Finally the framework, HASP framework combines HyDat and V&R energy tools to produce modified power system model files. Key Take-away points from contingency analysis studies include a) the number of critical contingencies increases as the water levels are reduced (70%>75%>80%), and b) both the extent and the quality of dynamic response of the Hydropower unit is different with varying water head levels.
Defining a Platform Approach and Market Participation: Data Driven Business Models for Solid State Transformer-Based Synthetic Inertia and Voltage Stability Controls (CRADA Final Report, Project 1, Mod 1)
The primary objective of this project is to determine the incremental value created with the medium voltage solid-state transformer (MV SST) technology to different stakeholders in view of the updated DER grid regulations. This includes studying the benefits of the MV SST technology in a range of use cases for EV and DER penetration including (1) “corridor charging” for EVs and (2) solar plus storage (FERC 2222). The potential customers of this technology include utilities for EV charging, DER installers who must meet utility interconnection requirements, balancing authorities, and DER aggregators. The traditional transformers on the grid could be a limiting factor for the EV-grid integration as the distribution transformers were not designed to handle the dynamic and fluctuating EV charging loads. Thus, the issues such as voltage fluctuations, increased losses and reduced efficiency [1] can negatively impact the grid operation. To address these challenges, transformers with flexibility and adaptability become imperative to meet the evolving energy demands. In this regard, the concept of Medium Voltage Solid-State Transformers.
Topical Report on Water Balance Model Development and Initial Application
This topical report summarizes results from developing a generic dynamic water balance tool which can be used by coal-fired power plant operators to evaluate FGD water management strategies. EPRI is using a statistical software model created on the GoldSim platform and data from coal-fired energy plants to determine the fraction of power plant water needs that can be satisfied by electrodialysis reversal treatment and, correspondingly, the discharge volume and/or byproducts that still need to be managed. The generic model is designed to accept a number of easily obtainable process variables and generate probabilities of resultant water characteristics. The model is also constructed as a universal process flow; one that can be adjusted to accommodate most major components of an FGD blowdown handling system. The generic model is dynamic and utilizes user-inputted operational variation in water quality and quantity to best provide a probabilistic representation of potential performance outcomes. In order to account for complexities of water composition and treatment, a separate chemical modeling software is used to evaluate water chemistry and unit operation performance. The thermodynamic modeling software, OLI Studio, is employed to convert ion data from laboratory analyses into balanced molecular concentrations that are classified as dissolved and suspended solids. The dynamic water model is designed to import a total of 11 species commonly found in FGD blowdown water as molecular concentrations.Water management unit operations are used in the model and categorized by either physical unit operation blocks or chemical unit operations blocks. As the name implies, the physical water treatment blocks are unit operations that are exclusively physical changes to the system (e.g., separations and volume changes). The chemical water treatment blocks are unit operations where chemical changes occur and require the use of OLI Studio to characterize subsequent streams. Water and material balances from three unique coal-fired power plants were obtained and preliminary modeling on the dynamic water balance tool was performed using the extracted data from these power plants. These three power plants were chosen due to their unique configurations and water profiles that represented a variety of operational changes. Results from using the dynamic tool with the three plant configurations are presented and discussed in the context of the existing tool and planned future capabilities.
1.4.2.402 - Water Risk for the Bulk Power System: Asset to Grid Impacts
Utilities and stakeholders need a standardized mechanism for evaluating how future climate and hydrologic conditions translate to water-related risks for power grid assets and systems to support planning decisions. Yet, no such mechanism exists. To address this need, our goals are to: (1) Develop and execute a state-of-the-art multi-model framework to assess future climate-water impacts and risks to the grid, including sensitivities to varying hydrologic drivers and infrastructure scenarios. (2) Create a standardized interactive visualization platform, using data from the climate-water risk assessments, that enables stakeholders to evaluate climate-water impacts, risks, and adaptation measures for power systems.
New U.S. Data Tools are Playing a Crucial Role in Decarbonizing Buildings at Speed, Scale, and Low Cost
Preparing buildings for retrofits traditionally requires expensive on-site audits or time- intensive simulation models. As a result, the majority of buildings fail to pursue cost-saving retrofits. To address these barriers, the U.S. Department of Energy (DOE) has introduced the Building Efficiency Targeting Tool for Energy Retrofits (BETTER)—a new, free, on-line tool that utilizes a data-driven analytical engine and user-friendly web interface to automatically analyze a building’s monthly energy usage in response to weather conditions. The tool benchmarks a building’s electric and fossil energy usage against peers; estimates energy, cost, and emissions reductions at the building and portfolio levels; recommends energy efficiency measures; and prioritizes buildings for net-zero energy retrofits. Thanks to interoperability with the DOE’s Standard Energy Efficiency Data (SEED) platform, BETTER is supporting U.S. jurisdictions to prepare buildings for retrofit at speed, scale, and low cost to comply with energy policies. This paper discusses the use of BETTER and SEED by one of the branches of the California state government to streamline a retrofit program across 455 public non-residential buildings to align with state goals to reduce greenhouse gas emissions. It describes the organization’s challenge to reduce energy consumption across a geographically diverse, aging portfolio; explores how BETTER and SEED improved workflow efficiency; presents preliminary results, including avoiding audit costs of $3.28 million and developing the groundwork for retrofit projects estimated to prevent emission of 2,271 t CO2e annually; and provides guidance for other jurisdictions seeking similar results.
A Hybrid System for High-Accuracy Timekeeping Using Millisecond Pulsars
Millisecond pulsars exhibit extremely stable rotational periods with negligible long-term variation, comparable to atomic clocks. Leveraging pulsar signal stability, this paper presents a hybrid Pulse Per Second (PPS) generation system for high-accuracy and GPS-independent timing. The system combines pulsar and GPS signals through a high-speed data acquisition platform featuring FPGA-driven processing and techniques. This design provides a reliable and precise timekeeping solution for energy systems, ensuring functionality when GPS signals are unavailable.
TransPlatformer
We propose TransPlatformer for translating toxicogenomics from one platform to another. Transcriptomic profiling has evolved through multiple generations of technology, from microarrays (e.g., Affymetrix, CodeLink) to more recent high-throughput sequencing and targeted panels such as S1500+. Microarrays, which dominated gene expression studies in the early 2000s, provided affordable and high-throughput transcript quantification but suffered from cross-hybridization issues and limited dynamic range . RNA-Seq, introduced in the late 2000s, revolutionized transcriptomics by enabling unbiased and comprehensive gene expression analysis, albeit at higher costs and computational demands . Despite advances, many studies rely on historical microarray data, necessitating the translation of legacy data into modern platforms to ensure continuity and comparability. This translation is complicated by factors such as platform-specific probe design, differences in transcript coverage, and batch effects . Existing methods for cross-platform mapping include statistical normalization, machine learning models, and biological anchoring approaches. The ability to translate transcriptomic data between platforms has broad implications, including enhanced meta-analyses, improved toxicological modeling, and better integration of historical datasets with contemporary research. TransPlatformer seeks to contribute to this effort by evaluating translation methodologies and proposing novel strategies to improve cross-platform gene expression harmonization. In this repository there are code examples for TransPlatformer implementation
A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)
Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.
MultiProBE Software Platform
MultiProBE Software Platform is cloud based multi-omic data repository and data processing compute platform.
Dataset from ORNL Flexible Research Platform (FRP)
The data comes from a two-story light commercial building which can be used to physically simulate light commercial buildings common in the nation's existing building stock. Based on a data collection plan, these measurements were performed for five different building operations. In the data set for each period, 98 data variables were selected and collected, in which 7 variables are weather data and the rest are all building and system operation data.
The Galaxy platform for accessible, reproducible, and collaborative data analyses: 2024 update
Galaxy (https://galaxyproject.org) is deployed globally, predominantly through free-to-use services, supporting user-driven research that broadens in scope each year. Users are attracted to public Galaxy services by platform stability, tool and reference dataset diversity, training, support and integration, which enables complex, reproducible, shareable data analysis. Applying the principles of user experience design (UXD), has driven improvements in accessibility, tool discoverability through Galaxy Labs/subdomains, and a redesigned Galaxy ToolShed. Galaxy tool capabilities are progressing in two strategic directions: integrating general purpose graphical processing units (GPGPU) access for cutting-edge methods, and licensed tool support. Engagement with global research consortia is being increased by developing more workflows in Galaxy and by resourcing the public Galaxy services to run them. The Galaxy Training Network (GTN) portfolio has grown in both size, and accessibility, through learning paths and direct integration with Galaxy tools that feature in training courses. Code development continues in line with the Galaxy Project roadmap, with improvements to job scheduling and the user interface. Environmental impact assessment is also helping engage users and developers, reminding them of their role in sustainability, by displaying estimated CO 2 emissions generated by each Galaxy job.
UAS remote sensing (Autel EVO II platform): Red-green-blue (RGB) imagery and derived products (Level 0-2 data), Seward Peninsula, Alaska, 2022
Airborne remote sensing data collected using a optical red-green-blue (RGB) sensor installed on an Autel EVO II unoccupied aerial system (UAS). This package includes data from 15 flights flown over the NGEE-Arctic Council Mile Marker (MM) 71, Kougarok MM64, and Teller MM27 sites on the Seward Peninsula, Alaska USA, in July 2022. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors, and Level 1-2 processed products including digital surface models (DSM), photo orthomosaics, canopy height models (CHM) and digital terrain models (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as image (*.jpg, *.tif), point cloud (*.laz), tabular (*.csv) and *.pdf formats. Raw images are compressed as tar.gz. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the data and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
UAS remote sensing (Autel EVO II platform): Red-green-blue (RGB) imagery and derived products (Level 0-2 data), Seward Peninsula, Alaska, 2023
Airborne remote sensing data collected using a optical red-green-blue (RGB) sensor installed on an Autel EVO II unoccupied aerial system (UAS). This package includes data from 4 flights flown over the NGEE-Arctic Council Mile Marker (MM) 71 and Teller MM27 sites on the Seward Peninsula, Alaska USA, in July 2023. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors, and Level 1-2 processed products including digital surface models (DSM), photo orthomosaics, canopy height models (CHM) and digital terrain models (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as image (*.jpg, *.tif), point cloud (*.laz), tabular (*.csv) and *.pdf formats. Raw images are compressed as tar.gz. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the data and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
DuraMAT Data Hub
The DuraMAT Data Hub has been supporting the consortium for the past six years. The Data Hub has had success in supporting the projects, providing a platform for sharing data within projects and to the public, and learning how to better leverage the existing software platform and the available Amazon Web Services environment. During this new generation of the Data Hub, we are looking at ways to help improve the data hub architecture, user experience, and improve operations by taking advantage of new technology platforms and software that will be more impactful on the consortium researchers and the broader scientific community. In this poster we will look at the current operational capabilities, data dissemination, and development that will improve the system in the near and far future.
An interactive machine learning platform for analyzing multi-particle coincidence data from cold target recoil ion momentum spectroscopy
We present SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training), a comprehensive software platform for analyzing tabulated high-dimensional multi-particle coincidence data from Cold Target Recoil Ion Momentum Spectroscopy (COLTRIMS) experiments. The software addresses critical challenges in modern momentum spectroscopy by integrating advanced machine learning techniques with physics-informed analysis in an interactive web-based environment. SCULPT implements uniform manifold approximation and projection for non-linear dimensionality reduction to reveal correlations in high-dimensional data. We also discuss potential extensions to deep autoencoders for feature learning and genetic programming for automated discovery of physically meaningful observables. A novel adaptive confidence scoring system provides quantitative reliability assessments by evaluating user-selected clustering quality metrics with predefined weights that reflect each metric’s robustness. The platform features configurable molecular profiles for different experimental systems, interactive visualization with selection tools, and comprehensive data filtering capabilities. Utilizing a subset of SCULPT’s capabilities, we analyze photo-double-ionization data measured using the COLTRIMS method for three-body dissociation of the D 2 O molecule, revealing distinct fragmentation channels and their correlations with physics parameters. The software’s modular architecture and web-based implementation make it accessible to the broader atomic and molecular physics community, significantly reducing the time required for complex multi-dimensional analyses. This opens the door to finding and isolating rare events exhibiting non-linear correlations on the fly during experimental measurements, which can help steer exploration and improve the efficiency of experiments.