Search NASA⌕ Search

SEARCH · Search NASA

Results for “gridded data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Distribution System Dataset Generator for AI Applications [SWR-24-75]

This software is a simple, light-weight python package to generate pytorch compatible machine learning graph dataset representing electric power distribution system. User is able to use these graph datasets to test their graph generation artificial intelligence (AI) models, link prediction AI models, graph classification AI models and so much more. This package uses grid-data-models (https://github.com/NREL-Distribution-Suites/grid-data-models) as input data format for power distribution system. NREL-Ditto (https://github.com/NREL-Distribution-Suites/ditto) tool can be leveraged to transform popular distribution system file formats such as opendss, cyme and synergi to grid-data-models.

Duwadi, Kapil↗
DOE OSTI2021

Solar-to-Grid Public Data File for Utility-scale (UPV) and Distributed Photovoltaics (DPV) Generation, Capacity Credit, and Value for 2012-2020

Lawrence Berkeley National Laboratory (Berkeley Lab) estimates hourly project-level generation data for utility-scale solar projects and hourly county-level generation data for residential and non-residential distributed photovoltaic (PV) systems in the seven organized wholesale markets and 10 additional Balancing Areas. To encourage its broader use, Berkeley Lab has made this data file public here at OEDI, covering the years 2012-2020. The public project-level dataset is updated annually with data from the previous calendar year. For more information about the research project, including a technical report, briefing material, visualizations, and additional data, please visit the project homepage linked in this submission.

annual solar value↗
DOE OSTI2025

Enhancing Streamflow Reanalysis Across the Conterminous US Leveraging Multiple Gridded Precipitation Data Sets

Streamflow observations, essential for various water resource applications, are often unavailable at critical locations in need. Although different models have been proposed to enhance streamflow predictability at ungauged locations, the challenge extends beyond model fidelity. Differences in meteorologic forcing data sets, precipitation in particular, can significantly affect the accuracy of hydrologic predictions. This challenge intensifies across regions characterized by diverse hydro-climatological and geographical conditions, such as in the conterminous US (CONUS) where a single precipitation product struggles to consistently replicate observed hydrographs, particularly peak flow dynamics. To enhance streamflow predictions, we utilize a VIC-RAPID hydrologic modeling framework driven by multiple commonly used meteorological forcing data sets, such as Daymet, PRISM, ST4, AORC, and their hybrids and create multiple sets of 40-year (1980–2019) hourly, daily, and monthly streamflow reanalysis, Dayflow Version 2, for 2.7 million river reaches across the CONUS. Most forcings lead to skillful streamflow performance, except for ST4 in the mountainous west, where severe radar blockage adversely affects the accuracy. The evaluation using over 6,000 hourly stream gauges shows that hourly AORC and ST4 lead to improved annual peak flow performance over Daymet—driven streamflow (Dayflow V1), particularly in smaller basins, highlighting the value of high temporal resolution forcings in hydrologic predictions. Compared with other benchmark data sets like National Water Model V3.0, AORC-driven VIC-RAPID exhibits improved regional streamflow performance, with comparable peak flow representation. We envision that multi-forcing streamflow reanalysis data can inform regions in need of forcing data enhancement, diagnose hydrologic model performance, and benefit diverse water resource applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

OEDI—Solar Grid Integration Data and Analytics Library

As a part of the Open Energy Data Initiative, this effort aims to develop and demonstrate novel distribution state estimation, control optimization, and transient analysis as well as provide access to data, data integration, and mapping information. More specifically, the focus of the effort will be on physics-based distribution system state estimation, hybrid (physics-based and machine learning) distribution optimal power flow, and event detection/analysis for solar integration and analytics. This work will enable reproducible, robust, replicable, and generalizable R&D in simulation and emulation of solar system integration. These test models and datasets will provide an integrated library for developing and testing power system operation technologies. To make the library user-friendly, this project will provide data curation tools such as data translators, mapping scripts and APIs, database schemas and metadata, interfaces and user dashboard, source code for the reference algorithms, description of the use-cases/scenarios, and comprehensive information on all the assumptions.

14 SOLAR ENERGY↗
DOE OSTI2021

An Extreme-Preserving Long-Term Gridded Daily Precipitation Data Set for the Conterminous United States

Extreme daily precipitation contributes to flooding that can cause significant economic damages, and so is important to properly capture in gridded meteorological data sets. This work examines precipitation extremes, the mean precipitation on wet days, and fraction of wet days in two widely used gridded data sets over the conterminous U.S. (CONUS). When compared to the underlying station observations, the gridded data show a 27% reduction in annual 1-day maximum precipitation, 25% increase in wet day fraction, 1.5 to 2.5 day increase in mean wet spell length, 30% low bias in 20-year return values of daily precipitation, and 25% decrease in mean precipitation on wet days. It is shown these changes arise primarily from the time-adjustment applied to put the precipitation gauge observations into a uniform time frame, with the gridding process playing a lesser role. A new daily precipitation data set is developed that omits the time-adjustment (as well as extending the gridded data by 7 years) and is shown to perform significantly better in reproducing extreme precipitation metrics. When the new data set is used to force a land surface model, annually averaged 1-day maximum runoff increases 38% compared to the original data, annual mean runoff increases 17%, evapotranspiration drops 2.3%, and fewer wet days leads to a 3.3% increase in estimated solar insolation. Consequently, these changes are large enough to affect portrayals of flood risk and water balance components important for ecological and climate-change applications across the CONUS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Foundation Models for the Electric Power Grid

Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of complex systems and dynamics can be applied to many downstream applications. Therefore, advances in FMs can find uses in electric power grids, challenged by the energy transition and climate change. This paper calls for the development of FMs for electric grids. We highlight their strengths and weaknesses amidst the challenges of a changing grid. It is argued that FMs learning from diverse grid data and topologies, which we call grid foundation models (GridFMs), could unlock transformative capabilities, pioneering a new approach to leveraging AI to redefine how we manage complexity and uncertainty in the electric grid. Finally, we discuss a practical implementation pathway and road map of a GridFM-v0, a first GridFM for power flow applications based on graph neural networks, and explore how various downstream use cases will benefit from this model and future GridFMs.

AI-based power flow simulation↗
DOE OSTI2024

ARPA-E Grid Optimization (GO) Competition Challenge 1

The ARPA-E Grid Optimization (GO) Competition Challenge 1, from 2018 to 2019, focused on the basic Security Constrained AC Optimal Power Flow problem (SCOPF) for a single time period. The Challenge utilized sets of unique datasets generated by the ARPA-E GRID DATA program. Each dataset consisted of a collection of power system network models of different sizes with associated operating scenarios (snapshots in time defining instantaneous power demand, renewable generation, generator and line availability, etc.). The datasets were of two types: Real-Time, which included starting-point information, and Online, which did not. Week-Ahead data is also provided for some cases but was not used in the Competition. Although most datasets were synthetic and generated by GRIDDATA, a few came from industry and were only used in the Final Event. All synthetic Input Data and Team Results for the GO Competition Challenge 1 for the Sandbox, Trial Events 1 to 3, and the Final Event along with problem, format, scoring and rules descriptions are available here. Data for industry scenarios will not be made public. Challenge 1, a minimization problem, required two computational steps. Solver 1 or Code 1 solved the base SCOPF problem under a strict wall clock time limit, as would be the case in industry, and reported the base case operating point as output, which was used to compute the Objective Function value that was used as the scenario score. The feasibility of the solution was provided by the Solver 2 or Code 2, which solves the power flow problem for all contingencies based on the results from Solver 1. This is not normally done in industry, so the time limits were relaxed. In fact, there were no time limits for Trial Event 1. This proved to be a mistake, with some codes running for more than 90 hours, and a time limit of 2 seconds per contingency was imposed for all other events. Entrants were free to use their own Solver 2 or use an open-source version provided by the Competition. Containers, such as Docker, were considered to improve the portability of codes, but none that could reliably support a multi-node parallel computing environment, e.g., MPI, could be found. For more information on the competition and challenge see the "GO Competition Challenge 1 Information" and "GO Competition Challenge 1 Additional Information" resources below.

ACOPF↗
DOE OSTI2020

Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6

The Observations for Model Intercomparison Project (Obs4MIPs) was initiated in 2010 to facilitate the use of observations in climate model evaluation and research, with a particular target being the Coupled Model Intercomparison Project (CMIP), a major initiative of the World Climate Research Programme (WCRP). To this end, Obs4MIPs (1) targets observed variables that can be compared to CMIP model variables; (2) utilizes dataset formatting specifications and metadata requirements closely aligned with CMIP model output; (3) provides brief technical documentation for each dataset, designed for nonexperts and tailored towards relevance for model evaluation, including information on uncertainty, dataset merits, and limitations; and (4) disseminates the data through the Earth System Grid Federation (ESGF) platforms, making the observations searchable and accessible via the same portals as the model output. Taken together, these characteristics of the organization and structure of obs4MIPs should entice a more diverse community of researchers to engage in the comparison of model output with observations and to contribute to a more comprehensive evaluation of the climate models. At present, the number of obs4MIPs datasets has grown to about 80; many are undergoing updates, with another 20 or so in preparation, and more than 100 are proposed and under consideration. A partial list of current global satellite-based datasets includes humidity and temperature profiles; a wide range of cloud and aerosol observations; ocean surface wind, temperature, height, and sea ice fraction; surface and top-of-atmosphere longwave and shortwave radiation; and ozone (O 3 ), methane (CH 4 ), and carbon dioxide (CO 2 ) products. A partial list of proposed products expected to be useful in analyzing CMIP6 results includes the following: alternative products for the above quantities, additional products for ocean surface flux and chlorophyll products, a number of vegetation products (e.g., FAPAR, LAI, burned area fraction), ice sheet mass and height, carbon monoxide (CO), and nitrogen dioxide (NO 2 ). While most existing obs4MIPs datasets consist of monthly-mean gridded data over the global domain, products with higher time resolution (e.g., daily) and/or regional products are now receiving more attention. Along with an increasing number of datasets, obs4MIPs has implemented a number of capability upgrades including (1) an updated obs4MIPs data specifications document that provides additional search facets and generally improves congruence with CMIP6 specifications for model datasets, (2) a set of six easily understood indicators that help guide users as to a dataset's maturity and suitability for application, and (3) an option to supply supplemental information about a dataset beyond what can be found in the standard metadata. With the maturation of the obs4MIPs framework, the dataset inclusion process, and the dataset formatting guidelines and resources, the scope of the observations being considered is expected to grow to include gridded in situ datasets as well as datasets with a regional focus, and the ultimate intent is to judiciously expand this scope to any observation dataset that has applicability for evaluation of the types of Earth system models used in CMIP.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

sfccldgrid2longstation

The site data in a station data product format used to produce the gridded cloud grid data product, sfccldgrid2caracena.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Multi-View Convolutional Neural Network for Data Spoofing Cyber-Attack Detection in Distribution Synchrophasors

Security of Distribution Synchrophasors Data (DSD) is of paramount importance as the data is used for critical smart grid applications including situational awareness, advanced protection, and dynamic control. Unfortunately, the DSD are attractive targets for malicious attackers aiming to damage grid. Data spoofing is a new class of deceiving attack, where the DSD of one Phasor Measurement Units (PMUs) is tampered by other PMUs thereby spoiling measurement based applications. In order to address this issue, a source authentication based data spoofing attack detection method is proposed using Multi-view Convolutional Neural Network (MCNN). First, common components embedded in raw frequency measurements from DSD are removed by Savitzky-Golay (SG) filter. Second, fast S transform (FST) is utilized to extract representative spatial fingerprints via time frequency analysis. Third, the spatial fingerprint is fed to MCNN, which combines dilated and standard convolutions for automatic feather extraction and source identification. Finally, according to the output of MCNN, spoofing attack detection is performed via threshold criterion. Extensive experiments with actual DSD from multiple locations in FNET/Grideye are conducted to verify the effectiveness of the proposed method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Projections of Hourly Meteorology by Balancing Authority Based on the IM3/HyperFACETS Thermodynamic Global Warming (TGW) Simulations

This dataset contains 40 years (1980-2019) of historical hourly meteorology and 80 years (2020-2099) of projected hourly meteorology for 54 Balancing Authorities (BAs) in the conterminous United States. Details about the scenarios and variables included in this dataset are in the readme.pdf file. This dataset is derived from the IM3/HyperFACETS Thermodynamic Global Warming (TGW) simulations (https://doi.org/10.57931/1885756). More details on the TGW approach can be found at: https://tgw-data.msdlive.org/. If you use this dataset please also cite the raw TGW dataset (Jones, A. D., Rastogi, D., Vahmani, P., Stansfield, A., Reed, K., Thurber, T., Ullrich, P., & Rice, J. S. (2022). IM3/HyperFACETS Thermodynamic Global Warming (TGW) Simulation Datasets (v1.0.0) [Data set]. MSD-LIVE Data Repository. https://doi.org/10.57931/1885756). To go from the TGW data to these BA-level aggregated data we first averaged the raw gridded data by county in the United States. That intermediate data step is also stored in MSD-LIVE (https://doi.org/10.57931/1960548). We then population-weight the county-level hourly data in order to create population-weighted meteorology time series for each BA. Historical populations are from the United States Census Bureau and the evolving future populations are based on Shared Socioeconomic Pathways (SSPs) 3 and 5. The four climate scenarios crossed with the two SSPs yield eight different future projections for each BA: rcp45cooler_ssp3, rcp45cooler_ssp5, rcp45hotter_ssp3, rcp45hotter_ssp5, rcp85cooler_ssp3, rcp85cooler_ssp5, rcp85hotterssp3, rcp85hotterssp5. For the historical period and each of the eight future scenarios the dataset has hourly estimates of the population-weighted average of five meteorological variables: Temperature, specific humidity, shortwave radiation, longwave radiation, and wind speed. All times are in Coordinated Universal Time (UTC). The code to go from the raw TGW data to county-level and then BA-level projections is available at: https://github.com/IMMM-SFA/im3components/tree/main/im3components/wrf_to_tell.

Balancing Authority↗
DOE OSTI2021

FEST: Facility Energy Saving and Securing Technology Using Multi-Source Data: (Milestone 2 Report)

This project aims to demonstrate three technologies developed in-house at LLNL and University of Michigan-Dearborn (UMD), at a military site, including i) Grid Data Crossing (called GriD-Xing) for increasing smart meter data usability, ii) Facility Energy Optimization (called Facility E-GO) for improving facility energy efficiency in both operation and planning perspectives, and iii) Co-simulation tool (called Co-Sim) for enhancing smart meter and energy facility networks resilience and security. In this report, Millstone 2 - Integration A: Integrate GriD-Xing and facility optimization tools is documented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Sample IEEE123 Bus system for OEDI SI

Time series load and PV data from an IEEE123 bus system. An example electrical system, named the OEDI SI feeder, is used to test the workflow in a co-simulation. The system used is the IEEE123 test system, which is a well studied test system (see link below to IEEE PES Test Feeder), but some modifications were made to it to add some solar power modules and measurements on the system. The aim of this project is to create an easy-to-use platform where various types of analytics can be performed on a wide range of electrical grid datasets. The aim is to establish an open-source library of algorithms that universities, national labs and other developers can contribute to which can be used on both open-source and proprietary grid data to improve the analysis of electrical distribution systems for the grid modeling community. OEDI Systems Integration (SI) is a grid algorithms and data analytics API created to standardize how data is sent between different modules that are run as part of a co-simulation. The readme file included in the S3 bucket provides information about the directory structure and how to use the algorithms. The sensors.json file is used to define the measurement locations.

123 bus↗