Search NASA⌕ Search

SEARCH · Search NASA

Results for “gridded data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

CACTI CSAPR2 Taranis Retrievals

Taranis is an end-to-end processing chain for radar data written in Python with C extension for computation performance. Features include: masking for quality control, specific differential phase (Kdp), attenuation correction for reflectivity factor (Z) and differential reflectivity (Zdr) in rain, and additional geophysical retrievals. Retrievals are mostly drawn from literature or open-source software when appropriate, and have been tested, tuned, and modified to work with one another cohesively rather than using isolated off-the-shelf algorithms. Incorporated algorithms include hydrometeor (echo) identification, rain water content, raindrop mass-weighted mean diameter (gamma size distribution assumption), and rainfall rate (QPE). Taranis data sets exist for CSAPR2 PPI, HSRHI, and sector RHI scans. Cartesian-gridded data sets were also produced as well as a near-surface rain rate retrieval. More details can be found in the README.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

Subsetting Satellite Level 2 Data at NASA GES DISC

Working with Level 2 satellite swath data can prove challenging for many users. The variety of metadata, high resolution, and orbit-based nature of such data makes it difficult to acquire and manage. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has developed a general-purpose Level 2 Subsetting service that facilitates access to Level 2 data products. The Level 2 Subsetter enables users to sub-sample swath and gridded data in a variety of ways: by location (in a lat/lon box, within a circle of given radius, or at a specific point), by time (via swath segments or collections of granules), by any nonspatial dimension, or by selecting specific variables. The Level 2 Subsetting service also allows users to specify output data configuration and file format. In this presentation, we will detail and demonstrate the capabilities of this new service.

Huwe, Paul↗
DOE OSTI2020

Probabilistic Look-ahead Contingency Analysis Integration with Commercial Tool and Practical Data

This paper presents an initial effort of integrating a smart sampling-based probabilistic look-ahead contingency analysis algorithm with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool as a proof-of-concept for a seamless research tool integration using real world large-scale grid data. With the increasing impact of random forces such as variable generation and load, their stochastic behaviors cannot be ignored. However, the current practices are still dominated by deterministic tools. They are becoming increasingly inadequate for the future grid. The developed look-ahead contingency analysis algorithm incorporates forecast errors of variable energy and load to address the challenges brought by the increasing uncertainty of power system. The algorithm can reveal the potential violations caused by the variance of variable energy and load that are not normally detected by traditional deterministic approaches. To test its performance under practical environments ( real data with real commercial tool), significant efforts have been made to prepare test cases, modify GE EMS tool, and adapt an extreme value distribution algorithm to analyze the GE EMS’s violation-only outputs. The test results clearly demonstrate the effectiveness of the developed algorithm as new transformer violations that were not previously detected have been identified. This performance provides better situational awareness to engineers for their decision-making process under uncertainty. Moreover, with the discussion of computational performance and future work, this paper has shown a clear path for integrating the probabilistic algorithm with commercial tools to make us better equipped for the changing power system.

Modeling and simulation of power systems, constrai↗
DOE OSTI2021

Optimal interpolation of global dissolved oxygen: 1965–2015

Oxygen inventory of the global ocean has declined in recent decades potentially due to the warming-induced reduction in solubility as well as the circulation and biogeochemical changes associated with ocean warming and increasing stratification. Earth System Models predict continued oxygen decline for this century with profound impacts on marine ecosystem and fisheries. Observational constraint on the rate of oxygen loss is crucial for assessing the ability of models to accurately simulate these changes. There are only a few observational assessments of the global oceanic oxygen inventory reporting a range of oxygen loss. This study develops a gridded data set of dissolved oxygen for the global oceans using optimal interpolation method. The resulting gridded product includes full-depth map of dissolved oxygen as 5-year moving average from 1965 to 2015 with uncertainty estimates. The uncertainty can come from unresolved small-scale and high-frequency variability and mapping errors. The multi-decadal trend of global dissolved oxygen is in the range of -281 to -373 Tmol/decade. This estimate is more conservative than previous works. In this study, the grid points far from the observations are essentially set equal to zero anomaly from the climatology. Calculating global inventory with this approach produces a relatively conservative estimate; thus, the results from this study likely provide a useful lower bound estimate of the global oxygen loss.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

A Status Update for the FLASHFlux Working Group

This presentation provides an overview of the progress made by the FLASHFlux working group within the CERES Science Team. FLASHFlux is maintaining operations, continuing validation, migration production code for future production systems, and evaluating new inputs for their impacts on the current radiative flux data products. FLASHFlux data products continue to be served to the community and comprise the low latency solar and thermal infrared data products provided to the energy and agricultural communities at relatively low latency for global gridded data fluxes. (< 7days).

surface radiative flux↗
DOE OSTI2025

Adapting Grid Criticality for Data Centers

This presentation explores the evolving definition of “critical load” in the electric grid, emphasizing the growing importance of digital infrastructure—particularly data centers—in grid resilience, restoration, and modernization. As utilities increasingly rely on AI-driven analytics and software-defined control systems, data centers have shifted from passive electricity consumers to essential computational hubs that enable National Critical Functions (NCFs) and support real-time grid operations. The deck examines the scale and impact of digital loads, the need for grid modernization to manage rapid load growth, and the diverse computing paradigms required for AI deployment. It introduces a tiered taxonomy for classifying critical loads, highlights operational dependencies between the grid and digital infrastructure, and discusses policy implications for integrating data centers into emergency planning and restoration protocols. Through case studies and practical frameworks, the presentation provides actionable insights for utilities, regulators, and planners navigating the digital transformation of the power sector.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗
DOE OSTI2025

Seismic Contingency Auto Generator

This code takes in premade earthquake scenario XML files from USGS, power grid data, and converts them into a contingency file (.con file) that can be used by power grid solvers. Within the .con file are a number (Specified by the user) of contingencies that have randomly failed power transformers based on their likelihood of failure and peak ground acceleration (PGA) value around the transformer. The transformers' likelihood of failure was calculated based on a variety of finite element modeling on various transformer designed for specific transformer voltage classes. Parameters from these FEM were used to create generic fragility curves for transformers within a specific voltage class, which correspond with earthquake PGA values to produced a probability of failure for a given earthquake scenario. More refined versions of this process, such as specifying specific transformer design categories within a voltage class, could also be applied in future iterations of the software.

Vaagensmith, Bjorn [Idaho National Laboratory (INL↗
DOE OSTI2024

GLIMPSE of Future Power Grid Models

Power grid is one of the critical national infrastructures with social, economics, and national security impacts. Particularly, power distribution systems represent part of the infrastructure between power distribution substations and customers such as residential, commercial, and industrial. To address various grid modernization challenges, state-of-the-art algorithms and methodologies have been developed to deploy, operate, and expand a secure and resilient power grid. At the same time, there is a need to develop capabilities to assist power grid stakeholders to quickly get insight into the design and structure of the grid. Data visualization is a key approach to comprehend and understand complex systems such as the power grid. We present GLIMPSE Grid Layout Interface for Model Preview and System Exploration), a graph-based semantic-aware application to visualize and update distribution power grid models. The GLIMPSE can be used with standard IEEE models to search and highlight power grid objects such as generators, loads, overhead lines, etc. Additionally, it supports updating attributes and model export to integrate with GridLAB-D simulations.

Cybersecurity, power grid, visualization↗
NASA NTRS2003

Data Assimilation Office (DAO) Operational Analyses and Reanalyses for Coordinated Enhanced Observing Period (CEOP)

The DAO operational assimilation system has produced and archived gridded data since 1998, and will continue through the CEOP period. However, major system upgrades and new assimilation variables will significantly affect the surface energy balance and data product. These changes will be discussed and the prospects for a CEOP reanalysis will be presented. W e will also review the data currently available and describe how to access the data.

Bosilovich, M.↗
DOE OSTI2022

Lithologies and Depositional Environments for the NATCARB Saline Reservoirs

This dataset summarize the results of a literature review performed to define the primary lithologies and depositional environments for the target reservoir units defined by the National Carbon Sequestration Database (NATCARB) Saline reservoir 10km Grid data layer, accessible at https://edx.netl.doe.gov/dataset/natcarb. The potential saline storage reservoirs, defined in the Saline 10km Grid layer and in this sheet as "RESOURCE_NAME", were summarized and a literature review was completed to define the primary lithology and depositional environment, and sometimes a secondary lithology and depositional environment for each rock unit. If no verifiable resources were found during the literature review, the primary and secondary lithology and depositional environments were left blank. This file is organized by sheets for each of the 7 Regional Carbon Sequestration Partnerships (RCSP): Big Sky Carbon Sequestration Partnership (BSCSP), the Midwest Geological Sequestration Consortium (MGSC), the Midwest Regional Carbon Sequestration Partnership (MRCSP), the Plains CO₂ Reduction Partnership (PCOR), the Southeast Regional Carbon Sequestration Partnership (SECARB), the Southwest Regional Partnership on Carbon Storage (SWP), and the West Coast Regional Carbon Sequestration Partnership (WESTCARB). The partnerships last updated the NATCARB database in 2015.

Basin↗
NASA NTRS2015

Global Precipitation Measurement (GPM) Mission: Precipitation Processing System (PPS) GPM Mission Gridded Text Products Provide Surface Precipitation Retrievals

In February 2015, the Global Precipitation Measurement (GPM) mission core satellite will complete its first year in space. The core satellite carries a conically scanning microwave imager called the GPM Microwave Imager (GMI), which also has 166 GHz and 183 GHz frequency channels. The GPM core satellite also carries a dual frequency radar (DPR) which operates at Ku frequency, similar to the Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar, and a new Ka frequency. The precipitation processing system (PPS) is producing swath-based instantaneous precipitation retrievals from GMI, both radars including a dual-frequency product, and a combined GMIDPR precipitation retrieval. These level 2 products are written in the HDF5 format and have many additional parameters beyond surface precipitation that are organized into appropriate groups. While these retrieval algorithms were developed prior to launch and are not optimal, these algorithms are producing very creditable retrievals. It is appropriate for a wide group of users to have access to the GPM retrievals. However, for researchers requiring only surface precipitation, these L2 swath products can appear to be very intimidating and they certainly do contain many more variables than the average researcher needs. Some researchers desire only surface retrievals stored in a simple easily accessible format. In response, PPS has begun to produce gridded text based products that contain just the most widely used variables for each instrument (surface rainfall rate, fraction liquid, fraction convective) in a single line for each grid box that contains one or more observations.This paper will describe the gridded data products that are being produced and provide an overview of their content. Currently two types of gridded products are being produced: (1) surface precipitation retrievals from the core satellite instruments GMI, DPR, and combined GMIDPR (2) surface precipitation retrievals for the partner constellation satellites. Both of these gridded products are generated for a.25 degree x.25 degree hourly grid, which are packaged into daily ASCII (American Standard Code for Information Interchange) files that can downloaded from the PPS FTP (File Transfer Protocol) site. To reduce the download size, the files are compressed using the gzip utility.This paper will focus on presenting high-level details about the gridded text product being generated from the instruments on the GPM core satellite. But summary information will also be presented about the partner radiometer gridded product. All retrievals for the partner radiometer are done using the GPROF2014 algorithmusing as input the PPS generated inter-calibrated 1C product for the radiometer.

precipitation↗
NASA NTRS2019

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher↗
NASA NTRS1987

TOMS: The Antarctic ozone hole and ozone trends

The Total Ozone Mapping Spectrometer (TOMS) instrument aboard Nimbus 7 has proved invaluable for the investigation of the recent rapid decline in the springtime total ozone over the Antarctic. The principle problem discussed is that of observing the atmosphere over long periods of time to determine whether or not trends and/or slow oscillations are taking place. Total ozone is an excellent summary parameter for the state of the stratosphere. It responds to temperature changes, and in the long term, is expected to respond to chemical changes. Thus, when changes take place in total ozone, such as the springtime Antarctic decrease it is a clear indication of an important problem, both because of environmental potential and scientific importance. TOMS is actually an overkill for this problem. Significantly more data is taken than is necessary. Tests have shown that maps produced on a 2 by 4 degree grid are essentially equivalent to those produced from the entire gridded data set. Because the critical aspect of the search for changes in ozone is continuous data, reflight of a polar orbiting TOMS is important. Included in the flight should be a stratospheric temperature sensor and, if possible, a modification to obtain some ozone altitude information. A critical aspect of the problem is timeliness of the data. This is the only drawback of the existing TOMS. It is expected that in the very near future the processing will be done within two weeks of real time. This is critical to the process of discovery of phenomena such as the Antarctic ozone hole.

Stolarski, Richard S.↗
DOE OSTI2023

QuadConv: Quadrature-based convolutions with applications to non-uniform PDE data compression

We present a new convolution layer for deep learning architectures which we call QuadConv — an approximation to continuous convolution via quadrature. Our operator is developed explicitly for use on non-uniform, mesh-based data, and accomplishes this by learning a continuous kernel that can be sampled at arbitrary locations. Moreover, the construction of our operator admits an efficient implementation which we detail and construct. As an experimental validation of our operator, we consider the task of compressing partial differential equation (PDE) simulation data from fixed meshes. Here, we show that QuadConv can match the performance of standard discrete convolutions on uniform grid data by comparing a QuadConv autoencoder (QCAE) to a standard convolutional autoencoder (CAE). Further, we show that the QCAE can maintain this accuracy even on non-uniform data. In both cases, QuadConv also outperforms alternative unstructured convolution methods such as graph convolution.

Compression↗
NASA NTRS2005

Custom Sky-Image Mosaics from NASA's Information Power Grid

yourSkyG is the second generation of the software described in yourSky: Custom Sky-Image Mosaics via the Internet (NPO-30556), NASA Tech Briefs, Vol. 27, No. 6 (June 2003), page 45. Like its predecessor, yourSkyG supplies custom astronomical image mosaics of sky regions specified by requesters using client computers connected to the Internet. Whereas yourSky constructs mosaics on a local multiprocessor system, yourSkyG performs the computations on NASA s Information Power Grid (IPG), which is capable of performing much larger mosaicking tasks. (The IPG is high-performance computation and data grid that integrates geographically distributed 18 NASA Tech Briefs, September 2005 computers, databases, and instruments.) A user of yourSkyG can specify parameters describing a mosaic to be constructed. yourSkyG then constructs the mosaic on the IPG and makes it available for downloading by the user. The complexities of determining which input images are required to construct a mosaic, retrieving the required input images from remote sky-survey archives, uploading the images to the computers on the IPG, performing the computations remotely on the Grid, and downloading the resulting mosaic from the Grid are all transparent to the user

Jacob, Joseph↗
NASA NTRS1990

A global view of lander-to-orbiter communications accessibility for a Mars Global Network Mission

Given the mission objective to deploy a number of small landers to the surface of Mars at various latitude/longitude locations, it is of interest to obtain a global perspective of the communications link geometry between the landers and a data relay orbiter. Specifically, the question to be answered is what is the total time interval over one Martian day (1 sol) that a lander at any given latitude and longitude can communicate data to the orbiter. Results should be obtained for more than one elevation angle constraint (lander antenna design issue), and also for several time points into the mission since the orbiter's periapsis location moves under the influence of Mars' oblateness perturbation. Such information is presented in terms of global contour maps of available communications time per sol summed over all orbiter pases on that day. Global data of this type complements more detailed local site data such as communications range and elevation vs time per pass. Communications time contour maps are included here for sol grids of 180, 232, 318, 361, and 404 corresponding to orbiter periapsis latitudes of 35 S, 90 S, equatorial, 45 N, and 90 N. For each of these days, there is a map for both a 15 deg and 45 deg minimum elevation constraint on the lander-to-orbiter line of sight. The jagged appearance of the contour lines is due to computational resolution in interpolating between a finite number of latitude/longitude grid points. Although the contours should really be smooth, the general information content is represented by the lower resolution maps shown here. An example of the tabulated, finite-grid data points is also given. Communication with all sites is possible at the 15 deg elevation constraint, at times only for several minutes per sol but more generally for a much longer time up to 14 hours per sol. Significantly less time is available with a 45 deg elevation constraint, and at certain times in the mission some localized regions of the planet are inaccessible. Still, one may conclude that the reference orbit selection will support a more than adequate communications link through the mission timeline with landers emplaced at any desired location on Mars.

Friedlander, Alan L.↗