Search NASASearch

SEARCH · Search NASA

Results for “gridded data products”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Integrated Hourly Meteorological Database of 20 Meteorological Stations (1981-2022) for Watershed Function SFA Hydrological Modeling

This dataset contains (a) a script “R_met_integrated_for_modeling.R”, and (b) associated input CSV files: 3 CSV files per location to create a 5-variable integrated meteorological dataset file (air temperature, precipitation, wind speed, relative humidity, and solar radiation) for 19 meteorological stations and 1 location within Trail Creek from the modeling team within the East River Community Observatory as part of the Watershed Function Scientific Focus Area (SFA). As meteorological forcings varied across the watershed, a high-frequency database is needed to ensure consistency in the data analysis and modeling. We evaluated several data sources, including gridded meteorological products and field data from meteorological stations. We determined that our modeling efforts required multiple data sources to meet all their needs. As output, this dataset contains (c) a single CSV data file (*_1981-2022.csv) for each location (20 CSV output files total) containing hourly time series data for 1981 to 2022 and (d) five PNG files of time series and density plots for each variable per location (100 PNG files). Detailed location metadata is contained within the Integrated_Met_Database_Locations.csv file for each point location included within this dataset, obtained from Varadharajan et al., 2023 doi:10.15485/1660962. This dataset also includes (e) a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata and (f) a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type. Review the (g) ReadMe_Integrated_Met_Database.pdf file for additional details on the script, methods, and structure of the dataset.The script integrates Northwest Alliance for Computational Science and Engineering’s PRISM gridded data product, National Oceanic and Atmospheric Administration’s NCEP-NCAR Reanalysis 1 gridded data product (through the `RCNEP` R package, Kemp et al., doi:10.32614/CRAN.package.RNCEP), and analytical-based calculations. Further, this script downscales the input data into hourly frequency, which is necessary for the modeling efforts.

54 ENVIRONMENTAL SCIENCES

Packaging data products using data grid middleware for Deep Space Mission Systems

We are investigating a distributed computing infrastructure for releasing science products out of the mission pipeline. We are creating a DSMS Product Service and DSMS Data Packaging Service based on the OODT middleware, a Data Grid middleware technology that has proven successful in providing access to heterogeneous, disparate data, and federating that data using a common data model.

Deep Space Mission Systems

Evaluation of daily gridded climate products using in situ FLUXNET data and tree growth modeling

Gridded climate data products have facilitated research in climate and ecology by providing meteorological data continuously across large spatial scales. However, the sensitivity of scientific outcomes to dataset choice remains poorly understood, and evaluation using station-based records can favor datasets built heavily on weather stations. Here, we evaluate seven high-resolution daily gridded datasets covering the contiguous United States using independent meteorology from the FLUXNET2015 dataset, with a focus on the implications of dataset choice for process-based tree growth modeling. We find that gridded products tend to capture temperature accurately while consistently overestimating the magnitude and frequency of precipitation and its extremes. Moreover, datasets vary in how they define a ‘day,’ which significantly affects temporal alignment with FLUXNET2015 observations. Despite differences among the datasets, the interannual variability in tree ring simulations is insensitive to dataset choice, likely because daily-scale biases are averaged out through accumulated growth across several months. However, inaccuracies in temperature and precipitation can significantly bias modeled xylem cell production, with systematically higher annual precipitation in the gridded datasets leading to greater xylem production compared to simulations using in situ data. Our results suggest that model applications, especially those that integrate to time scales longer than one day, are likely insensitive to climate dataset choice, but applications that are sensitive to daily climate variations or to absolute climate values need to carefully consider biases in gridded climate products.

54 ENVIRONMENTAL SCIENCES

ICESat-2 Mission: Status, Outlook, and Contributions to Polar Science

The Ice, Cloud and land Elevation Satellite-2 (ICESat-2) mission carries the Advanced Topographic Laser Altimeter System (ATLAS) lidar to measure the changing height of Earth surface. After more than 3 years of science data collection, ATLAS has emitted well over a trillion laser pulses and continues to operate nominally. The ICESat-2 data products were initially released in May 2019, and have been used in over 150 peer-reviewed publications to date. Recent community white papers have noted the importance of ice elevation measurements for the coming decades, and as CryoSat-2 has entered it’s second decade and future missions are uncertain, ICESat-2 will be a critical part of the Earth System Observatory for the 2020s. In the polar regions, ICESat-2 has enabled year-round sea ice freeboard measurements as well as ice sheet elevation changes on seasonal, annual, and decadal time scales when combined with other missions. These data enable measurement of change at fine spatial and temporal scales to help understand or characterize the processes driving these observations. As of this presentation, Release 005 is the current version of the along-track data products, including surface-specific products for sea ice, land ice, ground and canopy height, ocean, and inland water heights. In addition, first versions of gridded data products for land ice, sea ice, and ocean are all available. Data spans the start of the mission (14 October 2018) through early 2022. The ICESat-2 project has also begun to produce and distribute QuickLook products with a nominal 3-day latency (as opposed to the ~45-day latency of the final data products). Initial versions of these QuickLook products have elevation accuracy of ~3 meters, and geolocation accuracy of ~50 meters. All products are available through the National Snow and Ice Data Center (nsidc.org). This presentation will summarize the current state and health of the observatory, current state of the ICESat-2 data products, data product quality assessment, and outlook for the future.

ICESat-2

Global Precipitation Measurement (GPM) Mission: Precipitation Processing System (PPS) GPM Mission Gridded Text Products Provide Surface Precipitation Retrievals

In February 2015, the Global Precipitation Measurement (GPM) mission core satellite will complete its first year in space. The core satellite carries a conically scanning microwave imager called the GPM Microwave Imager (GMI), which also has 166 GHz and 183 GHz frequency channels. The GPM core satellite also carries a dual frequency radar (DPR) which operates at Ku frequency, similar to the Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar, and a new Ka frequency. The precipitation processing system (PPS) is producing swath-based instantaneous precipitation retrievals from GMI, both radars including a dual-frequency product, and a combined GMIDPR precipitation retrieval. These level 2 products are written in the HDF5 format and have many additional parameters beyond surface precipitation that are organized into appropriate groups. While these retrieval algorithms were developed prior to launch and are not optimal, these algorithms are producing very creditable retrievals. It is appropriate for a wide group of users to have access to the GPM retrievals. However, for researchers requiring only surface precipitation, these L2 swath products can appear to be very intimidating and they certainly do contain many more variables than the average researcher needs. Some researchers desire only surface retrievals stored in a simple easily accessible format. In response, PPS has begun to produce gridded text based products that contain just the most widely used variables for each instrument (surface rainfall rate, fraction liquid, fraction convective) in a single line for each grid box that contains one or more observations.This paper will describe the gridded data products that are being produced and provide an overview of their content. Currently two types of gridded products are being produced: (1) surface precipitation retrievals from the core satellite instruments GMI, DPR, and combined GMIDPR (2) surface precipitation retrievals for the partner constellation satellites. Both of these gridded products are generated for a.25 degree x.25 degree hourly grid, which are packaged into daily ASCII (American Standard Code for Information Interchange) files that can downloaded from the PPS FTP (File Transfer Protocol) site. To reduce the download size, the files are compressed using the gzip utility.This paper will focus on presenting high-level details about the gridded text product being generated from the instruments on the GPM core satellite. But summary information will also be presented about the partner radiometer gridded product. All retrievals for the partner radiometer are done using the GPROF2014 algorithmusing as input the PPS generated inter-calibrated 1C product for the radiometer.

precipitation

How Can NASA Science Benefit Solar Energy Development and Assessment?

This is a keynote presentation for a workshop highlighting the use of remote sensing and modeling products derived with NASA missions and Earth system modeling for solar energy system development. We broadly introduce NASA's fleet of satellite producing publicly available data products that would be useful for the information needed solar energy development. We also introduce the work in Earth system science modeling that provides additional global gridded data products that are also relevant. We identify that one issue is obtaining and using this data is the level of expertise needed to find it. NASA has developed a new Earth Action program to address this gap and bring the data closer to the user. Now under the Energy Resources element, the NASA LaRC's POWER (Prediction of Worldwide Renewable Energy) project has developed a web services platform that provides key information needed for solar energy development as analysis-ready. This means that the data for particular locations are immediately useful for help provide the information needed by engineers and architects to plan for solar systems. Thus, the presentation shows why NASA products would be relevant and then shows examples of finding the needed data through the POWER web portal.

remote sensing

Landscape-Scale Canopy Complexity in and Near Braulio Carillo National Park, Costa Rica

Using medium-large footprint lidar sampling of approximately 500 square km of Costa Rica, we assessed the vertical and horizontal complexity of a forest-dominated tropical landscape. As expected, vertical extents of structure and canopy heights estimated from lidar waveforms were smaller in high elevation forests than in forests at lower elevations. In areas of the park and long-protected areas of La Selva Biological Station, forests typically had more consistent ratios of median height to total height than areas with other types of recent land use. Areas outside the park exhibited both stronger and weaker spatial correlations in canopy properties than most areas within the park. We also simulated the effects of these differences on data products gridded from lidar transects, like those produced by the Vegetation Canopy Lidar (VCL) Mission.

Knox, Robert G.

Merged and Gridded GPM and Atmospheric River Data Product

The Global Precipitation Measurement (GPM) Mission Core Observatory satellite launched in 2014 as a joint mission between National Aeronautics and Space Administration (NASA) and JAXA. Global Precipitation Measurement (GPM) has, since that time, provided continuous, valuable dual-frequency radar and passive microwave radiometer observations. Here, we introduce a gridded data set of collocated GPM Core Observatory observational products merged with a reanalysis-derived Atmospheric river (AR) data set in the North Atlantic and North Pacific sectors. The three data sets that are merged and gridded are: (a) the NASA Goddard Profiling (GPROF) precipitation product, which uses GPM passive microwave radiometer observations to derive surface precipitation rates, (b) a water vapor data product derived from the GPM Core Observatory radiometer, provided by Remote Sensing Systems (RSS), and (c) the Mattingly et al. (2018, https://doi.org/10.1029/2018jd028714) AR data set that is specifically tuned to the high-latitude regions. This novel merged data set spans from May 2014 to December 2022 with plans to update annually through 2026 at minimum. This gridded product combines RSS passive water vapor and precipitation estimates with coincident AR detection. This data product benefits the scientific community by providing (a) user-friendly gridded satellite data compared to standard satellite data sets, while maintaining high temporal resolution, and (b) coincident satellite observations to assess the link between ARs and precipitation.

Marian E Mateling

Enhanced Product Generation at NASA Data Centers Through Grid Technology

This paper describes how grid technology can support the ability of NASA data centers to provide customized data products. A combination of grid technology and commodity processors are proposed to provide the bandwidth necessary to perform customized processing of data, with customized data subsetting providing the initial example. This customized subsetting engine can be used to support a new type of subsetting, called phenomena-based subsetting, where data is subsetted based on its association with some phenomena, such as mesoscale convective systems or hurricanes. This concept is expanded to allow the phenomena to be detected in one type of data, with the subsetting requirements transmitted to the subsetting engine to subset a different type of data. The subsetting requirements are generated by a data mining system and transmitted to the subsetter in the form of an XML feature index that describes the spatial and temporal extent of the phenomena. For this work, a grid-based mining system called the Grid Miner is used to identify the phenomena and generate the feature index. This paper discusses the value of grid technology in facilitating the development of a high performance customized product processing and the coupling of a grid mining system to support phenomena-based subsetting.

Barkstrom, Bruce R.

Digital overlaying of the universal transverse Mercator grid with LANDSAT data derived products

Picture elements of data from the LANDSAT multispectral scanner are correlated with the universal tranverse Mercator grid. In the procedure, a series of computer modules was used to make approximations of universal transverse Mercator grid locations for all picture elements from the grid locations of a limited number of known control points and to provide display and digital storage of the data. The software has been written in FORTRAN 4 language for a Varian 70-series computer.

Graham, M. H.

TRMM .25 deg x .25 deg Gridded Precipitation Text Product

Since the launch of the Tropical Rainfall Measuring Mission (TRMM), the Precipitation Measurement Missions science team has endeavored to provide TRMM precipitation retrievals in a variety of formats that are more easily usable by the broad science community than the standard Hierarchical Data Format (HDF) in which TRMM data is produced and archived. At the request of users, the Precipitation Processing System (PPS) has developed a .25 x .25 gridded product in an easily used ASCII text format. The entire TRMM mission data has been made available in this format. The paper provides the details of this new precipitation product that is designated with the TRMM designator 3G68.25. The format is packaged into daily files. It provides hourly precipitation information from the TRMM microwave imager (TMI), precipitation radar (PR), and TMI/PR combined rain retrievals. A major advantage of this approach is the inclusion only of rain data, compression when a particular grid has no rain from the PR or combined, and its direct ASCII text format. For those interested only in rain retrievals and whether rain is convection or stratiform, these products provide a huge reduction in the data volume inherent in the standard TRMM products. This paper provides examples of the 3G68 data products and their uses. It also provides information about C tools that can be used to aggregate daily files into larger time samples. In addition, it describes the possibilities inherent in the spatial sampling which allows resampling into coarser spatial sampling. The paper concludes with information about downloading the gridded text data products.

Stocker, Erich

Comparisons of Instantaneous TRMM Ground Validation and Satellite Rain Rate Estimates at Different Spatial Scales

This study provides a comprehensive inter-comparison of instantaneous rain estimates from the two rain sensors aboard the TRMM satellite with ground data from thee designated Ground Validation Sites: Kwajalein Atoll, Melbourne, Florida and Houston, Texas. The satellite rain retrievals utilize rain observations collected by the TRMM microwave imager (TMI) and the Precipitation Radar (PR) aboard the TRMM satellite. Three standard instantaneous rain products are the generated from the rain information retrieved from the satellite using the TMI, PR and Combined (COM) rain algorithms. The validation data set used in this study was obtained from instantaneous rain rates inferred from ground radars at each GV site. The first comparison used 0.5(sup 0) x 0.5(sup 0) gridded data obtained from the TRMM 3668 product, and similarly gridded GV data obtained from ground-based radars. The comparisons were made at the same spatial and temporal scales in order to eliminate sampling biases in our comparisons. An additional comparison was made by averaging rain rates for the PR, COM and GV estimates within each TMI footprint (approx. 150 square kilometers). For this analysis, unconditional mean rain rates from PR, COM and GV estimates were calculated within each TMI footprint that was observed within 100 km from the respective GV site (and also observed by the PR). This analysis used all the available matching data from the period 1999-2004, representing a sample size of over 50,000 footprints for each site. In the first analysis our results showed that all of the respective rain rate estimates agree well, with some exceptions. The more salient differences were associated with heavy rain events in which one or more of the algorithms failed to properly retrieve these extreme events. Also, it appears that there is a preferred mode of precipitation for TMI rain rates at or near 2 mm per hour over the ocean. This mode was noted over ocean areas of Melbourne, Florida and Kwajalein, Republic of the Marshall Islands, and is shown to exist in TRMM tropical-global ocean areas as well. Further research by algorithm developers is needed to explain or justify the seemingly errant observed probability distributions.

Wolff, David B.

Climate Reanalysis: Progress and Future Prospects

Reanalysis is the process whereby an unchanging data assimilation system is used to provide a consistent reprocessing of observations, typically spanning an extended segment of the historical data record. The process relies on an underlying model to combine often-disparate observations in a physically consistent manner, enabling production of gridded data sets for a broad range of applications including the study of historical weather events, preparation of climatologies, business sector development and, more recently, climate monitoring. Over the last few decades, several generations of reanalyses of the global atmosphere have been produced by various operational and research centers, focusing more or less on the period of regular conventional and satellite observations beginning in the mid to late twentieth century. There have also been successful efforts to extend atmospheric reanalyses back to the late nineteenth and early twentieth centuries, using mostly surface observations. Much progress has resulted from (and contributed to) advancements in numerical weather prediction, especially improved models and data assimilation techniques, increased computing capacity, the availability of new observation types and efforts to recover and improve the quality of historical ones. The recent extension of forecast systems that allow integrated modeling of meteorological, oceanic, land surface, and chemical variables provide the basic elements for coupled data assimilation. This has opened the door to the development of a new generation of coupled reanalyses of the Earth system, or integrated Earth system analyses (IESA). Evidence so far suggests that this approach can improve the analysis of currently uncoupled components of the Earth system, especially at their interface, and lead to increased predictability. However, extensive analysis coupling as envisioned for IESA, while progressing, still presents significant challenges. These include model biases that can be exacerbated when coupled, component systems with different physical characteristics and different spatial and temporal scales, and component observations in different media with different spatial and temporal frequencies and different latencies. Quantification of uncertainty in reanalyses is also a critical challenge and is important for expanding their utility as a tool for climate change assessment. This talk provides a brief overview of the progress of reanalysis development during recent decades, and describes remaining challenges in the progression toward coupled Earth system reanalyses.

IES

Community-Based Services that Facilitate Interoperability and Intercomparison of Precipitation Datasets from Multiple Sources

Over the past 12 years, large volumes of precipitation data have been generated from space-based observatories (e.g., TRMM), merging of data products (e.g., gridded 3B42), models (e.g., GMAO), climatologies (e.g., Chang SSM/I derived rain indices), field campaigns, and ground-based measuring stations. The science research, applications, and education communities have greatly benefited from the unrestricted availability of these data from the Goddard Earth Sciences Data and Information Services Center (GES DISC) and, in particular, the services tailored toward precipitation data access and usability. In addition, tools and services that are responsive to the expressed evolving needs of the precipitation data user communities have been developed at the Precipitation Data and Information Services Center (PDISC) (http://disc.gsfc.nasa.gov/precipitation or google NASA PDISC), located at the GES DISC, to provide users with quick data exploration and access capabilities. In recent years, data management and access services have become increasingly sophisticated, such that they now afford researchers, particularly those interested in multi-data set science analysis and/or data validation, the ability to homogenize data sets, in order to apply multi-variant, comparison, and evaluation functions. Included in these services is the ability to capture data quality and data provenance. These interoperability services can be directly applied to future data sets, such as those from the Global Precipitation Measurement (GPM) mission. This presentation describes the data sets and services at the PDISC that are currently used by precipitation science and applications researchers, and which will be enhanced in preparation for GPM and associated multi-sensor data research. Specifically, the GES-DISC Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) will be illustrated. Giovanni enables scientific exploration of Earth science data without researchers having to perform the complicated data access and match-up processes. In addition, PDISC tool and service capabilities being adapted for GPM data will be described, including the Google-like Mirador data search and access engine; semantic technology to help manage large amounts of multi-sensor data and their relationships; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion to various formats (e.g., netCDF, HDF, KML (for Google Earth)); visualization and analysis of Level 2 data profiles and maps; parameter and spatial subsetting; time and temporal aggregation; regridding; data version control and provenance; continuous archive verification; and expertise in data-related standards and interoperability. The goal of providing these services is to further the progress towards a common framework by which data analysis/validation can be more easily accomplished.

Liu, Zhong

Gridded Hourly Text Products: A TRMM Data Reduction Approach

The quantity of precipitation data from satellite-based observations is a blessing and a curse. The sheer volume of the data makes it difficult for many researchers to use in targeted applications. This volume increases further as algorithm improvements lead to the reprocessing of mission data. In addition to the overall volume of data, the size and format complexity of orbital granules contribute to the difficulty in using all the available data. Finally, the number of different instruments available to measure rainfall and related parameters further contributes to the volume concerns. In summary, we have an embarrassment of riches. The science team of the Tropical Rainfall Measuring Mission (TRMM) recognized this dilemma and has developed a strategy to address it. The TRMM Science Data and Information System (TSDIS) produces, at the direction of the Joint TRMM Science Team, a number of instantaneous rainfall products. The TRMM Microwave Imager (TMI), the Precipitation Radar and a Combined TMI/PR are the key "instruments" used in this production. Each of these products contains an entire orbit of data. The algorithm code computes not just rain rates but a large number of other physical parameters as well as information needed for monitoring algorithm performance. That makes these products very large. For example, a single orbit of TMI rain rate product is 99 MB, a single orbit of the combined product yields a granule that is 158 MB, while the 80 vertical levels of rain information from the PR yields an orbital product of 253 MB. These are large products that are often difficult for science users to electronically transfer to their sites especially if they want a large period of time. Level 3 gridded products are much smaller, but their 5 or 30 day temporal resolution is insufficient for many researchers. In addition, TRMM standard products are produced in the HDF format. While a large number of user-friendly tools are available to hide the details of the format (including a toolkit developed at TSDIS for the TRMM science team), many potential users shy away

Stocker, Erich