Search NASA⌕ Search

SEARCH · Search NASA

Results for “data versions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Global Precipitation Measurement (GPM) Mission Products and Services at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC)

On February 27, 2014, the NASA Global Precipitation Measurement (GPM) mission was launched to provide the next-generation global observations of rain and snow (http:pmm.nasa.govGPM). The GPM mission consists of an international network of satellites in which a GPM Core Observatory satellite carries both active and passive microwave instruments to measure precipitation and serve as a reference standard, to unify precipitation measurements from a constellation of other research and operational satellites. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) hosts and distributes GPM data within the NASA Earth Observation System Data Information System (EOSDIS). The GES DISC is home to the data archive for the GPM predecessor, the Tropical Rainfall Measuring Mission (TRMM). Over the past 16 years, the GES DISC has served the scientific as well as other communities with TRMM data and user-friendly services. During the GPM era, the GES DISC will continue to provide user-friendly data services and customer support to users around the world. GPM products currently and to-be available include the following: 1. Level-1 GPM Microwave Imager (GMI) and partner radiometer products. 2. Goddard Profiling Algorithm (GPROF) GMI and partner products. 3. Integrated Multi-satellitE Retrievals for GPM (IMERG) products. (early, late, and final)A dedicated Web portal (including user guides, etc.) has been developed for GPM data (http:disc.sci.gsfc.nasa.govgpm). Data services that are currently and to-be available include Google-like Mirador (http:mirador.gsfc.nasa.gov) for data search and access; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion into various formats (e.g., netCDF, HDF, KML (for Google Earth), ASCII); exploration, visualization, and statistical online analysis through Giovanni (http:giovanni.gsfc.nasa.gov); generation of value-added products; parameter and spatial subsetting; time aggregation; regridding; data version control and provenance; documentation; science support for proper data usage, FAQ, help desk; monitoring services (e.g. Current Conditions) for applications.In this presentation, we will present GPM data products and services with examples.

NASA GES DISC↗

Global Precipitation Measurement (GPM) Mission Products and Services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC)

On February 27, 2014, the NASA Global Precipitation Measurement (GPM) mission was launched to provide the next-generation global observations of rain and snow (http:pmm.nasa.govGPM). The GPM mission consists of an international network of satellites in which a GPM Core Observatory satellite carries both active and passive microwave instruments to measure precipitation and serve as a reference standard, to unify precipitation measurements from a constellation of other research and operational satellites. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) hosts and distributes GPM data within the NASA Earth Observation System Data Information System (EOSDIS). The GES DISC is home to the data archive for the GPM predecessor, the Tropical Rainfall Measuring Mission (TRMM). Over the past 16 years, the GES DISC has served the scientific as well as other communities with TRMM data and user-friendly services. During the GPM era, the GES DISC will continue to provide user-friendly data services and customer support to users around the world. GPM products currently and to-be available include the following:Level-1 GPM Microwave Imager (GMI) and partner radiometer productsLevel-2 Goddard Profiling Algorithm (GPROF) GMI and partner productsLevel-3 daily and monthly productsIntegrated Multi-satellitE Retrievals for GPM (IMERG) products (early, late, and final) A dedicated Web portal (including user guides, etc.) has been developed for GPM data (http:disc.sci.gsfc.nasa.govgpm). Data services that are currently and to-be available include Google-like Mirador (http:mirador.gsfc.nasa.gov) for data search and access; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion into various formats (e.g., netCDF, HDF, KML (for Google Earth), ASCII); exploration, visualization, and statistical online analysis through Giovanni (http:giovanni.gsfc.nasa.gov); generation of value-added products; parameter and spatial subsetting; time aggregation; regridding; data version control and provenance; documentation; science support for proper data usage, FAQ, help desk; monitoring services (e.g. Current Conditions) for applications.

precipitation↗

Community-Based Services that Facilitate Interoperability and Intercomparison of Precipitation Datasets from Multiple Sources

Over the past 12 years, large volumes of precipitation data have been generated from space-based observatories (e.g., TRMM), merging of data products (e.g., gridded 3B42), models (e.g., GMAO), climatologies (e.g., Chang SSM/I derived rain indices), field campaigns, and ground-based measuring stations. The science research, applications, and education communities have greatly benefited from the unrestricted availability of these data from the Goddard Earth Sciences Data and Information Services Center (GES DISC) and, in particular, the services tailored toward precipitation data access and usability. In addition, tools and services that are responsive to the expressed evolving needs of the precipitation data user communities have been developed at the Precipitation Data and Information Services Center (PDISC) (http://disc.gsfc.nasa.gov/precipitation or google NASA PDISC), located at the GES DISC, to provide users with quick data exploration and access capabilities. In recent years, data management and access services have become increasingly sophisticated, such that they now afford researchers, particularly those interested in multi-data set science analysis and/or data validation, the ability to homogenize data sets, in order to apply multi-variant, comparison, and evaluation functions. Included in these services is the ability to capture data quality and data provenance. These interoperability services can be directly applied to future data sets, such as those from the Global Precipitation Measurement (GPM) mission. This presentation describes the data sets and services at the PDISC that are currently used by precipitation science and applications researchers, and which will be enhanced in preparation for GPM and associated multi-sensor data research. Specifically, the GES-DISC Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) will be illustrated. Giovanni enables scientific exploration of Earth science data without researchers having to perform the complicated data access and match-up processes. In addition, PDISC tool and service capabilities being adapted for GPM data will be described, including the Google-like Mirador data search and access engine; semantic technology to help manage large amounts of multi-sensor data and their relationships; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion to various formats (e.g., netCDF, HDF, KML (for Google Earth)); visualization and analysis of Level 2 data profiles and maps; parameter and spatial subsetting; time and temporal aggregation; regridding; data version control and provenance; continuous archive verification; and expertise in data-related standards and interoperability. The goal of providing these services is to further the progress towards a common framework by which data analysis/validation can be more easily accomplished.

Liu, Zhong↗

Variable Lidar Ratios for Marine and Dusty Marine Using MODIS AOD Constrained Retrievals and GOCART Model Simulations and their Impact on Level 2 CALIPSO Data Products in Version 5

The Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) onboard CALIPSO provided global measurements of attenuated backscatter profiles of various tropospheric aerosol species from June 2006 through June 2023. Extinction profiles are retrieved from these backscatter measurements by assuming a value for the extinction-to-backscatter or lidar ratio (LR). Up until version V4.51 of the data products, only a constant global value for each of the species has been used, spatially and temporally. However, it has been well known from various ground-based measurements that LRs of each aerosol species can potentially vary spatially as well seasonally. For the forthcoming Version 5 of the CALIPSO products, the CALIPSO team will implement variable lidar ratios at 532 nm for the species classified as “marine” and “dusty marine”. Here we present the essential elements of this scheme, which involves estimating lidar ratios by constraining Fernald solutions for the CALIOP particulate backscatter profiles using aerosol optical depths (AOD) from collocated MODIS retrievals. To account for the lack of measurements in various regions and seasons (e.g., Arctic winters), we leverage collocated model sea-salt volume fractions (SSVF) simulated by the Goddard Chemistry Aerosol Radiation and Transport (GOCART) model and use an empirical relationship between the SSVF and LR to build hybrid climatological maps for the entire globe, i.e., using the modelled values when reliable values of the constrained LRs are not available. Initial evaluation of the resulting extinction profiles and corresponding AODs, both globally and in specific regions are presented using a limited amount of data. The primary improvement in AOD occurs in the coastal areas, like the Arabian Sea and Bay of Bengal. The estimated marine LR values in these regions are significantly higher than the constant value of 23 sr used in previous data releases, likely due to mixing with offshore pollution which results in higher AODs. Initial validation results using the CALIPSO Ocean Derived Column Optical Depth (ODCOD) retrievals and ground-based AERONET AOD measurements are presented.

CALIPSO↗

Variability of ozone loss during Arctic winter (1991 to 2000) estimated from UARS Microwave Limb Sounder measurement

A comprehensive analysis of version 5 Upper Atmosphere Research Satellite (UARS) Microwave Limb Sounder (MLS) ozone data using a Lagrangian Transport (LT) model provides estimates of chemical ozone depletion for the 1991-1992 through 1997-1998 Arctic winters. These new estimates give a consistent, three-dimensional picture of ozone loss during seven Arctic winters; previous Arctic ozone loss estimates from MLS were based on various earlier data versions and were done only for late winter and only for a subset of the years observed by MLS. We find large interannual variability in the amount, timing, and patterns of ozone depletion and in the degree to which chemical loss is masked by dynamical processes.

Arctic ozone loss↗

Technical report series on global modeling and data assimilation. Volume 4: Documentation of the Goddard Earth Observing System (GEOS) data assimilation system, version 1

This report describes the analysis component of the Goddard Earth Observing System, Data Assimilation System, Version 1 (GEOS-1 DAS). The general features of the data assimilation system are outlined, followed by a thorough description of the statistical interpolation algorithm, including specification of error covariances and quality control of observations. We conclude with a discussion of the current status of development of the GEOS data assimilation system. The main components of GEOS-1 DAS are an atmospheric general circulation model and an Optimal Interpolation algorithm. The system is cycled using the Incremental Analysis Update (IAU) technique in which analysis increments are introduced as time independent forcing terms in a forecast model integration. The system is capable of producing dynamically balanced states without the explicit use of initialization, as well as a time-continuous representation of non- observables such as precipitation and radiational fluxes. This version of the data assimilation system was used in the five-year reanalysis project completed in April 1994 by Goddard's Data Assimilation Office (DAO) Data from this reanalysis are available from the Goddard Distributed Active Center (DAAC), which is part of NASA's Earth Observing System Data and Information System (EOSDIS). For information on how to obtain these data sets, contact the Goddard DAAC at (301) 286-3209, EMAIL daac@gsfc.nasa.gov.

Suarez, Max J.↗

A Variational Assimilation Method for Satellite and Conventional Data: Model 2 (version 1)

The Model II variational data assimilation model is the second of the four variational models designed to blend diverse meteorological data into a dynamically constrained data set. Model II differs from Model I in that it includes the thermodynamic equation as the fifth dynamical constraint. Thus, Model II includes all five of the primative equations that govern atmospheric flow for a dry atmosphere.

Achtemeier, Gary L.↗

Conditions Databases at FNAL

Conditions databases is an important class of database applications where the database is used to record the state of a set of quantities as a function of observation time. Conditions databases are used in Hight Energy Physics to record the state of the detector apparatus during data taking, and then to use the data during the event reconstruction and analysis phases. At FNAL, we have a set of 3 different conditions database products, Minerva Conditions DB, ConDB and UConDB, which cover the whole range of the use cases presented by the FNAL experiments. These products have common features such as conditions data representation model, data version control, ability to restore the database to a previous state, scalable web service data access interface. In the paper, we will present the common features of the products, common solutions used to build them and also the differences between the products and their target use cases.

Mandrichenko, Igor V.↗

Persistent Octrees for Parallel Mesh Refinement Through Non-Volatile Byte-Addressable Memory

We report that octree-based mesh adaptation has enabled simulations of complex physical phenomena. Existing meshing algorithms were proposed with the assumption that computer memory is volatile. Consequently, for failure recovery, the in-core algorithms need to save memory states as snapshots with slow file I/Os. The out-of-core algorithms store octants on disks for persistence. However, neither of them was designed to leverage unique characteristics of non-volatile byte-addressable memory (NVBM). In this paper, we propose a novel data structure Distributed Persistent Merged octree (DPM-octree) for both meshing and in-memory storage of persistent octrees using NVBM. It is a multi-version data structure and can recover from failures using its earlier persistent version stored in NVBM. In addition, we design a feature-directed sampling approach to help dynamically transform the DPM-octree layout for reducing NVBM-induced memory write latency. DPM-octree uses parity trees which are created using erasure coding and stored in NVBM to support low-latency in-memory octant recovery after data loss. DPM-octree has been successfully integrated with Gerris software for simulation of fluid dynamics. Finally, our experimental results with real-world scientific workloads show that DPM-octree scales up to 1.1 billion mesh elements with 1000 processors on the Titan supercomputer.

97 MATHEMATICS AND COMPUTING↗

Long Term Potential Evapotranspiration and Evapotranspiration Data and Services at NASA GES DISC

Recently, the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has released global land 3-hourly Potential Evapotranspiration and Supporting Forcing Data Version-1 (PET_PU_3H025.001), at 0.25x0.25 degree spatial resolution, spanning the 23 year period from 1984 to 2006. The Version-2 will be released in the near future, covering longer time period. This dataset was generated by Professor Justin Sheffield through NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) project. Potential evapotranspiration (PET) is a representation of the environmental demand for evapotranspiration (ET). ET and PET are important part of the global water cycle estimation, and are also critical to advance our understanding of the climate system. NASA GES DISC archives and distributes various global and regional ET datasets from several projects, for example, Land Data Assimilation System (LDAS), Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), other MEaSUREs Projects, such as Land Surface Atmospheric Boundary Interaction Product by William Rossow; and SRB/GEWEX evapotranspiration (Penman-Monteith) by Eric F. Wood. In this presentation, we will overview all available PET and ET datasets and services at GES DISC. As examples, climatology and some seasonal characteristics of PET and selected ET will be shown. The data can be accessed from NASA GES DISC (https://disc.gsfc.nasa.gov/) by searching keyword "evapotranspiration".

Shen, Suhung↗

Task 28: Web Accessible APIs in the Cloud Trade Study

This study explored three candidate architectures for serving NASA Earth Science Hierarchical Data Format Version 5 (HDF5) data via Hyrax running on Amazon Web Services (AWS). We studied the cost and performance for each architecture using several representative Use-Cases. The objectives of the project are: Conduct a trade study to identify one or more high performance integrated solutions for storing and retrieving NASA HDF5 and Network Common Data Format Version 4 (netCDF4) data in a cloud (web object store) environment. The target environment is Amazon Web Services (AWS) Simple Storage Service (S3).Conduct needed level of software development to properly evaluate solutions in the trade study and to obtain required benchmarking metrics for input into government decision of potential follow-on prototyping. Develop a cloud cost model for the preferred data storage solution (or solutions) that accounts for different granulation and aggregation schemes as well as cost and performance trades.

cost model↗

Simulated hydrological dynamics and coupled iron redox cycling impact methane production in an Arctic soil: Modeling Archive

This Modeling Archive is in support of an NGEE Arctic publication "Simulated hydrological dynamics and coupled iron redox cycling impact methane production in an Arctic soil" in the Journal of Geophysical Research-Biogeosciences. We simulated biogeochemical cycling in arctic soils using the PFLOTRAN geochemical model combined with measurements from previous NGEE Arctic incubations of polygonal permafrost soils in northern Alaska (Zheng et al., 2018). Simulated iron cycling, carbon dioxide production, and methane production were compared with incubation measurements and the parameterized model was then used to simulate coupled iron and carbon cycling over repeated oxic-anoxic cycles at different levels of carbon substrate availability and pH. The most recent data version (2.0) in the archive incorporates changes to the model and simulations as suggested by reviewers during the manuscript review process. These changes include an updated parameterization of the model; a new set of simulations omitting the iron cycle for direct evaluation of how iron cycle processes affect modeled outcomes; and a set of simulations testing different scenarios of carbon substrate availability in addition to scenarios of initial soil pH. This archive contains simulation code, model output, and analysis code for PFLOTRAN simulations. All scripts are python except the batch script for submitting multiprocessor jobs. Note that the model also requires compiled versions of the Alquimia interface and the NGEE Arctic fork of the PFLOTRAN geochemical simulator (see the README_INSTALL document for basic instructions). The Output directory contains eight data files in netCDF format generated by the model. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 10-year research effort (2012-2022) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Benchmark Tracking System for Performance Monitoring

Benchmarking is essential for high-performance software development, particularly for monitoring performance across code iterations. This project focused on enhancing the benchmarking process for Lamellar, an asynchronous runtime for High-Performance Computing (HPC) systems developed at Pacific Northwest National Laboratory. Prior to this work, benchmark results were difficult to track and compare across code versions, presenting significant challenges in identifying performance regressions and long-term trends. The primary objective was to establish a systematic, reproducible approach for measuring performance and detecting regressions following code commits. Our methodology involved three key components: standardizing benchmark outputs, implementing data versioning, and developing analysis tools. We standardized the benchmark output format to JSON Line records containing specific fields (execution time, hardware specifications, and environmental variables). To address data management challenges, we evaluated several options and eventually chose a git repository dedicated to benchmark data. We developed a suite of Python tools that processed benchmark results, enriched them with metadata, and facilitated search in the repository. The resulting system enables more efficient filtering and comparison of performance metrics across commit histories, hardware configurations, and benchmark variants through a unified query interface. Our implementation reduces computational overhead by first checking for existing results through configuration matching before initiating new benchmark runs, thereby conserving resources. The system has been validated by Lamellar developers. It organizes results by benchmark type and build configurations for efficient retrieval. Future developments include a planned Large Language Model interface for predicting benchmark performance, incorporating the criterion package for statistical analysis, which will enable automated detection of statistically significant performance changes, and integration with continuous integration pipelines. Despite these enhancements being reserved for future work, this project has successfully provided the Lamellar development team with a framework for maintaining consistent performance standards and identifying optimization opportunities across workloads and hardware environments.

97 MATHEMATICS AND COMPUTING↗