SEARCH · Search NASA

Results for “subsetting archiving”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2004

Grid Technology as a Cyber Infrastructure for Earth Science Applications

This paper describes how grids and grid service technologies can be used to develop an infrastructure for the Earth Science community. This cyberinfrastructure would be populated with a hierarchy of services, including discipline specific services such those needed by the Earth Science community as well as a set of core services that are needed by most applications. This core would include data-oriented services used for accessing and moving data as well as computer-oriented services used to broker access to resources and control the execution of tasks on the grid. The availability of such an Earth Science cyberinfrastructure would ease the development of Earth Science applications. With such a cyberinfrastructure, application work flows could be created to extract data from one or more of the Earth Science archives and then process it by passing it through various persistent services that are part of the persistent cyberinfrastructure, such as services to perform subsetting, reformatting, data mining and map projections.

Hinke, Thomas H.↗

NASA NTRS1990

Analysis of diurnal variation of SCu layer using 2 days of CLASS soundings on San Nicolas Island

Sixty-nine soundings were taken at San Nicolas Island during the FIRE marine stratocumulus experiment. The archived thermodynamic data at 5mb vertical resolution were reduced to 25mb vertical resolution by averaging. Ceilometer data showed the time variation of cloud-base. A subset of 20 soundings taken during a 2 day period of light winds were analyzed. The soundings are grouped into 6 hr. averages (with 5 soundings in each category) to examine the diurnal variation of the thermodynamic structure. Consistent with the solar heating during the daytime, cloud-base rises during the daytime hours and the cloud layer thins. The subcloud layer also becomes more stable, suggesting some uncoupling of the cloud layer from the surface.

Betts, Alan K.↗

NASA NTRS2017

Global Precipitation Products at NASA GES DISC for Supporting Agriculture Research and Applications

This presentation describes precipitation products available at the NASA GES DISC that support agricultural research. XXXX Key environmental variables for agriculture: precipitation, temperature, water (soil moisture), solar radiation, NDVI, etc. Rainfed agriculture - major farming practices that rely on rainfall for water. Rainfed agriculture: >95% of farmed land (sub- Saharan Africa); 90% (Latin America); 75% (Near East and North Africa); 65% (East Asia); 60% (South Asia). Precipitation is very important for rainfed agriculture. Droughts can cause severe damage. Precipitation information can be used to monitor the growing season. The Goddard Earth Sciences (GES) Data and Information Services Center (DISC), one of 12 NASA data centers, located in Greenbelt, Maryland, USA. The GES DISC is a major data archive center for global precipitation, water & energy cycles, atmospheric composition, and climate variability Global and regional precipitation datasets (satellite-based and data assimilation Data services (subsetting, format conversion, online visualization, etc.) User services are available FAQs, How to (recipes), Glossary, etc. Social media (Twitter, YouTube, User forum) Help desk (phone, email, online feedback) Training materials (ARSET => Applied Remote Sensing Training) Liu,

precipitation↗

NASA NTRS2019

An Integrated Data Analytics Platform

An Integrated Science Data Analytics Platform is an environment that enables the confluence of resources for scientific investigation. It harmonizes data, tools and computational resources which subsequently enable the research community to focus on the investigation rather than spending time on security, data preparation, management, etc. OceanWorks is a NASA technology integration project to establish a cloud-based Integrated Ocean Science Data Analytics Platform at NASA’s Physical Oceanography Distributed Active Archive Center (PO.DAAC) for big ocean science. It focuses on advancement and maturity by bringing together several NASA open-source, big data projects for parallel analytics, anomaly detection, in-situ to satellite data matchup, quality-screened data subsetting, search relevancy, and data discovery. Our communities are relying on data distributed through data centers such as the PO.DAAC, COAPS, NCAR, and many others to conduct their research. In typical investigations, scientists would engage in: search for data, evaluate the relevance of that data, download it, and then apply algorithms to identify trends. Such workflow cannot scale if the research involves a massive amount of data or multi-variate measurements. NASA’s Surface Water and Ocean Topography (SWOT) mission is expected to produce massive amount of observational data during its 3-year nominal mission. Collections like SWOT challenges all existing Earth Science data archival, distribution and analysis paradigms. In this paper, we will discuss how OceanWorks enhances the analysis of physical ocean data where the computation is done on an elastic cloud platform next to the archive to deliver fast, web-accessible services for working with oceanographic measurements.

Yang, Chaowei↗

NASA NTRS1993

EOSDIS - Its role in the EOS program and its importance to the scientific community

In order to manage the global data sets required to understand the earth as a system, the EOS Data and Information System (EOSDIS) will collect and store satellite, aircraft, and in situ measurements and their resultant data products, and will distribute the data conveniently. EOSDIS will also provide product generation and science computing facilities to support the development, processing, and validation of standard EOS science data products. The overall architecture of EOSDIS, and how the Distributed Active Archive Centers fit into that structure, are shown. EOSDIS will enable users to query data bases nationally, make use of keywords and other mnemonic identifiers, and see graphic images of subsets of available data prior to ordering full (or selected pieces of) data sets for use in their 'home' environment.

Price, Robert D.↗

NASA NTRS2016

GES DISC Datalist Enables Easy Data Selection for Natural Phenomena Studies

In order to investigate and assess natural hazards such as tropical storms, winter storms, volcanic eruptions, floods, and drought in a timely manner, the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been developing an efficient data search and access service. Called Datalist, this service enables users to acquire their data of interest all at once, with minimum effort. A Datalistis a virtual collection of predefined or user-defined data variables from one or more archived data sets. Datalistsare more than just data. Datalistseffectively provide users with a sophisticated integrated data and services package, including metadata, citation, documentation, visualization, and data-specific services (e.g., subset and OPeNDAP), all available from one-stop shopping. The predefined Datalists, created by the experienced GES DISC science support team, should save a significant amount of time that users would otherwise have to spend. The Datalistservice is an extension of the new GES DISC website, which is completely data-driven. A Datalist, also known as data bundle, is treated just as any other data set. Being a virtual collection, a Datalistrequires no extra storage space.

Earth events↗

NASA NTRS1999

Chandra Serendipitous and Cycle 1 Targeted Surveys

A team led by scientists at the Chandra X-ray Center (CXC, formally known as the AXAF Science Center) is developing plans for a Serendipitous Survey using a selected subset of Chandra observations starting with Cycle 1. This survey will include two parts: (1) for sources sufficiently bright to be identified in available sky surveys (V approximately < 21), probable optical identifications and related imaging data will be, provided with the X-ray data as part of the Chandra data products. (2) at fainter flux X-ray source identifications will be determined from publically available, archival data and new optical imaging observations. We estimate that this survey will yield approximately 2500 source identifications in Cycle 1 down to X-ray flux levels approximately 10(exp -15) erg/sq cm.s and covering an area of sky approximately 10 sq degs. Optical spectroscopy and radio imaging will also be obtained for a subset of these sources. We are exploring appropriate ways to involve interested Chandra observers as well as other scientists in this survey project. A general overview of the various surveys which comprise a portion of the Chandra Cycle 1 GTO and GO programs and are not covered elsewhere in these proceedings will also be presented.

Wilkes, Belinda↗

NASA NTRS2017

GES DISC Datalist Enables Easy Data Selection For Natural Phenomena Studies

In order to investigate and assess natural hazards such as tropical storms, winter storms, volcanic eruptions, floods, and drought in a timely manner, the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been developing an efficient data search and access service. Called "Datalist," this service enables users to acquire their data of interest "all at once," with minimum effort. A Datalist is a virtual collection of predefined or user-defined data variables from one or more archived data sets. Datalists are more than just data. Datalists effectively provide users with a sophisticated integrated data and services package, including metadata, citation, documentation, visualization, and data-specific services (e.g., subset and OPeNDAP), all available from one-stop shopping. The predefined Datalists, created by the experienced GES DISC science support team, should save a significant amount of time that users would otherwise have to spend. The Datalist service is an extension of the new GES DISC website, which is completely data-driven. A Datalist, also known as "data bundle," is treated just as any other data set. Being a virtual collection, a Datalist requires no extra storage space.

natural hazards↗

NASA NTRS1986

El Nino and outgoing longwave radiation: An atlas of Nimbus-7 Earth radiation budget observations

Five years of broadband Earth Radiation Budget (ERB) measurements taken by the Nimbus-7 ERB experiment have been archived. This five year period included the 1982 to 1983 El Nino/Southern Oscillation event, which reached its peak in January 1983 (near the beginning of the fifth data year). An outgoing longwave radiation subset of the data, for the period June 1980 to October 1983, was processed to enhance spatial resolution. This atlas contains the analyses of the resultant fields. In addition, a set of anomaly maps, based on a definition of pre-El Nino climatology, is included. Together, these two sets of maps provide the first broadband glimpse of the terrestrial outgoing longwave radiation response to the El Nino event.

Kyle, H. L.↗

NASA NTRS1996

Development of Secondary Archive System at Goddard Space Flight Center Version 0 Distributed Active Archive Center

The Goddard Space Flight Center (GSFC) version 0 Distributed Active Archive Center (DAAC) has been developed to support existing and pre Earth Observing System (EOS) Earth science datasets, facilitate the scientific research, and test EOS data and information system (EOSDIS) concepts. To ensure that no data is ever lost, each product received at GSFC DAAC is archived on two different media, VHS and digital linear tape (DLT). The first copy is made on VHS tape and is under the control of UniTree. The second and third copies are made to DLT and VHS media under a custom built software package named 'Archer'. While Archer provides only a subset of the functions available with commercial software like UniTree, it supports migration between near-line and off-line media and offers much greater performance and flexibility to satisfy the specific needs of a data center. Archer is specifically designed to maximize total system throughput, rather than focusing on the turn-around time for individual files. The commercial off the shelf software (COTS) hierarchical storage management (HSM) products evaluated were mainly concerned with transparent, interactive, file access to the end-user, rather than a batch-orientated, optimizable (based on known data file characteristics) data archive and retrieval system. This is critical to the distribution requirements of the GSFC DAAC where orders for 5000 or more files at a time are received. Archer has the ability to queue many thousands of file requests and to sort these requests into internal processing schedules that optimize overall throughput. Specifically, mount and dismount, tape load and unload cycles, and tape motion are minimized. This feature did not seem to be available in many COTS pacages. Archer also uses a generic tar tape format that allows tapes to be read by many different systems rather than the proprietary format found in most COTS packages. This paper discusses some of the specific requirements at GSFC DAAC, the motivations for implementing the Archer system, and presents a discussion of the Archer design that resulted.

Sherman, Mark↗

NASA NTRSDate not supplied

Efficient Access to MERRA-2 Reanalysis Data from the Cloud Archives

The Modern-Era Retrospective analysis for Research and Applications, Version (MERRA-2) dataset is now available in the AWS West Region-2 cloud. The free data downloading policy remains unchanged. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) offers cloud services such as OPeNDP subsetting, and time series services. This presentation will showcase use cases that testing the procedures and find the most efficiency workflows to access and process the data for finding climate extremes. The use cases include a) accessing and processing data directly in the cloud S3 bucket without downloading it, and b) downloading subset data to process on the user’s local system.

data access, cloud computing, climate extremes↗

NASA NTRS2002

Global Precipitation Measurement: Benefits of Partnering with GPM Mission - Report 2

An important goal of the Global Precipitation Measurement (GPM) mission is to maximize participation by non-NASA partners both domestic and international. A consequence of this objective is the provision for NASA to provide sufficient incentives to achieve partner buy-in and commitment to the program. NASA has identified seven specific areas in which substantive incentives will be offered: (1) partners will be offered participation in governance of GPM mission science affairs including definition of data products; (2) partners will be offered use of NASA's TDRSS capability for uplink and downlink of commands and data in regards to partner provided spacecraft; (3) partners will be offered launch support for placing partner provided spacecraft in orbit conditional upon mutually agreeable co-manifest arrangements; (4) partners will be offered direct data access at the NASA-GPM server level rather than through standard data distribution channels; (5) partners will be offered the opportunity to serve as regional data archive and distribution centers for standard GPM data products; and (6) partners will be offered the option to insert their own specialized filtering and extraction software into the GPM data processing stream or to obtain specialized subsets and products over specific areas of interest (7) partners will be offered GPM developed software tools that can be run on their platforms. Each of these incentives, either individually or in combination, represents a significant advantage to partners who may wish to participate in the GPM mission.

Stocker, Erich F.↗

NASA NTRS2018

Sentinel-5P/TROPOMI and S-NPP/OMPS Data Support at GES DISC

The TROPspheric Monitoring Instrument (TROPOMI) on the Sentinel-5 Precursor (Sentinel-5P) is the first of the Atmospheric Composition Sentinels by the European Space Agency (ESA) that provides measurements of ozone, NO2, SO2, CH4, CO, formaldehyde, aerosols and cloud at high spatial, temporal and spectral resolutions. The early afternoon orbit of Sentinel-5P mission provides a strong synergy with the U.S. Suomi National Polar-orbiting Partnership (S-NPP) satellite, especially in that the S-NPP Ozone Monitoring and Profiling Suite (OMPS) facilitates high vertically resolved stratospheric and lower mesospheric ozone profiles. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) supports over a thousand data collections in the Focus Areas of Atmospheric Composition, Water & Energy Cycles, and Climate Variability and it is the Distributed Active Archive Center (DAAC) that is curating both offline Sentinel-5P TROPOMI and S-NPP OMPS Level-1B (L1B) and Level-2 (L2) products. Through its convenient and enhanced tools/services such as OPeNDAP and L2 Subsetting, GES DISC offers air quality remote sensing user communities facile solutions for complex Earth science data and applications. This presentation will demonstrate TROPOMI and OMPS products including earthview radiance, solar irradiance, and currently available L2 datasets, as well as easy ways to access, visualize and subset data. The implementation of the End User License Agreement (EULA) between NASA GES DISC and all data users accessing data at GES DISC will be emphasized as well.

TROPOMI↗

NASA NTRS2019

Carbon Cycle Science Data and Services at the Goddard Earth Sciences Data Information and Services Center (GES DISC)

The Goddard Earth Sciences Data Information and Services Center (GES DISC) archives and distributes a number of observational and model carbon cycle science data sets. We also provide services that facilitate data discovery, intercomparison, and visualization of these heterogeneous datasets for both research and applications users, such as subsetting, format conversion, How-To documentation, and the Help Desk.

Hearty, Thomas↗

NASA NTRS2012

Tropical Rainfall Measuring Mission (TRMM) Precipitation Data and Services for Research and Applications

Precipitation is a critical component of the Earth's hydrological cycle. Launched on 27 November 1997, TRMM is a joint U.S.-Japan satellite mission to provide the first detailed and comprehensive data set of the four-dimensional distribution of rainfall and latent heating over vastly under-sampled tropical and subtropical oceans and continents (40 S - 40 N). Over the past 14 years, TRMM has been a major data source for meteorological, hydrological and other research and application activities around the world. The purpose of this short article is to inform that the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides TRMM archive and near-real-time precipitation data sets and services for research and applications. TRMM data consist of orbital data from TRMM instruments at the sensor s resolution, gridded data at a range of spatial and temporal resolutions, subsets, ground-based instrument data, and ancillary data. Data analysis, display, and delivery are facilitated by the following services: (1) Mirador (data search and access); (2) TOVAS (TRMM Online Visualization and Analysis System); (3) OPeNDAP (Open-source Project for a Network Data Access Protocol); (4) GrADS Data Server (GDS); and (5) Open Geospatial Consortium (OGC) Web Map Service (WMS) for the GIS community. Precipitation data application services are available to support a wide variety of applications around the world. Future plans include enhanced and new services to address data related issues from the user community. Meanwhile, the GES DISC is preparing for the Global Precipitation Measurement (GPM) mission which is scheduled for launch in 2014.

Liu, Zhong↗

NASA NTRS2022

Asteroid Lightcurves From the Moa-Ii Survey: A Pilot Study

The Microlensing Observations in Astrophysics (MOA-II) survey has performed high cadence, wide field observations of the Galactic Bulge from New Zealand since 2005. The hourly cadence of the survey during eight months of the year, across nearly 50 deg 2 of sky, provides an opportunity to sample asteroid lightcurves in the broad MOA-R filter. We perform photometry of a subset of bright asteroids numbered observed by the survey. We obtain 26 asteroid rotation periods, including for two asteroids where no prior data exist, and present evidence for the possible non-principal axis rotation of (2011) Veteraniya. This archival search could be extended to several thousands of asteroids brighter than 22nd magnitude.

techniques: photometric↗

NASA NTRS1990

NSSDC data listing

In a highly summarized way, data available from the National Space Science Data Center (NSSDC) is identified. Most data are offline data sets (on magnetic tape or as film/print products of various sizes) from individual instruments carried on spacecraft; these compose the Satellite Data Listing. Descriptive names, time spans, data form, and quantity of these data sets are identified in the listing, which is sorted alphabetically-first by spacecraft name and then by the principal investigator's or team leader's last name. Several data sets held at NSSDC, not associated with individual spaceflight instruments, are identified in separate listings following the Satellite Data Listing. These data sets make up the Supplementary Data Listings and include composite spacecraft data sets, ground-based data, models, and computer routines. The identifiers used in the Supplementary Data Listings were created by NSSDC and are explained in the pages preceding the listings. Data set form codes are listed. NSSDC offers primarily archival, retrieval, replication, and dissemination services associated with the data sets discussed in the two major listings identified above. NSSDC also provides documentation which enables the data recipient to use the data received. NSSDC is working toward expanding presently limited capabilities for data subsetting and for promotion of data files to online residence for user downloading. NSSDC data holdings span the range of scientific disciplines in which NASA is involved, and include astrophysics, lunar and planetary science, solar physics, space plasma physics, and Earth science. In addition to the functions mentioned above, NSSDC offers data via special services and systems in a number of areas, including Astronomical Data Center (ADC), Coordinated Data Analysis Workshops (CDAWs), NASA Climate Data System (NCDS), Pilot Land Data System (PLDS), and Crustal Dynamics Data Information System (CDDIS). Furthermore, NSSDC has a no-password account on its SPAN/Telenet-accessible VAX through which the NASA Master Directory and selected online data bases are accessible and through which any data described here may be ordered. Astrophysics data support by NSSDC is not limited to the ADC. Each of these special services/systems is described briefly.

Horowitz, Richard↗

NASA NTRS2000

BOREAS TE-23 Map Plot Data

The Boreal Ecosystem-Atmospheric Study (BOREAS) TE-23 (Terrestrial Ecology) team collected map plot data in support of its efforts to characterize and interpret information on canopy architecture and understory cover at the BOREAS tower flux sites and selected auxiliary sites from May to August 1994. Mapped plots (typical dimensions 50 m x 60 m) were set up and characterized at all BOREAS forested tower flux and selected auxiliary sites. Detailed measurement of the mapped plots included: (1) stand characteristics (location, density, basal area); (2) map locations diameter at breast height (DBH) of all trees; (3) detailed geometric measures of a subset of trees (height, crown dimensions); and (4) understory cover maps. The data are stored in tabular ASCII files. The data files are available on a CD-ROM (see document number 20010000884), or from the Oak Ridge National Laboratory (ORNL) Distributed Active Archive Center (DAAC).

Rich, Paul M.↗