Taming Big Data Variety in the Earth Observing System Data and Information System

Lynnes, Christopher; Walter, Jeff

Home/Archive/NASA NTRS

NASA NTRS · 20150020838

Taming Big Data Variety in the Earth Observing System Data and Information System

Lynnes, Christopher·Walter, Jeff

View original source ↗Export metadata ↓

Abstract

Although the volume of the remote sensing data managed by the Earth Observing System Data and Information System is formidable, an oft-overlooked challenge is the variety of data. The diversity in satellite instruments, science disciplines and user communities drives cost as much or more as the data volume. Several strategies are used to tame this variety: data allocation to distinct centers of expertise; a common metadata repository for discovery, data format standards and conventions; and services that further abstract the variations in data.

Explore related subjects

Information Systems Data Analysis Big Data

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Lynnes, Christopher, Walter, Jeff. 2015-10-29. Taming Big Data Variety in the Earth Observing System Data and Information System. https://ntrs.nasa.gov/citations/20150020838

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2015

NASA EOSDIS Evolution in the BigData Era

NASA's EOSDIS system faces several challenges in the Big Data Era. Although volumes are large (but not unmanageably so), the variety of different data collections is daunting. That variety also brings with it a large and diverse user community. One key evolution EOSDIS is working toward is to enable more science analysis to be performed close to the data.

Information Systems↗

NASA NTRS1996

Packaging and distributing ecological data from multisite studies

Studies of global change and other regional issues depend on ecological data collected at multiple study areas or sites. An information system model is proposed for compiling diverse data from dispersed sources so that the data are consistent, complete, and readily available. The model includes investigators who collect and analyze field measurements, science teams that synthesize data, a project information system that collates data, a data archive center that distributes data to secondary users, and a master data directory that provides broader searching opportunities. Special attention to format consistency is required, such as units of measure, spatial coordinates, dates, and notation for missing values. Often data may need to be enhanced by estimating missing values, aggregating to common temporal units, or adding other related data such as climatic and soils data. Full documentation, an efficient data distribution mechanism, and an equitable way to acknowledge the original source of data are also required.

Information Systems↗

NASA NTRSDate not supplied

Earth System Digital Twins (ESDT)

"First Webinar for a digital twin webinar series titled ""Digital Twin Webinar Series 1: Concept, Practices, and Vision"". This kick-off webinar will focus on concepts, architecture and high level discussion on digital twins for Earth science and other domain sciences. The agenda will be the following: - Dr. Jacqueline Le Moigne is NASA AIST program manager, and the first federal program manager to programmatically fund 14 digital twin research projects. - Mr. Stan Posey is the HPC Program Manager, ESM and CFD Domains at NVIDIA. - Dr. Goodchild is a emeritus professor at UCSB, member of the national academy, and a founder of digital earth international society."

Information Systems↗