SEARCH · Search NASA

Results for “Earth Science Data Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

NASA NTRS2018

NASA's EOSDIS Near Term Challenges

Given the long-term requirements, and the rapid pace of information technology and changing expectations of the user community, the ESDIS Project has had to evolve EOSDIS continually over the past three decades. However, many challenges remain. One near-term challenge is the enormous quantity of new data that will need to be managed by the EOSDIS. With the upcoming launch of the latest NASA missions coupled with existing operational missions and field campaigns, EOSDIS can expect to handle as much as 50 petabytes of data per year. In perspective, this is twice the size of the current existing archive, which took over 21 years to collect. Another continuing challenge is the disparate requirements of a diverse science community. Maintaining rigorous long-term data preservation, supporting ease of discovery and access, incorporating user feedback, enabling reanalysis/ reprocessing, and agile integration of new data sources, continue to be the Project's objectives.

Remote Sensing↗

NASA NTRSDate not supplied

"Giovanni at 20: Consistency and Persistency in Making Earth Remote Sensing Data Available (and Useful) to the Earth Science Community"

Since its creation in the year 2000, the NASA Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) has been an exemplar of how to provide remotely-sensed satellite data and related Earth science datasets to a broad and globally diverse researcher community. One of the hallmarks of Giovanni system usage is that it is common to see practitioners of many branches of science – particularly those in fields not traditionally associated with remote-sensing data, such as animal behavior and paleooceanography – both accessing and employing datasets which the system provides. This usage pattern is attested to by the diversity of published science citing Giovanni. Giovanni has evolved through several versions, each of which increased analytical and visualization options while also enhancing ease-of-use. Information resources supporting Giovanni from the Goddard Earth Sciences Data and Information Services Center (GES DISC), which hosts the system, start with basic mapping and plotting functions and extend to “How-to” recipes demonstrating interusability with other data analysis systems and software. Giovanni is now being developed for use in a cloud environment, potentially expanding datasets the system can be applied to, and also improving performance for data having high spatial and temporal resolution. This presentation covers the system’s historical success with interesting examples of Giovanni-citing research, and will apply its current capabilities to a multi-dataset examination of derecho events associated with mesoscale convective phenomena in the summer of 2020, indicating how Giovanni is prepared for ongoing support of Earth science in a changing world.

Giovanni Derecho visualization↗

NASA NTRS2000

Earth Remote Sensing Center of Excellence at Scripps Institution of Oceanography

We developed advanced communications and networking capability and satellite reception systems for Earth science to improve the ability of scientists at Scripps Institution of Oceanography (SIO) to conduct interdisciplinary research. With matching funds from the SIO Director's office we implemented a "virtual center" utilizing modern networking hardware and software to enhance access for researchers and students to unique satellite and in situ data sets. The center provides facilities and data access to graduate students as well as research scientists at SIO, and outside SIO. Our private sector partners installed and testes and advanced X-band data acquisition system for satellite data capture relevant for Earth science research and applications. Some of the commercial applications of these partners have been developed (or are under development) with NASA SBIR resources. The X-band system collected RADARSAT, ERS-2 and MODIS imagery. Perhaps most importantly, this COE brought together - for the first time - an interdisciplinary team of SIO scientists with interests in Earth remote sensing. The collaboration extended beyond our infrastructure and research accomplishments leading to a dialog that resulted in a report with strong recommendations to the SIO community for enhancing satellite remote sensing at SIO.

Mitchell, B. Greg↗

NASA NTRS1994

An adaptive technique to maximize lossless image data compression of satellite images

Data compression will pay an increasingly important role in the storage and transmission of image data within NASA science programs as the Earth Observing System comes into operation. It is important that the science data be preserved at the fidelity the instrument and the satellite communication systems were designed to produce. Lossless compression must therefore be applied, at least, to archive the processed instrument data. In this paper, we present an analysis of the performance of lossless compression techniques and develop an adaptive approach which applied image remapping, feature-based image segmentation to determine regions of similar entropy and high-order arithmetic coding to obtain significant improvements over the use of conventional compression techniques alone. Image remapping is used to transform the original image into a lower entropy state. Several techniques were tested on satellite images including differential pulse code modulation, bi-linear interpolation, and block-based linear predictive coding. The results of these experiments are discussed and trade-offs between computation requirements and entropy reductions are used to identify the optimum approach for a variety of satellite images. Further entropy reduction can be achieved by segmenting the image based on local entropy properties then applying a coding technique which maximizes compression for the region. Experimental results are presented showing the effect of different coding techniques for regions of different entropy. A rule-base is developed through which the technique giving the best compression is selected. The paper concludes that maximum compression can be achieved cost effectively and at acceptable performance rates with a combination of techniques which are selected based on image contextual information.

Stewart, Robert J.↗

NASA NTRS1994

CESDIS

CESDIS, the Center of Excellence in Space Data and Information Sciences was developed jointly by NASA, Universities Space Research Association (USRA), and the University of Maryland in 1988 to focus on the design of advanced computing techniques and data systems to support NASA Earth and space science research programs. CESDIS is operated by USRA under contract to NASA. The Director, Associate Director, Staff Scientists, and administrative staff are located on-site at NASA's Goddard Space Flight Center in Greenbelt, Maryland. The primary CESDIS mission is to increase the connection between computer science and engineering research programs at colleges and universities and NASA groups working with computer applications in Earth and space science. Research areas of primary interest at CESDIS include: 1) High performance computing, especially software design and performance evaluation for massively parallel machines; 2) Parallel input/output and data storage systems for high performance parallel computers; 3) Data base and intelligent data management systems for parallel computers; 4) Image processing; 5) Digital libraries; and 6) Data compression. CESDIS funds multiyear projects at U. S. universities and colleges. Proposals are accepted in response to calls for proposals and are selected on the basis of peer reviews. Funds are provided to support faculty and graduate students working at their home institutions. Project personnel visit Goddard during academic recess periods to attend workshops, present seminars, and collaborate with NASA scientists on research projects. Additionally, CESDIS takes on specific research tasks of shorter duration for computer science research requested by NASA Goddard scientists.

Source record↗

NASA NTRS2001

ECHO Responds to NASA's Earth Science User Community

Over the past decade NASA has designed, built, evolved, and operated the Earth Observing System Data and Information System (EOSDIS) Information Management System (IMS) in order to provide user access to NASA's Earth Science data holdings. During this time revolutionary advances in technology have driven changes in NASA's approach to providing an IMS service. This paper will describe NASA's strategic planning and approach to build and evolve the EOSDIS IMS and to serve the evolving needs of NASA's Earth Science community. It discusses the original strategic plan and how lessons learned help to form a new plan, a new approach and a new system. It discusses the original technologies and how they have evolved to today.

Pfister, Robin↗

NASA NTRSDate not supplied

Maximizing Earth Science Observations with Data Harmonization: Harmonized Landsat/Sentinel-2

In August 2021, NASA released science quality harmonized Landsat/Sentinel-2 products for both cloud-based access and direct download from the Land Processes Distributed Active Archive Center (LP DAAC). These 30-meter products, HLSS30 (Sentinel-2 component) and HLSL30 (Landsat component) are placed on the same grid and are generated and distributed fully in the cloud. Similarly, ESA is prototyping harmonized Landsat Sentinel-2 products at 10-meter resolution. The data production and science teams from NASA and ESA will present technical details on the data production system, data product status and availability, and the benefit of harmonizing instruments with similar sensing characteristics between the agencies.

Earth Science↗

NASA NTRS2009

Utilizing Remote Sensing Data to Ascertain Soil Moisture Applications and Air Quality Conditions

Recognizing the significance of NASA remote sensing Earth science data in monitoring and better understanding our planet's natural environment, NASA Earth Applied Sciences has implemented the 'Decision Support Through Earth Science Research Results' program. Several applications support systems through collaborations with benefiting organizations have been implemented. The Goddard Earth Sciences Data and Information Services Center (GES DISC) has participated in this program on two projects (one complete, one ongoing), and has had opportune ad hoc collaborations utilizing NASA Earth science data. GES DISC's understanding of Earth science missions and resulting data and information enables the GES DISC to identify challenges that come with bringing science data to research applications. In this presentation we describe applications research projects utilizing NASA Earth science data and a variety of resulting GES DISC applications support system project experiences. In addition, defining metrics that really evaluate success will be exemplified.

Leptoukh, Gregory↗

NASA NTRS2001

Simple, Scalable, Script-Based Science Processor (S4P)

The development and deployment of data processing systems to process Earth Observing System (EOS) data has proven to be costly and prone to technical and schedule risk. Integration of science algorithms into a robust operational system has been difficult. The core processing system, based on commercial tools, has demonstrated limitations at the rates needed to produce the several terabytes per day for EOS, primarily due to job management overhead. This has motivated an evolution in the EOS Data Information System toward a more distributed one incorporating Science Investigator-led Processing Systems (SIPS). As part of this evolution, the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) has developed a simplified processing system to accommodate the increased load expected with the advent of reprocessing and launch of a second satellite. This system, the Simple, Scalable, Script-based Science Processor (S42) may also serve as a resource for future SIPS. The current EOSDIS Core System was designed to be general, resulting in a large, complex mix of commercial and custom software. In contrast, many simpler systems, such as the EROS Data Center AVHRR IKM system, rely on a simple directory structure to drive processing, with directories representing different stages of production. The system passes input data to a directory, and the output data is placed in a "downstream" directory. The GES DAAC's Simple Scalable Script-based Science Processing System is based on the latter concept, but with modifications to allow varied science algorithms and improve portability. It uses a factory assembly-line paradigm: when work orders arrive at a station, an executable is run, and output work orders are sent to downstream stations. The stations are implemented as UNIX directories, while work orders are simple ASCII files. The core S4P infrastructure consists of a Perl program called stationmaster, which detects newly arrived work orders and forks a job to run the appropriate executable (registered in a configuration file for that station). Although S4P is written in Perl, the executables associated with a station can be any program that can be run from the command line, i.e., non-interactively. An S4P instance is typically monitored using a simple Graphical User Interface. However, the reliance of S4P on UNIX files and directories also allows visibility into the state of stations and jobs using standard operating system commands, permitting remote monitor/control over low-bandwidth connections. S4P is being used as the foundation for several small- to medium-size systems for data mining, on-demand subsetting, processing of direct broadcast Moderate Resolution Imaging Spectroradiometer (MODIS) data, and Quick-Response MODIS processing. It has also been used to implement a large-scale system to process MODIS Level 1 and Level 2 Standard Products, which will ultimately process close to 2 TB/day.

Lynnes, Christopher↗

NASA NTRS2015

Architectures Toward Reusable Science Data Systems

Science Data Systems (SDS) comprise an important class of data processing systems that support product generation from remote sensors and in-situ observations. These systems enable research into new science data products, replication of experiments and verification of results. NASA has been building systems for satellite data processing since the first Earth observing satellites launched and is continuing development of systems to support NASA science research and NOAAs Earth observing satellite operations. The basic data processing workflows and scenarios continue to be valid for remote sensor observations research as well as for the complex multi-instrument operational satellite data systems being built today. System functions such as ingest, product generation and distribution need to be configured and performed in a consistent and repeatable way with an emphasis on scalability. This paper will examine the key architectural elements of several NASA satellite data processing systems currently in operation and under development that make them suitable for scaling and reuse. Examples of architectural elements that have become attractive include virtual machine environments, standard data product formats, metadata content and file naming, workflow and job management frameworks, data acquisition, search, and distribution protocols. By highlighting key elements and implementation experience we expect to find architectures that will outlast their original application and be readily adaptable for new applications. Concepts and principles are explored that lead to sound guidance for SDS developers and strategists.

Data Processing↗

NASA NTRS1991

High-speed, cross-continental networks - A necessity

The networking requirements that the Earth Observing System (EOS) program has levied on NASA and the national and international operational networking communities is addressed. The objectives of the EOS program are listed and include the development and operation of an observing system to acquire essential, global earth science data on a long-term, sustained basis and in a manner which maximizes the scientific utility of the data and simplifies data analysis. Network design issues are also discussed, including protocol selection, the Transport Control Protocol/Internet Protocol suite, the Open Systems Interconnect network suite, and the internet evolution. Open and closed network issues are also discussed. A number of networks now in place are assessed including NASNet, and ESNet. These offer possible options and/or solutions to be considered by the NASA Headquarters EOS Data and Information Systems Program.

Wong, C. M.↗

NASA NTRS1986

University participation via UNIDATA, part 1

The UNIDATA Project is a cooperative university project, operated by the University Corporation for Atmospheric Research (UCAR) with National Science Foundation (NSF) funding, aimed at providing interactive communication and computations to the university community in the atmospheric and oceanic sciences. The initial focus has been on providing access to data for weather analysis and prediction. However, UNIDATA is in the process of expanding and possibly providing access to the Pilot Climate Data System (PCDS) through the UNIDATA system in an effort to develop prototypes for an Earth science information system. The notion of an Earth science information system evolved from discussions within NASA and several advisory committees in anticipation of receiving data from the many Earth observing instruments on the space station complex (Earth Observing System).

Dutton, J.↗

NASA NTRS1984

Earth Observing System, Conclusions and Recommendations

The following Earth Observing Systems (E.O.S.) recommendations were suggested: (1) a program must be initiated to ensure that present time series of Earth science data are maintained and continued. (2) A data system that provides easy, integrated, and complete access to past, present, and future data must be developed as soon as possible. (3) A long term research effort must be sustained to study and understand these time series of Earth observations. (4) The E.O.S. should be established as an information system to carry out those aspects of the above recommendations which go beyond existing and currently planned activities. (5) The scientific direction of the E.O.S. should be established and continued through an international scientific steering committee.

Source record↗

NASA NTRSDate not supplied

Earth System Digital Twins (ESDT) Technology for NASA Earth Science

For NASA's Advanced Information Systems Technology (AIST) Program, an Earth System Digital Twin (ESDT) is defined as an interactive and integrated multidomain, multiscale, digital replica of the state and temporal evolution of Earth systems. It dynamically integrates: relevant Earth system models and simulations; other relevant models (e.g., related to the world's infrastructure); continuous and timely (including near real time and direct readout) observations (e.g., space, air, ground, over/underwater, Internet of Things (IoT), socioeconomic); long-time records; as well as analytics and artificial intelligence tools. Effective ESDTs enable users to run hypothetical scenarios to improve the understanding, prediction of and mitigation/response to Earth system processes, natural phenomena and human activities as well as their many interactions. An ESDT is a type of integrated information system that, for example, enables continuous assessment of impact from naturally occurring and/or human activities on physical and natural environments. AIST ESDT strategic goals are to: 1. Develop information system frameworks to provide continuous and accurate representations of systems as they change over time; 2. Mirror various Earth Science systems and utilize the combination of Data Analytics, Artificial Intelligence, Digital Thread, and state-of-the-art models to help predict the Earth’s response to various phenomena; 3. Provide the tools to conduct "what if" investigations that can result in actionable predictions. The AIST ESDT thrust is developing capabilities toward the development of future digital twins of the Earth or of subcomponents of the Earth. This will enable the development of an overarching framework that will integrate New Observing Strategies (NOS) to enable new observation measurements, i.e., multi-source, coordinated, dynamic and responsive to needs and requests defined by Analytic Collaborative Frameworks (ACF) that enable agile science investigations fusing and analyzing very large amounts of diverse data. NOS and ACF capabilities along with open access to various science, infrastructure and human data, interconnected modeling, data assimilation, simulations, surrogate modeling, high-performance computing and advanced visualization, will define a powerful framework that could be utilized for local, regional or global and/or thematic digital twins. This presentation will describe a general overview of the AIST ESDT vision including prior work done in the areas of NOS and ACF as well as current and upcoming ESDT projects.

Jacqueline Le Moigne↗

NASA NTRS2014

Architectures Toward Reusable Science Data Systems

Data Processing↗

NASA NTRS1984

Artificial intelligence applications concepts for the remote sensing and earth science community

The following potential applications of AI to the study of earth science are described: (1) intelligent data management systems; (2) intelligent processing and understanding of spatial data; and (3) automated systems which perform tasks that currently require large amounts of time by scientists and engineers to complete. An example is provided of how an intelligent information system might operate to support an earth science project.

Campbell, W. J.↗

NASA NTRS1987

NASA's use of McIDAS technology - A data systems tool for meteorological research and applications

The Earth Science and Applications Division of the NASA Marshall Space Flight Center has been chartered to conduct research, and to develop and use space technology to gain a basic understanding of the earth processes with emphasis on atmospheric processes. An integral part of the research and development efforts has been the Man computer Interactive Data Access System (McIDAS). The McIDAS computer system has permitted integration of data from satellites, aircraft remote sensors, ground based meteorological data sources, and modeled atmospheric radiances. The result has been an increase in knowlege of mesoscale atmospheric processes and has enabled researchers to recommend improvements and suggestions for planned future remote sensing instruments.

Goodman, H. Michael↗

NASA NTRS2003

A Data System Architecture for Measurement Based Systems: Precipitation Processing System

NASA s Earth Science Enterprise (ESE) is changing focus from single satellite missions to measurement oriented programs. An example of this paradigm shift is the Global Precipitation Measurement (GPM) project. GPM is conceptualized as a rolling-wave of measurement possibilities all focused on the key precipitation parameter. In response to this shift to measurement programs and also integral to the ESE s new strategy for processing and management its data, a measurement based approach is also critical for data processing system that support measurement programs like GPM. This paper provides an overview of the paradigm shift from mission to measurement. It also presents a summary of the ESE s new strategy for its data systems. Building on this background the paper details the architectural, design and implementation aspects of the Precipitation Processing System (PPS). The PPS is an evolution of a single point system developed for the Tropical Rainfall Measurement Mission to a generic precipitation data system. The paper provides the context within which PPS will support the GPM program.

Stocker, Erich Franz↗