Search NASA⌕ Search

SEARCH · Search NASA

Results for “data provenance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Analysis of ERS 1 synthetic aperture radar data of frozen lakes in northern Montana and implications for climate studies

Lakes that freeze each winter are good indicators of regional climate change if key parameters, such as freeze-up and breakup date and maximum ice thickness, are measured over a decade-scale time frame. Synthetic aperture radar (SAR) satellite data have proven to be especially useful for measurement of climatologically significant parameters characteristic of frozen lakes. In this paper, five lakes in Glacier National Park, Montana, have been studied both in the field and using Earth Remote-Sensing Satellite (ERS) 1 SAR data during the 1992-1993 winter. The lakes are characterized by clear ice, sometimes with tubular or rounded bubbles, and often with a layer of snow ice on top of the clear ice. They are also often snow covered. Freeze-up is detected quite easily using ERS 1 SAR data as soon as a thin layer of ice forms. The effect of snow ice on the backscatter is thought to be significant but is, as yet, undetermined. On the five lakes studied, relative backscatter was found to increase with ice thickness until a maximum was reached in February. Breakup, an often ill-defined occurrence, is difficult to detect because surface water causes the SAR signal to be absorbed, thus masking the ice below. Comparison of the bubble structure of thaw lakes in northern Alaska with lakes in northern Montana has shown that the ice structure is quite different, and this difference may contribute to differential SAR signature evolution in the lakes of the two areas.

Hall, Dorothy K.↗
NASA NTRS2001

Simple, Scalable, Script-Based Science Processor (S4P)

The development and deployment of data processing systems to process Earth Observing System (EOS) data has proven to be costly and prone to technical and schedule risk. Integration of science algorithms into a robust operational system has been difficult. The core processing system, based on commercial tools, has demonstrated limitations at the rates needed to produce the several terabytes per day for EOS, primarily due to job management overhead. This has motivated an evolution in the EOS Data Information System toward a more distributed one incorporating Science Investigator-led Processing Systems (SIPS). As part of this evolution, the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) has developed a simplified processing system to accommodate the increased load expected with the advent of reprocessing and launch of a second satellite. This system, the Simple, Scalable, Script-based Science Processor (S42) may also serve as a resource for future SIPS. The current EOSDIS Core System was designed to be general, resulting in a large, complex mix of commercial and custom software. In contrast, many simpler systems, such as the EROS Data Center AVHRR IKM system, rely on a simple directory structure to drive processing, with directories representing different stages of production. The system passes input data to a directory, and the output data is placed in a "downstream" directory. The GES DAAC's Simple Scalable Script-based Science Processing System is based on the latter concept, but with modifications to allow varied science algorithms and improve portability. It uses a factory assembly-line paradigm: when work orders arrive at a station, an executable is run, and output work orders are sent to downstream stations. The stations are implemented as UNIX directories, while work orders are simple ASCII files. The core S4P infrastructure consists of a Perl program called stationmaster, which detects newly arrived work orders and forks a job to run the appropriate executable (registered in a configuration file for that station). Although S4P is written in Perl, the executables associated with a station can be any program that can be run from the command line, i.e., non-interactively. An S4P instance is typically monitored using a simple Graphical User Interface. However, the reliance of S4P on UNIX files and directories also allows visibility into the state of stations and jobs using standard operating system commands, permitting remote monitor/control over low-bandwidth connections. S4P is being used as the foundation for several small- to medium-size systems for data mining, on-demand subsetting, processing of direct broadcast Moderate Resolution Imaging Spectroradiometer (MODIS) data, and Quick-Response MODIS processing. It has also been used to implement a large-scale system to process MODIS Level 1 and Level 2 Standard Products, which will ultimately process close to 2 TB/day.

Lynnes, Christopher↗
NASA NTRS2016

Impact of the Timing of a SAR Image Acquisition on the Calibration of a Flood Inundation Model

Synthetic Aperture Radar (SAR) data have proven to be a very useful source of information for the calibration of flood inundation models. Previous studies have focused on assigning uncertainties to SAR images in order to improve flood forecast systems (e.g. Giustarini et al. (2015) and Stephens et al. (2012)). This paper investigates whether the timing of a SAR acquisition of a flood has an important impact on the calibration of a flood inundation model. As no suitable time series of SAR data exists, we generate a sequence of consistent SAR images through the use of a synthetic framework. This framework uses two available ERS-2 SAR images of the study area, one taken during the flood event of interest, the second taken during a dry reference period. The obtained synthetic observations at different points in time during the flood event are used to calibrate the flood inundation model. The results of this study indicate that the uncertainty of the roughness parameters is lower when the model is calibrated with an image taken before rather than during or after the flood peak. The results also show that the error on the modeled extent is much lower when the model is calibrated with a pre-flood peak image than when calibrated with a near-flood peak or a post-flood peak image. It is concluded that the timing of the SAR image acquisition of the flood has a clear impact on the model calibration and consequently on the precision of the predicted flood extent.

Flood inundation↗
NASA NTRS2003

The Use of Sage Water Vapor Data for Investigating Climate Change Issues

SAGE water vapor data has proven valuable for addressing several of the important issues in climate change research. It has been used to investigate how the upper troposphere water vapor responds to warming and convection, a key question in understanding the water vapor feedback to anthropogenic global warming. In the case of summer versus winter differences, SAGE results showed that the upper tropospheric relative humidity remained approximately constant; this result was in general agreement with how a GCM handled the seasonal difference, and gave credence to the argument that the GCM was not overestimating the water vapor feedback associated with convection. In addition, the convection-water vapor relationship was investigated further using SAGE water vapor and ISCCP cloud data. The results showed that upper tropospheric drying did appear to occur simultaneously with deep convective events in the tropics, only to be replaced by moistening a few hours later, associated (most likely) with the reevaporation of moisture from anvil clouds. The total effect was, again, a moistening of the upper troposphere associated with convection. Calculation of the actual trends in upper tropospheric moisture is a potential goal for SAGE data usage; trends calculated with radiosonde data, or instruments calibrated with radiosonde data have the problem of the effect of changing radiosonde instruments. SAGE data have in effect been used to compare different radiosondes through comparisons, and could continue to do so. SAGE 3 should also help clarify the absolute accuracy of SAGE retrievals in the troposphere. and its consequences. Model results show that water vapor increases can help explain the observations of stratospheric cooling, along with increasing C02 and ozone reduction. SAGE has been shown to provide trends similar to those of some other satellite and in situ retrievals, with increasing water vapor over time. However, SAGE is impacted by aerosol contamination which must be removed from the data; approaches used in the past will be reviewed. The SAGE water vapor errors, if taken literally, would make it hard to justify using SAGE data for such trends, and the error bars must be investigated. Stratospheric water vapor increases, like tropospheric increases, would lead to noticeable warming at the surface, and their changes must be quantified.

Rind, D.↗
DOE OSTI2026

Electromagnetic production of kaons on the nucleon

Studies of the electromagnetic production of strange quarks started in the 1950s as something of a curiosity that puzzled experimentalists and theorists alike. Eventually, a nascent understanding of these processes began to take shape through the first pioneering experiments dedicated to explore photo- and electroproduction that were carried out in the period from the 1950s to the 1980s. As the datasets increased, concomitant advances in theoretical models were realized. However, these initial studies also made clear that more precise data was essential to continue to move forward. A paradigm shift occurred in the 1990s with the development of second-generation facilities at ELSA, MAMI, SPring-8, and JLab. High-intensity, high duty-factor accelerators, coupled with novel detector systems and advances in computing and readout electronics, brought nuclear physics experiments forward by orders of magnitude in counting statistics compared to the first-generation efforts. This was an utter boon to strangeness physics investigations, and to date, more than 50 dedicated experiments in kaon photo- and electroproduction have been completed at facilities around the world, leading to a host of experimental observables that have enabled significant advances in the exploration of strongly interacting systems that decay via $s\bar{s}$ quark pair creation. These data have proven to be an essential complementary pathway to study the spectrum and structure of the excited states of the nucleon, and the search for missing and exotic baryon configurations. As well, investigations in these channels are requisite for exploring hypernuclear production as a probe of the $YN$ interaction and for studies of the electromagnetic form factors of strange mesons. This review was designed to provide the first-ever in-depth overview of both the experimental and theoretical progress in the field of the electromagnetic production of strangeness. This work looks back over 70 years of past developments, discusses ongoing work and near-term plans, and details future possibilities being considered for third-generation facilities. Extensive lists of the available datasets and theoretical models are provided, together with a comprehensive supporting bibliography of the field. Throughout this work, the primary impacts of these explorations are highlighted, along with connections to a wide range of related phenomenological applications. An important goal of this review is to provide a complete, (reasonably) self-contained guide into this field prepared at a level that is relevant for both new and seasoned scientists, whether experimentalists, phenomenologists, or theorists, to better understand what has been accomplished by so many dedicated folks-each building on what has come before-and to appreciate the exciting future potential for continued studies in this area.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1975

Marine geodetic control for geoidal profile mapping across the Puerto Rican Trench

A marine geodetic control was established for the northern end of the geoidal profile mapping experiment across the Puerto Rican Trench by determining the three-dimensional geodetic coordinates of the four ocean-bottom mounted acoustic transponders. The data reduction techniques employed and analytical processes involved are described. Before applying the analytical techniques to the field data, they were tested with simulated data and proven to be effective in theory as well as in practice.

Fubara, D. M.↗
NASA NTRS1991

Approach and landing simulator for Space Shuttle Orbiter touchdown conditions

This study describes a computer simulation that provides an accurate calculation of the touchdown conditions. The program is small enough to operate on a personal computer. The program simulates the Orbiter trajectory from an altitude of 10,000 ft to the earth's surface. It assumes the Orbiter files close to its reference altitude profile, with negligible crosswind effects. Flight data have proven both assumption to be valid. By incorporating these assumptions with the Shuttle guidance logic, a quick approximation can be made of the touchdown speed and downrange distance to an accuracy within 400 ft of the mainframe prediction.

Walyus, Keith D.↗
NASA NTRS2014

Adapting the Reconfigurable SpaceCube Processing System for Multiple Mission Applications

This paper will detail the use of SpaceCube in multiple space flight applications including the Hubble Space Telescope Servicing Mission 4 (HST-SM4), an International Space Station (ISS) radiation test bed experiment, and the main avionics subsystem for two separate ISS attached payloads. Each mission has had varying degrees of data processing complexities, performance requirements, and external interfaces. We will show the methodology used to minimize the changes required to the physical hardware, FPGA designs, embedded software interfaces, and testing.This paper will summarize significant results as they apply to each mission application. In the HST-SM4 application we utilized the FPGA resources to accelerate portions of the image processing algorithms more than 25 times faster than a standard space processor in order to meet computational speed requirements. For the ISS radiation on-orbit demonstration, the main goal is to show that we can rely on the commercial FPGAs and processors in a space environment. We describe our FPGA and processor radiation mitigation strategies that have resulted in our eight PowerPCs being available and error free for more than 99.99 of the time over the period of four years. This positive data and proven reliability of the SpaceCube on ISS resulted in the Department of Defense (DoD) selecting SpaceCube, which is replacing an older and slower computer currently used on ISS, as the main avionics for two upcoming ISS experiment campaigns. This paper will show how we quickly reconfigured the SpaceCube system to meet the more stringent reliability requirements

SpaceCube↗
NASA NTRS2015

Assessment of Precipitation Anomalies in California Using TRMM and MERRA Data

Using modern satellite (Tropical Rainfall Measuring Mission, TRMM, 1998-2014) and reanalysis (Modern-Era Retrospective Analysis for Research and Applications, MERRA, 1979-2015) data, we reassess certain aspects of the precipitation climate in California from the past decades. California has a well-pronounced rain season that peaks in December-February. However, the 95% confidence interval around the climatological precipitation during these months imply that deviations on the order of 60% of the expected amounts are very likely during the most important period of the rain season. While these positive and negative anomalies alternate almost every year and tend to cancel each other, severe multiyear declines of precipitation in California appear on decadal scales. The 1986-1994 decline of precipitation was similar to the current one that started in 2011 and is apparent in the reanalysis data. In terms of accumulated deficits of precipitation, that episode was no less severe than the current one. While El Niño (the warm phase of the El Nino-Southern Oscillation, ENSO) is frequently cited as the natural forcing expected to bring a relief from drought, our assessment is that ENSO has been driving at best only 6% of precipitation variability in California in the past three decades. Using fractional risk analysis of precipitation during typical versus drying periods, we show that the likelihood of losing the most intensive precipitation events drastically increases during the multiyear drying events. Storms delivering up to 50% of the precipitation in California are driven by atmospheric rivers making landfall. However, these phenomena can be suppressed and even blocked by persistent ridges of atmospheric pressure in the northeast Pacific. The reanalysis and satellite data are proven to be reliable to the extent where they yield information on developing conditions and observed precipitation anomalies.

precipitation↗
NASA NTRS2011

Towards a Standard for Provenance and Context for Preservation of Data for Earth System Science

Long-term data sets with data from many missions are needed to study trends and validate model results that are typical in Earth System Science research. Data and derived products originate from multiple missions (spaceborne, airborne and/or in situ) and from multiple organizations. During the missions as well as well past their termination, it is essential to preserve the data and products to support future studies. Key aspects of preservation are: preserving bits and ensuring data are uncorrupted, preserving understandability with appropriate documentation, and preserving reproducibility of science with appropriate documentation and other artifacts. Computer technology provides adequate standards to ensure that, with proper engineering, bits are preserved as hardware evolves. However, to ensure understandability and reproducibility, it is essential to plan ahead to preserve all the relevant data and information. There are currently no standards to identify the content that needs to be preserved, leading to non-uniformity in content and users not being sure of whether preserved content is comprehensive. Each project, program or agency can specify the items to be preserved as a part of its data management requirements. However, broader community consensus that cuts across organizational or national boundaries would be needed to ensure comprehensiveness, uniformity and long-term utility of archived data. The Federation of Earth Science Information Partners (ESIP), a diverse network of scientists, data stewards and technology developers, has a forum for ESIP members to collaborate on data preservation issues. During early 2011, members discussed the importance of developing a Provenance and Context Content Standard (PCCS) and developed an initial list of content items. This list is based on the outcome of a NASA and NOAA meeting held in 1998 under the auspices of the USGCRP, documentation requirements from NOAA and our experience with some of the NASA Earth science missions. The items are categorized into the following 8 high level categories: Preflight/Pre-Operations, Products (Data), Product Documentation, Mission Calibration, Product Software, Algorithm Input, Validation, Software Tools.

Ramaprian, Hampapuram K.↗
DOE OSTI2026

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1999

Pyroshock Environments Characterized for Spacecraft Missions

Pyrotechnic shock, or pyroshock, is the transient response of a structure to loading induced by the ignition of pyrotechnic (explosive or propellant activated) devices. These devices are typically used to separate structural systems (e.g., separate a spacecraft from a launch vehicle) and deploy appendages (e.g., solar panels). Pyroshocks are characterized by high peak acceleration, high-frequency content, and short duration. Because of their high acceleration and high-frequency, pyroshocks can cause spaceflight hardware to fail. Verifying by test that spaceflight hardware can withstand the anticipated shock environment is considered essential to mission success. The Earth Observing System (EOS) AM-1 spacecraft for NASA's Mission to Planet Earth is scheduled to be launched on an Atlas IIAS vehicle in 1999, and the NASA Lewis Research Center is the launch vehicle integrator for this NASA Goddard Space Flight Center spacecraft. The EOS spacecraft was subjected to numerous ground shock tests to verify that its scientific instruments and avionics components will withstand the shock-induced vibration produced when the spacecraft separates from the launch vehicle. Shock test data from these tests represent the third largest available pyroshock database in the United States. Future spacecraft missions will directly benefit from the knowledge gained from these tests. The payload separation system used for EOS is a new system that operates by firing six separation nuts. This system was tested to verify its functional operation and to characterize the resulting shock levels. The launch vehicle contractor (Lockheed Martin Astronautics) and spacecraft contractor (Lockheed Martin Missiles & Space) completed 16 separation test firings. This resulted in an unusually large amount of pyroshock data. Typically, only one or two pyroshock test firings are performed for a spacecraft mission. Because of the size of this separation system shock database, engineers were able to perform unique statistical analyses to characterize the distribution of the test data. For example, it was proven that the shock data follow a lognormal distribution, a concept often assumed but rarely proven. The test-to-test repeatability of the shock source level was analyzed, and the effects of various test configurations and separation nut production lots were examined and quantified. Engineers investigated the change in shock level as the shock traveled from the spacecraft separation interface to the avionics components of the upper stage and analyzed the effects of the structural fidelity (simulator versus real) of the components and their weight on vibrational response. In addition, the shock attenuation with distance and across joints was quantified and compared with concepts originally generated in 1970, and the effects of separation nut preload and firing sequences effects were examined. Because of this EOS shock testing and the analyses performed at NASA Lewis, a significant amount of new information on pyroshock and its characteristics is now available to the aerospace industry. We hope that this information will help future spacecraft test planners to perform better and cheaper spacecraft separation shock tests and to better understand their test data.

Hughes, William O.↗
NASA NTRS2015

Global Precipitation Measurement (GPM) Mission Products and Services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC)

The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) hosts and distributes GPM data within the NASA Earth Observation System Data Information System (EOSDIS). The GES DISC is also home to the data archive for the GPM predecessor, the Tropical Rainfall Measuring Mission (TRMM). Over the past 17 years, the GES DISC has served the scientific as well as other communities with TRMM data and user-friendly services. During the GPM era, the GES DISC will continue to provide user-friendly data services and customer support to users around the world. GPM products currently and to-be available: -Level-1 GPM Microwave Imager (GMI) and partner radiometer products, DPR products -Level-2 Goddard Profiling Algorithm (GPROF) GMI and partner products, DPR products -Level-3 daily and monthly products, DPR products -Integrated Multi-satellitE Retrievals for GPM (IMERG) products (early, late, and final) A dedicated Web portal (including user guides, etc.) has been developed for GPM data (http://disc.sci.gsfc.nasa.gov/gpm). Data services that are currently and to-be available include Google-like Mirador (http://mirador.gsfc.nasa.gov/) for data search and access; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion into various formats (e.g., netCDF, HDF, KML (for Google Earth), ASCII); exploration, visualization, and statistical online analysis through Giovanni (http://giovanni.gsfc.nasa.gov); generation of value-added products; parameter and spatial subsetting; time aggregation; regridding; data version control and provenance; documentation; science support for proper data usage, FAQ, help desk; monitoring services (e.g. Current Conditions) for applications. The United User Interface (UUI) is the next step in the evolution of the GES DISC web site. It attempts to provide seamless access to data, information and services through a single interface without sending the user to different applications or URLs (e.g., search, access, subset, Giovanni, documents).

precipitation↗
NASA NTRS2015

Global Precipitation Measurement (GPM) Mission Products and Services at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC)

On February 27, 2014, the NASA Global Precipitation Measurement (GPM) mission was launched to provide the next-generation global observations of rain and snow (http:pmm.nasa.govGPM). The GPM mission consists of an international network of satellites in which a GPM Core Observatory satellite carries both active and passive microwave instruments to measure precipitation and serve as a reference standard, to unify precipitation measurements from a constellation of other research and operational satellites. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) hosts and distributes GPM data within the NASA Earth Observation System Data Information System (EOSDIS). The GES DISC is home to the data archive for the GPM predecessor, the Tropical Rainfall Measuring Mission (TRMM). Over the past 16 years, the GES DISC has served the scientific as well as other communities with TRMM data and user-friendly services. During the GPM era, the GES DISC will continue to provide user-friendly data services and customer support to users around the world. GPM products currently and to-be available include the following: 1. Level-1 GPM Microwave Imager (GMI) and partner radiometer products. 2. Goddard Profiling Algorithm (GPROF) GMI and partner products. 3. Integrated Multi-satellitE Retrievals for GPM (IMERG) products. (early, late, and final)A dedicated Web portal (including user guides, etc.) has been developed for GPM data (http:disc.sci.gsfc.nasa.govgpm). Data services that are currently and to-be available include Google-like Mirador (http:mirador.gsfc.nasa.gov) for data search and access; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion into various formats (e.g., netCDF, HDF, KML (for Google Earth), ASCII); exploration, visualization, and statistical online analysis through Giovanni (http:giovanni.gsfc.nasa.gov); generation of value-added products; parameter and spatial subsetting; time aggregation; regridding; data version control and provenance; documentation; science support for proper data usage, FAQ, help desk; monitoring services (e.g. Current Conditions) for applications.In this presentation, we will present GPM data products and services with examples.

NASA GES DISC↗
NASA NTRS2014

Global Precipitation Measurement (GPM) Mission Products and Services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC)

On February 27, 2014, the NASA Global Precipitation Measurement (GPM) mission was launched to provide the next-generation global observations of rain and snow (http:pmm.nasa.govGPM). The GPM mission consists of an international network of satellites in which a GPM Core Observatory satellite carries both active and passive microwave instruments to measure precipitation and serve as a reference standard, to unify precipitation measurements from a constellation of other research and operational satellites. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) hosts and distributes GPM data within the NASA Earth Observation System Data Information System (EOSDIS). The GES DISC is home to the data archive for the GPM predecessor, the Tropical Rainfall Measuring Mission (TRMM). Over the past 16 years, the GES DISC has served the scientific as well as other communities with TRMM data and user-friendly services. During the GPM era, the GES DISC will continue to provide user-friendly data services and customer support to users around the world. GPM products currently and to-be available include the following:Level-1 GPM Microwave Imager (GMI) and partner radiometer productsLevel-2 Goddard Profiling Algorithm (GPROF) GMI and partner productsLevel-3 daily and monthly productsIntegrated Multi-satellitE Retrievals for GPM (IMERG) products (early, late, and final) A dedicated Web portal (including user guides, etc.) has been developed for GPM data (http:disc.sci.gsfc.nasa.govgpm). Data services that are currently and to-be available include Google-like Mirador (http:mirador.gsfc.nasa.gov) for data search and access; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion into various formats (e.g., netCDF, HDF, KML (for Google Earth), ASCII); exploration, visualization, and statistical online analysis through Giovanni (http:giovanni.gsfc.nasa.gov); generation of value-added products; parameter and spatial subsetting; time aggregation; regridding; data version control and provenance; documentation; science support for proper data usage, FAQ, help desk; monitoring services (e.g. Current Conditions) for applications.

precipitation↗
NASA NTRS2008

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗
NASA NTRS2011

From Science to e-Science to Semantic e-Science: A Heliosphysics Case Study

The past few years have witnessed unparalleled efforts to make scientific data web accessible. The Semantic Web has proven invaluable in this effort; however, much of the literature is devoted to system design, ontology creation, and trials and tribulations of current technologies. In order to fully develop the nascent field of Semantic e-Science we must also evaluate systems in real-world settings. We describe a case study within the field of Heliophysics and provide a comparison of the evolutionary stages of data discovery, from manual to semantically enable. We describe the socio-technical implications of moving toward automated and intelligent data discovery. In doing so, we highlight how this process enhances what is currently being done manually in various scientific disciplines. Our case study illustrates that Semantic e-Science is more than just semantic search. The integration of search with web services, relational databases, and other cyberinfrastructure is a central tenet of our case study and one that we believe has applicability as a generalized research area within Semantic e-Science. This case study illustrates a specific example of the benefits, and limitations, of semantically replicating data discovery. We show examples of significant reductions in time and effort enable by Semantic e-Science; yet, we argue that a "complete" solution requires integrating semantic search with other research areas such as data provenance and web services.

Narock, Thomas↗
NASA NTRS2017

Earth Science Informatics - Overview

Over the last 10-15 years, significant advances have been made in information management, there are an increasing number of individuals entering the field of information management as it applies to Geoscience and Remote Sensing data, and the field of informatics has come to its own. Informatics is the science and technology of applying computers and computational methods to the systematic analysis, management, interchange, and representation of science data, information, and knowledge. Informatics also includes the use of computers and computational methods to support decision making and applications. Earth Science Informatics (ESI, a.k.a. geoinformatics) is the application of informatics in the Earth science domain. ESI is a rapidly developing discipline integrating computer science, information science, and Earth science. Major national and international research and infrastructure projects in ESI have been carried out or are on-going. Notable among these are: the Global Earth Observation System of Systems (GEOSS), the European Commissions INSPIRE, the U.S. NSDI and Geospatial One-Stop, the NASA EOSDIS, and the NSF DataONE, EarthCube and Cyberinfrastructure for Geoinformatics. More than 18 departments and agencies in the U.S. federal government have been active in Earth science informatics. All major space agencies in the world, have been involved in ESI research and application activities. In the United States, the Federation of Earth Science Information Partners (ESIP), whose membership includes over 180 organizations (government, academic and commercial) dedicated to managing, delivering and applying Earth science data, has been working on many ESI topics since 1998. The Committee on Earth Observation Satellites (CEOS)s Working Group on Information Systems and Services (WGISS) has been actively coordinating the ESI activities among the space agencies.The talk will present an overview of current efforts in ESI, the role members of IEEE GRSS play, and discuss recent developments in data preservation and provenance.

Remote Sensing↗