Search NASASearch

SEARCH · Search NASA

Results for “Remote Sensing; Data Systems; Information Quality; Usability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Information Quality Cluster and Usability

The Information Quality Cluster (IQC) of the Federation of Earth Science Information Partners (ESIP) has been active since 2014 with membership from multiple organizations including NASA and NOAA. The purpose of this presentation is to foster collaboration between the IQC and the ESIP Usability Cluster. The IQC's activities are motivated partly by the guidelines on information quality from several federal agencies. The agencies developed the guidelines complying with a request in 2002 from the Office of Management and Budget (OMB). The OMB request resulted from a congressional mandate, namely, Section 515 of the Treasury and General Government Appropriations Act for Fiscal Year 2001 (Public Law 106-554; H.R. 5658). NASA's guidelines, for example, emphasize the need for high information quality indicating the various types of public users of information from NASA's missions and programs. The IQC's vision is to become an authoritative and responsive resource of information and guidance to data providers on how best to implement data quality standards and best practices, so that the implementations comply with the various agencies' guidelines, as well as provide users with the best quality of information possible. The IQC interacts with various national and international organizations and encourages collaboration for exchange of information. The IQC considers four aspects of information quality: Scientific Quality, Product Quality, Stewardship Quality and Service Quality. The IQC has considered several use cases to identify issues in capturing, describing, providing access to, and enabling use of information on quality. Several of these use cases point to issues about the usability of information. Collaboration between the IQC and Usability Cluster will be beneficial for arriving at solutions to such issues.

Remote Sensing; Data Systems; Information Quality;

The Cabauw Intercomparison Campaign for Nitrogen Dioxide Measuring Instruments (CINDI): Design, Execution, and Early Results

From June to July 2009 more than thirty different in-situ and remote sensing instruments from all over the world participated in the Cabauw Intercomparison campaign for Nitrogen Dioxide measuring Instruments (CINDI). The campaign took place at KNMI's Cabauw Experimental Site for Atmospheric Research (CESAR) in the Netherlands. Its main objectives were to determine the accuracy of state-ofthe- art ground-based measurement techniques for the detection of atmospheric nitrogen dioxide (both in-situ and remote sensing), and to investigate their usability in satellite data validation. The expected outcomes are recommendations regarding the operation and calibration of such instruments, retrieval settings, and observation strategies for the use in ground-based networks for air quality monitoring and satellite data validation. Twenty-four optical spectrometers participated in the campaign, of which twenty-one had the capability to scan different elevation angles consecutively, the so-called Multi-axis DOAS systems, thereby collecting vertical profile information, in particular for nitrogen dioxide and aerosol. Various in-situ samplers and lidar instruments simultaneously characterized the variability of atmospheric trace gases and the physical properties of aerosol particles. A large data set of continuous measurements of these atmospheric constituents has been collected under various meteorological conditions and air pollution levels. Together with the permanent measurement capability at the CESAR site characterizing the meteorological state of the atmosphere, the CINDI campaign provided a comprehensive observational data set of atmospheric constituents in a highly polluted region of the world during summertime. First detailed comparisons performed with the CINDI data show that slant column measurements of NO2, O4 and HCHO with MAX-DOAS agree within 5 to 15%, vertical profiles of NO2 derived from several independent instruments agree within 25% of one another, and MAX-DOAS aerosol optical thickness agrees within 20-30% with AERONET data. For the in-situ NO2 instrument using a molybdenum converter, a bias was found as large as 5 ppbv during day time, when compared to the other in-situ instruments using photolytic converters.

Atmospheric composition

Data Access Services that Make Remote Sensing Data Easier to Use

This slide presentation reviews some of the processes that NASA uses to make the remote sensing data easy to use over the World Wide Web. This work involves much research into data formats, geolocation structures and quality indicators, often to be followed by coding a preprocessing program. Only then are the data usable within the analysis tool of choice. The Goddard Earth Sciences Data and Information Services Center is deploying a variety of data access services that are designed to dramatically shorten the time consumed in the data preparation step. On-the-fly conversion to the standard network Common Data Form (netCDF) format with Climate-Forecast (CF) conventions imposes a standard coordinate system framework that makes data instantly readable through several tools, such as the Integrated Data Viewer, Gridded Analysis and Display System, Panoply and Ferret. A similar benefit is achieved by serving data through the Open Source Project for a Network Data Access Protocol (OPeNDAP), which also provides subsetting. The Data Quality Screening Service goes a step further in filtering out data points based on quality control flags, based on science team recommendations or user-specified criteria. Further still is the Giovanni online analysis system which goes beyond handling formatting and quality to provide visualization and basic statistics of the data. This general approach of automating the preparation steps has the important added benefit of enabling use of the data by non-human users (i.e., computer programs), which often make sub-optimal use of the available data due to the need to hard-code data preparation on the client side.

Lynnes, Christopher

Experiences in Bridging the Gap between Science and Decision Making at NASA's GSFC Earth Science Data and Information Services Center (GES DISC)

Recognizing the significance of NASA remote sensing Earth science data in monitoring and better understanding our planet s natural environment, NASA has implemented the Decision Support Through Earth Science Research Results program (NASA ROSES solicitations). a) This successful program has yielded several monitoring, surveillance, and decision support systems through collaborations with benefiting organizations. b) The Goddard Space Flight Center (GSFC) Earth Sciences Data and Information Services Center (GES DISC) has participated in this program on two projects (one complete, one ongoing), and has had opportune ad hoc collaborations gaining much experience in the formulation, management, development, and implementation of decision support systems utilizing NASA Earth science data. c) In addition, GES DISC s understanding of Earth science missions and resulting data and information, including data structures, data usability and interpretation, data interoperability, and information management systems, enables the GES DISC to identify challenges that come with bringing science data to decision makers. d) The purpose of this presentation is to share GES DISC decision support system project experiences in regards to system sustainability, required data quality (versus timeliness), data provider understanding of how decisions are made, and the data receivers willingness to use new types of information to make decisions, as well as other topics. In addition, defining metrics that really evaluate success will be exemplified.

Kempler, Steven

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher

TCL3 UTM (UAS Traffic Management) Flight Tests, Airspace Operations Laboratory (AOL) Report

The Technology Capability Level-3 (TCL3) flight tests were conducted at six different test sites located across the USA from March to May of 2018. The campaign resulted in over 830 data collection flights using 28 different aircraft and involving 20 flight crews. Flights not only varied in duration, but also in the environments and terrains over which they flew. The TCL3 tests highlighted four different types of tests: three tests focused on Communication, Navigation and Surveillance (CNS); six tests focused on Sense and Avoid (SAA) technologies; six tests focused on USS Data and Information Exchange (DAT); and five tests focused on exploring fundamental Concepts of the project (CON). This document presents data collected during the TCL3 tests that informed the operator’s experiences—the quality of the unmanned aerial system (UAS) Service Supplier (USS) information that the operator was provided with, the usefulness of this information, and the usability of the automation, both while airborne and on the ground. It is intended to complement the reports written by the test sites and the quantitative reports and presentations of the UAS Traffic Management (UTM) project. With the goal of instructing what the minimum information requirements and/or best practices might be in TCL3 operations, the driving enquiry was: How do you get the information you need, when you need it, to successfully fly a UAS in UTM airspace? This enquiry touches on two requirements for displays, which are to provide adequate situation awareness (SA) and to share information through a USS. The six test sites participating in the TCL3 tests flew a subset of the 20 tests (outlined above), with most sites working on a subset of each of the four types: Communications, Navigation and Surveillance (CNS); DAT; CON; and Sense and Avoid (SAA). The, mainly qualitative, data addressed in this report was collected by the AOL (Airspace Operations Laboratory) both on-site and remotely for each test. The data consists of the contents of end-of-day debriefs, end-of-day surveys, observer notes, and flight test information, all submitted as part of the Data Management Plan (DMP).

Martin, Lynne

Fractals and Spatial Methods for Mining Remote Sensing Imagery

The rapid increase in digital remote sensing and GIS data raises a critical problem -- how can such an enormous amount of data be handled and analyzed so that useful information can be derived quickly? Efficient handling and analysis of large spatial data sets is central to environmental research, particularly in global change studies that employ time series. Advances in large-scale environmental monitoring and modeling require not only high-quality data, but also reliable tools to analyze the various types of data. A major difficulty facing geographers and environmental scientists in environmental assessment and monitoring is that spatial analytical tools are not easily accessible. Although many spatial techniques have been described recently in the literature, they are typically presented in an analytical form and are difficult to transform to a numerical algorithm. Moreover, these spatial techniques are not necessarily designed for remote sensing and GIS applications, and research must be conducted to examine their applicability and effectiveness in different types of environmental applications. This poses a chicken-and-egg problem: on one hand we need more research to examine the usability of the newer techniques and tools, yet on the other hand, this type of research is difficult to conduct if the tools to be explored are not accessible. Another problem that is fundamental to environmental research are issues related to spatial scale. The scale issue is especially acute in the context of global change studies because of the need to integrate remote-sensing and other spatial data that are collected at different scales and resolutions. Extrapolation of results across broad spatial scales remains the most difficult problem in global environmental research. There is a need for basic characterization of the effects of scale on image data, and the techniques used to measure these effects must be developed and implemented to allow for a multiple scale assessment of the data before any useful process-oriented modeling involving scale-dependent data can be conducted. Through the support of research grants from NASA, we have developed a software module called ICAMS (Image Characterization And Modeling System) to address the need to develop innovative spatial techniques and make them available to the broader scientific communities. ICAMS provides new spatial techniques, such as fractal analysis, geostatistical functions, and multiscale analysis that are not easily available in commercial GIS/image processing software. By bundling newer spatial methods in a user-friendly software module, researchers can begin to test and experiment with the new spatial analysis methods and they can gauge scale effects using a variety of remote sensing imagery. In the following, we describe briefly the development of ICAMS and present application examples.

Lam, Nina

An Intelligent Archive Testbed Incorporating Data Mining

Many significant advances have occurred during the last two decades in remote sensing instrumentation, computation, storage, and communication technology. A series of Earth observing satellites have been launched by U.S. and international agencies and have been operating and collecting global data on a regular basis. These advances have created a data rich environment for scientific research and applications. NASA s Earth Observing System (EOS) Data and Information System (EOSDIS) has been operational since August 1994 with support for pre-EOS data. Currently, EOSDIS supports all the EOS missions including Terra (1999), Aqua (2002), ICESat (2002) and Aura (2004). EOSDIS has been effectively capturing, processing and archiving several terabytes of standard data products each day. It has also been distributing these data products at a rate of several terabytes per day to a diverse and globally distributed user community (Ramapriyan et al. 2009). There are other NASA-sponsored data system activities including measurement-based systems such as the Ocean Data Processing System and the Precipitation Processing system, and several projects under the Research, Education and Applications Solutions Network (REASoN), Making Earth Science Data Records for Use in Research Environments (MEaSUREs), and the Advancing Collaborative Connections for Earth-Sun System Science (ACCESS) programs. Together, these activities provide a rich set of resources constituting a value chain for users to obtain data at various levels ranging from raw radiances to interdisciplinary model outputs. The result has been a significant leap in our understanding of the Earth systems that all humans depend on for their enjoyment, livelihood, and survival. The trend in the community today is towards many distributed sets of providers of data and services. Despite this, visions for the future include users being able to locate, fuse and utilize data with location transparency and high degree of interoperability, and being able to convert data to information and usable knowledge in an efficient, convenient manner, aided significantly by automation (Ramapriyan et al. 2004; NASA 2005). We can look upon the distributed provider environment with capabilities to convert data to information and to knowledge as an Intelligent Archive in the Context of a Knowledge Building system (IA-KBS). Some of the key capabilities of an IA-KBS are: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting (Ramapriyan et al. 2004).

Ramapriyan, H.