The TextureCam project is developing a 'smart camera' that can classify geologic surfaces in planetary images. This would allow autonomous spacecraft to collect data opportunisitcally during intervals between communications with Earth, such as during long traverses. Its surface classifications can identify new targets that were not anticipated in advance. The spacecraft might use this information to target these features with high-resolution instruments such as spectrometers nd narrow-field cameras. Classifications could also inform data 'triage' decisions, identifying high value images for prioritized downlink. Finally, the surface classification can serve as compressed maps of image content. Each of these strategies can improve the science data returned at each command cycle and speed reconnaissance during site survey and astrobiology investigation. Our first year of development has completed the image analysis algorithms and validated them in software tests. Here we survey these initial results and explore several application areas relevant to Mars and beyond.

Hyperspectral imagery↗

NASA NTRS2012

Integrating High-Resolution Taskable Imagery into a Sensorweb for Automatic Space-Based Monitoring of Flooding in Thailand

Several space-based assets (Terra, Aqua, Earth Observing One) have been integrated into a sensorweb to monitor flooding in Thailand. In this approach, the Moderate Imaging Spectrometer (MODIS) data from Terra and Aqua is used to perform broad-scale monitoring to track flooding at the regional level (250m/pixel) and EO-1 is autonomously tasked in response to alerts to acquire higher resolution (30m/pixel) Advanced Land Imager (ALI) data. This data is then automatically processed to derive products such as surface water extent and volumetric water estimates. These products are then automatically pushed to organizations in Thailand for use in damage estimation, relief efforts, and damage mitigation. More recently, this sensorweb structure has been used to request imagery, access imagery, and process high-resolution (several m to 30m), targetable asset imagery from commercial assets including Worldview-2, Ikonos, Radarsat-2, Landsat-7, and Geo-Eye-1. We describe the overall sensorweb framework as well as new workflows and products made possible via these extensions.

sensorweb operations↗

NASA NTRS2012

Onboard Autonomy and Ground Operations Automation for the Intelligent Payload Experiment (IPEX) CubeSat Mission

The Intelligent Payload Experiment (IPEX) is a cubesat manifested for launch in October 2013 that will flight validate autonomous operations for onboard instrument processing and product generation for the Intelligent Payload Module (IPM) of the Hyperspectral Infra-red Imager (HyspIRI) mission concept. We first describe the ground and flight operations concept for HyspIRI IPM operations. We then describe the ground and flight operations concept for the IPEX mission and how that will validate HyspIRI IPM operations. We then detail the current status of the mission and outline the schedule for future development.

project data planning↗

NASA NTRS2012

Using WorldView-2 Imagery to Track Flooding in Thailand in a Multi-Asset Sensorweb

For the flooding seasons of 2011-2012 multiple space assets were used in a "sensorweb" to track major flooding in Thailand. Worldview-2 multispectral data was used in this effort and provided extremely high spatial resolution (2m / pixel) multispectral (8 bands at 0.45-1.05 micrometer spectra) data from which mostly automated workflows derived surface water extent and volumetric water information for use by a range of NGO and national authorities. We first describe how Worldview-2 and its data was integrated into the overall flood tracking sensorweb. We next describe the use of Support Vector Machine learning techniques that were used to derive surface water extent classifiers. Then we describe the fusion of surface water extent and digital elevation map (DEM) data to derive volumetric water calculations. Finally we discuss key future work such as speeding up the workflows and automating the data registration process (the only portion of the workflow requiring human input).

surface water extent↗

NASA NTRS2012

Onboard Processing and Autonomous Operations on the IPEX Cubesat

IPEX is a 1u Cubesat sponsored by NASA Earth Science Technology Office (ESTO), the goals or which are: (1) Flight validate high performance flight computing, (2) Flight validate onboard instrument data processing product generation software, (3) flight validate autonomous operations for instrument processing, (4) enhance NASA outreach and university ties.

Hyperspectral Infrared Imager (HyspIRI)↗

NASA NTRS2011

Space-Based Sensorweb Monitoring of Wildfires in Thailand

We describe efforts to apply sensorweb technologies to the monitoring of forest fires in Thailand. In this approach, satellite data and ground reports are assimilated to assess the current state of the forest system in terms of forest fire risk, active fires, and likely progression of fires and smoke plumes. This current and projected assessment can then be used to actively direct sensors and assets to best acquire further information. This process operates continually with new data updating models of fire activity leading to further sensing and updating of models. As the fire activity is tracked, products such as active fire maps, burn scar severity maps, and alerts are automatically delivered to relevant parties.We describe the current state of the Thailand Fire Sensorweb which utilizes the MODIS-based FIRMS system to track active fires and trigger Earth Observing One / Advanced Land Imager to acquire imagery and produce active fire maps, burn scar severity maps, and alerts. We describe ongoing work to integrate additional sensor sources and generate additional products.

sensorweb↗

NASA NTRS2011

Combining Space-Based and In-Situ Measurements to Track Flooding in Thailand

We describe efforts to integrate in-situ sensing, space-borne sensing, hydrological modeling, active control of sensing, and automatic data product generation to enhance monitoring and management of flooding. In our approach, broad coverage sensors and missions such as MODIS, TRMM, and weather satellite information and in-situ weather and river gauging information are all inputs to track flooding via river basin and sub-basin hydrological models. While these inputs can provide significant information as to the major flooding, targetable space measurements can provide better spatial resolution measurements of flooding extent. In order to leverage such assets we automatically task observations in response to automated analysis indications of major flooding. These new measurements are automatically processed and assimilated with the other flooding data. We describe our ongoing efforts to deploy this system to track major flooding events in Thailand.

Flooding↗

NASA NTRS2011

Rapid Response During a Volcanic Crisis with the Autonomous Volcano Sensor Web (VSW)

No abstract available

autonomy↗

NASA NTRS2011

Integrating Multiple Space Ground Sensors to Track Volcanic Activity

Volcanic activity can occur with little or no warning. Increasing numbers of space borne assets can enable coordinated measurements of volcanic events to enhance both scientific study and hazard response. We describe the use of space and ground measurements to target further measurements as part of a worldwide volcano monitoring system. We utilize a number of alert systems including the MODVOLC, GOESVOLC, US Air Force Weather Advisory, and Volcanic Ash Advisory Center (VAAC) alert systems. Additionally we use in-situ data from ground instrumentation at a number of volcanic sites, including Iceland.

volcanoes↗

NASA NTRS2010

Onboard Processing of Multispectral and Hyperspectral Data of Volcanic Activity for Future Earth-Orbiting and Planetary Missions

Autonomous onboard processing of data allows rapid response to detections of dynamic, changing processes. Software that can detect volcanic eruptions from thermal emission has been used to retask the Earth Observing 1 spacecraft to obtain additional data of the eruption. Rapid transmission of these data to the ground, and the automatic processing of the data to generated images, estimates of eruption parameters and maps of thermal structure, has allowed these products to be delivered rapidly to volcanologists to aid them in assessing eruption risk and hazard. Such applications will enhance science return from future Earth-orbiting spacecraft and also from spacecraft exploring the Solar System, or beyond, which hope to image dynamic processes. Especially in the latter case, long communication times between the spacecraft and Earth exclude a rapid response to what may be a transient process - only using onboard autonomy can the spacecraft react quickly to such an event.

Jupiter↗

NASA NTRS2010

Autonomous Sensorweb Operations for Integrated Space, In-Situ Monitoring of Volcanic Activity

We have deployed and demonstrated operations of an integrated space in-situ sensorweb for monitoring volcanic activity. This sensorweb includes a network of ground sensors deployed to the Mount Saint Helens volcano as well as the Earth Observing One spacecraft. The ground operations and space operations are interlinked in that ground-based intelligent event detections can cause the space segment to acquire additional data via observation requests and space-based data acquisitions (thermal imagery) can trigger reconfigurations of the ground network to allocate increased bandwidth to areas of the network best situated to observe the activity. The space-based operations are enabled by an automated mission planning and tasking capability which utilizes several Opengeospatial Consortium (OGC) Sensorweb Enablement (SWE) standards which enable acquiring data, alerts, and tasking using web services. The ground-based segment also supports similar protocols to enable seamless tasking and data delivery. The space-based segment also supports onboard development of data products (thermal summary images indicating areas of activity, quicklook context images, and thermal activity alerts). These onboard developed products have reduced data volume (compared to the complete images) which enables them to be transmitted to the ground more rapidly in engineering channels.

Chien, Steve A.↗

NASA NTRS2009

Onboard Classification of Hyperspectral Data on the Earth Observing One Mission

Remote-sensed hyperspectral data represents significant challenges in downlink due to its large data volumes. This paper describes a research program designed to process hyperspectral data products onboard spacecraft to (a) reduce data downlink volumes and (b) decrease latency to provide key data products (often by enabling use of lower data rate communications systems). We describe efforts to develop onboard processing to study volcanoes, floods, and cryosphere, using the Hyperion hyperspectral imager and onboard processing for the Earth Observing One (EO-1) mission as well as preliminary work targeting the Hyperspectral Infrared Imager (HyspIRI) mission.

cryosphere↗

NASA NTRS2008

Lights Out Operations of a Space, Ground, Sensorweb

We have been operating an autonomous, integrated sensorweb linking numerous space and ground sensors in 24/7 operations since 2004. This sensorweb includes elements of space data acquisition (MODIS, GOES, and EO-1), space asset retasking (EO-1), integration of data acquired from ground sensor networks with on-demand ground processing of data into science products. These assets are being integrated using web service standards from the Open Geospatial Consortium. Future plans include extension to fixed and mobile surface and subsurface sea assets as part of the NSF's ORION Program.

Chien, Steve↗

NASA NTRS2001

Using Multiple Space Assests with In-Situ Measurements to Track Flooding in Thailand

Increasing numbers of space assets can enable coordinated measurements of flooding phenomena to enhance tracking of extreme events. We describe the use of space and ground measurements to target further measurements as part of a flood monitoring system in Thailand. We utilize rapidly delivered MODIS data to detect major areas of flooding and the target the Earth Observing One Advanced Land Imager sensor to acquire higher spatial resolution data. Automatic surface water extent mapping products delivered to interested parties. We are also working to extend our network to include in-situ sensing networks and additional space assets.

flooding↗