Search NASASearch

Engineering topics

Hua, Hook

Publications and source records attributed to Hua, Hook.

At least 19 records

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher

Lessons Learned from Recent Rapid Imaging of Earthquake Ruptures with Satellite Geodesy

Rapid determination of the location and extent of earthquake ruptures at the surface and at depth is helpful for disaster response, as it allows prediction of the likely area of major damage from the earthquake and can help with rescue and recovery planning. The Caltech-Jet Propulsion Laboratory (JPL) Advanced Rapid Imaging and Analysis (ARIA) project has responded to many recent large earthquakes to process geodetic data and help determine the location and extent of ruptures. With the increasing availability of near real-time data from the Global Positioning System (GPS) and other global navigation satellite system receivers in active tectonic regions, and with the shorter repeat times of many recent and newly launched radar satellites, geodetic data can now be obtained quickly after earthquakes or other disasters. We have been building an ARIA data system that can ingest, catalog, and process geodetic data and combine it with seismic analysis to estimate the fault rupture locations and slip distributions for large earthquakes that are on or near land.

Simons, Mark