Search NASA⌕ Search

SEARCH · Search NASA

Results for “spatial data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

A data reduction, management, and analysis system for a 10-terabyte data set

Within 12 months a 5-year space-based research investigation with an estimated daily data volume of 10 to 15 gigabytes will be launched. Our instrument/analysis team will analyze 2 to 8 gigabytes per day from this mission. Most of these data will be spatial and multispectral collected from nine sensors covering the UV/Visible/NlR spectrum. The volume and diversity of these data and the nature of its analysis require a very robust reduction and management system. This paper is a summary of the systems requirements and a high-level description of a solution. The paper is intended as a case study of the problems and potential solutions faced by the new generation of Earth observation data support systems.

DeMajistre, R.↗

Global-Scale Hydrology: Simple Characterization of Complex Simulation

Atmospheric general circulation models (AGCMS) are unique and valuable tools for the analysis of large-scale hydrology. AGCM simulations of climate provide tremendous amounts of hydrological data with a spatial and temporal coverage unmatched by observation systems. To the extent that the AGCM behaves realistically, these data can shed light on the nature of the real world's hydrological cycle. In the first part of the seminar, I will describe the hydrological cycle in a typical AGCM, with some emphasis on the validation of simulated precipitation against observations. The second part of the seminar will focus on a key goal in large-scale hydrology studies, namely the identification of simple, overarching controls on hydrological behavior hidden amidst the tremendous amounts of data produced by the highly complex AGCM parameterizations. In particular, I will show that a simple 50-year-old climatological relation (and a recent extension we made to it) successfully predicts, to first order, both the annual mean and the interannual variability of simulated evaporation and runoff fluxes. The seminar will conclude with an example of a practical application of global hydrology studies. The accurate prediction of weather statistics several months in advance would have tremendous societal benefits, and conventional wisdom today points at the use of coupled ocean-atmosphere-land models for such seasonal-to-interannual prediction. Understanding the hydrological cycle in AGCMs is critical to establishing the potential for such prediction. Our own studies show, among other things, that soil moisture retention can lead to significant precipitation predictability in many midlatitude and tropical regions.

Koster, Randal D.↗

Accelerating Time-Varying Hardware Volume Rendering Using TSP Trees and Color-Based Error Metrics

This paper describes a new hardware volume rendering algorithm for time-varying data. The algorithm uses the Time-Space Partitioning (TSP) tree data structure to identify regions within the data that have spatial or temporal coherence. By using this coherence, the rendering algorithm can improve performance when the volume data is larger than the texture memory capacity by decreasing the amount of textures required. This coherence can also allow improved speed by appropriately rendering flat-shaded polygons instead of textured polygons, and by not rendering transparent regions. To reduce the polygonization overhead caused by the use of the hierarchical data structure, we introduce an optimization method using polygon templates. The paper also introduces new color-based error metrics, which more accurately identify coherent regions compared to the earlier scalar-based metrics. By showing experimental results from runs using different data sets and error metrics, we demonstrate that the new methods give substantial improvements in volume rendering performance.

Ellsworth, David↗

Comparing Goldstone Solar System Radar Earth-based Observations of Mars with Orbital Datasets

The Goldstone Solar System Radar (GSSR) has collected a self-consistent set of delay-Doppler near-nadir radar echo data from Mars since 1988. Prior to the Mars Global Surveyor (MGS) Mars Orbiter Laser Altimeter (MOLA) global topography for Mars, these radar data provided local elevation information, along with radar scattering information with global coverage. Two kinds of GSSR Mars delay-Doppler data exist: low 5 km x 150 km resolution and, more recently, high (5 to 10 km) spatial resolution. Radar data, and non-imaging delay-Doppler data in particular, requires significant data processing to extract elevation, reflectivity and roughness of the reflecting surface. Interpretation of these parameters, while limited by the complexities of electromagnetic scattering, provide information directly relevant to geophysical and geomorphic analyses of Mars. In this presentation we want to demonstrate how to compare GSSR delay-Doppler data to other Mars datasets, including some idiosyncracies of the radar data. Additional information is included in the original extended abstract.

Haldemann, A. F. C.↗

Data Science and the Knowledge Discovery Adventure

This talk will cover the important steps involved in the data science and knowledge discovery process: • Initial fact gathering (interview domain experts, review reports, articles, state-of-the-art) • Identify the problem (prediction, classification, statistical analysis, etc.) • Survey supporting data sources • Understand the data (numerical, categorical, text, sampling rate, data quality issues, etc.) • Selecting relevant features and sources • Acquire the data (set up agreements with the data stewards, APIs to download, etc.) • Merge data sources (temporal, spatial, common key, other ontologies...) • Feature Engineering (non linear domain knowledge or physics-based relationships) • Build data processing pipeline (may need to tap into data stream, develop parallel processing algorithm, federated learning etc.) • Build model and test (tune hyper-parameters, cross validation.) • Analyze/Validate results (do the results make sense. Does it answer the original question). • Deploy/Publish (Monitor and assess benefits)

Data science↗

Premature Deaths Due to Heat Exposure: the Potential Effects of Neighborhood-Level Versus City-Level Acclimatization Within Us Cities

For the population of a given US city, the risk of premature death associated with heat exposure increases as temperatures rise, but risks in hotter cities are generally lower than in cooler cities at equivalent temperatures due to factors such as acclimatization. Those living in especially hot neighborhoods within cities might therefore suffer much more than average if such adaptation is only at the city-wide level, whereas they might not experience greatly increased risk if adjustment is at the neighborhood level. To compare these possibilities, we use high spatial resolution temperature data to evaluated heat-related deaths assuming either adjustment at the city-wide or at the neighborhood scale in 10 large US cities. On average, we find that if inhabitants are adjusted to their local conditions, a neighborhood that was 10°C hotter than a cooler one would experience only about 1.0–1.5 excess heat deaths per year per 100,000 persons. By contrast, if inhabitants are acclimatized to city-wide temperatures, the hotter neighborhood would experience about 15 excess deaths per year per 100,000 persons. Using idealized analyses, we demonstrate that current city-wide epidemiological data do not differentiate between these differing adjustments. Given the very large effects of assumptions about neighborhood-level acclimatization found here, as well as the fact that current literature is conflicting on the spatial scale of acclimatization, more neighborhood-level epidemiological data are urgently needed to determine the health impacts of variations in heat exposure within urban areas, better constrain projected changes, and inform mitigation efforts.

heat island↗

Onboard Science and Applications Algorithm for Hyperspectral Data Reduction

An onboard processing mission concept is under development for a possible Direct Broadcast capability for the HyspIRI mission, a Hyperspectral remote sensing mission under consideration for launch in the next decade. The concept would intelligently spectrally and spatially subsample the data as well as generate science products onboard to enable return of key rapid response science and applications information despite limited downlink bandwidth. This rapid data delivery concept focuses on wildfires and volcanoes as primary applications, but also has applications to vegetation, coastal flooding, dust, and snow/ice applications. Operationally, the HyspIRI team would define a set of spatial regions of interest where specific algorithms would be executed. For example, known coastal areas would have certain products or bands downlinked, ocean areas might have other bands downlinked, and during fire seasons other areas would be processed for active fire detections. Ground operations would automatically generate the mission plans specifying the highest priority tasks executable within onboard computation, setup, and data downlink constraints. The spectral bands of the TIR (thermal infrared) instrument can accurately detect the thermal signature of fires and send down alerts, as well as the thermal and VSWIR (visible to short-wave infrared) data corresponding to the active fires. Active volcanism also produces a distinctive thermal signature that can be detected onboard to enable spatial subsampling. Onboard algorithms and ground-based algorithms suitable for onboard deployment are mature. On HyspIRI, the algorithm would perform a table-driven temperature inversion from several spectral TIR bands, and then trigger downlink of the entire spectrum for each of the hot pixels identified. Ocean and coastal applications include sea surface temperature (using a small spectral subset of TIR data, but requiring considerable ancillary data), and ocean color applications to track biological activity such as harmful algal blooms. Measuring surface water extent to track flooding is another rapid response product leveraging VSWIR spectral information.

Chien, Steve A.↗

Analysis of terrestrial conditions and dynamics

Land spectral reflectance properties for selected locations, including the Goddard Space Flight Center, the Wallops Flight Facility, a MLA test site in Cambridge, Maryland, and an acid test site in Burlington, Vermont, were measured. Methods to simulate the bidirectional reflectance properties of vegetated landscapes and a data base for spatial resolution were developed. North American vegetation patterns observed with the Advanced Very High Resolution Radiometer were assessed. Data and methods needed to model large-scale vegetation activity with remotely sensed observations and climate data were compiled.

Goward, S. N.↗

Data for: A hybrid biophysical-machine learning framework for diurnal surface energy flux estimation using proximal sensing

Thermal-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal datasets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for specific surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of an ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81-0.94) and H (R2 = 0.46-0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical – machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

Agricultural Sciences↗

Visualizing Time-Varying Distribution Data in EOS Application

In this research, we have developed several novel visualization methods for spatial probability density function data. Our focus has been on 2D spatial datasets, where each pixel is a random variable, and has multiple samples which are the results of experiments on that random variable. We developed novel clustering algorithms as a means to reduce the information contained in these datasets; and investigated different ways of interpreting and clustering the data.

Shen, Han-Wei↗

Improved Soil Moisture Estimation and Detection of Irrigation Signal By Incorporating SMAP Soil Moisture Into the Indian Land Data Assimilation System (ILDAS)

Land surface models have facilitated the estimation of soil moisture over a range of spatiotemporal scales. However, limitations in model parameterization and under-representation of anthropogenic processes restrict their ability to estimate local-scale soil moisture variability, especially over irrigated areas. Assimilation of satellite-based soil moisture retrievals into land surface models can be a viable approach to overcome these constraints, specially over highly irrigated countries such as India, where such applications are rare. Additionally, large-scale validation of modeled soil moisture has been limited over India till now due to lack of a representative station network. By assimilating Soil Moisture Active Passive (SMAP)-based estimates into the state-of-the-art Indian Land Data Assimilation System (ILDAS) and combining with a new soil moisture station network of more than 200 stations, this study demonstrates improved soil moisture estimations and capture of irrigation signals over the region. The Noah-MP land surface model is forced by multiple local and global meteorological datasets and Ensemble Kalman Filter (EnKF) is used for assimilation of soil moisture. Comparison of open-loop and data assimilated soil moisture against station soil moisture data shows relative spatial mean improvement of 0.0178 in correlation and 0.0029 m3/m3 in RMSE. Further statistical comparison with in-situ data has also shown better results over most of the stations, as evident from improved correlations and reduced unbiased RMSE after assimilation. Finally, the climatology of soil moisture over the different irrigation fractions reveals that data assimilated outputs over irrigated grid cells tend to have higher soil moisture during dry winter season, demonstrating the ability to capture irrigation signals. These findings quantify the value of data assimilation in improving soil moisture estimates and the ability to capture unmodeled processes such as irrigation, which lays the science groundwork for upcoming space missions such as NASA ISRO Synthetic Aperture Radar (NISAR).

Soil Moisture↗

A Study of the Non-Thermal X-ray Emission of Shell-Type Supernova Remnants

The term of the forth year of the award is the period from March 15, 2003 to March 14, 2004. During this year, Dr. Thomas Pannuti, who had been performing most of the analyses, made a transition to a new position at Caltech. As of September 2003, Dr. Michael Stage began performing most of the analyses. Dr. Stage has begun constructing a detailed catalog of the spatial and spectral properties of young supernova remnants as described in sections 1 and 4 of the proposal. Specifically, he has focused on the analysis of Chandra ACIS data. The exquisite spatial resolution of the Chandra telescope and the modest spectral resolution of the CCDs make these data ideal. Dr. Stage has developed a standard set of procedures to reduce the data, generate telescope and detector response libraries and handle instrumental and celestial background subtraction. He has also adapted some existing code to automate spectral extraction and fitting. This code enables us to analyze the spectra of tens of thousands of small subregions of supernova remnants. Dr. Stage has recently applied this process to ACIS data for the supernova remnants Cas A and Kepler. The results include maps of the fitted parameters, such as individual line intensities and centroids (i.e. Doppler shifts), the electron temperature, and the absorption column density. These maps are more accurate than simple energy-cut images because it is difficult (and sometimes impossible) to cleanly separate the line emission from the underlying continuum (especially at low energies). It is now possible to identify the locations at which emission from each element is produced. Some of the elements are seen to be layered. The electron temperature maps demonstrate that the outer edges of Cas A and Kepler are very hot with weak lines. This emission is almost certainly synchrotron dominated. Therefore, not only are the maps interesting in and of themselves, but they also provide an unbiased means of easily identifying features in the remnants that can be studied in more detail using, for example, synchrotron models. Over the next year, Dr. Stage will refine the analysis procedures, expand the analyses to include several other remnants, present the results at major scientific conferences and publish a catalog of the results. Since this work is producing impressive results, we have applied for very long Chandra observations of Kepler and Tycho to obtain enough counts to take lull advantage of the technique. A i Ms observation of Cas A is already scheduled. Over the past year, I completed a joint, spectra,l analysis of some X-ray, radio, and gamma-ray data for the supernova remnant SN 1006. The results of this analysis show that the synchrotron and, hence, electron spectrum of the remnant is curved. The amount of curvature in the electron spectrum is quantitatively consistent with predictions of the amount of curvature in the proton spectrum of the remnant. A paper describing this work is nearly complete. When Dr. Pannuti left, he was analyzing X-ray data for the young supernova remnant G266.2-1.2. Dr. Pannuti found the first evidence of thermal X-ray emission from this remnant. Furthermore, like SN 1006, the cutoff frequency varies with azimuth along the bright northeastern rim. This work will be published during the coming year.

Allen, Glenn E.↗

Advanced Data Structure and Geographic Information Systems

The current state of the art in specified areas of Geographic Information Systems GIS technology is examined. Study of the question of very large, efficient, heterogeneous spatial databases is required in order to explore the potential application of remotely sensed data for studying the long term habitability of the Earth. Research includes a review of spatial data structures and storage, development of operations required by GIS, and preparation of a testbed system to compare Vaster data structure with NASA's Topological Raster Structure.

Peuquet, D.↗

Wildfire Smoke Particle Properties and Evolution, From Space-Based Multi-Angle Imaging II: The Williams Flats Fire during the FIREX-AQ Campaign

Although the characteristics of biomass burning events and the ambient ecosystem determine emitted smoke composition, the conditions that modulate the partitioning of black carbon (BC) and brown carbon (BrC) formation are not well understood, nor are the spatial or temporal frequency of factors driving smoke particle evolution, such as hydration, coagulation, and oxidation, all of which impact smoke radiative forcing. In situ data from surface observation sites and aircraft field campaigns offer deep insight into the optical, chemical, and microphysical traits of biomass burning (BB) smoke aerosols, such as single scattering albedo (SSA) and size distribution, but cannot by themselves provide robust statistical characterization of both emitted and evolved particles. Data from the NASA Earth Observing System’s Multi-Angle Imaging SpectroRadiometer (MISR) instrument can provide at least a partial picture of BB particle properties and their evolution downwind, once properly validated. Here we use in situ data from the joint NOAA/NASA 2019 Fire Influence on Regional to Global Environments Experiment-Air Quality (FIREX-AQ) field campaign to assess the strengths and limitations of MISR-derived constraints on particle size, shape, light-absorption, and its spectral slope, as well as plume height and associated wind vectors. Based on the satellite observations, we also offer inferences about aging mechanisms effecting downwind particle evolution, such as gravitational settling, oxidation, secondary particle formation, and the combination of particle aggregation and condensational growth. This work builds upon our previous study, adding confidence to our interpretation of the remote-sensing data based on an expanded suite of in situ measurements for validation. The satellite and in situ measurements offer similar characterizations of particle property evolution as a function of smoke age for the 06 August Williams Flats Fire, and most of the key differences in particle size and absorption can be attributed to differences in sampling and changes in the plume geometry between sampling times. Whereas the aircraft data provide validation for the MISR retrievals, the satellite data offer a spatially continuous mapping of particle properties over the plume, which helps identify trends in particle property downwind evolution that are ambiguous in the sparsely sampled aircraft transects. The MISR data record is more than two decades long, offering future opportunities to study regional wildfire plume behavior statistically, where aircraft data are limited or entirely lacking.

biomass burning↗

Sea Ice Kinematics and Thickness from RGPS: Observations and Theory

The RADARSAT Geophysical Processor System (RGPS) has produced a wealth of data on Arctic sea ice motion, deformation, and thickness with broad geographical coverage and good temporal resolution. These data provide unprecedented spatial detail of the structure and evolution of the sea ice cover. The broad purpose of this study was to take advantage of the strengths of the RGPS data set to investigate sea ice kinematics and thickness, which affect the climate through their influence on ice production, ridging, and transport (i.e. mass balance); heat flux to the atmosphere; and structure of the upper ocean mixed layer. The objectives of this study were to: (1) Explain the relationship between the discontinuous motion of the ice cover and the large-scale, smooth wind field that drives the ice; (2) Characterize the sea ice deformation in the Arctic at different temporal and spatial scales, and compare it with deformation predicted by a state-of-theart ice/ocean model; and (3) Compare RGPS-derived sea ice thickness with other data, and investigate the thinning of the Arctic sea ice cover as seen in ULS data obtained by U.S. Navy submarines. We briefly review the results of our work below, separated into the topics of sea ice deformation and sea ice thickness. This is followed by a list of publications, meetings and presentations, and other activities supported under this grant. We are attaching to this report copies of all the listed publications. Finally, we would like to point out our community service to NASA through our involvement with the ASF User Working Group and the RGPS Science Working Group, as evidenced in the list of meetings and presentations below.

Stern, Harry↗

AERO-MAP: a data compilation and modeling approach to understand spatial variability in fine- and coarse-mode aerosol composition

Abstract. Aerosol particles are an important part of the Earth climate system, and their concentrations are spatially and temporally heterogeneous, as well as being variable in size and composition. Particles can interact with incoming solar radiation and outgoing longwave radiation, change cloud properties, affect photochemistry, impact surface air quality, change the albedo of snow and ice, and modulate carbon dioxide uptake by the land and ocean. High particulate matter concentrations at the surface represent an important public health hazard. There are substantial data sets describing aerosol particles in the literature or in public health databases, but they have not been compiled for easy use by the climate and air quality modeling community. Here, we present a new compilation of PM2.5 and PM10 surface observations, including measurements of aerosol composition, focusing on the spatial variability across different observational stations. Climate modelers are constantly looking for multiple independent lines of evidence to verify their models, and in situ surface concentration measurements, taken at the level of human settlement, present a valuable source of information about aerosols and their human impacts complementarily to the column averages or integrals often retrieved from satellites. We demonstrate a method for comparing the data sets to outputs from global climate models that are the basis for projections of future climate and large-scale aerosol transport patterns that influence local air quality. Annual trends and seasonal cycles are discussed briefly and are included in the compilation. Overall, most of the planet or even the land fraction does not have sufficient observations of surface concentrations – and, especially, particle composition – to characterize and understand the current distribution of particles. Climate models without ammonium nitrate aerosols omit ∼ 10 % of the globally averaged surface concentration of aerosol particles in both PM2.5 and PM10 size fractions, with up to 50 % of the surface concentrations not being included in some regions. In these regions, climate model aerosol forcing projections are likely to be incorrect as they do not include important trends in short-lived climate forcers.

Mahowald, Natalie M. (ORCID:000000022873997X)↗

Chandra Interactive Analysis of Observations (CIAO)

The Chandra (formerly AXAF) telescope, launched on July 23, 1999, provides X-rays data with unprecedented spatial and spectral resolution. As part of the Chandra scientific support, the Chandra X-ray Observatory Center provides a new data analysis system, CIAO ("Chandra Interactive Analysis of Observations"). We will present the main components of the system: "First Look" analysis; SHERPA: a multi-dimensional, multi-mission modeling and fitting application; Chandra Imaging and Plotting System; Detect package-source detection algorithms; and DM package generic data manipulation tools, We will set up a demonstration of the portable version of the system and show examples of Chandra Data Analysis.

Dobrzycki, Adam↗

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions.This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

synthetic data↗