Search NASASearch

SEARCH · Search NASA

Results for “data gap”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Constructing a coherent long-term global total ozone climatology from the BUV, MFR, and SBUV/TOMS data sets

Multichannel Filter Radiometer (MFR) data are intercompared with Solar Backscattered Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) data during a five-month period of their data overlap in order to determine the usefulness of MFR data to represent the SBUV/TOMS and backscatter ultraviolet spectrometer data during their data gap period. Total ozone differences found were latitudinally and monthly dependent. Average differences between the TOMS and the MFR ozone data vary from -12.4 to +13.3 percent, with differences in the tropical to middle latitudes generally between + or - 4 percent. Biases between the data sets can be removed for certain latitude zones by applying an appropriate algorithm to the MFR ozone data.

Ellis, J. S.

Analysis of AVHRR, CZCS and historical in situ data off the Oregon Coast

The original scientific objectives of this grant were to: (1) characterize the seasonal cycles and interannual variability for phytoplankton concentrations and sea surface temperature (SST) in the California Current using satellite data; and (2) to explore the spatial and temporal relationship between these variables and surface wind forcing. An additional methodological objective was to develop statistical methods for forming mean fields, which minimize the effects of random data gaps and errors in the irregularly sampled CZCS (Coastal Zone Color Scanner) and AVHRR (Advanced Very High Resolution Radiometer) satellite data. A final task was to evaluate the level of uncertainty in the wind fields used for the statistical analysis. Funding in the first year included part of the cost of an image processing system to enable this and other projects to process and analyze satellite data. This report consists of summaries of the major projects carried out with all or partial support from this grant. The appendices include a list of papers and professional presentations supported by the grant, as well as reprints of the major papers and reports.

Strub, P. Ted

Quantitative Estimation of Some Possible Errors Associated With TRMM GV Monthly Rain Maps and a Scheme for Spatial Averaging of Radar Accumulations

The Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) rain products are generated from ground-based radar observations using a bulk adjusted FACE radar reflectivity (Ze) - rain rate (R) relationship. Monthly Ze-R relationships are obtained by extracting the Ze data with a horizontal resolution of 2 km from an altitude of 1.5 km (from Constant Altitude PPIS, CAPPIS) over the locations of the gauges. The gauge and radar data are merged, and a quality control procedure is applied that eliminates poorly correlated gauge-radar data. Bulk adjusted Ze-R relations are then derived from this quality-controlled merged data base. These Z-R relations are applied to the base scan reflectivity to produce rain maps. The present study examines the effect of these different planes on the total accumulations from the radar and the associated effect on the bulk adjustment coefficient. In order to evaluate the credibility of these GV products, the effect of the different planes involved in the bulk adjustment method will be discussed, The gauge data will also be used to assess the impact of missing radar data (i.e., data gaps) upon the monthly radar-derived rainfall estimates. Experiments were also performed varying both the area of the radar data extracted over the gauges and the use of different weighting coefficients. Preliminary results from these sensitivity tests indicate improved agreement and consistency between the gauge and radar data.

Datta, Saswati

Impacts of Snow and Cloud Covers on Satellite-Derived PM 2.5 Levels

Satellite aerosol optical depth (AOD) has been widely employed to evaluate ground fine particle (PM 2.5 ) levels, whereas snow/cloud covers often lead to a large proportion of non-random missing AOD. As a result, the fully covered and unbiased PM 2.5 estimates will be hard to generate. Among the current approaches to deal with the data gap issue, few have considered the cloud-AOD relationship and none of them have considered the snow-AOD relationship. This study examined the impacts of snow and cloud covers on AOD and PM 2.5 and made full-coverage PM 2.5 predictions with the consideration of these impacts. To estimate the missing AOD, daily gap-filling models with snow/cloud fractions and meteorological covariates were developed using the random forest algorithm. By using these models in New York State, a daily AOD data set with a 1-km resolution was generated with a complete coverage. The“out-of-bag” R 2 of the gap-filling models averaged 0.93 with an interquartile range from 0.90 to 0.95. Subsequently, a random forest-based PM 2.5 prediction model with the gap-filled AOD and covariates was built to predict fully covered PM 2.5 estimates. A ten-fold cross-validation for the prediction model showed a good performance with an R 2 of 0.82. In the gap-filling models, the snow fraction was of higher significance in the snow season compared with the rest of the year. The prediction models fitted with/without the snow fraction also suggested the discernible changes in PM 2.5 patterns, further confirming the significance of this parameter. Compared with the methods without considering snow and cloud covers, our PM 2.5 prediction surfaces showed more spatial details and reflected small-scale terrain-driven PM 2.5 patterns. The proposed methods can be generalized to the areas with extensive snow/cloud covers and large proportions of missing satellite AOD for predicting PM 2.5 levels with high resolutions and complete coverage.

AOD

Use of MODIS Satellite Images and an Atmospheric Dust Transport Model to Evaluate Juniperus spp. Pollen Phenology and Transport

Pollen can be transported great distances. Van de Water et al., 2003 reported Juniperus spp. pollen, a significant aeroallergen was transported 200-600 km. Hence local observations of plant phenology may not be consistent with the timing and source of pollen collected by pollen sampling instruments. Direct detection of pollen via satellite is not practical. A practical alternative combines modeling and phenological observations using ground based sampling and satellite data. The DREAM (Dust REgional Atmospheric Model) is a verified model for atmospheric dust transport modeling using MODIS data products to identify source regions and quantities of dust (Nickovic et al. 2001). The use of satellite data products for studying phenology is well documented (White and Nemani 2006). In the current project MODIS data will provide critical input to the PREAM model providing pollen source location, timing of pollen release, and vegetation type. We are modifying the DREAM model (PREAM - Pollen REgional Atmospheric Model) to incorporate pollen transport. The linkages already exist with DREAM through PHAiRS (Public Health Applications in Remote Sensing) to the public health community. This linkage has the potential to fill this data gap so that the potential association of health effects of pollen can better be tracked for possible linkage with health outcome data which may be associated with asthma, respiratory effects, myocardial infarction, and lost workdays. Juniperus spp. pollen phenology may respond to a wide range of environmental factors such as day length, growing degree-days, precipitation patterns and soil moisture. Species differences are also important. These environmental factors vary over both time and spatial scales. Ground based networks such as the USA National Phenology Network have been established to provide national wide observations of vegetation phenology. However, the density of observers is not adequate to sufficiently document the phenology variability over large regions. Hence the use of satellite data is critical to observe Juniperus spp. pollen phenology. MODIS data was used to observe Juniperus spp. pollen phenology. The MODIS surface reflectance product(MOD09) provided information on the Juniper spp. cone formation and cone density (Fig 1). Ground based observational records of pollen release timing and quantities were used as verification. Techniques developed using MOD09 surface reflectance products will be directly applicable to the next generation sensors such as VIIRS.

Luvall, J. C.

Nimbus-7 Earth Radiation Budjet compact solar data set user's guide

Nimbus-7 Earth Radiation Budget (ERB) solar measurements extend from November 16, 1978, to December 13, 1993, but with data gaps in 1992 and 1993. The measurements include the total solar irradiance plus six broadband spectral components. The Channel 10c total irradiance data appears very stable, and the calibration, well done. A number of characterization problems remain in the spectral measurements. In the original program, the solar and Earth flux measurements were intermixed and spread over about 170 computer tapes. For easier access, the solar data have been collected into two compact data sets. All of the data are collected into 14 Summary Solar Tapes (SST's). In addition, two Channel 10c Solar Tapes (CST's) give a separate listing of the stable total solar irradiance measurements. Channel 10c calibration and orbital irradiance values are given on separate PC disks. This document gives data descriptions and formats, together with quality control and calibration procedures.

Kyle, H. Lee

Informing Disaster Response: An Introduction to the NASA Disaster Response Coordination System

Satellite observations provide information about the Earth that can be critical to building situational awareness and filling in data gaps during disaster response. The National Aeronautics and Space Administration (NASA) Earth Science Division’s Disasters Program aims to advance Earth science data and information to support management decisions that prevent or mitigate the impacts of disasters. In support of this goal, NASA’s Disaster Response Coordination System (DRCS) manages a One-NASA approach to coordinate and mobilize the Agency’s assets and expertise to provide geospatial information during disasters. The purpose of the DRCS is to advance the utility of Earth observation information for supporting disaster response decision support, build skilled and effective response communities through improved coordination, engagement, and learning, and reduce impact to lives and livelihoods by empowering communities to respond to disasters more effectively. The DRCS employs a user-centered, activation framework that begins with direct requests from responders and ends with after-action assessments that feed lessons learned and process improvements. This poster will introduce the DRCS model and approach to expanding the use of Earth observations and geospatial information to support disaster response, share use cases for recent event activations, and highlight initial lessons learned.

Disaster Response

Informing Disaster Response through Earth Observation: A User-Centric Model for Enhancing Disaster Response Using Geospatial Assets

Satellite observations can provide critical insights to building situational awareness and filling data gaps during disaster response. The National Aeronautics and Space Administration (NASA) Earth Science Division’s Disasters Program aims to advance Earth science data and information to support management decisions that prevent or mitigate the impacts of disasters. In support of this goal, NASA’s Disasters Response Coordination System (DRCS) employs a “One NASA” approach to coordinate and mobilize the Agency’s assets and expertise to provide geospatial information during disasters. The DRCS advances the utility of Earth observation information for supporting disaster response needs and builds skills in the emergency management and disaster response communities through improved coordination, engagement, and learning. The DRCS aims to support reduction of impact to lives and livelihoods by empowering communities to more effectively respond to disasters. The DRCS is organized across six NASA centers and managed by a project office located at NASA Langley, working in alignment with NASA Headquarters. The DRCS employs a user-centered framework that begins with requests from disaster responders (state, local, federal government and non-profits working at a national scale) and ends with after-action assessments that feed lessons learned and process improvements. This poster introduces the DRCS model and approach to expanding the use of Earth observations and geospatial information to support disaster response, share use cases for recent event activations working with decision-making organizations, and highlight initial lessons learned.

Remote Sensing

Stewardship Best Practices for Improved Discovery and Reuse of Heterogeneous and Cross-Disciplinary Earth System Data

Some of the Earth system data products such as those from NASA airborne and field investigations (a.k.a. campaigns), are highly heterogeneous and cross-disciplinary, making the data extremely challenging to manage. For example, airborne and field campaign measurements tend to be sporadic over a period of time, with large gaps. Data products generated are of various processing levels and utilized for a wide range of inter- and cross-disciplinary research and applications. Data and derived products have been historically stored in a variety of domain-specific standard (and some non-standard) formats and in various locations such as NASA Distributed Active Archive Centers (DAACs), NASA airborne science facilities, field archives, or even individual scientists’ computer hard drives. As a result, airborne and field campaign data products have often been managed and represented differently, making it onerous for data users to find, access, and utilize campaign data. Some difficulties in discovering and accessing the campaign data originate from the incomplete data product and contextual metadata that may contain details relevant to the campaign (e.g. campaign acronym and instrument deployment locations), but tend to lack other significant information needed to understand conditions surrounding the data. Such details can be burdensome to locate after the conclusion of a campaign. Utilizing consistent terminology, essential for improved discovery and reuse, is also challenging due to the variety of involved disciplines. To help address the aforementioned challenges faced by many repositories and data managers handling airborne and field data, this presentation will describe stewardship practices developed by the Airborne Data Management Group (ADMG) within the Interagency Implementation and Advanced Concepts Team (IMPACT) under the NASA’s Earth Science Data systems (ESDS) Program.

best practices

Discovery of a Similar to 5 Day Characteristic Timescale in the Kepler Power Spectrum of Zw 229-15

We present time series analyses of the full Kepler dataset of Zw 229− 15. This Kepler light curve- with a baseline greater than three years, composed of virtually continuous, evenly sampled 30-minute measurements - is unprecedented in its quality and precision. We utilize two methods of power spectral analysis to investigate the optical variability and search for evidence of a bend frequency associated with a characteristic optical variability timescale. Each method yields similar results. The first interpolates across data gaps to use the standard Fourier periodogram. The second, using the CARMA-based time-domain modeling technique of Kelly et al., does not need evenly-sampled data. Both methods find excess power at high frequencies that may be due to Kepler instrumental effects. More importantly both also show strong bends (delta alpha is approx. 2) at timescales of approx. 5 days, a feature similar to those seen in the X-ray PSDs of AGN but never before in the optical. This observed approx. 5 day timescale may be associated with one of several physical processes potentially responsible for the variability. A plausible association could be made with light -crossing, dynamical or thermal timescales, depending on the assumed value of the accretion disk size and on unobserved disk parameters such as alpha and H¬R. This timescale is not consistent with the viscous timescale, which would be years in a approx. 10(exp7) solar mass AGN such as Zw 229− 15. However there must be a second bend on long (& 1 year) timescales, and that feature could be associated with the viscous timescale.

timescale

A shock surface geometry: The 15-16 February 1967 event

The flare-associated interplanetary shock observed by Explorer 33 and Pioneer 7 is analyzed to yield an estimation of the ecliptic plane geometry of the shock surface near 1 AU. These spacecraft were separated by 23 deg in the heliocentric longitude and Pioneer 7 was at a distance of 1.12 AU from the sun. Although a data gap occurred at the apparent time of passage of the disturbance at Pioneer 6, which was 85 deg in heliocentric longitude from Pioneer 7 and at 0.83 AU, the recovered data did suggest such a passage. A consistent picture of the shock propagation is given to explain the difference in arrival times at Pioneers 6, 7, and Explorer 33 and the difference of the shock normals observed by Pioneer 7 and Explorer 33. The average shock speed from the sun to each spacecraft and the local speed at Explorer 33 and their relations to the position of the initiating solar flare are obtained and discussed. In the region of space between the earth and Pioneer 7 the shock surface radius of curvature in the ecliptic plane was 0.4 AU or less.

Lepping, R. P.

Quality-Controlled Wind Data from the Kennedy Space Center 915 Megahertz Doppler Radar Wind Profiler Network

The National Aeronautics and Space Administration s (NASA) Kennedy Space Center (KSC) has installed a five-instrument 915-Megahertz (MHz) Doppler Radar Wind Profiler (DRWP) system that records atmospheric wind profile properties. The purpose of these profilers is to fill data gaps between the top of the KSC wind tower network and the lowest measurement altitude of the KSC 50-MHz DRWP. The 915-MHz DRWP system has the capability to generate three-dimensional wind data outputs from approximately 150 meters (m) to 6,000 m at roughly 15-minute (min) intervals. NASA s long-term objective is to combine the 915-MHz and 50-MHz DRWP systems to create complete vertical wind profiles up to 18,300 m to be used in trajectory and loads analyses of space vehicles and by forecasters on day-of-launch (DOL). This analysis utilizes automated and manual quality control (QC) processes to remove erroneous and unrealistic wind data returned by the 915-MHz DRWP system. The percentage of data affected by each individual QC check in the period of record (POR) (i.e., January to April 2006) was computed, demonstrating the variability in the amount of data affected by the QC processes. The number of complete wind profiles available at given altitude thresholds for each profiler in the POR was calculated and outputted graphically, followed by an assessment of the number of complete wind profiles available for any profiler in the POR. A case study is also provided to demonstrate the QC process on a day of a known weather event.

Dryden, Rachel L.

Towards an Improved Understanding of the Antarctic Coastal Zone and Its Contribution to Future Global Sea Level

Understanding the coastal zone of the Antarctic Ice Sheet (AIS), where it interacts with the Southern Ocean and warmer air masses, is crucial for predicting Antarctica's influence on the global climate and sea level. This region has multiple tipping mechanisms that could trigger large, rapid, and potentially irreversible changes in the AIS, the Southern Ocean and their global connections in the coming centuries. The AIS remains the largest source of uncertainty in future sea-level projections. Bed topography beneath the ice shelves and the coastal ice sheet is not yet well documented, and is a major source of this uncertainty. This review assesses current knowledge of the coastal zone and highlights methods to investigate it, including aerogeophysical surveys, ground- and ship-based measurements, satellite observations, and computer modeling. An ensemble analysis of published bed topography data sets identifies significant data gaps and their regional distribution, framed in the context of current ice-sheet behavior and potential instability. We propose scientific priorities and guidelines for future aerogeophysical surveys, advocating for a comprehensive, coordinated international effort to build a next-generation data set of Antarctic bed properties. Such an initiative would significantly advance understanding of the role of coastal processes in ice-sheet dynamics, reducing uncertainties in sea-level rise projections and improving predictions of future ocean and climate changes.

Kenichi Matsuoka

Reducing Errors in Velocity–Azimuth Display (VAD) Wind and Deformation Retrievals from Airborne Doppler Radars in Convective Environments

The present study describes methods to reduce the uncertainty of velocity–azimuth display (VAD) wind and deformation retrievals from downward-pointing, conically scanning, airborne Doppler radars. These retrievals have important applications in data assimilation and real-time data processing. Several error sources for VAD retrievals are considered here, including violations to the underlying wind field assumptions, Doppler velocity noise, data gaps, temporal variability, and the spatial weighting function of the VAD retrieval. Specific to airborne VAD retrievals, we also consider errors produced due to the radar scans occurring while the instrument platform is in motion. While VAD retrievals are typically performed using data from a single antenna revolution, other strategies for selecting data can be used to reduce retrieval errors. Four such data selection strategies for airborne VAD retrievals are evaluated here with respect to their effects on the errors. These methods are evaluated using the second hurricane nature run numerical simulation, analytic wind fields, and observed Doppler radar radial velocities. The proposed methods are shown to reduce the median absolute error of the VAD wind retrievals, especially in the vicinity of deep convection embedded in stratiform precipitation. The median absolute error due to wind field assumption violations for the along-track and for the across-track wind is reduced from 0.36 to 0.08 m s−1 and from 0.35 to 0.24 m s−1, respectively. Although the study focuses on Doppler radars, the results are equally applicable to conically scanning Doppler lidars as well.

Charles N Helms

Analysis of the MODIS Above-Cloud Aerosol Retrieval Algorithm Using MCARS

The Multi-sensor Cloud and Aerosol Retrieval Simulator (MCARS) presently produces synthetic radiance data from Goddard Earth Observing System version 5 (GEOS-5) model output as if the Moderate Resolution Imaging Spectroradiometer (MODIS) was viewing a combination of atmospheric column inclusive of clouds, aerosols and a variety of gases and land/ocean surface at a specific location. In this paper we use MCARS to study the MODIS Above-Cloud AEROsol retrieval algorithm (MOD06ACAERO). MOD06ACAERO is presently a regional research algorithm able to retrieve aerosol optical thickness over clouds, in particular absorbing biomass burning aerosols overlying marine boundary layer clouds in the Southeastern Atlantic Ocean. The algorithm’s ability to provide aerosol information in cloudy conditions makes it a valuable source of information for modeling and climate studies n an area where current clear sky-only operational MODIS aerosol retrievals effectively have a data gap between the months of June and October. We use MCARS for a verification and closure study of the MOD06ACAERO algorithm. The purpose of this study is to develop a set of constraints a model developer might use during assimilation of MOD06ACAERO data. Our simulations indicate that the MOD06ACAERO algorithm performs well for marine boundary layer clouds in the SE Atlantic provided some specific screening rules are observed. For the present study, a combination of five simulated MODIS data granules was used for a dataset of 13.5 million samples with known input conditions. When pixel retrieval uncertainty was less than 30%, optical thickness of the underlying cloud layer was greater than 4 and scattering angle range within the cloud bow was excluded, MOD06ACAERO retrievals agreed with the underlying ground truth (GEOS-5 cloud and aerosol profiles used to generate the synthetic radiances) with a slope of 0.913, offset of 0.06, and RMSE=0.107. When only near-nadir pixels were considered (view zenith angle within +/-20 degrees) the agreement with source data further improved (0.977, 0.051 and 0.096 respectively). Algorithm closure was examined using a single case out of the five 38 used for verification. For closure, the MOD06ACAERO code was modified to use GEOS-5 temperature and moisture profiles as ancillary. Agreement of MOD06ACAERO retrievals with source data for the closure study had a slope of 0.996 with offset -0.007 and RMSE of 0.097 at pixel uncertainty level of less than 40%, illustrating the benefits of high-quality ancillary atmospheric data for such retrievals.

MODIS

Applying Satellite Data to Support Disaster Response and Emergency Management Decision Making

Using the vantage point of space, satellite observations provide information about the Earth that can serve a critical role in building situational awareness and filling in data gaps during disaster response. NASA’s Earth Science Division ( studies the Earth as a system and develops technologies to improve the quality of life here on our home planet. Within NASA ESD, the Disasters Program and its Disasters Response Coordination System (DRCS) aims to advance Earth science data and information to support management decisions that prevent or mitigate the impacts of disasters. Using a whole-of-NASA approach to coordinate and mobilize the Agency’s assets and expertise to provide geospatial information during disasters, this work brings the utility of Earth observation information to emergency management and disaster response and reduces the impacts of disasters on lives and livelihoods .This poster will introduce the utility of satellite and geospatial information to disaster response through examples of recent DRCS incident response activations and highlight the DRCS model that employs a user-centered activation framework beginning with direct requests from responders and ending with after-action assessments that feed lessons learned and process improvements.

Remote Sensing

An EOF Iteration Approach for Obtaining Homogeneous Radiative Fluxes from Satellites Observations

Conventional observations of climate parameters are sparse in space and/or in time and the representativeness of such information needs to be optimized. Observations from satellites provide improved spatial coverage than point observations however they pose new challenges for obtaining homogeneous coverage. Surface radiative fluxes, the forcing functions of the hydrologic cycle and biogeophysical processes, are now becoming available from global scale satellite observations. They are derived from independent satellite platforms and sensors that differ in temporal and spatial resolution and in the size of the footprint from which information is derived. Data gaps, degraded spatial resolution near boundaries of geostationary satellites, and different viewing geometries in areas of satellite overlap, could result in biased estimates of radiative fluxes. In this study, discussed will be issues related to the sources of inhomogeneity in surface radiative fluxes as derived from satellites; development of an approach to obtain homogeneous data sets; and application of the methodology to the widely used International Satellite Cloud Climatology Project (ISCCP) data that currently serve as a source of information for deriving estimates of surface and top of the atmosphere radiative fluxes. Introduced is an Empirical Orthogonal Function (EOF) iteration scheme for homogenizing the fluxes. The scheme is evaluated in several ways including comparison of the inferred radiative fluxes against ground observations, both before and after the EOF approach is applied. On the average, the latter reduces the rms error by about 2-3 W/m2.

Zhang, Banglin

Proactive Wildfire Management: A Remote Sensing and Multimodal CNN-MLP Architecture for Ignition Risk Forecasting

As the frequency and intensity of wildfires increase, with fire seasons now starting earlier and ending later than they have over the past decades, current monitoring systems, such as lookout towers and satellites, are hindered by cloud cover, low-resolution imagery, and static data gaps that fail to track vegetation moisture levels fast enough to catch rapid pre-ignition changes. This report proposes a Machine Learning-enabled Wildfire Ignition Prediction framework that combines satellite monitoring with dynamic and high-resolution remote sensing from Unmanned Aerial Vehicle (UAV) swarms. The method would use multispectral and thermal data from the Landsat program to create a baseline for vegetation health, calculating a two-band Enhanced Vegetation Index (EVI2) and the moisture content of the vegetation. These inputs will later be fused with microscale UAV weather data, including thermal hotspots found through thick canopies, hyperspectral chemical signatures of pre-visual combustion, and local weather streams. The multispectral satellite, multispectral Light Detection and Ranging (LiDAR), and thermal data would then be processed through a Convolutional Neural Network (CNN), alongside a Multilayer Perceptron (MLP) for the micro-weather telemetry. The outputs of these networks would be fused into a single feature representation and passed through a final prediction network to generate real-time ignition risk scores and hotspot alerts. Model performance would be assessed using standard classification metrics, including a Receiver Operating Characteristic - Area Under the Curve (ROC AUC) and F1 score. This system would allow first responders to identify high-risk zones and intervene before ignition occurs, improving emergency response time compared to current approaches.

machine learning