Search NASA⌕ Search

SEARCH · Search NASA

Results for “reprocessed data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Algorithm Updates for the Fourth SeaWiFS Data Reprocessing

The efforts to improve the data quality for the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) data products have continued, following the third reprocessing of the global data set in May 2000. Analyses have been ongoing to address all aspects of the processing algorithms, particularly the calibration methodologies, atmospheric correction, and data flagging and masking. All proposed changes were subjected to rigorous testing, evaluation and validation. The results of these activities culminated in the fourth reprocessing, which was completed in July 2002. The algorithm changes, which were implemented for this reprocessing, are described in the chapters of this volume. Chapter 1 presents an overview of the activities leading up to the fourth reprocessing, and summarizes the effects of the changes. Chapter 2 describes the modifications to the on-orbit calibration, specifically the focal plane temperature correction and the temporal dependence. Chapter 3 describes the changes to the vicarious calibration, including the stray light correction to the Marine Optical Buoy (MOBY) data and improved data screening procedures. Chapter 4 describes improvements to the near-infrared (NIR) band correction algorithm. Chapter 5 describes changes to the atmospheric correction and the oceanic property retrieval algorithms, including out-of-band corrections, NIR noise reduction, and handling of unusual conditions. Chapter 6 describes various changes to the flags and masks, to increase the number of valid retrievals, improve the detection of the flag conditions, and add new flags. Chapter 7 describes modifications to the level-la and level-3 algorithms, to improve the navigation accuracy, correct certain types of spacecraft time anomalies, and correct a binning logic error. Chapter 8 describes the algorithm used to generate the SeaWiFS photosynthetically available radiation (PAR) product. Chapter 9 describes a coupled ocean-atmosphere model, which is used in one of the changes described in Chapter 4. Finally, Chapter 10 describes a comparison of results from the third and fourth reprocessings along the US. Northeast coast.

Hooker, Stanford, B.↗

The NASA Ocean Data System at the Jet Propulsion Laboratory

Global change studies require satellite oceanographic observations archived in an active data center. This paper describes the activities of an experimental active oceanographic data archive center specializing in distribution of high-level oceanographic data products produced by research oceanographers from satellite altimeter, scatterometer, and microwave and infrared radiometer measurements. Methods to encourage data sharing practices were developed. Services initiated to help oceanographers conduct research more effectively included rapid delivery of data, reprocessing data sets, subsetting of large data sets, and distribution of multiple data sets on a single medium.

Halpern, David↗

TESS Data Release Notes:Reprocessing of Sectors 14–19, DR30 & DR33

TESS data release 30 (DR30) provides reprocessed data products of Sector 14 to 19. The updated data products were generated using version 4.0 of the science processing pipeline and conform to the final set of data anomaly flags defined over the last two years of TESS data analysis and pipeline development. Data release 33 (DR33) corresponds to a multisector search for transiting planets in the same reprocessed data. A detailed description of the changes in the data products in DR30 and DR33 is discussed in§2, and a brief list of changes is summarized here: The timestamps for 2 minute cadence and FFI data are more accurate. The differences between reprocessed data and previous data releases are less than 2.0 seconds in all cases. Photometric apertures were increased in size for targets with T mag<11. Three new Data Anomaly Flags were added to mitigate the effects of scattered light:–Cadences with strong scattered light signals or saturation effects that corrupt the calibration data are flagged and removed from analysis (bit 15, value 16384, “Bad Calibration Exclude”).–Scattered light data anomaly flags are customized for each target, and flagged automatically based on the local background level (bit 13, value 4096, ”Scattered light flag”).–Cadences with insufficient targets to derive cotrending basis vectors are flagged and the PDCSAP FLUX light curves are set to NULL at these times (bit 16, value 32768, “Insufficient Targets for Error Correction Exclude”). The planet search of the reprocessed light curves produced a different set of TCEs from the original processed data. Although there is a high degree of overlap between the original and reprocessed data (∼83% of targets produced TCEs in common), new TCEs were produced in DR30 and not every TCE from previous data releases was recovered. The same is true of the multisector search results from DR33 compared to DR28

TESS'↗

TRMM Version 8 Reprocessing Improvements and Incorporation into the GPM Data Suite

The National Aeronautics and Space Administration (NASA) has always included data reprocessing as a major component of every science mission. A final reprocessing is typically a part of mission closeout (known as phase F).The Tropical Rainfall Measuring Mission (TRMM) is currently in phase F, and NASA is preparing for the last reprocessing of all the TRMM precipitation data as part of the closeout. This reprocessing includes improvements in calibration of both the TRMM Microwave Imager (TMI) and the TRMM Precipitation Radar (PR). An initial step in the version 8 reprocessing is the improvement of geolocation. The PR calibration is being updated by the Japan Aerospace Exploration Agency (JAXA) using data collected as part of the calibration of the Dual-Frequency Precipitation Radar (DPR) on the Global Precipitation Measurement (GPM) Core Observatory. JAXA undertook a major effort to ensure TRMM PR and GPM Ku-band calibration is consistent. A major component of the TRMM version 8 reprocessing is to create consistent retrievals with the GPM version 05 (V05) retrievals. To this end, the TRMM version 8 reprocessing uses retrieval algorithms based on the GPM V05 algorithms. This approach ensures consistent retrievals from December 1997 (the beginning of TRMM) through the current ongoing GPM retrievals. An outcome of this reprocessing is the incorporation of TRMM data products into the GPM data suite. Incorporation also means that GPM file naming conventions and reprocessed TRMM data carry the V05 data product version. This paper describes the TRMM version 8 reprocessing, focusing on the improvements in TMI level 1 products.

Stocker, E. F.↗

Reprocessing Microflare Data

The report concerns work on detecting and cataloging solar microflares using an automated. An accompanying figure represents the solar microflare distribution during the period of April 1991 to November 1992, the height of solar activity after the launch of CGRO. It also shows the distribution extending below the distribution obtained at GSFC by manual means. We have implemented significant refinements in the search algorithm. The algorithm in its simplest form searches for transient events and based upon the distribution of the signal among the different BATSE detectors, we can assign it to be of solar origin if the signal distribution conforms to what one expects from a burst or transient from that direction. One of the major problems in an earlier effort was to search for microflares and large flares simultaneously. The requirement for a dynamic range of almost 10(exp 4) resulted in ambiguous identifications at the low side of the distribution. We have since restricted the search to events with peak count rates under 2000/s. Larger events are easily identified in the manual search, so we have chosen not to duplicate that work. The second problem was that missing counts existed below channel 0 in the BATSE Large Area Detector (LAD) data. These have been recovered and are now included in the search process. This provides data below 20 keV, and as we get closer to the thermal part of the spectrum, it provides greater sensitivity. The third problem was that too many BATSE detectors were used in the search. Detectors with pointing directions far from the Sun, although detecting the event, had poorly known responses. Detectors greater than approximately 60 degrees off the Sun are no longer included in the search process. By reducing the systematic errors with the large off-axis detectors we can conduct more rigorous statistical tests of a candidate event to ascertain whether it originated from the solar direction. We have reprocessed the period in the early mission that covers solar maximum and constructed the microflare distribution shown in the figure. The results of the automated search start to deviate from the manual search results below about 1000/s. Not only do we now have this distribution but we have a database of solar microflares that was used to construct the distribution. This database contains the signal at higher energy channels as well as that in channel zero (and below). From this one can, using software at GSFC, construct a photon spectrum for some of the larger microflares. It can also be used in other solar studies, especially those that correlate the X-ray flux with emission at other wavelengths. With some additional effort we hope to integrate this database into the corresponding one residing at the Solar Data Analysis Center at GSFC. The entire CGRO mission's data can now be reprocessed to obtain the microflare distribution at all phases of the solar cycle. This work is in progress. The results of this work will be presented in forthcoming scientific workshops and conferences.

Ryan, James M.↗

TM Geometric Performance: Line to Line Displacement Analysis (LLDA)

An early acquired TM data frame (track 23, frame 35 of 22 August 1982) was used to assess the geometric performance of the LANDSAT-4 thematic mapper instrument. The developed method consists in determining the displacements of adjacent lines by locating the maximum of the correlation profile between the two lines. Then the line to line displacement is used to characterize the TM instrument in respect to: scan to scan jitter and image skew, scan profile non-linearity, along scan jitter, detector to detector displacement, and band to band displacement. To verify the quality of the reported performance parameters, some extracted geometric parameters were used to correct the original raw data. Comparison between P-tape data and results of reprocessed data shows no significant differences in an area of 1024 x 1024 pixels.

Fusco, L.↗

TRMM Data Improvement as Part of the GPM Data Processing

NASA has a long standing commitment to the improvement of its mission datasets. Indeed, data reprocessing is always built into the plans, schedule and budget for the mission data processing system. However, in addition to these ongoing mission reprocessing, NASA also supports a final reprocessing of all the data for a mission upon its completion (known as Phase F). TRMM Phase F started with the end of the TRMM mission in June of 2015. This last reprocessing has two overall goals: improvement of the TRMM mission data products; incorporation of the 17+ years of TRMM data into the ongoing NASA/JAXA GPM data processing. The first goal guarantees that the latest algorithms used for precipitation retrievals will also be used in reprocessing the TRMM data. The second goal ensures that as GPM algorithms are improved, the entire TRMM data will always be reprocessed with each GPM reprocessing. In essence TRMM becomes another of the GPM constellation satellites. This paper will concentrate on presenting the improvements to TMI level 1 data including calibration, geolocation, and emissive antenna corrections. It will describe the format changes that will occur how the TMI level 1C product will be intercalibrated using GMI as the reference calibration. It will also provide an overview of changes in the precipitation radar products as well as the combined TMIPR product.

GPM↗

TESS Data Release Notes: Sector 59, DR84

TESS Sector 59 observations include physical orbits 125 and 126 of the spacecraft around the Earth. Data collection was paused for a total of 0.63 days to download data. Data were downloaded approximately every seven days, once near apogee of each orbit and once near perigee. Note that the Sector 59 data were briefly made available on 2023 January 18–19 before an issue was identified that required reprocessing. Data have since been reprocessed. The reprocessing has a minimal impact on the final light curves, but resulted in a different set of TCEs than initially released. Users should re-download the data if retrieved before January 19th. In total, there are 25.79 days of science data collected in Sector 59.

TESS↗

Calibration Refinements in Support of MISR

The Multi-angle Imaging SpectroRadiometer (MISR) is one of five instruments on-board the EOSI Terra spacecraft, and has collected science data since March 2000. A multi-angle capability is provided by ninecameras, which view up to 70' forward and aft of the spacecraft track and enable unique geophysical retrievals. Throughout its mission, a calibration team has made periodic refinements to the process used to calibrate MISR. These have resulted in improved absolute, and band and camera-relative calibrations, as well as in derived geophysical data products. Data reprocessing is on-going, such that these refinements also improve previous data acquisitions. The calibration process is believed to be mature at this time, with no other changes anticipated. Bimonthly deployments of the on-board-calibrator continue to monitor instrument response degradations, and provide correction coefficients needed to maintain the accuracy of the radiance products.

refinements↗

The EOS data and information system

The Earth Observing System (EOS) is proposed as a 1991 new initiative by NASA as part of the Mission to Planet Earth. One of the key components of the EOS program is the EOS Data and Information System (EOSDIS). Two independent Phase B studies of EOSDIS were conducted from January 1989 through April 1990. Some of the key challenges faced by EOSDIS are: satisfying the data and information needs of a diverse multidisciplinary scientific community integrating product generation algorithms for over two dozen instruments, keeping up with an orbital average data rate of over 50 Mb/sec and assuring prompt generation of standard products, reprocessing data as product generation algorithms change, and storing, and managing information about tens of Petabytes of data over the 15-year life of the mission.

Ramapriyan, H. K.↗

The Third EGRET Catalog of High-Energy Gamma-Ray Sources

The third catalog of high-energy gamma-ray sources detected by the EGRET telescope on the Compton Gamma Ray Observatory includes data from 1991 April 22 to 1995 October 3 (Cycles 1, 2, 3, and 4 of the mission). In addition to including more data than the second EGRET catalog and its supplement, this catalog uses completely reprocessed data (to correct a number of mostly minimal errors and problems). The 271 sources (E greater than 100 MeV) in the catalog include the single 1991 solar flare bright enough to be detected as a source, the Large Magellanic Cloud, five pulsars, one probable radio galaxy detection (Cen A), and 66 high-confidence identifications of blazars (BL Lac objects, flat-spectrum radio quasars, or unidentified flat-spectrum radio sources). In addition, 27 lower-confidence potential blazar identifications are noted. Finally, the catalog contains 170 sources not yet identified firmly with known objects, although potential identifications have been suggested for a number of those. A figure is presented that gives approximate upper limits for gamma-ray sources at any point in the sky, as well as information about sources listed in the second catalog and its supplement which do not appear in this catalog.

Hartman, R. C.↗

The Tropical Rainfall Measuring Mission (TRMM)

Recognizing the importance of rain in the tropics and the accompanying latent heat release, NASA for the U.S. and NASDA for Japan have partnered in the design, construction and flight of an Earth Probe satellite to measure tropical rainfall and calculate the associated heating. Primary mission goals are 1) the understanding of crucial links in climate variability by the hydrological cycle, 2) improvement in the large-scale models of weather and climate 3) improvement in understanding cloud ensembles and their impacts on larger scale circulations. The linkage with the tropical oceans and landmasses are also emphasized. The Tropical Rainfall Measuring Mission (TRMM) satellite was launched in November 1997 with fuel enough to obtain a four to five year data set of rainfall over the global tropics from 37 N to 37 S. This paper reports progress from launch date through the spring of 1999. The data system and its products and their access is described, as are the algorithms used to obtain the data. Some exciting early results from TRMM are described. Some important algorithm improvements are shown. These will be used in the first total data reprocessing, scheduled to be complete in early 2000. The reader is given information on how to access and use the data.

Simpson, Joanne↗

The Tropical Rainfall Measuring Mission (TRMM) Progress Report

Recognizing the importance of rain in the tropics and the accompanying latent heat release, NASA for the U.S. and NASDA for Japan have partnered in the design, construction and flight of an Earth Probe satellite to measure tropical rainfall and calculate the associated heating. Primary mission goals are 1) the understanding of crucial links in climate variability by the hydrological cycle, 2) improvement in the large-scale models of weather and climate 3) Improvement in understanding cloud ensembles and their impacts on larger scale circulations. The linkage with the tropical oceans and landmasses are also emphasized. The Tropical Rainfall Measuring Mission (TRMM) satellite was launched in November 1997 with fuel enough to obtain a four to five year data set of rainfall over the global tropics from 37'N to 37'S. This paper reports progress from launch date through the spring of 1999. The data system and its products and their access is described, as are the algorithms used to obtain the data. Some exciting early results from TRMM are described. Some important algorithm improvements are shown. These will be used in the first total data reprocessing, scheduled to be complete in early 2000. The reader is given information on how to access and use the data.

Simpson, Joanne↗

The Tropical Rainfall Measuring Mission (TRMM)

Recognizing the importance of rain in the tropics and the accompanying latent heat release, NASA for the U.S. and NASDA for Japan have partnered in the design, construction and flight of an Earth Probe satellite to measure tropical rainfall and calculate the associated heating. Primary mission goals are: 1) the understanding of crucial links in climate variability by the hydrological cycle, 2) improvement in the large-scale models of weather and climate, and 3) improvement in understanding cloud ensembles and their impacts on larger scale circulations. The linkage with the tropical oceans and landmasses are also emphasized. The Tropical Rainfall Measuring Mission (TRMM) satellite was launched in November 1997 with fuel enough to obtain a four to five year data set of rainfall over the global tropics from 37 deg N to 37 deg S. This paper reports progress from launch date through the spring of 1999. The data system and its products and their access is described, as are the algorithms used to obtain the data. Some exciting early results from TRMM are described. Some important algorithm improvements are shown. These will be used in the first total data reprocessing, scheduled to be complete in early 2000. The reader is given information on how to access and use the data.

Simpson, Joanne↗

The Third EGRET Catalog of High-Energy Gamma-Ray Sources

The third catalog of high-energy gamma-ray sources detected by the EGRET telescope on the Compton Gamma Ray Observatory includes data from 1991 April 22 to 1995 October 3 (Cycles 1, 2, 3, and 4 of the mission). In addition to including more data than the second EGRET catalog (Thompson et al. 1995) and its supplement (Thompson et al. 1996), this catalog uses completely reprocessed data (to correct a number of mostly minimal errors and problems). The 271 sources (E greater than 100 MeV) in the catalog include the single 1991 solar flare bright enough to be detected as a source, the Large Magellanic Cloud, five pulsars, one probable radio galaxy detection (Cen A), and 66 high-confidence identifications of blazars (BL Lac objects, flat-spectrum radio quasars, or unidentified flat-spectrum radio sources). In addition, 27 lower-confidence potential blazar identifications are noted. Finally, the catalog contains 170 sources not yet identified firmly with known objects, although potential identifications have been suggested for a number of those. A figure is presented that gives approximate upper limits for gamma-ray sources at any point in the sky, as well as information about sources listed in the second catalog and its supplement which do not appear in this catalog.

Hartman, R. C.↗

MODIS Science Algorithms and Data Systems Lessons Learned

For almost 10 years, standard global products from NASA's Earth Observing System s (EOS) two Moderate Resolution Imaging Spectroradiometer (MODIS) sensors are being used world-wide for earth science research and applications. This paper discusses the lessons learned in developing the science algorithms and the data systems needed to produce these high quality data products for the earth sciences community. Strong science team leadership and communication, an evolvable and scalable data system, and central coordination of QA and validation activities enabled the data system to grow by two orders of magnitude from the initial at-launch system to the current system able to reprocess data from both the Terra and Aqua missions in less than a year. Many of the lessons learned from MODIS are already being applied to follow-on missions.

Wolfe, Robert E.↗

The Suomi National Polar-Orbiting Partnership (SNPP): Continuing NASA Research and Applications

The Suomi National Polar-orbiting Partnership (SNPP) satellite was successfully launched into a polar orbit on October 28, 2011 carrying 5 remote sensing instruments designed to provide data to improve weather forecasts and to increase understanding of long-term climate change. SNPP provides operational continuity of satellite-based observations for NOAA's Polar-orbiting Operational Environmental Satellites (POES) and continues the long-term record of climate quality observations established by NASA's Earth Observing System (EOS) satellites. In the 2003 to 2011 pre-launch timeframe, NASA's SNPP Science Team assessed the adequacy of the operational Raw Data Records (RDRs), Sensor Data Records (SDRs), and Environmental Data Records (EDRs) from the SNPP instruments for use in NASA Earth Science research, examined the operational algorithms used to produce those data records, and proposed a path forward for the production of climate quality products from SNPP. In order to perform these tasks, a distributed data system, the NASA Science Data Segment (SDS), ingested RDRs, SDRs, and EDRs from the NOAA Archive and Distribution and Interface Data Processing Segments, ADS and IDPS, respectively. The SDS also obtained operational algorithms for evaluation purposes from the NOAA Government Resource for Algorithm Verification, Independent Testing and Evaluation (GRAVITE). Within the NASA SDS, five Product Evaluation and Test Elements (PEATEs) received, ingested, and stored data and performed NASA's data processing, evaluation, and analysis activities. The distributed nature of this data distribution system was established by physically housing each PEATE within one of five Climate Analysis Research Systems (CARS) located at either at a NASA or a university institution. The CARS were organized around 5 key EDRs directly in support of the following NASA Earth Science focus areas: atmospheric sounding, ocean, land, ozone, and atmospheric composition products. The PEATES provided the system level interface with members of the NASA SNPP Science Team and other science investigators within each CARS. A sixth Earth Radiation Budget CARS was established at NASA Langley Research Center (NASA LaRC) to support instrument performance, data evaluation, and analysis for the SNPP Clouds and the Earth's Radiant Budget Energy System (CERES) instrument. Following the 2011 launch of SNPP, spacecraft commissioning, and instrument activation, the NASA SNPP Science Team evaluated the operational RDRs, SDRs, and EDRs produced by the NOAA ADS and IDPS. A key part in that evaluation was the NASA Science Team's independent processing of operational RDRs and SDRs to EDRs using the latest NASA science algorithms. The NASA science evaluation was completed in the December 2012 to April 2014 timeframe with the release of a series of NASA Science Team Discipline Reports. In summary, these reports indicated that the RDRs produced by the SNPP instruments were of sufficiently high quality to be used to create data products suitable for NASA Earth System science and applications. However, the quality of the SDRs and EDRs were found to vary greatly when considering suitability for NASA science. The need for improvements in operational algorithms, adoption of different algorithmic approaches, greater monitoring of on-orbit instrument calibration, greater attention to data product validation, and data reprocessing were prominent findings in the reports. In response to these findings, NASA, in late 2013, directed the NASA SNPP Science Team to use SNPP instrument data to develop data products of sufficiently high quality to enable the continuation of EOS time series data records and to develop innovative, practical applications of SNPP data. This direction necessitated a transition of the SDS data system from its pre-launch assessment mode to one of full data processing and production. To do this, the PEATES, which served as NASA's data product testing environment during the prelaunch and early on-orbit periods, were transitioned to Science Investigator-led Processing Systems (SIPS). The distributed data architecture was maintained in this new system by locating the SIPS at the same institutions at which the CARS and PEATES were located. The SIPS acquire raw SNPP instrument Level 0 (i.e. RDR) data over the full SNPP mission from the NOAA ADS and IDPS through the NASA SDS Data Distribution and Depository Element (SD3E). The SIPS process those data into NASA Level 1, Level 2, and global, gridded Level 3 standard products using peer-reviewed algorithms provided by members of the NASA Science Team. The SIPS work with the NASA SNPP Science Team in obtaining enhanced, refined, or alternate real-time algorithms to support the capabilities of the Direct Readout Laboratory (DRL). All data products, algorithm source codes, coefficients, and auxiliary data used in product generation are archived in an assigned NASA Distributed Active Archive Center (DAAC).

remote sensing↗

65 Years of Reprocessed GLDAS Version 2.0 Data and Their Exploration Using the NASA GES DISC Giovanni

GLDAS-2.0 data have been reprocessed with updated Princeton meteorological forcing data within the Land Information System (LIS) Version 7, and temporal coverage have been extended to 1948-2012.Global Land Data Assimilation System Version 2 (GLDAS-2) has two components: GLDAS-2.0: entirely forced with the Princeton meteorological forcing data GLDAS-2.1: forced with atmospheric analysis and observation-based data after 2001In order to create more climatologically consistent data sets, NASA GSFC's Hydrological Sciences Laboratory (HSL) has recently reprocessed the GLDAS-2.0, by using updated Princeton meteorological forcing data within the LIS Version 7.GLDAS-2.0 data and data services are provided at NASA GES DISC Hydrology Data and Information Services Center (HDISC), in collaboration with HSL.

data assimilation↗