GRACE/GRACE-FO science data archiving, distribution and user support at PO.DAAC
No abstract provided
Finch, Christopher↗
SEARCH · Search NASA
Results for “Science Archive”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
KDD Services at the Goddard Earth Sciences Distributed Active Archive Center
NASA's Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) processes, stores and distributes earth science data from a variety of remote sensing satellites. End users of the data range from instrument scientists to global change and climate researchers to federal agencies and foreign governments. Many of these users apply data mining techniques to large volumes of data (up to 1 TB) received from the GES DAAC. However, rapid advances in processing power are enabling increases in data processing that are outpacing tape drive performance and network capacity. As a result, the proportion of data that can be distributed to users continues to decrease. As mitigation, we are migrating more data mining and mining preparation activities into the data center in order to reduce the data volume that needs to be distributed and to offer the users a more useful and manageable product. This migration of activities faces a number of technical and human-factor challenges. As data reduction and mining algorithms are normally quite specific to the user's research needs, the user's algorithm must be integrated virtually unchanged into the archive environment. Also, the archive itself is busy with everyday data archive and distribution activities and cannot be dedicated to, or even impacted by, the mining activities. Therefore, we schedule KDD 'campaigns' (similar to reprocessing campaigns), during which we schedule a wholesale retrieval of specific data products, offering users the opportunity to extract information from the data being retrieved during the campaign.
Lynnes, Christopher↗
The Nuclear Spectroscopic Telescope Array (NuSTAR)
The Nuclear Spectroscopic Telescope Array (NuSTAR) is a NASA Small Explorer mission that will carry the first focusing hard X-ray (5 - 80 keV) telescope to orbit. NuSTAR will offer a factor 50 - 100 sensitivity improvement compared to previous collimated or coded mask imagers that have operated in this energy band. In addition, NuSTAR provides sub-arcminute imaging with good spectral resolution over a 12-arcminute field of view. After launch, NuSTAR will carry out a two-year primary science mission that focuses on four key programs: studying the evolution of massive black holes through surveys carried out in fields with excellent multiwavelength coverage, understanding the population of compact objects and the nature of the massive black hole in the center of the Milky Way, constraining explosion dynamics and nucleosynthesis in supernovae, and probing the nature of particle acceleration in relativistic jets in active galactic nuclei. A number of additional observations will be included in the primary mission, and a. guest observer program will be proposed for an extended mission to expand the range of scientific targets. The payload consists of two co-aligned depth-graded multilayer coated grazing incidence optics focused onto solid state CdZnTe pixel detectors. To be launched in early 2012 on a Pegasus rocket into a low-inclination Earth orbit. NuSTAR largely avoids SAA passages, and will therefore have low and stable detector backgrounds. The telescope achieves a 10.15-meter focal length through on-orbit deployment of all mast. An aspect and alignment metrology system enable reconstruction of the absolute aspect and variations in the telescope alignment resulting from mast flexure during ground data processing. Data will be publicly available at GSFC's High Energy Astrophysics Science Archive Research Center (HEASARC) following validation at the science operations center located at Caltech.
Harrison, Fiona A.↗
Compositional Analysis of Titan’s Atmosphere Using Spitzer Infrared Spectrograph Data
We present, for the first time, infrared spectra from the Spitzer Space Telescope’s Infrared Spectrograph (IRS) (2004-2008) of Titan in both the short wavelength-low resolution(SL, R=60~127,5.13-14.29 μm) and short wavelength-high resolution channels (SH, R=600, 9.89-19.51 μm) showing the emissions of CH4, C2H4, C2H2, C2H6, HCN, CO2, HC3N, C3H4, C4H2, and C3H8. Spitzer IRS data has been used to measure atmospheric composition of various Solar System bodies, including Neptune [1] and Uranus [2],[3]. Although Spitzer took multiple dedicated observations of Titan, none of the results have been modeled before. We conduct our own investigation of these datasets and search for new results. We retrieve temperature and gas composition profiles and compare the results obtained for Titan to those of the Cassini Composite Infrared Spectrometer (CIRS) and the Infrared Space Observatory Short Wavelength Spectrometer [4], and comment on the effect of spectral resolution on retrieved information content. We conclude by recommending gaps in current spectroscopic knowledge of molecular bands that could be addressed by theoretical and laboratory study to aid future astronomical studies of Titan, for example the James Webb Space Telescope (JWST) and the Stratospheric Observatory for Infrared Astronomy (SOFIA) Acknowledgments: Data analyzed in this project is public available online on the Spitzer Heritage Archive (sha.ipac.caltech.edu). This research has made use of the NASA/IPAC Infrared Science Archive, which is funded by the National Aeronautics and Space Administration and operated by the California Institute of Technology.
Titan↗
Cassini Archive Tracking System
The Cassini Archive Tracking System (CATS) is a computer program that enables tracking of scientific data transfers from originators to the Planetary Data System (PDS) archives. Without CATS, there is no systematic means of locating products in the archive process or ensuring their completeness. By keeping a database of transfer communications and status, CATS enables the Cassini Project and the PDS to efficiently and accurately report on archive status. More importantly, problem areas are easily identified through customized reports that can be generated on the fly from any Web-enabled computer. A Web-browser interface and clearly defined authorization scheme provide safe distributed access to the system, where users can perform functions such as create customized reports, record a transfer, and respond to a transfer. CATS ensures that Cassini provides complete science archives to the PDS on schedule and that those archives are available to the science community by the PDS. The three-tier architecture is loosely coupled and designed for simple adaptation to multimission use. Written in the Java programming language, it is portable and can be run on any Java-enabled Web server.
Conner, Diane↗
A Complete Public Archive for the Einstein Imaging Proportional Counter
Consistent with our proposal to the Astrophysics Data Program in 1992, we have completed the design, construction, documentation, and distribution of a flexible and complete archive of the data collected by the Einstein Imaging Proportional Counter. Along with software and data delivered to the High Energy Astrophysics Science Archive Research Center at Goddard Space Flight Center, we have compiled and, where appropriate, published catalogs of point sources, soft sources, hard sources, extended sources, and transient flares detected in the database along with extensive analyses of the instrument's backgrounds and other anomalies. We include in this document a brief summary of the archive's functionality, a description of the scientific catalogs and other results, a bibliography of publications supported in whole or in part under this contract, and a list of personnel whose pre- and post-doctoral education consisted in part in participation in this project.
Helfand, David J.↗
The Hopkins Ultraviolet Telescope: The Final Archive
The Hopkins Ultraviolet Telescope (HUT) was a 0.9 m telescope and moderate-resolution (Delta)lambda equals 3 A) far-ultraviolet (820-1850 Å) spectrograph that flew twice on the space shuttle, in 1990 December (Astro-1, STS-35) and 1995 March (Astro-2, STS-67). The resulting spectra were originally archived in a nonstandard format that lacked important descriptive metadata. To increase their utility, we have modified the original datareduction software to produce a new and more user-friendly data product, a time-tagged photon list similar in format to the Intermediate Data Files (IDFs) produced by the Far Ultraviolet Spectroscopic Explorer calibration pipeline. We have transferred all relevant pointing and instrument-status information from locally-archived science and engineering databases into new FITS header keywords for each data set. Using this new pipeline, we have reprocessed the entire HUT archive from both missions, producing a new set of calibrated spectral products in a modern FITS format that is fully compliant with Virtual Observatory requirements. For each exposure, we have generated quicklook plots of the fully-calibrated spectrum and associated pointing history information. Finally, we have retrieved from our archives HUT TV guider images, which provide information on aperture positioning relative to guide stars, and converted them into FITS-format image files. All of these new data products are available in the new HUT section of the Mikulski Archive for Space Telescopes (MAST), along with historical and reference documents from both missions. In this article, we document the improved data-processing steps applied to the data and show examples of the new data products.
Hopkins↗
A Quantitative Analysis on the Use of Supervised Machine Learning in Earth Science
Recent review papers (Ball et al., 2017; Reichstein et al., 2019) have investigated the opportunities and challenges in applying supervised machine learning (ML) techniques to Earth science problems. A common challenge is the lack of training (or labeled) data. Supervised ML, and especially deep learning (DL), require large training datasets. While there are large, open access Earth science archives, the data typically require preprocessing in preparation for supervised ML, frequently including manual labeling. Our objective is to understand the landscape of supervised ML in the Earth sciences, including which research communities have most rapidly adopted supervised ML, which algorithms are applied, and what data are used to train these algorithms. We conducted a literature survey of Earth science papers published during the last 10 years in journals from the American Geophysical Union (AGU), American Meteorological Society (AMS), the Institute of Electrical and Electronics Engineers(IEEE), and the Society of Photo-Optical Instrumentation Engineers (SPIE). We identified papers containing the terms ML, DL, or the names of individual supervised ML algorithms. "Earth science" is an additional required search term for IEEE and SPIE. We investigate trends in supervised ML usage during the 10-year study period, and manually analyzed AGU papers from 2018-2019 to enable deep-dive statistics.
Katrina S Virts↗
EMISSA (Exploring Millimeter Indicators of Solar-Stellar Activity): I. The initial millimeter–centimeter main-sequence star sample
Due to their wide wavelength coverage across the millimeter to centimeter (mm–cm) range and their increased sensitivity, modern interferometric arrays facilitate observations of the thermal and non-thermal radiation that is emitted from different layers in the outer atmospheres of stars. We study the spectral energy distribution (S obs (ν)) of main-sequence stars based on archival observations in the mm–cm range with the aim to study their atmospheric stratification as a function of stellar type. The main-sequence stars with significant detection in mm bands were identified in the ALMA Science Archive. These data were then complemented with spectral flux data in the extreme ultraviolet to cm range as compiled from various catalogues and observatory archives. We compared the resultant S obs (ν) of each star with a photospheric emission model (S mod (ν)) calculated with the PHOENIX code. The departures of S obs (ν) from S mod (ν) were quantified in terms of a spectral flux excess parameter (ΔS/S mod ) and studied as a function of stellar type. The initial sample consists of 12 main-sequence stars across a broad range of spectral types from A1 to M3.5 and the Sun-as-a-star as reference. The stars with T eff = 3000–7000 K (F–M type) showed a systematically higher S obs (ν) than S mod (ν) in the mm–cm range. Their ΔS/S mod exhibits a monotonic rise with decreasing frequency. The steepness of this rise is higher for cooler stars in the T eff = 3000–7000 K range, although the single fully convective star (T eff ~ 3000 K) in the sample deviates from this trend. Meanwhile, Sobs(ν) of the A-type stars agrees with S mod (ν) within errors. The systematically high ΔS/S mod in F–M stars indicates hotter upper atmospheric layers, that is, a chromosphere and corona in these stars, like for the Sun. The mm–cm ΔS/S mod spectrum offers a way to estimate the efficiency of the heating mechanisms across various outer atmospheric layers in main-sequence stars, and thereby to understand their structure and activity. We emphasise the need for dedicated surveys of main-sequence stars in the mm–cm range.
79 ASTRONOMY AND ASTROPHYSICS↗
Goddard's Astrophysics Science Divsion Annual Report 2014
The Astrophysics Science Division (ASD, Code 660) is one of the world's largest and most diverse astronomical organizations. Space flight missions are conceived, built and launched to observe the entire range of the electromagnetic spectrum, from gamma rays to centimeter waves. In addition, experiments are flown to gather data on high-energy cosmic rays, and plans are being made to detect gravitational radiation from space-borne missions. To enable these missions, we have vigorous programs of instrument and detector development. Division scientists also carry out preparatory theoretical work and subsequent data analysis and modeling. In addition to space flight missions, we have a vibrant suborbital program with numerous sounding rocket and balloon payloads in development or operation. The ASD is organized into five labs: the Astroparticle Physics Lab, the X-ray Astrophysics Lab, the Gravitational Astrophysics Lab, the Observational Cosmology Lab, and the Exoplanets and Stellar Astrophysics Lab. The High Energy Astrophysics Science Archive Research Center (HEASARC) is an Office at the Division level. Approximately 400 scientists and engineers work in ASD. Of these, 80 are civil servant scientists, while the rest are resident university-based scientists, contractors, postdoctoral fellows, graduate students, and administrative staff. We currently operate the Swift Explorer mission and the Fermi Gamma-ray Space Telescope. In addition, we provide data archiving and operational support for the XMM mission (jointly with ESA) and the Suzaku mission (with JAXA). We are also a partner with Caltech on the NuSTAR mission. The Hubble Space Telescope Project is headquartered at Goddard, and ASD provides Project Scientists to oversee operations at the Space Telescope Science Institute. Projects in development include the Neutron Interior Composition Explorer (NICER) mission, an X-ray timing experiment for the International Space Station; the Transiting Exoplanet Sky Survey (TESS) Explorer mission, in collaboration with MIT (Ricker, PI); the Soft X-ray Spectrometer (SXS) for the Astro-H mission in collaboration with JAXA, and the James Webb Space Telescope (JWST). The Wide-Field Infrared Survey Telescope (WFIRST), the highest ranked mission in the 2010 decadal survey, is in a pre-phase A study, and we are supplying study scientists for that mission.
Caltech on the NuSTAR mission↗
Public Outreach and Archiving of Data from the High Resolution Stereo Camera Onboard Mars Express: 2004 The First Year
During the first year of operation, corresponding to the calendar year 2004, the HRSC imaging experiment onboard ESA's Mars Express mission recorded 23 Gigabyte of 8-bit compressed raw data. After processing, the amount of data increased to more than 344 Gigabyte of decompressed and radiometrically calibrated scientifically useable image products. Every six months these HRSC Level 2 data are fed into ESA's Planetary Science Archive (PSA) that sends all data also to the Planetary Data System (PDS) to ensure easy availability to the interested user. On their respective web portals, the European Space Agency published in cooperation with the Principal Investigator-Group at Freie Universitat Berlin and the German Space Agency (DLR) almost 40 sets of high-level image scenes and movies for PR needs that have been electronically visited many hundred thousand times.
Koehler, U.↗
Explanatory Supplement to the WISE All-Sky Release Products
The Wide-field Infrared Survey Explorer (WISE; Wright et al. 2010) surveyed the entire sky at 3.4, 4.6, 12 and 22 microns in 2010, achieving 5-sigma point source sensitivities per band better than 0.08, 0.11, 1 and 6 mJy in unconfused regions on the ecliptic. The WISE All-Sky Data Release, conducted on March 14, 2012, incorporates all data taken during the full cryogenic mission phase, 7 January 2010 to 6 August 20l0,that were processed with improved calibrations and reduction algorithms. Release data products include: (1) an Atlas of 18,240 match-filtered, calibrated and coadded image sets; (2) a Source Catalog containing positions and four-band photometry for over 563 million objects, and (3) an Explanatory Supplement. Ancillary products include a Reject Table that contains 284 million detections that were not selected for the Source Catalog because they are low signal-to-noise ratio or spurious detections of image artifacts, an archive of over 1.5 million sets of calibrated WISE Single-exposure images, and a database of 9.4 billion source extractions from those single images, and moving object tracklets identified by the NEOWISE program (Mainzer et aI. 2011). The WISE All-Sky Data Release products supersede those from the WISE Preliminary Data Release (Cutri et al. 2011). The Explanatory Supplement to the WISE All-Sky Data Release Products is a general guide for users of the WISE data. The Supplement contains an overview of the WISE mission, facilities, and operations, a detailed description of WISE data processing algorithms, a guide to the content and formals of the image and tabular data products, and cautionary notes that describe known limitations of the All-Sky Release products. Instructions for accessing the WISE data products via the services of the NASA/IPAC Infrared Science Archive are provided. The Supplement also provides analyses of the achieved sky coverage, photometric and astrometric characteristics and completeness and reliability of the All-Sky Release data products. The WISE All-Sky Release Explanatory Supplement is an on-line document that is updated frequently to provide the most current information for users of the WISE data products. The Explanatory Supplement is maintained at: http://wise2.ipac.caltech.edu/docs/release/allsky/expsup/index.html WISE is a joint project of the University of California, Los Angeles and the Jet Propulsion Laboratory/California Institute of Technology, funded by the National Aeronautics and Space Administration. NEOWISE is a project of the Jet Propulsion Laboratory/California Institute of Technology, funded by the Planetary Science Division of the National Aeronautics and Space Administration.
Source record↗
Validity of the Landsat Surface Reflectance Archive for Aquatic Science: Implications for Cloud-Based Analysis
Originally developed for terrestrial science and applications, the US Geological Survey Landsat surface reflectance (SR) archive spanning ~ 40 yr of observations has been increasingly utilized in large‐scale water‐quality studies. These products, however, have not been rigorously validated using in situ measured reflectance. This letter quantifies and demonstrates the quality of the SR products by harnessing a sizeable global dataset ( N = 1100). We found that the Landsat 8/9 SR in the green and red bands marginally meet the targeted accuracy requirements (30%), whereas the uncertainties in the blue and coastal‐aerosol bands ranged from 48% to 110%. We further observed > +25% biases in the visible bands of Landsat 5/7 SR, which can introduce an apparent downward trend when applied in time‐series analyses combined with Landsat 8/9. Users must exercise caution when using this archive for trend analyses, and progress in atmospheric correction is required to foster advanced applications of the Landsat archive for aquatic science.
Landsat, lakes, harmful algal blooms↗
The CatWISE Preliminary Catalog: Motions from WISE and NEOWISE Data
CatWISE is a program to catalog sources selected from combined WISE and NEOWISE all-sky survey data at 3.4 and 4.6 μm (W1 and W2). The CatWISE Preliminary Catalog consists of 900,849,014 sources measured in data collected from 2010 to 2016. This data set represents four times as many exposures and spans over 10 times as large a time baseline as that used for the AllWISE Catalog. CatWISE adapts AllWISE software to measure the sources in coadded images created from six-month subsets of these data, each representing one coverage of the inertial sky, or epoch. The catalog includes the measured motion of sources in eight epochs over the 6.5 yr span of the data. From comparison to Spitzer, signal-to-noise ratio = 5 limits in magnitudes in the Vega system are W1 = 17.67 and W2 = 16.47, compared to W1 = 16.96 and W2 = 16.02 for AllWISE. From comparison to Gaia, CatWISE positions have typical accuracies of 50 mas for stars at W1 = 10 mag and 275 mas for stars at W1 = 15.5 mag. Proper motions have typical accuracies of 10 mas yr -1 and 30 mas yr -1 for stars with these brightnesses, an order of magnitude better than from AllWISE. The catalog is available in the WISE/NEOWISE Enhanced and Contributed Products area of the NASA/IPAC Infrared Science Archive.
79 ASTRONOMY AND ASTROPHYSICS↗
The Sloan Digital Sky Survey Quasar Catalog: Sixteenth Data Release
We present the final Sloan Digital Sky Survey IV (SDSS-IV) quasar catalog from Data Release 16 of the extended Baryon Oscillation Spectroscopic Survey (eBOSS). This catalog comprises the largest selection of spectroscopically confirmed quasars to date. The full catalog includes two subcatalogs (the current versions are DR16Q_v4 and DR16Q_Superset_v3 at https://data.sdss.org/sas/dr16/eboss/qso/DR16Q/): a "superset" of all SDSS-IV/eBOSS objects targeted as quasars containing 1,440,615 observations and a quasar-only catalog containing 750,414 quasars, including 225,082 new quasars appearing in an SDSS data release for the first time, as well as known quasars from SDSS-I/II/III. We present automated identification and redshift information for these quasars alongside data from visual inspections for 320,161 spectra. Here, the quasar-only catalog is estimated to be 99.8% complete with 0.3%-1.3% contamination. Automated and visual inspection redshifts are supplemented by redshifts derived via principal component analysis and emission lines. We include emission-line redshifts for Hα, Hβ, Mg II, C III], C IV, and Lyα. Identification and key characteristics generated by automated algorithms are presented for 99,856 broad absorption-line quasars and 35,686 damped Lyman alpha quasars. In addition to SDSS photometric data, we also present multiwavelength data for quasars from the Galaxy Evolution Explorer, UKIDSS, the Wide-field Infrared Survey Explorer, FIRST, ROSAT/2RXS, XMM-Newton, and Gaia. Calibrated digital optical spectra for these quasars can be obtained from the SDSS Science Archive Server.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
The CatWISE2020 Catalog
The CatWISE2020 Catalog consists of 1,890,715,640 sources over the entire sky selected from Wide-field Infrared Survey Explorer (WISE) and NEOWISE survey data at 3.4 and 4.6 μm (W1 and W2) collected from 2010 January 7 to 2018 December 13. This data set adds two years to that used for the CatWISE Preliminary Catalog, bringing the total to six times as many exposures spanning over 16 times as large a time baseline as the AllWISE catalog. The other major change from the CatWISE Preliminary Catalog is that the detection list for the CatWISE2020 Catalog was generated using crowdsource from Schlafly et al., while the CatWISE Preliminary Catalog used the detection software used for AllWISE. These two factors result in roughly twice as many sources in the CatWISE2020 Catalog. The scatter with respect to Spitzer photometry at faint magnitudes in the COSMOS field, which is out of the Galactic Plane and at low ecliptic latitude (corresponding to lower WISE coverage depth) is similar to that for the CatWISE Preliminary Catalog. The 90% completeness depth for the CatWISE2020 Catalog is at W1 = 17.7 mag and W2 = 17.5 mag, 1.7 mag deeper than in the CatWISE Preliminary Catalog. In comparison to Gaia, CatWISE2020 motions are accurate at the 20 mas yr-1 level for W1~15 mag sources and at the ~100 mas yr-1 level for W1~17 mag sources. This level of accuracy represents a 12 improvement over AllWISE. Finally, the CatWISE catalogs are available in the WISE/NEOWISE Enhanced and Contributed Products area of the NASA/IPAC Infrared Science Archive.
79 ASTRONOMY AND ASTROPHYSICS↗
ROSAT implementation of a proposed multi-mission x ray data format
Until recently little effort has been made to ensure that data from X-ray telescopes are delivered in a format that reflects the common characteristics that most X-ray datasets share. Instrument-specific data-product design hampers the comparison of X-ray measurements made by different detectors and should be avoided whenever possible. The ROSAT project and the High Energy Astrophysics Science Archive Research Center (HEASARC) have defined a set of X-ray data products ('rationalized files') for ROSAT data that can be used for distribution and archiving of data from other X-ray missions. This set of 'rationalized files' has been defined to isolate instrument-independent and instrument-specific quantities using standards FITS constructs to ensure portability. We discuss the usage of the 'rationalized files' by ROSAT for data distribution and archiving, with particular emphasis on discrimination between instrument-independent and instrument-specific quantities, and discuss application of this format to data from other X-ray missions.
Corcoran, M.↗
The HEASARC graphical user interface
An OSF/Motif-based graphical user interface has been developed to facilitate the use of the database and data analysis software packages available from the High Energy Astrophysics Science Archive Research Center (HEASARC). It can also be used as an interface to other, similar, routines. A small number of tables are constructed to specify the possible commands and command parameters for a given set of analysis routines. These tables can be modified by a designer to affect the appearance of the interface screens. They can also be dynamically changed in response to parameter adjustments made while the underlying program is running. Additionally, a communication protocol has been designed so that the interface can operate locally or across a network. It is intended that this software be able to run on a variety of workstations and X terminals.
White, N.↗