Search NASA⌕ Search

SEARCH · Search NASA

Results for “Archive”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

A Step Beyond Simple Keyword Searches: Services Enabled by a Full Content Digital Journal Archive

The problems of managing and searching large archives of scientific journal articles can potentially be addressed through data mining and statistical techniques matured primarily for quantitative scientific data analysis. A journal paper could be represented by a multivariate descriptor, e.g., the occurrence counts of a number key technical terms or phrases (keywords), perhaps derived from a controlled vocabulary ( e . g . , the American Meteorological Society's Glossary of Meteorology) or bootstrapped from the journal archive itself. With this technique, conventional statistical classification tools can be leveraged to address challenges faced by both scientists and professional societies in knowledge management. For example, cluster analyses can be used to find bundles of "most-related" papers, and address the issue of journal bifurcation (when is a new journal necessary, and what topics should it encompass). Similarly, neural networks can be trained to predict the optimal journal (within a society's collection) in which a newly submitted paper should be published. Comparable techniques could enable very powerful end-user tools for journal searches, all premised on the view of a paper as a data point in a multidimensional descriptor space, e.g.: "find papers most similar to the one I am reading", "build a personalized subscription service, based on the content of the papers I am interested in, rather than preselected keywords", "find suitable reviewers, based on the content of their own published works", etc. Such services may represent the next "quantum leap" beyond the rudimentary search interfaces currently provided to end-users, as well as a compelling value-added component needed to bridge the print-to-digital-medium gap, and help stabilize professional societies' revenue stream during the print-to-digital transition.

Boccippio, Dennis J.↗

A Low-Cost Clustered Archive Approach for Storing Remote Sensing Data

As part of NASA's Earth Observing System (EOS) Data and Information System (EOSDIS), the Moderate Resolution Imaging Spectrometer (MODIS) Data Processing System (MODAPS) is now processing data from two instruments on the EOS flag ship spacecraft Terra and Aqua. Between the two, MODAPS is generating over 1 Terrabyte of data per day and has surpassed 3 Petabytes of total data. The bulk of the data is stored near-line in StorageTek Powerhorn tape jukeboxes. Accessing data that has been moved to tape involves submitting an order, scheduling the tape, and waiting for the data to become available. I am developing a low cost clustered archive that could enable storing a very large amount of data such as the MODIS data described above in an organized fashion on a cluster of commodity hardware using low cost SATA hard drives such that the files are directly available online. The system takes full advantage of Open Source software, using the GNULinux operating system, PostgreSQL relational database and the Apache HTTP Server. This poster session will depict my approach, the interface to the archive, a brief discussion of the internals of the system and some performance numbers from my prototyping. I will also describe various costs and benefits of this approach versus the traditional large tape jukebox approach currently in use in the EOSDIS.

Tilmes, Curt↗

Validation of the Archived CERES Surface and Atmosphere Radiation Budget (SARB) at SGP

The CERES Surface and Atmosphere Radiation Budget (SARB) product (Charlock et al, 2002) includes the vertical profile of broadband SW, broadband LW, and 8-12 micron window (WN) fluxes; upwelling and downwelling at TOA, 70 hPa, 200 hPa, 500 hPa, and the surface; and for all-sky and clear-sky conditions. We test the archived CERES TRMM record of SARB for January-August 1998 and focus on discrepancies with ground-based measurements at SGP. The CERES SARB is generated by a highly modified Fu-Liou radiative transfer code (Fu and Liou, 1993). The most critical inputs for this application are cloud optical properties (fractional area, optical depth, particle size and phase, height of top, and estimate of geometrical thickness Minnis et al., 2002) from the narrowband VIRS imager. Numerous VIRS pixels (approx. 2km resolution at nadir) are matched to each of the large (approx. 20km) CERES broadband footprints (Wielicki et al, 1996). Other inputs include temperature and humidity from ECMWF (Rabier et al, 1998) , NCEP ozone profiles from SBUV and TOVS (Yang et al, 2001), aerosol optical thickness (AOT) from the Model for Atmospheric Transport and Chemistry (MATCH) aerosol assimilation (Collins et al., 2001) or alternately from the VIRS imager (Ignatov and Stowe, 2000). VIRS AOT is available for clear and partly cloudy ocean footprints during daylight; and only when viewing geometry renders a contribution from sunglint as unlikely. For other footprints, AOT is taken from MATCH. AOT is apportioned into fractions of dust (Tegan and Lacis, 1996), sea salt, sulfate, dust, soluble organic, insoluble organic, and soot (Hess et al., 1996) using the 6-hourly MATCH output. Tuned fluxes are retrieved by adjusting inputs to nudge computed TOA fluxes toward CERES observations (Rose et al, 1997). In clear conditions, the fields of humidity, surface skin temperature, surface albedo and AOT are adjusted to produce a closer match of computed and observed fluxes at TOA. When CERES footprints have clouds, the cloud optical thickness, fractional area within the footprint, and temperature of cloud top are adjusted by the tuning algorithm. Both tuned and untuned fluxes are archived, as are the respective adjustments to any parameters at the surface or within the atmosphere.

Charlock, Thomas P.↗

An Intelligent Archive Testbed Incorporating Data Mining

Many significant advances have occurred during the last two decades in remote sensing instrumentation, computation, storage, and communication technology. A series of Earth observing satellites have been launched by U.S. and international agencies and have been operating and collecting global data on a regular basis. These advances have created a data rich environment for scientific research and applications. NASA s Earth Observing System (EOS) Data and Information System (EOSDIS) has been operational since August 1994 with support for pre-EOS data. Currently, EOSDIS supports all the EOS missions including Terra (1999), Aqua (2002), ICESat (2002) and Aura (2004). EOSDIS has been effectively capturing, processing and archiving several terabytes of standard data products each day. It has also been distributing these data products at a rate of several terabytes per day to a diverse and globally distributed user community (Ramapriyan et al. 2009). There are other NASA-sponsored data system activities including measurement-based systems such as the Ocean Data Processing System and the Precipitation Processing system, and several projects under the Research, Education and Applications Solutions Network (REASoN), Making Earth Science Data Records for Use in Research Environments (MEaSUREs), and the Advancing Collaborative Connections for Earth-Sun System Science (ACCESS) programs. Together, these activities provide a rich set of resources constituting a value chain for users to obtain data at various levels ranging from raw radiances to interdisciplinary model outputs. The result has been a significant leap in our understanding of the Earth systems that all humans depend on for their enjoyment, livelihood, and survival. The trend in the community today is towards many distributed sets of providers of data and services. Despite this, visions for the future include users being able to locate, fuse and utilize data with location transparency and high degree of interoperability, and being able to convert data to information and usable knowledge in an efficient, convenient manner, aided significantly by automation (Ramapriyan et al. 2004; NASA 2005). We can look upon the distributed provider environment with capabilities to convert data to information and to knowledge as an Intelligent Archive in the Context of a Knowledge Building system (IA-KBS). Some of the key capabilities of an IA-KBS are: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting (Ramapriyan et al. 2004).

Ramapriyan, H.↗

Advances in Spatial Data Infrastructure, Acquisition, Analysis, Archiving and Dissemination

The authors review recent contributions to the state-of-thescience and benign proliferation of satellite remote sensing, spatial data infrastructure, near-real-time data acquisition, analysis on high performance computing platforms, sapient archiving, multi-modal dissemination and utilization for a wide array of scientific applications. The authors also address advances in Geoinformatics and its growing ubiquity, as evidenced by its inclusion as a focus area within the American Geophysical Union (AGU), European Geosciences Union (EGU), as well as by the evolution of the IEEE Geoscience and Remote Sensing Society's (GRSS) Data Archiving and Distribution Technical Committee (DAD TC).

Ramapriyan, Hampapuran K.↗

Facilitating Navigation Through Large Archives

Automated Visual Access (AVA) is a computer program that effectively makes a large collection of information visible in a manner that enables a user to quickly and efficiently locate information resources, with minimal need for conventional keyword searches and perusal of complex hierarchical directory systems. AVA includes three key components: (1) a taxonomy that comprises a collection of words and phrases, clustered according to meaning, that are used to classify information resources; (2) a statistical indexing and scoring engine; and (3) a component that generates a graphical user interface that uses the scoring data to generate a visual map of resources and topics. The top level of an AVA display is a pictorial representation of an information archive. The user enters the depicted archive by either clicking on a depiction of subject area cluster, selecting a topic from a list, or entering a query into a text box. The resulting display enables the user to view candidate information entities at various levels of detail. Resources are grouped spatially by topic with greatest generality at the top layer and increasing detail with depth. The user can zoom in or out of specific sites or into greater or lesser content detail.

Shelton, Robert O.↗

New Insights into Prebiotic Chemistry from Old Archived Miller Extracts

Following the discovery of an archived set of samples from Stanley Miller's early experiments, analyses were undertaken to better understand the diversity of compounds produced from electric discharges acting on reducing gas mixtures. The paper chromatography methods that Miller used in the 1950s were only capable of detecting a few amino acids and were unable to provide substantial quantitative data relative to today's techniques. Current analytical techniques are much more sensitive and selective, and are capable of precisely quantifying a much larger range of amino acids and their enantiomeric abundances. In one study, preserved dried samples produced by Miller using a lesser-known volcanic apparatus which differed from Miller's classic apparatus in that it utilized an aspirator that injected steam into the electric discharge chamber, simulating a volcanic eruption. The volcanic apparatus produced a wider variety of amino acids than the classic configuration. Prebiotic compounds synthesized in these environments may have locally accumulated where they could have undergone further processing. An additional preserved set of samples from an experiment conducted in 1958 were also found in Miller's archived collection. These samples which had been generated using a mixture of CH4, NH3, H2S and CO2 were collected, catalogued, and stored by Miller, but for unknown reasons were never studied. In our analyses a total of 23 amino acids and 4 amines, including 7 organosulfur compounds, were detected in these samples. The major amino acids with chiral centers are racemic within the accuracy of the measurements, indicating that they are not contaminants introduced during sample storage. This experiment marks the first synthesis of sulfur amino acids from spark discharge experiments designed to imitate primordial environments. The relative yield of some amino acids, in particular the isomers of amino butyric acid, are the highest ever found in a spark discharge experiment. The simulated primordial conditions used by Miller in these experiments may serve as a model for early volcanic plume chemistry and provide insight to the possible roles such plumes may have played in abiotic organic synthesis. Additionally, the overall abundances of the synthesized amino acids in the presence of H2S are very similar to the abundances found in some carbonaceous meteorites, suggesting that H2S may have played an important role in prebiotic reactions in early solar system environments. Although experiments using a variety of gases as components of the primordial Earth's atmospheric composition and a spark discharge apparatus configured according to Miller's original or volcanic design can be readily carried out, the unique opportunity to investigate samples prepared by the pioneer in abiotic synthesis using state of the art analytical methods is of considerable historic interest.

Parker, Eric T.↗

Direct Detection and Orbit Analysis of the Exoplanets HR 8799 bcd from Archival 2005 Keck/NIRC2 Data

We present previously unpublished July 2005 H-band coronagraphic data of the young, planet-hosting star HR 8799 from the newly-released Keck/NIRC2 archive. Despite poor observing conditions, we detect three of the planets (HR 8799 bcd), two of them (HR 8799 bc) without advanced image processing. Comparing these data with previously published 1998-2011 astrometry and that from re-reduced October 2010 Keck data constrains the orbits of the planets. Analyzing the planets' astrometry separately, HR 8799 d's orbit is likely inclined at least 25 deg from face-on and the others may be on in inclined orbits. For semimajor axis ratios consistent with a 4:2:1 mean-motion resonance our analysis yields precise values for HR 8799 bcd's orbital parameters and strictly constrains the planets' eccentricities to be less than 0.18-0.3. However, we find no acceptable orbital solutions with this resonance that place the planets in face-on orbits; HR 8799 d shows the largest deviation from such orbits. Moreover, few orbits make HR 8799 d coplanar with b and c, whereas dynamical stability analyses used to constrain the planets' masses typically assume coplanar and/or fare.on orbits. This paper illustrates the significant science gain enabled with the release of the NIRC2 archive.

Currie, Thayne↗

From EXOSAT to the High Energy Astrophysics Science Archive (HEASARC): X-ray Astronomy Comes of Age

In May 1983 the European Space Agency launched EXOSAT, its first X-ray astronomy observatory. Even though it lasted only 3 short years, this mission brought not only new capabilities that resulted in unexpected discoveries, but also a pioneering approach to operations and archiving that changed X-ray astronomy from observations led by small instrument teams, to an observatory approach open to the entire community through a guest observer program. The community use of the observatory was supported by a small dedicated team of scientists, the precursor to the data center activities created to support e.g. Chandra and XMM-Newton. The new science capabilities of EX OS AT included a 90 hr highly eccentric high earth orbit that allow unprecedented continuous coverage of sources as well as direct communication with the satellite that allowed real time decisions to respond to unexpected events through targets of opportunity. The advantages of this orbit demonstrated by EXOSAT resulted in Chandra and XMM-Newton selecting similar orbits. The three instruments on board the EXOSAT observatory were complementary, designed to give complete coverage over a wide energy band pass of 0.05-50 keY. An onboard processor could be programmed to give multiple data modes that could be optimized in response to science discoveries: These new capabilities resulted in many new discoveries including the first comprehensive study of AGN variability, new orbital periods in X-ray binaries and cataclysmic variables, new black holes, quasi-periodic oscillations from neutron stars and black holes and broad band X-ray spectroscopy. The EXOSAT team generated a well-organized database accessible worldwide over the nascent internet, allowing remote selection of data products, making samples and undertaking surveys from the data. The HEASARC was established by NASA at Goddard Space Flight Center in 1990 as the repository of NASA X-ray and Gamma-ray data. The proven EXOSAT database system became the core of the HEASARC infrastructure. The HEASARC pioneered many concepts now taken for granted including standardized formats using FITS files, restoring data from earlier missions, multi-mission analysis tools and a searchable archive over the world wide web.

White, Nicholas E.↗

Standardization of the Definitions of Vertical Resolution and Uncertainty in the NDACC-archived Ozone and Temperature Lidar Measurements

The international Network for the Detection of Atmospheric Composition Change (NDACC) is a global network of high-quality, remote-sensing research stations for observing and understanding the physical and chemical state of the Earth atmosphere. As part of NDACC, over 20 ground-based lidar instruments are dedicated to the long-term monitoring of atmospheric composition and to the validation of space-borne measurements of the atmosphere from environmental satellites such as Aura and ENVISAT. One caveat of large networks such as NDACC is the difficulty to archive measurement and analysis information consistently from one research group (or instrument) to another [1][2][3]. Yet the need for consistent definitions has strengthened as datasets of various origin (e.g., satellite and ground-based) are increasingly used for intercomparisons, validation, and ingested together in global assimilation systems.In the framework of the 2010 Call for Proposals by the International Space Science Institute (ISSI) located in Bern, Switzerland, a Team of lidar experts was created to address existing issues in three critical aspects of the NDACC lidar ozone and temperature data retrievals: signal filtering and the vertical filtering of the retrieved profiles, the quantification and propagation of the uncertainties, and the consistent definition and reporting of filtering and uncertainties in the NDACC- archived products. Additional experts from the satellite and global data standards communities complement the team to help address issues specific to the latter aspect.

Detection of Atmospheric Composition Change (NDACC↗

Qualitative Comparison of IGRA and ESRL Radiosonde Archived Databases

Multiple databases of atmospheric profile information are freely available to individuals and groups such as the Natural Environments group. Two of the primary database archives provided by NOAA that are most frequently used are those from the Earth Science Research Laboratory (ESRL) and the Integrated Global Radiosonde Archive (IGRA). Inquiries have been made as to why one database is used as opposed to the other, yet to the best of knowledge, no formal comparison has been performed. The goal of this study is to provide a qualitative comparison of the ESRL and IGRA radiosonde databases. For part of this analyses, 14 upper air observation sites were selected. These sites all have the common attribute of having been used or are planned for use in the development of Range Reference Atmospheres (RRAs) in support of NASA's and DOD's current and future goals.

Walker, John R.↗

Access to Archived Astronaut Data for Human Research Program Researchers: Update on Progress and Process Improvements

Since the 2010 NASA directive to make the Life Sciences Data Archive (LSDA) and Lifetime Surveillance of Astronaut Health (LSAH) data archives more accessible by the research and operational communities, demand for astronaut medical data has increased greatly. LSAH and LSDA personnel are working with Human Research Program on many fronts to improve data access and decrease lead time for release of data. Some examples include the following: Feasibility reviews for NASA Research Announcement (NRA) data mining proposals; Improved communication, support for researchers, and process improvements for retrospective Institutional Review Board (IRB) protocols; Supplemental data sharing for flight investigators versus purely retrospective studies; Work with the Multilateral Human Research Panel for Exploration (MHRPE) to develop acceptable data sharing and crew consent processes and to organize inter-agency data coordinators to facilitate requests for international crewmember data. Current metrics on data requests crew consenting will be presented, along with limitations on contacting crew to obtain consent. Categories of medical monitoring data available for request will be presented as well as flow diagrams detailing data request processing and approval steps.

Lee, L. R.↗

Archive Management of NASA Earth Observation Data to Support Cloud Analysis

NASA collects, processes and distributes petabytes of Earth Observation (EO) data from satellites, aircraft, in situ instruments and model output, with an order of magnitude increase expected by 2024. Cloud-based web object storage (WOS) of these data can simplify the execution of such an increase. More importantly, it can also facilitate user analysis of those volumes by making the data available to the massively parallel computing power in the cloud. However, storing EO data in cloud WOS has a ripple effect throughout the NASA archive system with unexpected challenges and opportunities. One challenge is modifying data servicing software (such as Web Coverage Service servers) to access and subset data that are no longer on a directly accessible file system, but rather in cloud WOS. Opportunities include refactoring of the archive software to a cloud-native architecture; virtualizing data products by computing on demand; and reorganizing data to be more analysis-friendly.

Lynnes, Christopher↗

Archive Management of NASA Earth Observation Data to Support Cloud Analysis

NASA collects, processes and distributes petabytes of Earth Observation (EO) data from satellites, aircraft, in situ instruments and model output, with an order of magnitude increase expected by 2024. Cloud-based web object storage (WOS) of these data can simplify the execution of such an increase. More importantly, it can also facilitate user analysis of those volumes by making the data available to the massively parallel computing power in the cloud. However, storing EO data in cloud WOS has a ripple effect throughout the NASA archive system with unexpected challenges and opportunities. One challenge is modifying data servicing software (such as Web Coverage Service servers) to access and subset data that are no longer on a directly accessible file system, but rather in cloud WOS. Opportunities include refactoring of the archive software to a cloud-native architecture; virtualizing data products by computing on demand; and reorganizing data to be more analysis-friendly. Reviewed by Mark McInerney ESDIS Deputy Project Manager.

Lynnes, Christopher↗

Development of a Complete Landsat Evapotranspiration and Energy Balance Archive to Support Agricultural Consumptive Water Use Reporting and Prediction in the Central Valley, CA

Mapping evapotranspiration (ET) from agricultural areas in Californias Central Valley is critical for understanding historical consumptive use of surface and groundwater. In addition, long histories of ET maps provide valuable training information for predictive studies of surface and groundwater demands. During times of drought, groundwater is commonly pumped to supplement reduced surface water supplies in the Central Valley. Due to the lack of extensive groundwater pumping records, mapping consumptive use using satellite imagery is an efficient and robust way for estimating agricultural consumptive use and assessing drought impacts. To this end, we have developed and implemented an algorithm for automated calibration of the METRIC remotely sensed surface energy balance model on NASAs Earth Exchange (NEX) to estimate ET at the field scale. Using automated calibration techniques on the NEX has allowed for the creation of spatially explicit historical ET estimates for the Landsat archive dating from 1984 to the near present. Further, our use of spatial NLDAS and CIMIS weather data, and spatial soil water balance simulations within the NEX METRIC workflow, has helped overcome challenges of time integration between satellite image dates. This historical and near present time archive of agricultural water consumption for the Central Valley will be an extremely useful dataset for water use and drought impact reporting, and predictive analyses of groundwater demands.

valleys↗

Managing and Servicing Physical Oceanographic Data at a NASA Distributed Active Archive Center

The NASA Earth Science Data Information Systems Project funds and operates 12 Distributed Active Archive Center(s) (DAAC) throughout the United States. Of these 12 centers, the Physical Oceanography DAAC (PO.DAAC) is committed to providing long term archival, distribution and stewardship for NASA physical oceanographic data, primarily derived from space-born satellite systems, but also including a growing set of recent and future in situ observations from the SPURS-1 and SPURS-2 campaigns. Notable NASA missions supported include: Seasat, TOPEX/Poseidon, NSCAT, QuikSCAT, ISS-RapidScat, Jason-1, Jason-2/OSTM, GRACE, Aquarius, GHRSST, and MODIS. The following interagency and international missions are also supported by PO.DAAC: AVHRR, Coriolis, DMSP, MetOp-A, MetOp-B, Oceansat-2. The PO.DAAC currently holds 525 datasets in public distribution, spanning the following observational parameters: sea surface temperature, sea surface salinity, ocean color, ocean surface currents, ocean surface wind speed, ocean surface wind direction, sea surface height, significant wave height, ocean water mass/thickness, and sea ice age. A hundred of these datasets are available in near-real-time. Datasets are distributed through a variety of open-source access protocols including FTP, OPeNDAP, and THREDDS. FTP will soon be phased out in favor of a recently introduced HTTPS PO.DAAC Drive interface that supports WebDAV and interoperable machine-to-machine communication. OPeNDAP supports remote data/metadata query, subset, and download. THREDDS provides the features of OPeNDAP with the additional feature of temporal aggregation. PO.DAAC also offers proprietary tools and services to further enhance the data discovery, visualization and analysis experience, including but not limited to: State of the Ocean, Web Services (data/metadata discovery and extraction), HiTIDE Level-2 subsetter, Live Access Server (LAS), Webification (w10nsci), and Rich Site Summary (RSS) Datacasting. To assist with provenance of datasets, PO.DAAC has implemented DOIs for the data it distributes so that they can be properly cited. There is a user forum and helpdesk that contains data recipes and via which users can get guidance. In summary, this presentation aims to provide a general overview of PO.DAAC’s web portal and data holdings along with a set of illustrative examples leading prospective data users into the practical utility of its tools and services.

Moroni, David F.↗

Cumulus Lessons Learned: Building, Testing, and Sharing a Cloud Archive

Cumulus is a scalable, extensible cloud-based archive system which is capable of ingesting, archiving, and distributing data from both existing on-prem sources and new cloud-native missions. As we have built and evolved the system with contributions from seven NASA EOSDIS organizations, we have learned several lessons about how to build a robust, broadly-applicable, microservices-based cloud system for geospatial data which we will share in this talk.

Quinn, Patrick↗