Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing and archiving”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

NLSI Focus Group on Recovery of Missing ALSEP Data: Status Update for 2012 NLSI Science Forum

On the six Apollo lunar landed missions, the Astronauts deployed the Apollo Lunar Surface Experiments Package (ALSEP) science stations which measured active and passive seismic events, magnetic fields, charged particles, solar wind, heat flow, the diffuse atmosphere, meteorites and their ejecta, lunar dust, etc. Today s investigators are able to extract new information and make new discoveries from the old ALSEP data utilizing recent advances in computer capabilities and new analysis techniques. However, current-day investigators are encountering problems in trying to use the ALSEP data. The data were in formats often not well described in the published reports and contained rerecording anomalies which required tape experts to resolve. To solve these problems the DPS Lunar Data Node was established at NASA Goddard Space Flight Center (GSFC) NASA Space Science Data Center (NSSDC) in 2008 and is currently in the process of making the existing archived ALSEP data available to current-day investigators in easily useable forms. However, current estimates by NSSDC archivists are that only about 60 percent of the PI processed ALSEP data and less than 30 percent of the raw experiment ALSEP data-of-interest to current lunar science investigators are currently in the NSSDC archives.

Lewis, Lyach R.↗
NASA NTRS2017

Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems

NASA's Earth Observing System (EOS) is a coordinated series of satellites for long term global observations. NASA's Earth Observing System Data and Information System (EOSDIS) is a multi-petabyte-scale archive of environmental data that supports global climate change research by providing end-to-end services from EOS instrument data collection to science data processing to full access to EOS and other earth science data. On a daily basis, the EOSDIS ingests, processes, archives and distributes over 3 terabytes of data from NASA's Earth Science missions representing over 6000 data products ranging from various types of science disciplines. EOSDIS has continually evolved to improve the discoverability, accessibility, and usability of high-impact NASA data spanning the multi-petabyte-scale archive of Earth science data products. Reviewed and approved by Chris Lynnes.

Cumulus↗
NASA NTRS2006

Characterizing the LANDSAT Global Long-Term Data Record

The effects of global climate change are fast becoming politically, sociologically, and personally important: increasing storm frequency and intensity, lengthening cycles of drought and flood, expanding desertification and soil salinization. A vital asset in the analysis of climate change on a global basis is the 34-year record of Landsat imagery. In recognition of its increasing importance, a detailed analysis of the Landsat observation coverage within the US archive was commissioned. Results to date indicate some unexpected gaps in the US-held archive. Fortunately, throughout the Landsat program, data have been downlinked routinely to International Cooperator (IC) ground stations for archival, processing, and distribution. These IC data could be combined with the current US holdings to build a nearly global, annual observation record over this 34-year period. Today, we have inadequate information as to which scenes are available from which IC archives. Our best estimate is that there are over four million digital scenes in the IC archives, compared with the nearly two million scenes held in the US archive. This vast pool of Landsat observations needs to be accurately documented, via metadata, to determine the existence of complementary scenes and to characterize the potential scope of the global Landsat observation record. Of course, knowing the extent and completeness of the data record is but the first step. It will be necessary to assure that the data record is easy to use, internally consistent in terms of calibration and data format, and fully accessible in order to fully realize its potential.

Arvidson, T.↗
NASA NTRS1997

Satellite Analysis of Ocean Biogeochemistry and Mesoscale Variability in the Sargasso Sea

The objective of this study was to analyze the impact of spatial variability on the time-series of biogeochemical measurements made at the U.S. JGOFS Bermuda Atlantic Time-series Study (BATS) site. Originally the study was planned to use SeaWiFS as well as AVHRR high-resolution data. Despite the SeaWiFS delays we were able to make progress on the following fronts: (1) Operational acquisition, processing, and archive of HRPT data from a ground station located in Bermuda; (2) Validation of AVHRR SST data using BATS time-series and spatial validation cruise CTD data; (3) Use of AVHRR sea surface temperature imagery and ancillary data to assess the impact of mesoscale spatial variability on P(CO2) and carbon flux in the Sargasso Sea; (4) Spatial and temporal extent of tropical cyclone induced surface modifications; and (5) Assessment of eddy variability using TOPEX/Poseidon data.

Siegel, D. A.↗
NASA NTRS2014

Temperature and Humidity Profiles in the TqJoint Data Group of AIRS Version 6 Product for the Climate Model Evaluation

The Atmospheric Infrared Sounder (AIRS) mission is entering its 13th year of global observations of the atmospheric state, including temperature and humidity profiles, outgoing long-wave radiation, cloud properties, and trace gases. Thus AIRS data have been widely used, among other things, for short-term climate research and observational component for model evaluation. One instance is the fifth phase of the Coupled Model Intercomparison Project (CMIP5) which uses AIRS version 5 data in the climate model evaluation. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the home of processing, archiving, and distribution services for data from the AIRS mission. The GES DISC, in collaboration with the AIRS Project, released data from the version 6 algorithm in early 2013. The new algorithm represents a significant improvement over previous versions in terms of greater stability, yield, and quality of products. The ongoing Earth System Grid for next generation climate model research project, a collaborative effort of GES DISC and NASA JPL, will bring temperature and humidity profiles from AIRS version 6. The AIRS version 6 product adds a new "TqJoint" data group, which contains data for a common set of observations across water vapor and temperature at all atmospheric levels and is suitable for climate process studies. How different may the monthly temperature and humidity profiles in "TqJoint" group be from the "Standard" group where temperature and water vapor are not always valid at the same time? This study aims to answer the question by comprehensively comparing the temperature and humidity profiles from the "TqJoint" group and the "Standard" group. The comparison includes mean differences at different levels globally and over land and ocean. We are also working on examining the sampling differences between the "TqJoint" and "Standard" group using MERRA data.

climate model evaluation↗
NASA NTRS1992

ICE/ISEE plasma wave data analysis

The interval reported on, from Jan. 1990 to Dec. 1991, has been one of continued processing and archiving of ICE plasma wave (pw) data and transition from analysis of ISEE 3 and ICE cometary data to ICE data taken along its cruise trajectory, where coronal mass ejections are the focus of attention. We have continued to examine with great interest the last year of ISEE 3's precomet phase, when it spent considerable time far downwind from Earth, recording conditions upstream, downstream, and across the very weak, distant flank bow shock. Among other motivations was the apparent similarity of some shock and post shock structures to the signatures of the bow wave surrounding comet Giacobini-Zinner, whose ICE-phase data was revisited. While pursuing detailed, second-order scientific inquiries still pending from the late ISEE 3 recordings, we have also sought to position ourselves for study of CME's by instituting a data processing format new to the ISEE 3/ICE pw detector. Processed detector output has always been summarized and archived in 24-hour segments, with all pw channels individually plotted and stacked one above the next down in frequency, with each channel calibrated separately to keep all data patterns equally visible in the plots, regardless of gross differences in energy content at the various frequencies. Since CME's, with their preceding and following solar wind plasmas, can take more than one day to pass by the spacecraft, a more condensed synoptic view of the pw data is required to identify, let alone assess, CME characteristics than has been afforded by the traditional routines. This requirement is addressed in a major new processing initiative in the past two years. Besides our own ongoing and fresh investigations, we have cooperated, within our resources, with studies conducted extramurally by distant colleagues irrespective of the phase of the ISEE 3/ICE mission under scrutiny. The remainder of this report summarizes our processing activities, our investigations, both internal and cooperative, our scientific results, and our publication activity.

Greenstadt, E. W.↗
NASA NTRS2018

Improving AIRS NRT Imagery for the Enhancement of Visualization Services in LANCE

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been the home of processing, archiving, and distribution services for data from the Atmospheric Infrared Sounder (AIRS) mission since its launch in 2002. AIRS provides data enabling global observations of the atmospheric state. The GES DISC provides service to both AIRS standard products and Near Real-time (NRT) products. The AIRS NRT product is one important element in the Land, Atmosphere Near real-time Capability for EOS (LANCE). The LANCE processing of the AIRS NRT product and the generation of the imagery are performed at the GES DISC. The AIRS NRT imagery are generated by mosaicking and mapping the available AIRS 6-minute retrieval granules to a global cylindrical projection. The images are constantly refreshed when new granules are produced. The AIRS NRT Viewer and LANCE Worldview provide visualization services to online users for AIRS NRT imagery. The imagery include atmospheric temperature, humidity, precipitation, Dust Score, CO, and SO2. The AIRS Applications Development Team at NASA JPL developed a new orbit-based algorithm and software to improve the AIRS NRT imagery. The GES DISC is collaborating with the AIRS Applications Development Team for the implementation of the new algorithm and software. The improvements include image quality, new color palettes, and variable changes. In this presentation, we will detail the improvements and demonstrate visualization of the new imagery.

Ding, Feng↗
NASA NTRS1981

State involvement in and use of LANDSAT technology

The background of state involvement in LANDSAT systems planning and the status of state LANDSAT use are reviewed. Major recommendations on data continuity; frequency and pattern of observation; state representation in program management; pointable sensors for a fully operational system; data processing systems; data pricing; data copyright; data archival; and technology transfer are highlighted. Plans of the government regarding the LANDSAT system are reflected in the FY-1982 budget process are examined.

Tessar, P. A.↗
NASA NTRS2004

Probing the Physics of Active Galactic Nuclei

As a result of a number of large multiwavelength monitoring campaigns that have taken place since the late 1980s, there are now several very large data sets on bright variable active galactic nuclei (AGNs) that are well-sampled in time and can be used to probe the physics of the AGN continuum source and the broad-line emitting region. Most of these data sets have been underutilized, as the emphasis thus far has been primarily on reverberation-mapping issues alone. Broader attempts at analysis have been made on some of the earlier IUE data sets (e.g., data from the 1989 campaign on NGC5 548) , but much of this analysis needs to be revisited now that improved versions of the data are now available from final archive processing. We propose to use the multiwavelength monitoring data that have been accumulated to undertake more thorough investigations of the AGN continuum and broad emission lines, including a more detailed study of line-profile variability, making use of constraints imposed by the reverberation results.

Peterson, Bradley M.↗
NASA NTRS2019

Monitoring Volcanic Eruptions by OMI/OMPS, ASTER, and MERRA-2

Volcanic lava flows and/or the gas eruptions are the most common characteristics that can be remotely monitored with satellite technology in the global perspective and on different timescales. Atmospheric Sulfur Dioxide (SO2), one of the most abundant gases from volcanic eruptions apart from atmospheric common gases Carbon Dioxide and water vapor, can be directly detected by space-based sensors on satellites. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of the 12 Distributed Active Archive Centers (DAACs) within NASA's Earth Observing System Data and Information System (EOSDIS), which archives SO2 data sets from the Nimbus-7 Total Ozone Mapping Spectrometer (TOMS) in 1978, till the ongoing Ozone Monitoring Instrument (OMI) on NASA's EOS-Aura satellite, the Ozone Mapping Profiler Suite (OMPS) Nadir Mapper (NM) on both the Suomi National Polar-Orbiting Partnership (Suomi-NPP or SNPP) and the Joint Polar-orbiting Satellite System-1 (JPSS-1) satellites, into the future JPSS missions. In addition to the standard OMI/Aura and OMPS/S-NPP SO2 products, SO2 products created under the charter of the Making Earth System Data Records for Use in Research Environments (MEaSUREs) project, are also archived at GES DISC, through which NASA enacts to expand understanding the Earth system using consistent data records. The Land Processes Distributed Active Archive Center (LP DAAC) is another EOSDIS's DAAC that provides land data products and operates as a partnership with the U.S. Geological Survey (USGS). The LP DAAC has been archiving the satellite imagery from the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) aboard NASA's EOS-Terra satellite, a high spatial resolution (15 meters) and 14 band multispectral instrument. The ASTER imagery is one of the land products contributing to the application for monitoring hot spots and land terrain changes caused by volcanic eruption events. The data potential in GES DISC and LP DAAC to monitor volcanic sources of SO2 and the influence of wind fields on the gas plume spread will be demonstrated with the most recent 2018 May-July Kilauea Volcano eruption.

Zeng, Jian↗
NASA NTRS1990

Mission to Planet Earth

The rationale behind Mission to Planet Earth is presented, and the program plan is described in detail. NASA and its interagency and international partners will place satellites carrying advanced sensors in strategic earth orbits to collect muultidisciplinary data. A sophisticated data system will process and archive an unprecedented large amount of information about the earth and how it functions as a system. Attention is given to the space observatories, the data and information systems, and the interdisciplinary research.

Wilson, Gregory S.↗
NASA NTRS2019

Microphone Phased Array NetCDF/HDF5 Archival Files: Application Program Interface Reference

An application program interface (API) has been developed for the creation and access of structured data files generated by microphone phased arrays utilized in aeroacoustics research. Two structured binary file formats are supported, namely NetCDF (Network Common Data Form) and HDF5 (Hierarchical Data Format) files. The API consists of a library of routines callable from C, Fortran or Matlab, with native versions of the API provided for each language. The libraries are divided into categories for file handling, file definition and initialization, data writing, data recovery, and error handling. The API is intended to provide a mechanism for generating self-describing binary files for long-term archiving of raw and processed data generated by phased array systems.

Humphreys, William M., Jr.↗
NASA NTRS2014

NASA Plan for Increasing Access to the Results of Scientific Research

This plan is issued in response to the Executive Office of the President's February 22, 2013, Office of Science and Technology Policy (OSTP) Memorandum for the Heads of Executive Departments and Agencies, "Increasing Access to the Results of Federally Funded Scientific Research." Through this memorandum, OSTP directed all agencies with more than $100 million in annual research and development expenditures to prepare a plan for improving the public's access to the results of federally funded research. The National Aeronautics and Space Administration (NASA) invests on the order of $3 billion annually in fundamental and applied research and technology development1 across a broad range of topics, including space and Earth sciences, life and physical sciences, human health, aeronautics, and technology. Promoting the full and open sharing of data with research communities, private industry, academia, and the general public is one of NASA's longstanding core values. For example, NASA's space and suborbital mission personnel routinely process, archive, and distribute their data to researchers around the globe. This plan expands the breadth of NASA's open-access culture to include data and publications for all of the scientific research that the Agency sponsors.

Source record↗
NASA NTRS1996

Durable High-Density Data Storage

The focus ion beam (FIB) micromilling process for data storage provides a new non-magnetic storage method for archiving large amounts of data. The process stores data on robust materials such as steel, silicon, and gold coated silicon. The storage process was developed to provide a method to insure the long term storage life of data. We estimate that the useful life of data written on silicon or gold-coated silicon to be on the order of a few thousand years without the need to rewrite the data every few years. The process uses an ion beam to carve material from the surface, much like stone cutters in ancient civilizations removed material from stone. The deeper the information is carved into the media, the longer the expected life of the information. The process can record information in three formats: (1) binary at densities of 23 Gbits/square inch, (2) alphanumeric at optical or non-optical density, and (3) graphical at optical and non-optical density. The formats can be mixed on the same media; and thus, it is possible to record, in a human-viewable format, instructions that can be read using an optical microscope. These instructions provide guidance on reading the remaining higher density information.

Lamartine, Bruce C.↗
NASA NTRSDate not supplied

Use NASA Earthdata in the Cloud

With the impending arrival of new, high-data-volume Earth observation missions, NASA’s ability to effectively ingest, process, and archive large amounts of data requires the most cost-effective, flexible, and scalable data-management architectures and technologies. To meet these demands, NASA's Earth Science Data Systems (ESDS) Program is implementing a strategic vision to develop and operate multiple components of NASA's Earth Observing System Data and Information System (EOSDIS) in a commercial cloud environment. As more earth observing data is moved into the cloud, NASA EOSDIS wants to share our reasoning for moving data into the commercial cloud, as well as demonstrate how end-users can take advantage of both data in the cloud and cloud-deployed services. This presentation explains the enterprise reasons for moving data into the cloud, specifically the scalability of cloud systems, the flexibility to pivot to the most optimal language/system/architecture, and the reduced redundancy of a common architecture. Then we primarily focus on the user-driven reasons for moving to the cloud. Equal access to high performance computing helps all parties, especially users that don't have access to their own on-premise computing infrastructure. Rapid deployment allows users to spin up their own systems without needing the extensive platform previously required for large scale development. Cost effectiveness allows users a wide breadth of computing options, from super computer ability to small scale development, which can help underserved communities. Finally we link to internal resources that users can utilize to begin their cloud based development journey without having to be an expert in the field.

Nicholas Doty↗
NASA NTRS2006

A-Train Data Depot: Integrating, Visualizing, and Extracting Cloudsat, CALIPSO, MODIS, and AIRS Atmospheric Measurements Along the A-Train Tracks

The succession of US and international Earth observing satellites that follow each other, seconds to minutes apart, across the local afternoon equator crossing is called the ATrain. The A-Train consists of the following satellites, in order of equator crossing: OCO, EOS Aqua, CloudSat, CALIPSO, PARASOL, and EOS Aura. Flying in such formation increases the number of observations, validates observations, and enables coordination between science observations, resulting in a more complete virtual science platform (Kelly, 2000). The goal of this project is to create the first ever A-Train virtual data portal/center, the A-Train Data Depot (ATDD), to process, archive, access, visualize, analyze and correlate distributed atmosphere measurements from various A-Train instruments along A-Train tracks. The ATDD will enable the free movement of remotely located A-Train data so that they are combined to create a consolidated vertical view of the Earth's Atmosphere along the A-Train tracks. Once the infrastructure of the ATDD is in place, it will be easily evolved to serve data from all A-Train data measurements: one stop shopping. The innovative approach of analyzing and visualizing atmospheric profiles along the platforms track (i.e., time) will be accommodated by reusing the GSFC Atmospheric Composition Data and Information Services Center (ACDISC) visualization and analysis tool, GIOVANNI, existing data reduction tools, on-line archiving for fast data access, access to remote data without unnecessary data transfers, and data retrieval by users finding data desirable for further study. Initial measurements utilized include CALIPSO lidar backscatter, CloudSat radar reflectivity, clear air relative humidity, water vapor and temperature from AIRS, and cloud properties and aerosols from both MODIS. This will be foilowed by associated measurements from TVILS, =MI, HIRDLS, sad TES. Given the independent nature of instrumentlplatform development, the ATDD project has been met with many interesting challenges that, once resolved, will provide a much greater understanding of the relative flight dynamics and data co-registration of the suite of A-Train instruments, thus greatly increasing the accuracy of A-Train data analysis. Some of these challenges will be illustrated and discussed. The project's early visualizations and analysis efforts illustrate the importance of managing data so that measurements from various missions can be combined to enhance the understanding of the atmosphere. A-Train data management coordination, as performed here, is extremely significant in facilitating the A-Train science of clouds, precipitation, aerosol and chemistry.

Kempler, Steven↗