Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing and archiving”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Healthwatch-2 System Overview

Healthwatch-2 (HW-2) is a research tool designed to facilitate the development and testing of in-flight health monitoring algorithms. HW-2 software is written in C/C++ and executes on an x86-based computer running the Linux operating system. The executive module has interfaces for collecting various signal data, such as vibration, torque, tachometer, and GPS. It is designed to perform in-flight time or frequency averaging based on specifications defined in a user-supplied configuration file. Averaged data are then passed to a user-supplied algorithm written as a Matlab function. This allows researchers a convenient method for testing in-flight algorithms. In addition to its in-flight capabilities, HW-2 software is also capable of reading archived flight data and processing it as if collected in-flight. This allows algorithms to be developed and tested in the laboratory before being flown. Currently HW-2 has passed its checkout phase and is collecting data on a Bell OH-58C helicopter operated by the U.S. Army at NASA Ames Research Center.

Barszcz, Eric↗

"XMM/RXTE Observations of GX 339-4"

In March 2003, we performed two simultaneous XMM/RXTE observations of the black hole candidate GX 339-4. Our goal is to compare these data to our prior simultaneous RXTE/ASCA observations (Nowak, Wilms & Dove, 2002). These observations were carried out in timing mode, as opposed to burst mode, and are more complex to analyze than we expected. Specifically, the data suffered from a number of telemetry dropouts (in fact, the standard archive processing failed on these data, and more than a year passed from the time of the observations before the data was delivered to us). Furthermore, the core of the EPIC PSF suffers slightly from pileup and gain shifts. We continue to work on this data, however, and anticipate publishing it within the next academic year. Here we highlight our ongoing work and outline our plans for publication.

Nowak, M. A.↗

High-Resolution UV/Optical/IR Imaging of Jupiter in 2016–2019

Imaging observations of Jupiter with high spatial resolution were acquired beginning in 2016, with a cadence of 53 days to coincide with atmospheric observations of the Juno spacecraft during each perijove pass. The Wide Field Camera 3 (WFC3) aboard the Hubble Space Telescope (HST) collected Jupiter images from 236 to 925 nm in 14 filters. The Near-Infrared Imager (NIRI) at Gemini North imaged Jovian thermal emission using a lucky-imaging approach (co-adding the sharpest frames taken from a sequence of short exposures), using the M' filter at 4.7 μm. We discuss the data acquisition and processing and an archive collection that contains the processed WFC3 and NIRI data (doi:10.17909/T94T1H). Zonal winds remain steady over time at most latitudes, but significant evolution of the wind profile near 24°N in 2016 and near 15°S in 2017 was linked with convective superstorm eruptions. Persistent mesoscale waves were seen throughout the 2016–2019 period. We link groups of lightning flashes observed by the Juno team with water clouds in a large convective plume near 15°S and in cyclones near 35°N–55°N. Thermal infrared maps at the 10.8 micron wavelength obtained at the Very Large Telescope show consistent high brightness temperature anomalies, despite a diversity of aerosol properties seen in the HST data. Both WFC3 and NIRI imaging reveal depleted aerosols consistent with downwelling around the periphery of the 15°S storm, which was also observed by the Atacama Large Millimeter/submillimeter Array. NIRI imaging of the Great Red Spot shows that locally reduced cloud opacity is responsible for dark features within the vortex. The HST data maps multiple concentric polar hoods of high-latitude hazes.

Michael H. Wong↗

Earth observation archive activities at DRA Farnborough

Space Sector, Defence Research Agency (DRA), Farnborough have been actively involved in the acquisition and processing of Earth Observation data for over 15 years. During that time an archive of over 20,000 items has been built up. This paper describes the major archive activities, including: operation and maintenance of the main DRA Archive, the development of a prototype Optical Disc Archive System (ODAS), the catalog systems in use at DRA, the UK Processing and Archive Facility for ERS-1 data, and future plans for archiving activities.

Palmer, M. D.↗

NLSI Focus Group on Recovery of Missing ALSEP Data: Status Update for 2012 NLSI Science Forum

On the six Apollo lunar landed missions, the Astronauts deployed the Apollo Lunar Surface Experiments Package (ALSEP) science stations which measured active and passive seismic events, magnetic fields, charged particles, solar wind, heat flow, the diffuse atmosphere, meteorites and their ejecta, lunar dust, etc. Today s investigators are able to extract new information and make new discoveries from the old ALSEP data utilizing recent advances in computer capabilities and new analysis techniques. However, current-day investigators are encountering problems in trying to use the ALSEP data. The data were in formats often not well described in the published reports and contained rerecording anomalies which required tape experts to resolve. To solve these problems the DPS Lunar Data Node was established at NASA Goddard Space Flight Center (GSFC) NASA Space Science Data Center (NSSDC) in 2008 and is currently in the process of making the existing archived ALSEP data available to current-day investigators in easily useable forms. However, current estimates by NSSDC archivists are that only about 60 percent of the PI processed ALSEP data and less than 30 percent of the raw experiment ALSEP data-of-interest to current lunar science investigators are currently in the NSSDC archives.

Lewis, Lyach R.↗

Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems

NASA's Earth Observing System (EOS) is a coordinated series of satellites for long term global observations. NASA's Earth Observing System Data and Information System (EOSDIS) is a multi-petabyte-scale archive of environmental data that supports global climate change research by providing end-to-end services from EOS instrument data collection to science data processing to full access to EOS and other earth science data. On a daily basis, the EOSDIS ingests, processes, archives and distributes over 3 terabytes of data from NASA's Earth Science missions representing over 6000 data products ranging from various types of science disciplines. EOSDIS has continually evolved to improve the discoverability, accessibility, and usability of high-impact NASA data spanning the multi-petabyte-scale archive of Earth science data products. Reviewed and approved by Chris Lynnes.

Cumulus↗

Characterizing the LANDSAT Global Long-Term Data Record

The effects of global climate change are fast becoming politically, sociologically, and personally important: increasing storm frequency and intensity, lengthening cycles of drought and flood, expanding desertification and soil salinization. A vital asset in the analysis of climate change on a global basis is the 34-year record of Landsat imagery. In recognition of its increasing importance, a detailed analysis of the Landsat observation coverage within the US archive was commissioned. Results to date indicate some unexpected gaps in the US-held archive. Fortunately, throughout the Landsat program, data have been downlinked routinely to International Cooperator (IC) ground stations for archival, processing, and distribution. These IC data could be combined with the current US holdings to build a nearly global, annual observation record over this 34-year period. Today, we have inadequate information as to which scenes are available from which IC archives. Our best estimate is that there are over four million digital scenes in the IC archives, compared with the nearly two million scenes held in the US archive. This vast pool of Landsat observations needs to be accurately documented, via metadata, to determine the existence of complementary scenes and to characterize the potential scope of the global Landsat observation record. Of course, knowing the extent and completeness of the data record is but the first step. It will be necessary to assure that the data record is easy to use, internally consistent in terms of calibration and data format, and fully accessible in order to fully realize its potential.

Arvidson, T.↗

Satellite Analysis of Ocean Biogeochemistry and Mesoscale Variability in the Sargasso Sea

The objective of this study was to analyze the impact of spatial variability on the time-series of biogeochemical measurements made at the U.S. JGOFS Bermuda Atlantic Time-series Study (BATS) site. Originally the study was planned to use SeaWiFS as well as AVHRR high-resolution data. Despite the SeaWiFS delays we were able to make progress on the following fronts: (1) Operational acquisition, processing, and archive of HRPT data from a ground station located in Bermuda; (2) Validation of AVHRR SST data using BATS time-series and spatial validation cruise CTD data; (3) Use of AVHRR sea surface temperature imagery and ancillary data to assess the impact of mesoscale spatial variability on P(CO2) and carbon flux in the Sargasso Sea; (4) Spatial and temporal extent of tropical cyclone induced surface modifications; and (5) Assessment of eddy variability using TOPEX/Poseidon data.

Siegel, D. A.↗

Temperature and Humidity Profiles in the TqJoint Data Group of AIRS Version 6 Product for the Climate Model Evaluation

The Atmospheric Infrared Sounder (AIRS) mission is entering its 13th year of global observations of the atmospheric state, including temperature and humidity profiles, outgoing long-wave radiation, cloud properties, and trace gases. Thus AIRS data have been widely used, among other things, for short-term climate research and observational component for model evaluation. One instance is the fifth phase of the Coupled Model Intercomparison Project (CMIP5) which uses AIRS version 5 data in the climate model evaluation. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the home of processing, archiving, and distribution services for data from the AIRS mission. The GES DISC, in collaboration with the AIRS Project, released data from the version 6 algorithm in early 2013. The new algorithm represents a significant improvement over previous versions in terms of greater stability, yield, and quality of products. The ongoing Earth System Grid for next generation climate model research project, a collaborative effort of GES DISC and NASA JPL, will bring temperature and humidity profiles from AIRS version 6. The AIRS version 6 product adds a new "TqJoint" data group, which contains data for a common set of observations across water vapor and temperature at all atmospheric levels and is suitable for climate process studies. How different may the monthly temperature and humidity profiles in "TqJoint" group be from the "Standard" group where temperature and water vapor are not always valid at the same time? This study aims to answer the question by comprehensively comparing the temperature and humidity profiles from the "TqJoint" group and the "Standard" group. The comparison includes mean differences at different levels globally and over land and ocean. We are also working on examining the sampling differences between the "TqJoint" and "Standard" group using MERRA data.

climate model evaluation↗

ICE/ISEE plasma wave data analysis

The interval reported on, from Jan. 1990 to Dec. 1991, has been one of continued processing and archiving of ICE plasma wave (pw) data and transition from analysis of ISEE 3 and ICE cometary data to ICE data taken along its cruise trajectory, where coronal mass ejections are the focus of attention. We have continued to examine with great interest the last year of ISEE 3's precomet phase, when it spent considerable time far downwind from Earth, recording conditions upstream, downstream, and across the very weak, distant flank bow shock. Among other motivations was the apparent similarity of some shock and post shock structures to the signatures of the bow wave surrounding comet Giacobini-Zinner, whose ICE-phase data was revisited. While pursuing detailed, second-order scientific inquiries still pending from the late ISEE 3 recordings, we have also sought to position ourselves for study of CME's by instituting a data processing format new to the ISEE 3/ICE pw detector. Processed detector output has always been summarized and archived in 24-hour segments, with all pw channels individually plotted and stacked one above the next down in frequency, with each channel calibrated separately to keep all data patterns equally visible in the plots, regardless of gross differences in energy content at the various frequencies. Since CME's, with their preceding and following solar wind plasmas, can take more than one day to pass by the spacecraft, a more condensed synoptic view of the pw data is required to identify, let alone assess, CME characteristics than has been afforded by the traditional routines. This requirement is addressed in a major new processing initiative in the past two years. Besides our own ongoing and fresh investigations, we have cooperated, within our resources, with studies conducted extramurally by distant colleagues irrespective of the phase of the ISEE 3/ICE mission under scrutiny. The remainder of this report summarizes our processing activities, our investigations, both internal and cooperative, our scientific results, and our publication activity.

Greenstadt, E. W.↗

Improving AIRS NRT Imagery for the Enhancement of Visualization Services in LANCE

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been the home of processing, archiving, and distribution services for data from the Atmospheric Infrared Sounder (AIRS) mission since its launch in 2002. AIRS provides data enabling global observations of the atmospheric state. The GES DISC provides service to both AIRS standard products and Near Real-time (NRT) products. The AIRS NRT product is one important element in the Land, Atmosphere Near real-time Capability for EOS (LANCE). The LANCE processing of the AIRS NRT product and the generation of the imagery are performed at the GES DISC. The AIRS NRT imagery are generated by mosaicking and mapping the available AIRS 6-minute retrieval granules to a global cylindrical projection. The images are constantly refreshed when new granules are produced. The AIRS NRT Viewer and LANCE Worldview provide visualization services to online users for AIRS NRT imagery. The imagery include atmospheric temperature, humidity, precipitation, Dust Score, CO, and SO2. The AIRS Applications Development Team at NASA JPL developed a new orbit-based algorithm and software to improve the AIRS NRT imagery. The GES DISC is collaborating with the AIRS Applications Development Team for the implementation of the new algorithm and software. The improvements include image quality, new color palettes, and variable changes. In this presentation, we will detail the improvements and demonstrate visualization of the new imagery.

Ding, Feng↗

State involvement in and use of LANDSAT technology

The background of state involvement in LANDSAT systems planning and the status of state LANDSAT use are reviewed. Major recommendations on data continuity; frequency and pattern of observation; state representation in program management; pointable sensors for a fully operational system; data processing systems; data pricing; data copyright; data archival; and technology transfer are highlighted. Plans of the government regarding the LANDSAT system are reflected in the FY-1982 budget process are examined.

Tessar, P. A.↗

Probing the Physics of Active Galactic Nuclei

As a result of a number of large multiwavelength monitoring campaigns that have taken place since the late 1980s, there are now several very large data sets on bright variable active galactic nuclei (AGNs) that are well-sampled in time and can be used to probe the physics of the AGN continuum source and the broad-line emitting region. Most of these data sets have been underutilized, as the emphasis thus far has been primarily on reverberation-mapping issues alone. Broader attempts at analysis have been made on some of the earlier IUE data sets (e.g., data from the 1989 campaign on NGC5 548) , but much of this analysis needs to be revisited now that improved versions of the data are now available from final archive processing. We propose to use the multiwavelength monitoring data that have been accumulated to undertake more thorough investigations of the AGN continuum and broad emission lines, including a more detailed study of line-profile variability, making use of constraints imposed by the reverberation results.

Peterson, Bradley M.↗

Monitoring Volcanic Eruptions by OMI/OMPS, ASTER, and MERRA-2

Volcanic lava flows and/or the gas eruptions are the most common characteristics that can be remotely monitored with satellite technology in the global perspective and on different timescales. Atmospheric Sulfur Dioxide (SO2), one of the most abundant gases from volcanic eruptions apart from atmospheric common gases Carbon Dioxide and water vapor, can be directly detected by space-based sensors on satellites. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of the 12 Distributed Active Archive Centers (DAACs) within NASA's Earth Observing System Data and Information System (EOSDIS), which archives SO2 data sets from the Nimbus-7 Total Ozone Mapping Spectrometer (TOMS) in 1978, till the ongoing Ozone Monitoring Instrument (OMI) on NASA's EOS-Aura satellite, the Ozone Mapping Profiler Suite (OMPS) Nadir Mapper (NM) on both the Suomi National Polar-Orbiting Partnership (Suomi-NPP or SNPP) and the Joint Polar-orbiting Satellite System-1 (JPSS-1) satellites, into the future JPSS missions. In addition to the standard OMI/Aura and OMPS/S-NPP SO2 products, SO2 products created under the charter of the Making Earth System Data Records for Use in Research Environments (MEaSUREs) project, are also archived at GES DISC, through which NASA enacts to expand understanding the Earth system using consistent data records. The Land Processes Distributed Active Archive Center (LP DAAC) is another EOSDIS's DAAC that provides land data products and operates as a partnership with the U.S. Geological Survey (USGS). The LP DAAC has been archiving the satellite imagery from the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) aboard NASA's EOS-Terra satellite, a high spatial resolution (15 meters) and 14 band multispectral instrument. The ASTER imagery is one of the land products contributing to the application for monitoring hot spots and land terrain changes caused by volcanic eruption events. The data potential in GES DISC and LP DAAC to monitor volcanic sources of SO2 and the influence of wind fields on the gas plume spread will be demonstrated with the most recent 2018 May-July Kilauea Volcano eruption.

Zeng, Jian↗

Mission to Planet Earth

The rationale behind Mission to Planet Earth is presented, and the program plan is described in detail. NASA and its interagency and international partners will place satellites carrying advanced sensors in strategic earth orbits to collect muultidisciplinary data. A sophisticated data system will process and archive an unprecedented large amount of information about the earth and how it functions as a system. Attention is given to the space observatories, the data and information systems, and the interdisciplinary research.

Wilson, Gregory S.↗

Microphone Phased Array NetCDF/HDF5 Archival Files: Application Program Interface Reference

An application program interface (API) has been developed for the creation and access of structured data files generated by microphone phased arrays utilized in aeroacoustics research. Two structured binary file formats are supported, namely NetCDF (Network Common Data Form) and HDF5 (Hierarchical Data Format) files. The API consists of a library of routines callable from C, Fortran or Matlab, with native versions of the API provided for each language. The libraries are divided into categories for file handling, file definition and initialization, data writing, data recovery, and error handling. The API is intended to provide a mechanism for generating self-describing binary files for long-term archiving of raw and processed data generated by phased array systems.

Humphreys, William M., Jr.↗