Search NASA⌕ Search

SEARCH · Search NASA

Results for “raw data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A land-surface Testbed for EOSDIS

The main objective of the Testbed project was to deliver satellite images via the Internet to scientific and educational users free of charge. The main method of operations was to store satellite images on a low cost tape library system, visually browse the raw satellite data, access the raw data filed, navigate the imagery through 'C' programming and X-Windows interface software, and deliver the finished image to the end user over the Internet by means of file transfer protocol methods. The conclusion is that the distribution of satellite imagery by means of the Internet is feasible, and the archiving of large data sets can be accomplished with low cost storage systems allowing multiple users.

Emery, William↗

Parallel Knowledge Discovery from Large Complex Databases

NASA is focusing on grand challenge problems in Earth and space sciences. Within these areas of science, new instrumentation will be providing scientists with unprecedented amounts of unprocessed data. Our goal is to design and implement a system that takes raw data as input and efficiently discovers interesting concepts that can target areas for further investigation and can be used to compress the data. Our approach will provide an intelligent parallel data analysis system.

Cook, Diane J.↗

Parallel Knowledge Discovery from Large Complex Databases

NASA is focusing on grand challenge problems in Earth and space sciences. Within these areas of science, new instrumentation will be providing scientists with unprecedented amounts of unprocessed data. Our goal is to design and implement a system that takes raw data as input and efficiently discovers interesting concepts that can target areas for further investigation and can be used to compress the data. Our approach will provide an intelligent parallel data analysis system.

Cook, Diane J.↗

The Development of Two Science Investigator-led Processing Systems (SIPS) for NASA's Earth Observation System (EOS)

In 2001, NASA Goddard Space Flight Center's Laboratory for Terrestrial Physics started the construction of a science Investigator-led Processing System (SIPS) for processing data from the Ozone Monitoring Instrument (OMI) which will launch on the Aura platform in mid 2004. The Ozone Monitoring Instrument (OMI) is a contribution of the Netherlands Agency for Aerospace Programs (NIVR) in collaboration with the Finnish Meteorological Institute (FMI) to the Earth Observing System (EOS) Aura mission. It will continue the Total Ozone Monitoring System (TOMS) record for total ozone and other atmospheric parameters related to ozone chemistry and climate. OMI measurements will be highly synergistic with the other instruments on the EOS Aura platform. The LTP previously developed the Moderate Resolution Imaging Spectrometer (MODIS) Data Processing System (MODAPS), which has been in full operations since the launches of the Terra and Aqua spacecrafts in December, 1999 and May, 2002 respectively. During that time, it has continually evolved to better support the needs of the MODIS team. We now run multiple instances of the system managing faster than real time reprocessings of the data as well as continuing forward processing. The new OMI Data Processing System (OMIDAPS) was adapted from the MODAPS. It will ingest raw data from the satellite ground station and process it to produce calibrated, geolocated higher level data products. These data products will be transmitted to the Goddard Distributed Active Archive Center (GDAAC) instance of the Earth Observing System (EOS) Data and Information System (EOSDIS) for long term archive and distribution to the public. The OMIDAPS will also provide data distribution to the OMI Science Team for quality assessment, algorithm improvement, calibration, etc. We have taken advantage of lessons learned from the MODIS experience and software already developed for MODIS. We made some changes in the hardware system organization, database and software to adapt the system for OMI. We replaced the fundamental database system, Sybase, with an Open Source RDBMS called PostgreSQL, and based the entire OMIDAPS on a cluster of Linux based commodity computers rather than the large SGI servers that MODAPS uses. Rather than relying on a central I/O server host, the new system distributes its data archive among multiple server hosts in the cluster. OMI is also customizing the graphical user interfaces and reporting structure to more closely meet the needs of the OMI Science Team. Prior to 2003, simulated OMI data and the science algorithms were not ready for production testing. We initially constructed a prototype system and tested using a 25 year dataset of Total Ozone Mapping Spectrometer (TOMS) and Solar Backscatter Ultraviolet Instrument (SBUV) data. This prototype system provided a platform to support the adaptation of the algorithms for OMI, and provided reprocessing of the historical data aiding in its analysis. In a recent reanalysis of the TOMS data, the OMIDAPS processed 108,000 full orbits of data through 4 processing steps per orbit, producing about 800,000 files (400 GiB) of level 2 and greater data files. More recently we have installed two instances of the OMIDAPS for integration and testing of OM1 science processes as they get delivered from the Science Team. A Test instance of the OMIDAPS has also supported a series of "Interface Confidence Tests" (ICTs) and End-to-End Ground System tests to ensure the launch readiness of the system. This paper will discuss the high-level hardware, software, and database organization of the OMIDAPS and how it builds on the MODAPS heritage system. It will also provide an overview of the testing and implementation of the production OMIDAPS.

Tilmes, Curt↗

Modified polar format algorithm for processing spaceborne SAR data

This paper describes a modified polar format algorithm for SAR image-formation processing. the algorithm focuses raw data assuming a spherical reference surface (ground surface), and, unlike standard polar format algorithms, it assumes spherical rather than planar signal wavefronts.

polar format processing↗

A computer-controlled, on-board data acquisition system for wind-tunnel testing

A computer-controlled data acquisition system has been developed for the 40x80-foot wind tunnel at Ames Research Center. The system, consisting of several small onboard units installed in the model and a data-managing, data-displaying ground station, is capable of sampling up to 256 channels of raw data at a total sample rate of 128,000 samples/sec. Complete signal conditioning is contained within the on-board units. The sampling sequence and channel gain selection is completely random and under total control of the ground station. Outputs include a bar-graph display, digital-to-analog converters, and digital interface to the tunnel's central computer, an SEL 840MP. The system can be run stand-alone or under the control of the SEL 840MP.

Finger, H. J.↗

Technology Developed In Two Space Projects

Two projects examined for their influences on commercial products and future space missions. Three-volume report presents study of technological benefits of two spaceflight projects, Galileo, and Hubble space telescope. Study focused on equipment and computer programs developed between initial approval of projects and integration and testing of the systems. Volume 1 presents overview of study, discusses methods of collection and evaluation of data, and offers conclusion and recommendations. Volume 2 describes interview process and summarizes raw data. Volume 3 contains technology-assessment sheets for developments.

Joseph, Carlton H.↗

Lightning observations from space shuttle

The experimental program of the Earth Sciences and Applications Division at NASA/MSFC includes development of the Lightning Imaging Sensor (LIS) for the NOAA Earth Observing System (EOS) Polar Platform. The research plan is to use existing lightning information to generate simulated data for the LIS experiment. Navigation algorithms were used to transform pixel locations to latitude and longitude values. The simulated data would then be used to test and develop algorithms for the analysis of LIS data. Individual frames of video imagery obtained from Space Shuttle Missions provide the raw data for the simulation. Individual video frames were digitized to get the pixel locations of lightning flashes. The pixel locations will be used to locate the geographical position of the event. Because of a lack of detailed knowledge of camera orientation with respect to the Space Shuttle, video scenes that contain identifiable city lights were chosen for analysis. A method for locating the payload bay camera axis was developed and tested. Two measurements are needed: the pixel location of the apparent horizon and a timed siting of a known location passing the principal line of the image. Individual video frames were navigated and lightning illuminated clouds were located on the map. Satisfactory agreement in location was achieved for cities and LLP lightning locations. Ground truth measurements were compared to satellite observations. A vertical lightning event was identified on the horizon. Very low frequency (VLF) transmission on this particular occassion shows a strong response to negative cloud to cloud flashes.

Boeck, William L.↗

Smartfiles: An OO approach to data file interoperability

Data files for scientific and engineering codes typically consist of a series of raw data values whose descriptions are buried in the programs that interact with these files. In this situation, making even minor changes in the file structure or sharing files between programs (interoperability) can only be done after careful examination of the data file and the I/O statement of the programs interacting with this file. In short, scientific data files lack self-description, and other self-describing data techniques are not always appropriate or useful for scientific data files. By applying an object-oriented methodology to data files, we can add the intelligence required to improve data interoperability and provide an elegant mechanism for supporting complex, evolving, or multidisciplinary applications, while still supporting legacy codes. As a result, scientists and engineers should be able to share datasets with far greater ease, simplifying multidisciplinary applications and greatly facilitating remote collaboration between scientists.

Haines, Matthew↗

Moving Away from Ones and Zeros, Designing a Ground Data System Based on Higher Levels of Abstraction

Previous JPL ground systems have been designed with the Ground Data System (GDS) engineer in mind. The focus on these systems has been on packaging and delivery of low level information (frames, packets, telemetry values) to the end user. It was not that long ago when project teams would be huddled over a workstation, examining crude displays of telemetry bits organized in various ways, trying to determine the status of a spacecraft. Understanding the data often required additional levels of GDS expertise, or worse, transformation of the raw data into alternative formats followed by ingestion into other tools so that the data became meaningful. The primary focus was often to answer these types of questions: "Why did this particular frame fail Reed-Solomon decode? Why did this packet get marked as invalid? Why am I missing a block of telemetry from my query?" -- which are completely valid questions to ask from a GDS Engineer's point of view, and large families of tools have been designed to help answer these questions. But these are not the questions that most users care about - which are more like: "Why is the battery state of charge trending down? Show me a summary image report for the last traverse to the target. Show me a data accountability summary for the last DSN pass." Answers to these questions, which are what users are looking for, requires a higher level of abstraction and supporting tools than mining through ones and zeros. JPL has created a next generation capability called the Mission Data Processing and Control System (MPCS) which is designed to support this higher level of abstraction by providing customizable views of the ground system combining collections of lower level information into more meaningful ways. Instead of examining frames, packets, and individual telemetry data points -- MPCS is capable of providing comprehensive summary reports, product status, overall flight/ground event status, as well as payload health summaries. Based on these higher level views, end users can make tactical or strategic decisions, or drop into detailed analysis as needed. System designers need to continue building systems that support low level GDS troubleshooting - but the basic design of a GDS should be geared towards what end users actually need to see. This paper will describe the capabilities of MPCS that directly support these higher levels of abstraction, and which are being used today in missions such as the Mars Science Laboratory and other NASA missions.

MPCS↗

Online Rapid Analysis of Laser Heterodyne Radiometer (LHR) Data Using the Planetary Spectrum Generator (PSG)

One of the biggest challenges in developing scientific instruments is not just the build and testing of an instrument, but the method for processing the data and producing a consistent, well characterized data product that can be confidently used by the public and scientific community. Raw data products are frequently an array of numbers that are a read-out of voltages. The challenge is to convert these arrays into meaningful information as well as remove noise and interferences. Because this can be a tedious and time-consuming, the goal is to automate the process so that data ca be processed rapidly and be available in real-time for event monitoring. Here we present a rapid analysis method for Laser Heterodyne Radiometer (LHR) data that can be used to analyze data taken from a range of LHR observation modes (column, limb, etc.). This online tool uses the versatile Planetary Spectrum Generator (PSG) and allows LHR users to quickly analyze their own data using a NASA Goddard Space Flight Center (GSFC) monitored capability to ensure quality and reproducibility in the data products. Background: Development of a miniaturized LHR (mini-LHR) as a ground instrument for measuring carbon dioxide (CO 2 ) and methane (CH 4 ) in the atmospheric column started in 2009 with the commercial availability of distributive feedback lasers (DFB) in wavelengths that could measure absorption of gases in the near-IR. As new DFB lasers, detectors and hardware emerged at different wavelengths, additional gases were added to the capability. The mini-LHR was adapted into an occultation-viewing CubeSat with Lawrence Livermore National Laboratory (LLNL) for observing CO 2 , CH 4 , and H 2 O in the limb and was launched in 2019. Other versions of the LHR technology have been designed for observation of water vapor in the lunar exosphere as well as observations of trace gases in planetary atmospheres and plumes from icy moons. The PSG is an online tool developed at GSFC that can be used for synthesizing Earth and planetary spectra (atmospheres and surfaces) over a broad range of wavelengths (0.1 μm to 100 mm) for any observatory, orbiter or lander. Spectra are simulated by combining several state-of-the-art radiative transfer models, spectroscopic databases, planetary databases, as well as modern-era retrospective analysis for research and applications, version 2 (MERRA-2) data set which provides meteorological inputs such as modeled surface pressure for calculating dry-air columns.

Emily Wilson↗

Digital slope-threshold data compressor

Slope-threshold compression scheme for telemetered video data is efficient, and its principle of operation is as follows: when slope of raw data exceeds threshold decision reference, previous sample is transmitted. All-digital design is more economical than analog system. It exhibits well-defined accuracy, provides unlimited storage time, and is convenient and reliable.

Anderson, T. O.↗

Scan Angle and Detector Effects in Thematic Mapper Radiometry

The effects of scan angle and interdetector differences on thematic mapper radiometry were analyzed. The data set used for this study consisted of computer compatible tapes (CCT's) of raw data (CCT-BT), radiometrically corrected data (CCT-AT), and geometrically corrected data (CCT-PT) for two scenes, 40049-16262 (north central Iowa) and 40037-16031 (Arkansas). Radiometric corrections currently performed were found to improve overall consistency of data, but some residual stripping remains in the corrected data due to the quantization of signal values and other effects. A new type of banding was discovered which is related to the bi-directional scanning of TM. An initial empirical model was developed for correcting this effect in band 1, but should receive additional development. The scan angle effects observed corresponded to those expected based on atmospheric considerations and scene characteristics. Low frequency scan-to-scan noise was detected in band 1, band 7, and to a lesser extent in bands 2 and 3. The band 1 detectors which exhibited this noise showed strong correlation in their variation.

Metzler, M. D.↗

Large scale topography of Io

To investigate the large scale topography of the Jovian satellite Io, both limb observations and stereographic techniques applied to landmarks are used. The raw data for this study consists of Voyager 1 images of Io, 800x800 arrays of picture elements each of which can take on 256 possible brightness values. In analyzing this data it was necessary to identify and locate landmarks and limb points on the raw images, remove the image distortions caused by the camera electronics and translate the corrected locations into positions relative to a reference geoid. Minimizing the uncertainty in the corrected locations is crucial to the success of this project. In the highest resolution frames, an error of a tenth of a pixel in image space location can lead to a 300 m error in true location. In the lowest resolution frames, the same error can lead to an uncertainty of several km.

Gaskell, R. W.↗

A computer code to process and plot laser altimetry data interactively on a microcomputer

A computer program, written in FORTRAN, is described which uses a microcomputer to interactively process and plot laser altimetry data taken with a laser altimeter currently under development at the Goddard Space Flight Center. The program uses a plot routine written for a particular microcomputer, so that the program could only be implemented on a different computer by replacing the plot routine. The altimetry data are taken from an aircraft flying over mountainous terrain. The program unpacks the raw data, processes it into along-track distance and ground height and creates plots of the terrain profile. A zoom capability is provided to expand the plot to show greater detail, along either axis, and provision is made to interactively edit out spurious data points.

Safren, H. G.↗

A simple low-cost array on the lunar near-side for the early lunar expeditions

A concept of a simple, low-cost array on the lunar near-side is discussed. The concept includes 19 stations laid in a T, with three arms each 36 km long, and separated by 6 km. Each station consists of two 10-m-long orthogonal dipoles, each feeding a receiver of a commercial pocket digital shortwave radio type, and a 3-m spring-loaded mast with a small UHF array at the top for receiving the timing signals and tuning commmands and for sending out the digitized data streams. Each station has 0.25 square meters of solar arrays and 20 kg of lithium batteries. At the array center there is either a digital correlator for processing the signals from each antenna pair to compact the data into a 32-kb/sec channel or a 10-cm telescope for sending back raw data to earth.

Kuiper, T. B. H.↗

Explosive component acceptance tester using laser interferometer technology

Acceptance testing of explosive components requires a reliable and simple to use testing method that can discern less than optimal performance. For hot-wire detonators, traditional techniques use dent blocks or photographic diagnostic methods. More complicated approaches are avoided because of their inherent problems with setup and maintenance. A recently developed tester is based on using a laser interferometer to measure the velocity of flying plates accelerated by explosively actuated detonators. Unlike ordinary interferometers that monitor displacement of the test article, this device measures velocity directly and is commonly used with non-spectral surfaces. Most often referred to as the VISAR technique (Velocity Interferometer System for Any Reflecting Surface), it has become the most widely-accepted choice for accurate measurement of velocity in the range greater than 1 mm/micro-s. Traditional VISAR devices require extensive setup and adjustment and therefore are unacceptable in a production-testing environment. This paper describes a new VISAR approach which requires virtually no adjustments, yet provides data with accuracy comparable to the more complicated systems. The device, termed the Fixed-Cavity VISAR, is currently being developed to serve as a product verification tool for hot-wire detonators and slappers. An extensive data acquisition and analysis computer code was also created to automate the manipulation of raw data into final results.

Wickstrom, Richard D.↗