Search NASA⌕ Search

SEARCH · Search NASA

Results for “Software pipelines”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Analysis and Optimization of Parallel Software Pipeline Performance

Pipelining is a common strategy for extracting parallelism from a collection of independent computational tasks, each of which is spread among a number of processors and has an implied data dependence. When implemented on MIMD parallel computers with finite process interrupt times, pipeline algorithms suffer from slowdown--in addition to the expected pipeline fill time--due to a wave-like propagation of delays. This phenomenon, which has been observed experimentally using the performance monitoring system AIMS, is investigated analytically, and an optimal correction is derived to eliminate the wave. Efficiency increase through the correction is verified experimentally.

VanderWijngaart, Rob F.↗

The Effect of Interrupts on Software Pipeline Execution on Message-Passing Architectures

Pipelining is a common strategy for extracting parallelism from a collection of independent computational tasks, each of which is spread among a number of processors and has an implied data dependence. When implemented on MIMD parallel computers with finite process interrupt times, pipeline algorithms suffer from slowdown--in addition to the expected pipeline fill time--due to a wave-like propagation of delays. This phenomenon, which has been observed experimentally using the performance monitoring system AIMS, is investigated analytically, and an optimal correction is derived to eliminate the wave. Efficiency increase through the correction is verified experimentally.

VanderWijngaart, Rob F.↗

OnAIR: Applications of The NASA On-Board Artificial Intelligence Research Platform

Infusing artificial intelligence algorithms into production aerospace systems can be challenging due to costs, timelines, and a risk averse industry. We introduce the Onboard Artificial Intelligence Research (OnAIR) platform, an open source software pipeline and cognitive architecture tool which enables full life cycle AI research for on-board intelligent systems. We begin a description and user walk-through of the OnAIR tool. Next we describe four use cases of OnAIR for both research and deployed onboard applications, detailing their use of OnAIR and the benefits it provided to development and function of each respective scenario. We conclude with remarks on future work, future planned deployments and goals for forward progression of OnAIR as a tool to enable larger AI and aerospace research community.

Cognitive Architecture↗

Proposed US Contributions to LOFT

Proposed US Enhancements include:Tantalum X -ray collimator, Additional ground station, Large Observatory for X-Ray Timing (LOFT) instrument team participation, US science support center & data archive, and Science enabled by US hardware. High-Z material with excellent stopping power. Fabricated using a combination of laser micromachining and chemical etching. Known technology capable of producing high-aspect ratio holes and large open fractions. Reduces LOFT LAD background by a factor of 3. Telemetry formats for LOFT based upon RXTE/EDS experience. Ground system software and strategies for WFM based upon RXTE/ASM automated pipeline software. MSFC engineering trade studies supporting the Ta collimator. Burst alert triggers based upon Fermi/GBM and HETE-2. Science Enhancements Enabled by US Hardware include: Tantalum collimator: Reduces background by factor of 3. Improves sensitivity to faint sources such as AGN. Eliminates contamination by bright/variable sources. outside the LAD field of view. US Ground Station: Enables continuous telemetry of all events from the WFM. Allows LAD to observe very bright >500 mCrab sources with full event resolution.

Wilson-Hodge, Colleen↗

Description of the TCERT Vetting Reports for Data Release 25

This document, the Kepler Instrument Handbook (KIH), is for Kepler and K2 observers, which includes the Kepler Science Team, Guest Observers (GOs), and astronomers doing archival research on Kepler and K2 data in NASAs Astrophysics Data Analysis Program (ADAP). The KIH provides information about the design, performance, and operational constraints of the Kepler flight hardware and software, and an overview of the pixel data sets available. The KIH is meant to be read with these companion documents:1. Kepler Data Processing Handbook (KSCI-19081) or KDPH (Jenkins et al., 2016). The KDPH describes how pixels downlinked from the spacecraft are converted by the Kepler Data Processing Pipeline (henceforth just the pipeline) into the data products delivered to the MAST archive. 2. Kepler Archive Manual (KDMC-10008) or KAM (Thompson et al., 2016). The KAM describes the format and content of the data products, and how to search for them.3. Kepler Data Characteristics Handbook (KSCI-19040) or KDCH (Christiansen et al., 2016). The KDCH describes recurring non-astrophysical features of the Kepler data due to instrument signatures, spacecraft events, or solar activity, and explains how these characteristics are handled by the pipeline.4. Kepler Data Release Notes 25 (KSCI-19065) or DRN 25 (Thompson et al., 2015). DRN 25 describes signatures and events peculiar to individual quarters, and the pipeline software changes between a data release and the one preceding it.Together, these documents supply the information necessary for obtaining and understanding Kepler results, given the real properties of the hardware and the data analysis methods used, and for an independent evaluation of the methods used if so desired.

Instrument↗

Initial Performance of the Aspect System on the Chandra Observatory: Post-Facto Aspect Reconstruction

The aspect system of the Chandra Observatory plays a key role in realizing the full potential of Chandra's x-ray optics and detectors. To achieve the highest spatial and spectral resolution (for grating observations), an accurate post-facto time history of the spacecraft attitude and internal alignment is needed. The CXC has developed a suite of tools which process sensor data from the aspect camera assembly and gyroscopes, and produce the spacecraft aspect solution. In this poster, the design of the aspect pipeline software is briefly described, followed by details of aspect system performance during the first eight months of flight. The two key metrics of aspect performance are: image reconstruction accuracy, which measures the x-ray image blurring introduced by aspect; and celestial location, which is the accuracy of detected source positions in absolute sky coordinates.

Aldcroft, T.↗

A Comparison of Solar p-Mode Parameters from MDI and Gong: Mode Frequencies and Structure Inversions

Helioseismic analysis of solar global oscillations allows investigation of the internal structure of the Sun. One important test of the reliability of the inferences from helioseismology is that the results from independent sets of contemporaneous data are consistent with one another. Here we compare mode frequencies from the Global Oscillation Network Group and Michelson Doppler Imager on board SOHO and resulting inversion results on the Sun's internal structure. The average relative differences between the data sets are typically less than 1 x 10(exp -5) substantially smaller than the formal errors in the differences; however, in some cases the frequency differences show a systematic behavior that might nonetheless influence the inversion results. We find that the differences in frequencies are not a result of instrumental effects but are almost entirely related to the data pipeline software. Inversion of the frequencies shows that their differences do not result in any significant effects on the resulting inferences on solar structure. We have also experimented with fitting asymmetric profiles to the oscillation power spectra and find that, compared with the symmetric fits, this causes no significant change in the inversion results.

Basu, S.↗

The Nature of the Enigmatic 10-Minute Accreting Binary System ES CET

ES Cet is one of the most compact binary systems known with an orbital period of only 10.3 minutes. Our allocated observations with the XMM-Newton X-ray satellite were performed in January and July 2004, with the data being delivered to the PI in August 2004. Preliminary results were presented by the PI in September 2004 and January 2005. We have also secured supporting optical observations of ES Ceti using the Magellan telescopes (November 2004). The team is currently performing a thorough and final analysis of the X-ray, UV and optical data sets with the latest XMM pipeline software and our own analysis packages.

Steeghs, Daniel↗

Reaching the Diffraction Limit - Differential Speckle and Wide-Field Imaging for the Gemini-N Telescope

Speckle imaging allows telescopes to achieve di raction limited imaging performance. The technique requires cameras capable of reading out frames at a very fast rate, e ectively `freezing out' atmospheric seeing. The resulting speckles can be correlated and images reconstructed that are at the di raction limit of the telescope. These new instruments are based on the successful performance and design of the Di erential Speckle Survey Instrument (DSSI) [2, 1]. The instruments are being built for the Gemini-N and WIYN telescopes and will be made available to the community via the peer review proposal process. We envision their primary use to be validation and characterization of exoplanet targets from the NASA K2 and TESS missions and RV discovered exoplanets. Such targets will provide excellent follow-up candidates for both the WIYN and Gemini telescopes [3]. Examples of DSSI data are shown in the gures below. We expect similar data quality in speckle imaging mode with the new instruments. Additionally, both cameras will have a wide- eld mode and standard SDSS lters. They will be highly versatile instruments and it is that likely many other science programs will request time on the cameras. The limiting magnitude for speckle observations, will remain around 13-14th at WIYN and 16-17th at Gemini, while wide- eld, normal CCD imaging operation should be able to go to much fainter, providing usual CCD imaging and photometric capabilities. The instruments will also have high utility as scoring cameras for telescope engineering purposes, or other applications where high time resolution is needed. Instrument support will be provided, including a software pipeline that takes raw speckle data to fully reconstructed images.

Gemini-N↗

Reaching the Diffraction Limit - Differential Speckle and Wide-Field Imaging for the WIYN Telescope

Speckle imaging allows telescopes to achieve diffraction limited imaging performance. The technique requires cameras capable of reading out frames at a very fast rate, effectively 'freezing out' atmospheric seeing. The resulting speckles can be correlated and images reconstructed that are at the diffraction limit of the telescope. These new instruments are based on the successful performance and design of the Differential Speckle Survey Instrument (DSSI).The instruments are being built for the Gemini-N and WIYN telescopes and will be made available to the community via the peer review proposal process. We envision their primary use to be validation and characterization of exoplanet targets from the NASA, K2 and TESS missions and RV discovered exoplanets. Such targets will provide excellent follow-up candidates for both the WIYN and Gemini telescopes. We expect similar data quality in speckle imaging mode with the new instruments. Additionally, both cameras will have a wide-field mode and standard SDSS filters. They will be highly versatile instruments and it is that likely many other science programs will request time on the cameras. The limiting magnitude for speckle observations will remain around 13-14th at WIYN and 16-17th at Gemini, while wide-field, normal CCD imaging operation should be able to go to much fainter, providing usual CCD imaging and photometric capabilities. The instruments will also have high utility as scoring cameras for telescope engineering purposes, or other applications where high time resolution is needed. Instrument support will be provided, including a software pipeline that takes raw speckle data to fully reconstructed images.

detector↗

Fireballs in the Sky: An Augmented Reality Citizen Science Program

Fireballs in the Sky is an innovative Australian citizen science program that connects the public with the research of the Desert Fireball Network (DFN). This research aims to understand the early workings of the solar system, and Fireballs in the Sky invites people around the world to learn about this science, contributing fireball sightings via a user-friendly augmented reality mobile app. Tens of thousands of people have downloaded the app world-wide and participated in the science of meteoritics. The Fireballs in the Sky app allows users to get involved with the Desert Fireball Network research, supplementing DFN observations and providing enhanced coverage by reporting their own meteor sightings to DFN scientists. Fireballs in the Sky reports are used to track the trajectories of meteors - from their orbit in space to where they might have landed on Earth. Led by Phil Bland at Curtin University in Australia, the Desert Fireball Network (DFN) uses automated observatories across Australia to triangulate trajectories of meteorites entering the atmosphere, determine pre-entry orbits, and pinpoint their fall positions. Each observatory is an autonomous intelligent imaging system, taking 1000 by 36 megapixel all-sky images throughout the night, using neural network algorithms to recognize events. They are capable of operating for 12 months in a harsh environment, and store all imagery collected. We developed a completely automated software pipeline for data reduction, and built a supercomputer database for storage, allowing us to process our entire archive. The DFN currently stands at 50 stations distributed across the Australian continent, covering an area of 2.5 million square kilometers. Working with DFN's partners at NASA's Solar System Exploration Research Virtual Institute, the team is expanding the network beyond Australia to locations around the world. Fireballs in the Sky allows a growing public base to learn about and participate in this exciting research.

Day, Brian↗

Are We Alone? Kepler on a Quest

Two presentations, a technical and a non-technical with information about the Kepler Mission. Includes graphics on the telescope, how it works, the planets it has found. The technical includes couple of slides on the software pipeline architecture that helps detect the planets using Kepler Data. None of the Kepler graphics are newly created. Except the About Me slide everything else has been borrowed from not one but several different presentations, ones that I deemed helpful to me while doing my talks.

Kepler↗

Parallelization of Lower-Upper Symmetric Gauss-Seidel Method for Chemically Reacting Flow

Development of technologies for exploration of the solar system has revived an interest in computational simulation of chemically reacting flows since planetary probe vehicles exhibit non-equilibrium phenomena during the atmospheric entry of a planet or a moon as well as the reentry to the Earth. Stability in combustion is essential for new propulsion systems. Numerical solution of real-gas flows often increases computational work by an order-of-magnitude compared to perfect gas flow partly because of the increased complexity of equations to solve. Recently, as part of Project Columbia, NASA has integrated a cluster of interconnected SGI Altix systems to provide a ten-fold increase in current supercomputing capacity that includes an SGI Origin system. Both the new and existing machines are based on cache coherent non-uniform memory access architecture. Lower-Upper Symmetric Gauss-Seidel (LU-SGS) relaxation method has been implemented into both perfect and real gas flow codes including Real-Gas Aerodynamic Simulator (RGAS). However, the vectorized RGAS code runs inefficiently on cache-based shared-memory machines such as SGI system. Parallelization of a Gauss-Seidel method is nontrivial due to its sequential nature. The LU-SGS method has been vectorized on an oblique plane in INS3D-LU code that has been one of the base codes for NAS Parallel benchmarks. The oblique plane has been called a hyperplane by computer scientists. It is straightforward to parallelize a Gauss-Seidel method by partitioning the hyperplanes once they are formed. Another way of parallelization is to schedule processors like a pipeline using software. Both hyperplane and pipeline methods have been implemented using openMP directives. The present paper reports the performance of the parallelized RGAS code on SGI Origin and Altix systems.

Yoon, Seokkwan↗

The Kepler Science Operations Center Pipeline Framework Extensions

The Kepler Science Operations Center (SOC) is responsible for several aspects of the Kepler Mission, including managing targets, generating on-board data compression tables, monitoring photometer health and status, processing the science data, and exporting the pipeline products to the mission archive. We describe how the generic pipeline framework software developed for Kepler is extended to achieve these goals, including pipeline configurations for processing science data and other support roles, and custom unit of work generators that control how the Kepler data are partitioned and distributed across the computing cluster. We describe the interface between the Java software that manages the retrieval and storage of the data for a given unit of work and the MATLAB algorithms that process these data. The data for each unit of work are packaged into a single file that contains everything needed by the science algorithms, allowing these files to be used to debug and evolve the algorithms offline.

Klaus, Todd C.↗

Kepler Science Operations Center Pipeline Framework

The Kepler mission is designed to continuously monitor up to 170,000 stars at a 30 minute cadence for 3.5 years searching for Earth-size planets. The data are processed at the Science Operations Center (SOC) at NASA Ames Research Center. Because of the large volume of data and the memory and CPU-intensive nature of the analysis, significant computing hardware is required. We have developed generic pipeline framework software that is used to distribute and synchronize the processing across a cluster of CPUs and to manage the resulting products. The framework is written in Java and is therefore platform-independent, and scales from a single, standalone workstation (for development and research on small data sets) to a full cluster of homogeneous or heterogeneous hardware with minimal configuration changes. A plug-in architecture provides customized control of the unit of work without the need to modify the framework itself. Distributed transaction services provide for atomic storage of pipeline products for a unit of work across a relational database and the custom Kepler DB. Generic parameter management and data accountability services are provided to record the parameter values, software versions, and other meta-data used for each pipeline execution. A graphical console allows for the configuration, execution, and monitoring of pipelines. An alert and metrics subsystem is used to monitor the health and performance of the pipeline. The framework was developed for the Kepler project based on Kepler requirements, but the framework itself is generic and could be used for a variety of applications where these features are needed.

Klaus, Todd C.↗

Hubble Space Telescope Astrometry Science Team

Topics considered include: Calibration and Astrometry Pipeline; Astrometry Anomaly Analysis; The STAT pipeline and software analysis tools; GTO Program; Parallaxes of Astrophysically Interesting Objects; HST- Hipparcos Extragalactic Link; Ground-Based Observations of Radial Velocities; GTO Globular Cluster Internal Motions; and GTO Hyades Cluster Member FGS Parallaxes.

Benedict, George F.↗

Beta Pic-like Circumstellar Gas Disk Around 2 And

This grant was awarded to support the data analysis and publication of results from our project entitled P Pic-like Circumstellar Gas Disk Around 2 And . We proposed to obtain FUSE observations of 2 And and study the characteristics and origin of its circumstellar gas. We observed 2 Andromedae with FUSE on 3-4 July 2001 in 11 exposures with a total exposure time of 21,289 seconds through the LWRS aperture. Our data were calibrated with Version 1.8.7 of the CALFUSE pipeline processing software. We corrected the wavelength scale for the heliocentric velocity error in this version of the CALFUSE software. The relative accuracy of the calibrated wavelength scale is +/- 9 km/s . We produced a co-added spectrum in the LiF 1B and LiF 2A channels (covering the 1100 to 1180 A region) by cross-correlating the 11 individual exposures and doing an exposure-time weighted average flux. The final co-added spectra have a signal-to-noise ratio in the stellar continuum near 1150 A of about 20. To obtain an absolute wavelength calibration, we cross-correlated our observed spectra with a model spectrum to obtain the best fit for the photospheric C I lines. Because the photospheric lines are very broad, this yields an absolute accuracy for the wavelength scale of approx.+/- 15 km/s. We then rebinned 5 original pixels to yield the optimal sampling of .033 A for each new pixel, because the calibrated spectra oversample the spectral resolution for FUSE+LWRS (R = 20,000 +/- 2,000).

Cheng, Patricia↗

The initial data products from the EUVE software - A photon's journey through the End-to-End System

The End-to-End System (EES) is a unique collection of software modules created for use at the Center for EUV Astrophysics. The 'pipeline' is a shell script which executes selected EES modules and creates initial data products: skymaps, data sets for individual sources (called 'pigeonholes') and catalogs of sources. This article emphasizes the data from the all-sky survey, conducted between July 22, 1992 and January 21, 1993. A description of each of the major data products will be given and, as an example of how the pipeline works, the reader will follow a photon's path through the software pipeline into a pigeonhole. These data products are the primary goal of the EUVE all-sky survey mission, and so their relative importance for the follow-up science will also be discussed.

Antia, Behram↗