Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

On the Accuracy of the ALMA Flux Calibration in the Time Domain and across Spectral Windows

A diverse array of science goals requires accurate flux calibration of observations with the Atacama Large Millimeter/submillimeter array (ALMA); however, this goal remains challenging due to the stochastic time-variability of the “grid” quasars ALMA uses for calibration. In this work, we use 343.5 GHz (Band 7) ALMA Atacama Compact Array observations of four bright and stable young stellar objects over seven epochs to independently assess the accuracy of the ALMA flux calibration and to refine the relative calibration across epochs. The use of these four extra calibrators allows us to achieve an unprecedented relative ALMA calibration accuracy of ~3%. On the other hand, when the observatory calibrator catalog is not up to date, the Band 7 data calibrated by the ALMA pipeline may have a flux calibration poorer than the nominal 10%, which can be exacerbated by weather-related phase decorrelation when self-calibration of the science target is either not possible or not attempted. We also uncover a relative flux calibration uncertainty between spectral windows of 0.8%, implying that measuring spectral indices within a single ALMA band is likely highly uncertain. We thus recommend various methods for science goals requiring high flux accuracy and robust calibration, in particular, the observation of additional calibrators combined with a relative calibration strategy, and observation of solar system objects for high absolute accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗

Semantic Web Data Discovery of Earth Science Data at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC)

Mirador is a web interface for searching Earth Science data archived at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). Mirador provides keyword-based search and guided navigation for providing efficient search and access to Earth Science data. Mirador employs the power of Google's universal search technology for fast metadata keyword searches, augmented by additional capabilities such as event searches (e.g., hurricanes), searches based on location gazetteer, and data services like format converters and data sub-setters. The objective of guided data navigation is to present users with multiple guided navigation in Mirador is an ontology based on the Global Change Master directory (GCMD) Directory Interchange Format (DIF). Current implementation includes the project ontology covering various instruments and model data. Additional capabilities in the pipeline include Earth Science parameter and applications ontologies.

Hegde, Mahabaleshwara↗

High-Energy Electromagnetic Offline Follow-Up of Ligo-Virgo Gravitational-Wave Binary Coalescence Candidate Events

We present two different search methods for electromagnetic counterparts to gravitational-wave (GW) events from ground-based detectors using archival NASA high-energy data from the Fermi Gamma-ray Burst Monitor (GBM) and RXTE All-sky Monitor (ASM) instruments. To demonstrate the methods, we use a limited number of representative GW background noise events produced by a search for binary neutron star coalescence over the last two months of the LIGO-Virgo S6/VSR3 joint science run. Time and sky location provided by the GW data trigger a targeted search in the high-energy photon data. We use two custom pipelines: one to search for prompt gamma-ray counterparts in GBM, and the other to search for a variety of X-ray afterglow model signals in ASM. We measure the efficiency of the joint pipelines to weak gamma-ray burst counterparts, and a family of model X-ray afterglows. By requiring a detectable signal in either electromagnetic instrument coincident with a GW event, we are able to reject a large majority of GW candidates. This reduces the signal-to-noise ratio of the loudest surviving GW background event by around 15-20 percent.

gamma-ray burst: general↗

NASA’s Unsteady Pressure-Sensitive Paint Research and Operational Capability Developments

To address challenges in the field of unsteady aerodynamics, NASA has developed a new state-of-the-art capability called Unsteady Pressure-Sensitive Paint (uPSP). It has been developed as an operational surface-pressure measurement capability for deployment in NASA’s AETC ground test facilities. Offering unprecedented spatiotemporal resolution, uPSP is an extremely powerful tool for investigating unsteady separated flows. To accelerate scientific discovery, uPSP data is to be processed and distributed as rapidly as it is acquired. Several demonstrations of the technology collected valuable data that has been used to develop data products, a robust processing pipeline, and other computational capabilities. A collection of papers documents the most recent research and development work on the uPSP technology and capability. This paper summarizes the current state of this effort at NASA.

Pressure-Sensitive Paint↗

NASA’s Unsteady Pressure-Sensitive Paint Research and Operational Capability Developments

To address challenges in the field of unsteady aerodynamics, NASA has developed a new stateof-the-art capability called Unsteady Pressure-Sensitive Paint (uPSP). It has been developed as an operational surface-pressure measurement capability for deployment in NASA’s AETC ground test facilities. Offering unprecedented spatiotemporal resolution, uPSP is an extremely powerful tool for investigating unsteady separated flows. To accelerate scientific discovery, uPSP data is to be processed and distributed as rapidly as it is acquired. Several demonstrations of the technology collected valuable data that has been used to develop data products, a robust processing pipeline, and other computational capabilities. A collection of papers documents the most recent research and development work on the uPSP technology and capability. This paper summarizes the current state of this effort at NASA.

Pressure-Sensitive Paint↗

Ambient Mass Spectrometry Rapid Analysis Methods for Trace Inorganics

The ability to rapidly detect and characterize the chemistry of trace quantities of inorganic species has multiple potential applications, including nuclear safeguards, nuclear forensics, and environmental monitoring. Some mass spectrometric methods currently exist, but they are costly and time-intensive, often destroying chemical information in the process of ionization. Ambient mass spectrometry is a relatively new analytical method in which samples are introduced to the mass spectrometer from atmospheric pressure, rather than from high vacuum. Ambient MS can operate with gentler ionization methods such as electrospray ionization (ESI) and paper-spray ionization (PSI), reducing fragmentation and preserving the chemical information of the analyte. This may be useful for determining the intended purpose of material in a sample. Strontium, part of nuclear fallout, is analyzed here to test these new analytical methods for viability. Electrospray ionization mass spectrometry functions by spraying the sample as a solution through a needle charged to a few kV. A nebulizing gas flows out along with the sample to create the spray before droplets enter a drying chamber with heated drying gas to remove the solvent molecules. From there bare analyte ions enter the mass spectrometer. This method has the advantage of relatively fast sample preparation and stable ionization. More stable ionization produces higher-quality data. Paper-spray ionization mass spectrometry operates by applying sample to a paper triangle. The paper triangle is then electrified in a metal clamp to a few kV before spray solvent is applied. The spray solvent transports analyte in the sample to the tip, where it is ionized and enters the mass spectrometer. One advantage of this method is reduced sample preparation - an analyst can even swipe a surface and cut a triangle directly from the swipe. The data analysis serves to rapidly process tens of samples all at once. The mass spectrometer outputs a file containing a few hundred spectra for each sample. The pipeline processes each one to identify peaks of interest. A full palette of data analysis metrics are generated, including plots of the raw data and plots of calculated values such as isotopic ratios. The pipeline filters the raw data to remove noise and background peaks, as well as peaks representing detector saturation. A heat map is generated to show the overall spectrum in mass-time- intensity space. Post-processing, we obtained the desired calibration curves, demonstrating that both ESI-MS and PSI-MS are viable methods for quantifying trace amounts of inorganics while retaining their chemical speciation information. ESI-MS demonstrated a linear response region of 100 ppb to 20 ppm, with a limit-of-detection of around 100 ppb. At top left is an example spectrum with the {sup 88}SrNO{sub 3} peak identified to show the retention of chemical speciation. PSI-MS showed a linear response region of around 1 ppb to 1 ppm, with a limit-of-detection of near 1 ppb. PSI-MS produced more erratic results than ESI-MS, likely due to the variability in ionization resulting from manual positioning of the paper triangle near the MS inlet. Future efforts will focus on improving the repeatability of PSI-MS as well as analyzing other species of interest such as cerium and uranium. Improvements will also be made to create more reliable data extraction and intelligent data filtering.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Programable Pipelined-Image Processor

Computer serves as pipelined processor for imagery or other two-dimensional digital data. Processor does feature extraction, smoothing, edge detection, texture measurement, and stereoscoptic area correlation. Also plans routes for obstacle avoidance by robots and solves two-dimensional partial differential equations. Image processor consists of modular units: each includes set of computing elements of types particularly useful in pipelined-image processing. Flexible interconnection scheme used to route data to subsequent stages of pipeline.

Gennery, D. B.↗

Characterizing the Sample Selection for Supernova Cosmology

Type Ia supernovae (SNe Ia) are used as distance indicators to infer the cosmological parameters that specify the expansion history of the universe. Parameter inference depends on the criteria by which the analysis SN sample is selected. Only for the simplest selection criteria and population models can the likelihood be calculated analytically, otherwise it needs to be determined numerically, a process that inherently has error. Numerical errors in the likelihood lead to errors in parameter inference. This article presents toy examples where the distance modulus is inferred given a set of SNe at a single redshift. Parameter estimators and their uncertainties are calculated using Monte Carlo techniques. The relationship between the number of Monte Carlo realizations and numerical errors is presented. The procedure can be applied to more realistic models and used to determine the computational and data management requirements of the transient analysis pipeline.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating hydrogen permeation through medium-density and high-density polyethylene pipes to enable a hydrogen-compatible infrastructure

As the United States and the global community pursue energy abundance and resilience, hydrogen is becoming a critical energy carrier. The future of hydrogen transport depends on one thing: verifying that today’s pipelines are hydrogen ready. This study investigates the permeation behavior of medium-density polyethylene (MDPE) and high-density polyethylene (HDPE) pipelines under pure hydrogen gas environment at various pressures and temperatures. Using thermal desorption analysis (TDA) and direct pipe permeability measurements, hydrogen loss rates are quantified, revealing minimal permeation losses (< 10.5 g/km/day) under realistic operating conditions. Effects of temperature and pressure with Standard Dimension Ratios (SDR), were evaluated to determine their influence on permeation rates of MDPE and HDPE pipelines. In addition, ex-situ density and degree of crystallinity (DOC) of MDPE and HDPEs after hydrogen exposure were also investigated to understand pressure-dependency of polymer properties. The findings provide essential data for assessing polymer-based pipeline materials for safe and reliable hydrogen transport.

08 HYDROGEN↗

Coronal Thermal Structure and Abundance of Super-Metal-Rich Late-Type Stars

This observation is for grating spectroscopy of 30 Ari, a late-type star with very high metallicity. The goal is to use extreme cases to help understand how abundances change from the photosphere to the corona. The only progress is to report to date is preparation for the analysis of the data. The SAO team has produced spectral model predictions for comparison with the observed spectra. The target was obtained by X-ray Multimirror Mission (XMM)-Newton on 2001 January 16 for 28000 sec. Pipeline processing is difficult and the data have not yet been available. Furthermore, we have been cautioned that the data cannot be correctly processed until at least September of this year, as there are problems with the RGS software to extract the spectrum. We have attended two workshops this summer in which results from XMM on late-type stellar coronae were presented including SMM results from GT team members. We noted that only members of the instrument teams are in a position to analyze XMM data.

Brickhouse, N.↗

TESS Data Release Notes: Sector 24, DR35

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). The data products included in this data release are full frame images (FFIs), target pixel fi les, light curve fi les, collateral pixel fi les, cotrending basis vectors (CBVs), and Data Validation (DV) reports, time series, and associated xml fi les. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD). The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2019).2 The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018) contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

TESS↗

DRAGraces: A Pipeline for the GRACES High-resolution Spectrograph at Gemini

This paper describes the software Data Reduction and Analysis for GRACES (DRAGraces), which is a pipeline reducing spectra from Gemini Remote Access to the CFHT ESPaDOnS Spectrograph (GRACES) at the Gemini North Telescope. The code is written in the IDL language. It is designed to find all the GRACES frames in a given directory, automatically determine the list of bias, flat, arc, and science frames, and perform the whole reduction and extraction within a few minutes. We compare the output from DRAGraces with that of the Open source Pipeline for ESPaDOnS Reduction and Analysis (OPERA), a pipeline developed at the Canada–France–Hawaii Telescope (CFHT) that also can extract GRACES spectra. Both pipelines were developed completely independently, yet they give very similar extracted spectra. They both have their advantages and disadvantages. For instance, DRAGraces is more straightforward and easy to use and is less likely to be derailed by a parameter that needs to be tweaked, while OPERA offers a more careful extraction that can be significantly superior when the highest resolution is required and when the signal-to-noise ratio is low. One should compare both before deciding which one to use for their science. Yet, both pipelines deliver a fairly comparable resolution power (R ~ 52.8k and 36.6k for DRAGraces and R ~ 58k and 40k for OPERA in high- and low-resolution spectral modes, respectively), wavelength solution, and signal-to-noise ratio per resolution element.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The LSST DESC DC2 Simulated Sky Survey

Here, we describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep area of approximately 300 deg 2 , as well as a deep drilling field of approximately 1 deg 2 . We simulate 5 yr of the planned 10 yr survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the data set to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic test bed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time domain cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

TESS Data Release Notes: Sectors 1 – 13, Multi-Sector Search, DR20

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). This data release is a combined, multi-sector transit search only. The underlying data products from individual observing sectors have been previously released. The data products included in this data release are the Data Validation (DV) reports, time series, and associated xml les for the threshold crossing events (TCEs) found by searching a combined data set including data from multiple observing sectors. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD)1. The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2017)2. The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018)3 contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

Burke, Christopher J.↗

TESS Data Release Notes: Sector 21 DR 29

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). The data products included in this data release are full frame images (FFIs), target pixel les, light curve les, collateral pixel les, cotrending basis vectors (CBVs), and Data Validation (DV) reports, time series, and associated xml les. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD)1. The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2017).2 The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018) contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

Michael M. Fausnaugh↗

TESS Data Release Notes: Sectors 1 – 36, Multi-sector Search, DR53

These Data Release Notes provide information on the processing and export of data from the Transiting Exoplanet Survey Satellite (TESS). This data release is a combined, multi-sector transit search only. The underlying data products from individual observing sectors have been previously released. The data products included in this data release are the Data Validation (DV) reports, time series, and associated xml files for the threshold crossing events (TCEs) found by searching a combined data set including data from multiple observing sectors. These data products were generated by the TESS Science Processing Operations Center (SPOC, Jenkins et al., 2016) at NASA Ames Research Center from data collected by the TESS instrument, which is managed by the TESS Payload Operations Center (POC) at Massachusetts Institute of Technology (MIT). The format and content of these data products are documented in the Science Data Products Description Document (SDPDD)1. The SPOC science algorithms are based heavily on those of the Kepler Mission science pipeline, and are described in the Kepler Data Processing Handbook (Jenkins, 2020)2. The Data Validation algorithms are documented in Twicken et al. (2018) and Li et al. (2019). The TESS Instrument Handbook (Vanderspek et al., 2018) contains more information about the TESS instrument design, detector layout, data properties, and mission operations. The TESS Mission is funded by NASA's Science Mission Directorate.

TESS↗

Improving the Discovery Power of the Dark Energy Survey Gravitational Wave Program in Its Fourth Observing Campaign

The universe is growing at an accelerated rate, yet the several experiments and science cases used to measure this property yield conflicting results for the rate. Known colloquially as the Hubble tension problem, this discrepancy calls for a novel measurement of the Hubble Constant, H0, in order to be resolved. The Dark Energy Survey Gravitational Wave group (DESGW) aims to relieve this tension by performing a standard sirens measurement of H0 independent of traditional methods. To do so in the current era of data abundance and limited telescope time demands a robust, optimized, and complete science software pipeline to carefully balance the transition from gravitational wave data to state-of-the-art images, images to photometric data, and photometric data to identification and analysis of electromagnetic counterparts to gravitational wave signals. This thesis details the contributions of the author to the DESGW Search & Discovery Pipeline for the fourth observing run of the LIGO/Virgo/KAGRA gravitational wave detector network, as well as the science applications that have been pursued.

79 ASTRONOMY AND ASTROPHYSICS↗

HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data retrieval with significantly reduced data movement cost. However, most existing progressive methods are designed for CPUs, leaving a gap for them to unleash the power of today’s heterogeneous computing systems with GPUs.In this work, we propose HP-MDR, a high-performance and portable data refactoring and progressive retrieval framework for GPUs. Our contributions are four-fold: (1) We carefully optimize the bitplane encoding and lossless encoding, two key stages in progressive methods, to achieve high performance on GPUs; (2) We propose pipeline optimization and incorporate it with data refactoring and progressive retrieval workflows to further enhance the performance for large data process; (3) We leverage our framework to enable high-performance data retrieval with guaranteed error control for common Quantities of Interest; (4) We evaluate HP-MDR and compare it with state of the arts using five real-world datasets. Experimental results demonstrate that HP-MDR delivers an average 13.68 × and 6.31 × throughput in data refactoring and progressive retrieval tasks, respectively. It also leads to 11.22 × throughput for recomposing required data representations under Quantity-of-Interest error control and 6.04 × performance for the corresponding end-to-end data retrieval, when compared with state-of-the-art solutions.

Li, Yanliang [University of Oregon]↗