Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction pipelines”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Determination of Erosion/Corrosion Rates in Hanford Tank Farms Radioactive Waste Transfer System Pipelines - 16395

The twenty-eight double-shell underground radioactive waste storage tanks at the U.S. Department of Energy's Hanford Site near Richland, WA are interconnected by the Waste Transfer System network of buried steel encased pipelines and pipe jumpers in below-grade pits. The pipeline material is stainless steel or carbon steel in 51 mm to 152 mm (2 in. to 6 in.) sizes. The pipelines carry slurries ranging up to 20 volume percent solids and supernatants with less than one volume percent solids at velocities necessary to prevent settling. The pipelines, installed between 1976 and 2011, were originally intended to last until the 2028 completion of the double-shell tank storage mission. The mission has been subsequently extended. In 2010 the Tank Operating Contractor began a systematic evaluation of the Waste Transfer System pipeline conditions applying guidelines from API 579-1/ASME FFS-1 (2007), Fitness-For- Service. Between 2010 and 2014 Fitness-for-Service examinations of the Waste Transfer System pipeline materials, sizes, and components were completed. In parallel, waste throughput histories were prepared allowing side-by-side pipeline wall thinning rate comparisons between carbon and stainless steel, slurries and supernatants and throughput volumes. The work showed that for transfer volumes up to 6.1 E+05 m{sup 3} (161 million gallons), the highest throughput of any pipeline segment examined, there has been no detectable wall thinning in either stainless or carbon steel pipeline material regardless of waste fluid characteristics or throughput. The paper describes the field and laboratory evaluation methods used for the Fitness-for-Service examinations, the results of the examinations, and the data reduction methodologies used to support Hanford Waste Transfer System pipeline wall thinning conclusions. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Zwicky Transient Facility: System Overview, Performance, and First Results

The Zwicky Transient Facility (ZTF) is a new optical time-domain survey that uses the Palomar 48 inch Schmidt telescope. A custom-built wide-field camera provides a 47 deg 2 field of view and 8 s readout time, yielding more than an order of magnitude improvement in survey speed relative to its predecessor survey, the Palomar Transient Factory. We describe the design and implementation of the camera and observing system. The ZTF data system at the Infrared Processing and Analysis Center provides near-real-time reduction to identify moving and varying objects. We outline the analysis pipelines, data products, and associated archive. As a result, we present on-sky performance analysis and first scientific results from commissioning and the early survey. ZTF's public alert stream will serve as a useful precursor for that of the Large Synoptic Survey Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗

The Zwicky Transient Facility: System Overview, Performance, and First Results

The Zwicky Transient Facility (ZTF) is a new optical time-domain survey that uses the Palomar 48 inch Schmidt telescope. A custom-built wide-field camera provides a 47 deg ^(2) field of view and 8 s readout time, yielding more than an order of magnitude improvement in survey speed relative to its predecessor survey, the Palomar Transient Factory. We describe the design and implementation of the camera and observing system. The ZTF data system at the Infrared Processing and Analysis Center provides near-real-time reduction to identify moving and varying objects. We outline the analysis pipelines, data products, and associated archive. Finally, we present on-sky performance analysis and first scientific results from commissioning and the early survey. ZTF’s public alert stream will serve as a useful precursor for that of the Large Synoptic Survey Telescope.

Eric C. Bellm↗

A Co-design Framework for Online Data Analysis and Reduction

Science applications preparing for the exascale era are increasingly exploring in situ computations comprising of simulation-analysis-reduction pipelines coupled in-memory. Efficient composition and execution of such complex pipelines for a target platform is a codesign process that evaluates the impact and tradeoffs of various application- and system-specific parameters. In this article, we describe a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for composing parametric studies on coupled applications, and Savanna, a runtime engine for orchestrating and executing campaigns of codesign experiments. Furthermore, this toolset facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage versus compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design of Cheetah and Savanna, and present application examples that use this framework to conduct codesign studies on small clusters as well as leadership class supercomputers.

97 MATHEMATICS AND COMPUTING↗

Variable accretion processes in the young binary-star system UY Aur

We present new K-band spectroscopy of the UY Aur binary star system. Our data are the first to show H{sub 2} emission in the spectrum of UY Aur A and the first to spectrally resolve the Brγ line in the spectrum of UY Aur B. We see an increase in the strength of the Brγ line in UY Aur A and a decrease in Brγ and H{sub 2} line luminosity for UY Aur B compared to previous studies. Converting Brγ line luminosity to accretion rate, we infer that the accretion rate onto UY Aur A has increased by 2 × 10{sup –9} M {sub ☉} yr{sup –1} per year since a rate of zero was observed in 1994. The Brγ line strength for UY Aur B has decreased by a factor of 0.54 since 1994, but the K-band flux has increased by 0.9 mag since 1998. The veiling of UY Aur B has also increased significantly. These data evince a much more luminous disk around UY Aur B. If the lower Brγ luminosity observed in the spectrum of UY Aur B indicates an intrinsically smaller accretion rate onto the star, then UY Aur A now accretes at a higher rate than UY Aur B. However, extinction at small radii or mass pile-up in the circumstellar disk could explain decreased Brγ emission around UY Aur B even when the disk luminosity implies an increased accretion rate. In addition to our scientific results for the UY Aur system, we discuss a dedicated pipeline we have developed for the reduction of echelle-mode data from the ARIES spectrograph.

79 ASTRONOMY AND ASTROPHYSICS↗

Performance of the Gemini Planet Imager Non-redundant Mask and Spectroscopy of Two Close-separation Binaries: HR 2690 and HD 142527

The Gemini Planet Imager (GPI) contains a 10-hole non-redundant mask (NRM), enabling interferometric resolution in complement to its coronagraphic capabilities. The NRM operates both in spectroscopic (integral field spectrograph, henceforth IFS) and polarimetric configurations. NRM observations were taken between 2013 and 2016 to characterize its performance. Most observations were taken in spectroscopic mode, with the goal of obtaining precise astrometry and spectroscopy of faint companions to bright stars. We find a clear correlation between residual wavefront error measured by the adaptive optic system and the contrast sensitivity by comparing phase errors in observations of the same source, taken on different dates. We find a typical 5σ contrast sensitivity of (2–3) × 10 –3 at $~λ/D$. We explore the accuracy of spectral extraction of secondary components of binary systems by recovering the signal from a simulated source injected into several data sets. We outline data reduction procedures unique to GPI's IFS and describe a newly public data pipeline used for the presented analyses. We demonstrate recovery of astrometry and spectroscopy of two known companions to HR 2690 and HD 142527. NRM+polarimetry observations achieve differential visibility precision of σ ~ 0.4% in the best case. We discuss its limitations on Gemini-S/GPI for resolving inner regions of protoplanetary disks and prospects for future upgrades. We summarize lessons learned in observing with NRM in spectroscopic and polarimetric modes.

79 ASTRONOMY AND ASTROPHYSICS↗

Prospects for Galactic and stellar astrophysics with asteroseismology of giant stars in the TESS continuous viewing zones and beyond

ABSTRACT The NASA Transiting Exoplanet Survey Satellite (NASA-TESS) mission presents a treasure trove for understanding the stars it observes and the Milky Way, in which they reside. We present a first look at the prospects for Galactic and stellar astrophysics by performing initial asteroseismic analyses of bright (G < 11) red giant stars in the TESS southern continuous viewing zone (SCVZ). Using three independent pipelines, we detect νmax and Δν in 41 per cent of the 15 405 star parent sample (6388 stars), with consistency at a level of $\sim \! 2{{\ \rm per\ cent}}$ in νmax and $\sim \! 5{{\ \rm per\ cent}}$ in Δν. Based on this, we predict that seismology will be attainable for ∼3 × 105 giants across the whole sky and at least 104 giants with ≥1 yr of observations in the TESS-CVZs, subject to improvements in analysis and data reduction techniques. The best quality TESS-CVZ data, for 5574 stars where pipelines returned consistent results, provide high-quality power spectra across a number of stellar evolutionary states. This makes possible studies of, for example, the asymptotic giant branch bump. Furthermore, we demonstrate that mixed ℓ = 1 modes and rotational splitting are cleanly observed in the 1-yr data set. By combining TESS-CVZ data with TESS-HERMES, SkyMapper, APOGEE, and Gaia, we demonstrate its strong potential for Galactic archaeology studies, providing good age precision and accuracy that reproduces well the age of high [α/Fe] stars and relationships between mass and kinematics from previous studies based on e.g. Kepler. Better quality astrometry and simpler target selection than the Kepler sample makes this data ideal for studies of the local star formation history and evolution of the Galactic disc. These results provide a strong case for detailed spectroscopic follow-up in the CVZs to complement that which has been (or will be) collected by current surveys.

Mackereth, J. Ted↗

Real-Time Highly Resolved Spatial-Temporal Vehicle Energy Consumption Estimation Using Machine Learning and Probe Data

Real-time highly resolved spatial-temporal vehicle energy consumption is a key missing dimension in transportation data. Most roadway link-level vehicle energy consumption data are estimated using average annual daily traffic measures derived from the Highway Performance Monitoring System; however, this method does not reflect day-to-day energy consumption fluctuations. As transportation planners and operators are becoming more environmentally attentive, they need accurate real-time link-level vehicle energy consumption data to assess energy and emissions; to incentivize energy-efficient routing; and to estimate energy impact caused by congestion, major events, and severe weather. This paper presents a computational workflow to automate the estimation of time-resolved vehicle energy consumption for each link in a road network of interest using vehicle probe speed and count data in conjunction with machine learning methods in real time. The real-time pipeline can deliver energy estimates within a couple seconds on query to its interface. The proposed method was evaluated on the transportation network of the metropolitan area of Chattanooga, Tennessee. The volume estimation results were validated with ground truth traffic volume data collected in the field. To demonstrate the effectiveness of the proposed method, the energy consumption pipeline was applied to real-world data to quantify road transportation-related energy reduction because of mitigation policies to slow the spread of COVID-19 and to measure energy loss resulting from congestion.

Severino, Joseph↗

HUBBLE SPACE TELESCOPE PROPER MOTION (HSTPROMO) CATALOGS OF GALACTIC GLOBULAR CLUSTERS. I. SAMPLE SELECTION, DATA REDUCTION, AND NGC 7078 RESULTS

We present the first study of high-precision internal proper motions (PMs) in a large sample of globular clusters, based on Hubble Space Telescope (HST) data obtained over the past decade with the ACS/WFC, ACS/HRC, and WFC3/UVIS instruments. We determine PMs for over 1.3 million stars in the central regions of 22 clusters, with a median number of ∼60,000 stars per cluster. These PMs have the potential to significantly advance our understanding of the internal kinematics of globular clusters by extending past line-of-sight (LOS) velocity measurements to two- or three-dimensional velocities, lower stellar masses, and larger sample sizes. We describe the reduction pipeline that we developed to derive homogeneous PMs from the very heterogeneous archival data. We demonstrate the quality of the measurements through extensive Monte Carlo simulations. We also discuss the PM errors introduced by various systematic effects and the techniques that we have developed to correct or remove them to the extent possible. We provide in electronic form the catalog for NGC 7078 (M 15), which consists of 77,837 stars in the central 2.'4. We validate the catalog by comparison with existing PM measurements and LOS velocities and use it to study the dependence of the velocity dispersion on radius, stellar magnitude (or mass) along the main sequence, and direction in the plane of the sky (radial or tangential). Subsequent papers in this series will explore a range of applications in globular-cluster science and will also present the PM catalogs for the other sample clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

PSTN-019: The LSST Science Pipelines Software: Optical Survey Pipeline Reduction and Analysis Environment

The NSF-DOE Vera C. Rubin Observatory is executing the Legacy Survey of Space and Time (LSST) as its prime mission, producing a series of data releases over the ten-year survey. The LSST Science Pipelines Software will be used to create these data releases and to perform the nightly prompt processing and alert production. This paper provides an overview of the LSST Science Pipelines Software, describing the components and their integration into pipelines that generate science-ready data products.

79 ASTRONOMY AND ASTROPHYSICS↗

TH-AB-207A-05: A Fully-Automated Pipeline for Generating CT Images Across a Range of Doses and Reconstruction Methods

Purpose: To evaluate the robustness of CAD or Quantitative Imaging methods, they should be tested on a variety of cases and under a variety of image acquisition and reconstruction conditions that represent the heterogeneity encountered in clinical practice. The purpose of this work was to develop a fully-automated pipeline for generating CT images that represent a wide range of dose and reconstruction conditions. Methods: The pipeline consists of three main modules: reduced-dose simulation, image reconstruction, and quantitative analysis. The first two modules of the pipeline can be operated in a completely automated fashion, using configuration files and running the modules in a batch queue. The input to the pipeline is raw projection CT data; this data is used to simulate different levels of dose reduction using a previously-published algorithm. Filtered-backprojection reconstructions are then performed using FreeCT-wFBP, a freely-available reconstruction software for helical CT. We also added support for an in-house, model-based iterative reconstruction algorithm using iterative coordinate-descent optimization, which may be run in tandem with the more conventional recon methods. The reduced-dose simulations and image reconstructions are controlled automatically by a single script, and they can be run in parallel on our research cluster. The pipeline was tested on phantom and lung screening datasets from a clinical scanner (Definition AS, Siemens Healthcare). Results: The images generated from our test datasets appeared to represent a realistic range of acquisition and reconstruction conditions that we would expect to find clinically. The time to generate images was approximately 30 minutes per dose/reconstruction combination on a hybrid CPU/GPU architecture. Conclusion: The automated research pipeline promises to be a useful tool for either training or evaluating performance of quantitative imaging software such as classifiers and CAD algorithms across the range of acquisition and reconstruction parameters present in the clinical environment. Funding support: NIH U01 CA181156; Disclosures (McNitt-Gray): Institutional research agreement, Siemens Healthcare; Past recipient, research grant support, Siemens Healthcare; Consultant, Toshiba America Medical Systems; Consultant, Samsung Electronics.

60 APPLIED LIFE SCIENCES↗

Efficient Parallelization of Irregular Applications on GPU Architectures

With the enlarging computation capacity of general Graphics Processing Units (GPUs), leveraging GPUs to accelerate parallel applications has become a critical topic in academia and industry. However, a wide range of irregular applications with the computation-/memory-intensive nature cannot easily achieve high GPU utilization. The challenges mainly involve the following aspects: first, data dependence leads to coarse-grained kernel and inefficient parallelism; second, heavy GPU memory usage may cause frequent memory evictions and extra overhead of I/O; third, specific computation patterns produce memory redundancies; last, workload balance and data reusability conjunctly benefit the overall performance, but there may exist a dynamic trade-off between them. Targeting these challenges, this dissertation proposes multiple optimizations to accelerate two real-world applications: many-body correlation functions to simulate nuclear physics in a large-scale scientific system; the other is the eALS-based matrix factorization recommendation system. To accelerate the calculations of many-body correlation functions, this dissertation presents three frameworks in GPU memory management and multi-GPU scheduling. Firstly, an optimized systematic GPU memory management framework, MemHC, utilizes a series of new memory reduction designs in GPU memory allocation, CPU/GPU communications, and GPU memory oversubscription. Secondly, an enhanced multi-GPU scheduling framework, MICCO, particularly by taking both data dimension (e.g., data reuse and data eviction) and computation dimension into account. MICCO designs a heuristic scheduling algorithm and a machine learning-based regression model to generate the optimal settings of a proposed new concept to manage the trade-off. Thirdly, a locality-aware multi-GPU scheduling framework. This scheduler leverages pipeline batch generation with a looking-ahead strategy by building local dependency graphs for memory transfer reduction and better data reuse, achieving up to 79.92% memory cost reduction and 1.67x speedup. To parallelize the eALS-based recommendation system, this dissertation proposes an efficient CPU/GPU heterogeneous recommendation system, HEALS. HEALS employs newly designed architecture-adaptive data formats to achieve load balance and good data locality on CPU and GPU. To mitigate the data dependence, HEALS presents a CPU/GPU collaboration model for both task parallelism and data parallelism with multiple kernel computation optimizations. In summary, this dissertation efficiently accelerates two typical irregular applications on GPUs by building four frameworks, including CPU/GPU collaboration, GPU memory management, and multi-GPU scheduling.

Wang, Qihan↗

The Sixth Data Release of the Radial Velocity Experiment (Rave). II. Stellar Atmospheric Parameters, Chemical Abundances, and Distances

We present part 2 of the sixth and final Data Release (DR6) of the Radial Velocity Experiment (Rave), a magnitude-limited (9<I<12) spectroscopic survey of Galactic stars randomly selected in Earth’s southern hemisphere. The Rave medium-resolution spectra (R ∼ 7500) cover the Ca triplet region (8410–8795 Å) and span the complete time frame from the start of Rave observations on 2003 April 12 to their completion on 2013 April 4. In the second of two publications, we present the data products derived from 518,387 observations of 451,783 unique stars using a suite of advanced reduction pipelines focusing on stellar atmospheric parameters, in particular purely spectroscopically derived stellar atmospheric parameters (T{sub eff}, logg, and the overall metallicity), enhanced stellar atmospheric parameters inferred via a Bayesian pipeline using Gaia DR2 astrometric priors, and asteroseismically calibrated stellar atmospheric parameters for giant stars based on asteroseismic observations for 699 K2 stars. In addition, we provide abundances of the elements Fe, Al, and Ni, as well as an overall [α/Fe] ratio obtained using a new pipeline based on the GAUGUIN optimization method that is able to deal with variable signal-to-noise ratios. The Rave DR6 catalogs are cross-matched with relevant astrometric and photometric catalogs, and are complemented by orbital parameters and effective temperatures based on the infrared flux method. The data can be accessed via the Rave website (http://rave-survey.org) or the Vizier database.

79 ASTRONOMY AND ASTROPHYSICS↗

pySimpleMask

SF-26-118 pySimpleMask is a tool for creating masks and Q-partition maps for X-ray scattering patterns, supporting SAXS, WAXS, and XPCS data reduction. It ships both a desktop GUI and a headless Python API that can drive the full pipeline from scripts.

Chu, Miaoqi [Argonne National Laboratory (ANL), Ar↗

OPTIMAL STRATEGIES FOR CONTINUOUS GRAVITATIONAL WAVE DETECTION IN PULSAR TIMING ARRAYS

Supermassive black hole binaries (SMBHBs) are expected to emit a continuous gravitational wave signal in the pulsar timing array (PTA) frequency band (10{sup -9} to 10{sup -7} Hz). The development of data analysis techniques aimed at efficient detection and characterization of these signals is critical to the gravitational wave detection effort. In this paper, we leverage methods developed for LIGO continuous wave gravitational searches and explore the use of the F-statistic for such searches in pulsar timing data. Babak and Sesana have used this approach in the context of PTAs to show that one can resolve multiple SMBHB sources in the sky. Our work improves on several aspects of prior continuous wave search methods developed for PTA data analysis. The algorithm is implemented fully in the time domain, which naturally deals with the irregular sampling typical of PTA data and avoids spectral leakage problems associated with frequency domain methods. We take into account the fitting of the timing model and have generalized our approach to deal with both correlated and uncorrelated colored noise sources. We also develop an incoherent detection statistic that maximizes over all pulsar-dependent contributions to the likelihood. To test the effectiveness and sensitivity of our detection statistics, we perform a number of Monte Carlo simulations. We produce sensitivity curves for PTAs of various configurations and outline an implementation of a fully functional data analysis pipeline. Finally, we present a derivation of the likelihood maximized over the gravitational wave phases at the pulsar locations, which results in a vast reduction of the search parameter space.

79 ASTRONOMY AND ASTROPHYSICS↗

INVESTIGATION OF PIPELINES INTEGRITY ASSOCIATED WITH PUMP MODULES VIBRATION FOR PUMPING STATION 9 OF ALYESKA PIPELINE SERVICE COMPANY

Since the operation of PS09 SR module in 2007, it has been observed that there is vibration in various parts of the structures, on various segments of piping, and on appurtenance items. At DOT Pipeline and Hazardous Materials Safety Administration (PHMSA) request, ORNL Subject Matter Experts support PHMSA in its review and analysis of the observed vibration phenomenon. The review and analysis consider possible effects of pipeline design features, vibration characteristics, machinery configuration, and operating practices on the structural capacity and leak tight integrity of the pipeline. Emphasis is placed on protection of welded joints and machinery against failure from cyclic loading. A series of vibration measurements were carried out by the author during the site visit to PS09, the power of the operating pump during the data collection is at about 2970KW, which is less than that of APSC's vibration data collected at 3900KW. Thus, a first order proportional factor of 4900/2970 was used to project the measured velocity data to that of APSC's measurement of the velocity data. It is also noted here that the average or the peak-hold value of the measured velocity data was used in the author's reported data, and only the maximum peak-hold data was used in APSC's reported data. Therefore, in some cases APSC's data is higher than the author's projective estimates that using the average data. In general the projected velocity data are consistent with APSC's measurements; the examples of comparison at various locations are illustrated in the Table 1. This exercise validates and confirms the report vibration data stated in APSC's summary report. After the reinforcement project for PS09 Station, a significant reduction of vibration intensity was observed for the associated pipelines at the SR Modules. EDI Co. provided a detailed vibration intensity investigation for the newly reinforced Pump Module structures and the associated pipelines. A follow-up review of EDI's report was carried out by the author. The comments and questions regarding the EDI report are categorized into four subjects, namely (1) piping vibration severity, (2) pulsation and its impact on the PS09 structure and piping, (3) strain-gage stress history profiles, and (4) the cavitation potential investigation, where the questions are stated at the end of the comments for further follow-on investigations.

02 PETROLEUM↗

Pixel-Level Calibration in the Kepler Science Operations Center Pipeline

We present an overview of the pixel-level calibration of flight data from the Kepler Mission performed within the Kepler Science Operations Center Science Processing Pipeline. This article describes the calibration (CAL) module, which operates on original spacecraft data to remove instrument effects and other artifacts that pollute the data. Traditional CCD data reduction is performed (removal of instrument/detector effects such as bias and dark current), in addition to pixel-level calibration (correcting for cosmic rays and variations in pixel sensitivity), Kepler-specific corrections (removing smear signals which result from the lack of a shutter on the photometer and correcting for distortions induced by the readout electronics), and additional operations that are needed due to the complexity and large volume of flight data. CAL operates on long (~30 min) and short (~1 min) sampled data, as well as full-frame images, and produces calibrated pixel flux time series, uncertainties, and other metrics that are used in subsequent Pipeline modules. The raw and calibrated data are also archived in the Multi-mission Archive at Space Telescope at the Space Telescope Science Institute for use by the astronomical community.

Calibration↗

Validation and Calibration of Energy Models with Real Vehicle Data from Chassis Dynamometer Experiments

Accurate estimation of vehicle fuel consumption typically requires detailed modeling of complex internal powertrain dynamics, often resulting in computationally intensive simulations. However, many transportation applications-such as traffic flow modeling, optimization, and control-require simplified models that are fast, interpretable, and easy to implement, while still maintaining fidelity to physical energy behavior. This work builds upon a recently developed model reduction pipeline that derives physics-like energy models from high-fidelity Autonomie vehicle simulations. These reduced models preserve essential vehicle dynamics, enabling realistic fuel consumption estimation with minimal computational overhead. While the reduced models have demonstrated strong agreement with their Autonomie counterparts, previous validation efforts have been confined to simulation environments. This study extends the validation by comparing the reduced energy model's outputs against real-world vehicle data. Focusing on the MidSUV category, we tune the baseline Autonomie model to closely replicate the characteristics of a Toyota RAV4. We then assess the accuracy of the resulting reduced model in estimating fuel consumption under actual drive conditions. Our findings suggest that, when the reference Autonomie model is properly calibrated, the simplified model produced by the reduction pipeline can provide reliable, semi-principled fuel rate estimates suitable for large-scale transportation applications.

42 ENGINEERING↗