Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Detailed Chemical Abundances for a Benchmark Sample of M Dwarfs from the APOGEE Survey

Individual chemical abundances for 14 elements (C, O, Na, Mg, Al, Si, K, Ca, Ti, V, Cr, Mn, Fe, and Ni) are derived for a sample of M dwarfs using high-resolution, near-infrared H-band spectra from the Sloan Digital Sky Survey-IV/Apache Point Observatory Galactic Evolution Experiment (APOGEE) survey. The quantitative analysis included synthetic spectra computed with 1D LTE plane-parallel MARCS models using the APOGEE Data Release 17 line list to determine chemical abundances. The sample consists of 11 M dwarfs in binary systems with warmer FGK dwarf primaries and 10 measured interferometric angular diameters. To minimize atomic diffusion effects, [X/Fe] ratios are used to compare M dwarfs in binary systems and literature results for their warmer primary stars, indicating good agreement (<0.08 dex) for all studied elements. The mean abundance difference in primaries minus this work's M dwarfs is –0.05 ± 0.03 dex. It indicates that M dwarfs in binary systems are a reliable way to calibrate empirical relationships. A comparison with abundance, effective temperature, and surface gravity results from the APOGEE Stellar Parameter and Chemical Abundances Pipeline (ASPCAP) Data Release 16 finds a systematic offset of [M/H], T eff , log g = +0.21 dex, –50 K, and 0.30 dex, respectively, although ASPCAP [X/Fe] ratios are generally consistent with this study. The metallicities of the M dwarfs cover the range of [Fe/H] = –0.9 to +0.4 and are used to investigate Galactic chemical evolution via trends of [X/Fe] as a function of [Fe/H]. The behavior of the various elemental abundances [X/Fe] versus [Fe/H] agrees well with the corresponding trends derived from warmer FGK dwarfs, demonstrating that the APOGEE spectra can be used to examine Galactic chemical evolution using large samples of selected M dwarfs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Electrification Analysis: Container Ports' Cargo Handling Equipment

This one-page highlight details the key takeaways from a project that utilized NREL's Fleet Research, Energy Data, and Insights (FleetREDI) data analysis pipeline, the Electrification Analysis of Container Ports' Cargo Handling Equipment project. This project created a scalable solution to model energy demand per shipping container moved (kWh/TEU) for an all-electric cargo handling equipment fleet located at a maritime port. The model allows stakeholders to understand energy demand at each electric vehicle (EV) equipment level and is easily scalable to container demand and EV adoption rate projections.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Optimizing Cryo-Focused Pyrolysis GC/MS for Tracing Soil Organic Matter Across Diverse Ecosystems

The cycling of organic matter in terrestrial soils and sediments is central to a range of biogeochemical processes that regulate nutrient cycling, crop productivity, trace gas emissions, and contaminant transport. Pyrolysis-gas chromatography/mass spectrometry (py-GC/MS) is a powerful tool for characterizing bulk soil organic matter (SOM) at the molecular level. In this study, we used a cryo-focused py-GC/MS system to analyze soil samples from seven diverse ecosystems: vernal pool, prairie pothole, temperate forest, tropical forest, tundra, wildfire-affected boreal forest, and grassland. We addressed a key bottleneck in molecular-level SOM characterization by developing an automated data analysis pipeline to optimize py-GC/MS and complementary evolved gas analysis/mass spectrometry (EGA/MS) methods, incorporating advanced tools for peak deconvolution, developing a custom compound class library, and implementing fragmentation spectrum-based molecular networking for the first time. This improved workflow was applied to soil samples from all seven ecosystems, including multiple depths and density fractions. Our findings demonstrate that ecosystem type plays a dominant role in shaping compositional differences in SOM. We also identified trends in the source of SOM compounds (e.g., microbial vs plantderived) across soil depth and density fractions, which are critical for understanding persistence and turnover of SOM. Our molecular networking analysis indicated that although many compounds are widespread across ecosystems, others are restricted to specific environments, such as wetlands. This underscores the utility of molecular-level data in elucidating the complexity of SOM composition and the environmental drivers that shape it. Such molecular-level insights can deepen our knowledge of biogeochemical SOM cycles.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Electrification Analysis: Manhattan Beer

This one-page highlight details the key takeaways from a project that utilized NREL's Fleet Research, Energy Data, and Insights (FleetREDI) data analysis pipeline, the Manhattan Beer Electrification Project. This project determined that Class-8 beverage distribution trucks operating in Manhattan show substantial electrification potential due to daily driving distances below 50 miles and low average speeds of 22mph or less. Their duty cycle needs can often be met by even modestly sized batteries and charging infrastructure. Vulnerable communities near their routes would benefit from fleet electrification.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Automated Model for Improved Mapping of Country-Scale High-Resolution Coastal Bathymetry

Accurate and up-to-date maps of coastal bathymetry are critical for a variety of sectors from vessel navigation to port construction and are increasingly vital to inform coastal infrastructure management amid accelerating sea-level rise and more frequent and severe storm-surge events. The primary challenges to accurate and efficient bathymetric mapping from optical remote sensing are: accurately modeling light attenuation in both the atmosphere and water column; and inefficient data processing pipelines for highresolution satellite imagery. To address the effects of light attenuation within the water-column we have developed a novel physics-based bathymetry model that accounts for variations in water-column inherent optical properties on a pixel-by-pixel basis in optically-shallow aquatic environments, which represents a major advancement. For applications to satellite imagery, we have developed a software package that automatically applies the robust 6S atmospheric correction algorithm, estimates the bottom depth from the physics-based bathymetry model, which corrects for attenuation by suspended particulate matter and colored dissolved organic matter in the water column on a pixel-by-pixel basis, and leverages highperformance computing for rapid application to region-scale (e.g., CONUS) 2-meter resolution imagery datasets. Our approach is tailored to sensors that collect data at two-meter resolution with high return times for frequent updates. We mapped 591 WorldView satellite images for Florida, North Carolina, and Alaska and validated the maps against LiDAR-derived bathymetry data. Results show median RMSE of 1.75, 1.59, and 2.67 meters, respectively. By combining the strengths of Oak Ridge National Laboratory in high-performance computing and remote-sensing science with the water-column modeling expertise of Scripps Institution of Oceanography we advance the state of bathymetric mapping capability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

First detection of the BAO signal from early DESI data

We present the first detection of the baryon acoustic oscillations (BAOs) signal obtained using unblinded data collected during the initial 2 months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). From a selected sample of 261 291 luminous red galaxies spanning the redshift interval 0.4 < z < 1.1 and covering 1651 square degrees with a 57.9 per cent completeness level, we report a ∼5σ level BAO detection and the measurement of the BAO location at a precision of 1.7 per cent. Using a bright galaxy sample of 109 523 galaxies in the redshift range 0.1 < z < 0.5, over 3677 square degrees with a 50.0 per cent completeness, we also detect the BAO feature at ∼3σ significance with a 2.6 per cent precision. These first BAO measurements represent an important milestone, acting as a quality control on the optimal performance of the complex robotically actuated, fibre-fed DESI spectrograph, as well as an early validation of the DESI spectroscopic pipeline and data management system. Based on these first promising results, we forecast that DESI is on target to achieve a high-significance BAO detection at sub-per cent precision with the completed 5-yr survey data, meeting the top-level science requirements on BAO measurements. This exquisite level of precision will set new standards in cosmology and confirm DESI as the most competitive BAO experiment for the remainder of this decade.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

GrAMME: Semisupervised Learning Using Multilayered Graph Attention Models

Modern data analysis pipelines are becoming increasingly complex due to the presence of multiview information sources. While graphs are effective in modeling complex relationships, in many scenarios, a single graph is rarely sufficient to succinctly represent all interactions, and hence, multilayered graphs have become popular. Though this leads to richer representations, extending solutions from the single-graph case is not straightforward. Consequently, there is a strong need for novel solutions to solve classical problems, such as node classification, in the multilayered case. In this article, we consider the problem of semisupervised learning with multilayered graphs. Though deep network embeddings, e.g., DeepWalk, are widely adopted for community discovery, we argue that feature learning with random node attributes, using graph neural networks, can be more effective. To this end, we propose to use attention models for effective feature learning and develop two novel architectures, GrAMME-SG and GrAMME-Fusion, that exploit the interlayer dependences for building multilayered graph embeddings. Using empirical studies on several benchmark data sets, we evaluate the proposed approaches and demonstrate significant performance improvements in comparison with the state-of-the-art network embedding strategies. The results also show that using simple random features is an effective choice, even in cases where explicit node attributes are not available.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Characterizing Sub-Cohorts via Data Normalization and Representation Learning

The process of identifying a cohort of interest is a very challenging task. It requires manually inspecting many patient records of complex structure that might include medical coding errors and missing data. This paper presents a computational pipeline for refining the process of cohort selection based on medical concepts recorded in the electronic health records (EHRs). The pipeline extracts EHR data for a given cohort and normalizes this data using standard vocabularies. Then a stacked denoising autoencoder is used to embed the normalized patient vectors in a low dimensional space, where the patients are subsequently clustered into sub-cohorts. The goal is to represent the cohort in a standard format and abstract variants of sub-populations. As a use-case, we applied the pipeline to 1.8 million Veterans diagnosed with major depressive disorder (MDD), and identified four meaningful sub-cohorts using the features learned by the autoencoder. Then, each sub-cohort was explored using a set of keywords for interpretation.

Rush III, Everett↗
DOE OSTI2020

Revised astrometric calibration of the Gemini Planet Imager

We present a revision to the astrometric calibration of the Gemini Planet Imager (GPI), an instrument designed to achieve the high contrast at small angular separations necessary to image substellar and planetary-mass companions around nearby, young stars. We identified several issues with the GPI data reduction pipeline (DRP) that significantly affected the determination of the angle of north in reduced GPI images. As well as introducing a small error in position angle measurements for targets observed at small zenith distances, this error led to a significant error in the previous astrometric calibration that has affected all subsequent astrometric measurements. We present a detailed description of these issues and how they were corrected. We reduced GPI observations of calibration binaries taken periodically since the instrument was commissioned in 2014 using an updated version of the DRP. These measurements were compared to observations obtained with the NIRC2 instrument on Keck II, an instrument with an excellent astrometric calibration, allowing us to derive an updated plate scale and north offset angle for GPI. This revised astrometric calibration should be used to calibrate all measurements obtained with GPI for the purposes of precision astrometry.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Neural embedding: learning the embedding of the manifold of physics data

In this paper, we present a method of embedding physics data manifolds with metric structure into lower dimensional spaces with simpler metrics, such as Euclidean and Hyperbolic spaces. We then demonstrate that it can be a powerful step in the data analysis pipeline for many applications. Using progressively more realistic simulated collisions at the Large Hadron Collider, we show that this embedding approach learns the underlying latent structure. With the notion of volume in Euclidean spaces, we provide for the first time a viable solution to quantifying the true search capability of model agnostic search algorithms in collider physics (i.e. anomaly detection). Finally, we discuss how the ideas presented in this paper can be employed to solve many practical challenges that require the extraction of physically meaningful representations from information in complex high dimensional datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

A data engineering approach for sustainable chemical end-of-life management

The presence of chemicals causing significant adverse human health and environmental effects during end-of-life (EoL) stages is a challenge for implementing sustainable management efforts and transitioning towards a safer circular life cycle. Conducting chemical risk evaluation and exposure assessment of potential EoL scenarios can help understand the chemical EoL management chain for its safer utilization in a circular life-cycle environment. However, the first step is to track the chemical flows, estimate releases, and potential exposure pathways. Hence, this work proposes an EoL data engineering approach to perform chemical flow analysis and screening to support risk evaluation and exposure assessment for designing a safer circular life cycle of chemicals. This work uses publicly-available data to identify potential post-recycling scenarios (e.g., industrial processing/use operations), estimate inter-industry chemical transfers, and exposure pathways to chemicals of interest. Furthermore, a case study demonstration shows how the data engineering framework identifies, estimates, and tracks chemical flow transfers from EoL stage facilities (e.g., recycling and recovery) to upstream chemical life cycle stage facilities (e.g., manufacturing). Also, the proposed framework considers current regulatory constraints on closing the recycling loop operations and provides a range of values for the flow allocated to post-recycling uses associated with occupational exposure and fugitive air releases from EoL operations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

High throughput discovery of ternary Cu-Fe-Ru alloy catalysts for photo-driven hydrogen production

Light driven hydrogen production from the water splitting reaction has the ability to reduce dependence on fossil fuels in a green energy future. Here, we highlight the discovery of Cu x Ru y Fe 1-x-y nanoparticle catalysts for photo-driven hydrogen production. Through a high throughput experimental setup, robust data management pipelines and intentional experimental design, this study uncovered three highly active bimetallic systems for photo-driven hydrogen and identified a new trimetallic catalyst for this system. In most cases, the multimetallic catalysts outperformed the monometallics. Furthermore, this study highlights the expansive catalytic screening capabilities of this system in contrast to traditional catalytic selection processes through the discovery of distributions of particle compositions in binary and ternary mixtures of metals with high activity for hydrogen evolution.

08 HYDROGEN↗
DOE OSTI2023

Robust design of semi-automated clustering models for 4D-STEM datasets

Materials discovery and design require characterizing material structures at the nanometer and sub-nanometer scale. Four-Dimensional Scanning Transmission Electron Microscopy (4D-STEM) resolves the crystal structure of materials, but many 4D-STEM data analysis pipelines are not suited for the identification of anomalous and unexpected structures. This work introduces improvements to the iterative Non-Negative Matrix Factorization (NMF) method by implementing consensus clustering for ensemble learning. We evaluate the performance of models during parameter tuning and find that consensus clustering improves performance in all cases and is able to recover specific grains missed by the best performing model in the ensemble. The methods introduced in this work can be applied broadly to materials characterization datasets to aid in the design of new materials.

Bruefach, Alexandra (ORCID:0000000209323477)↗
DOE OSTI2025

The Simons Observatory: science goals and forecasts for the enhanced Large Aperture Telescope

We describe updated scientific goals for the wide-field, millimeter-wave survey that will be produced by the Simons Observatory (SO). Significant upgrades to the 6-meter SO Large Aperture Telescope (LAT) are expected to be complete by 2028, and will include a doubled mapping speed with 30,000 new detectors and an automated data reduction pipeline. In addition, a new photovoltaic array will supply most of the observatory's power. The LAT survey will cover about 60% of the sky at a regular observing cadence, with five times the angular resolution and ten times the map depth of the Planck satellite. The science goals are to: (1) determine the physical conditions in the early universe and constrain the existence of new light particles; (2) measure the integrated distribution of mass, electron pressure, and electron momentum in the late-time universe, and, in combination with optical surveys, determine the neutrino mass and the effects of dark energy via tomographic measurements of the growth of structure at redshifts z ≲ 3; (3) measure the distribution of electron density and pressure around galaxy groups and clusters, and calibrate the effects of energy input from galaxy formation on the surrounding environment; (4) produce a sample of more than 30,000 galaxy clusters, and more than 100,000 extragalactic millimeter sources, including regularly sampled AGN light-curves, to study these sources and their emission physics; (5) measure the polarized emission from magnetically aligned dust grains in our Galaxy, to study the properties of dust and the role of magnetic fields in star formation; (6) constrain asteroid regoliths, search for Trans-Neptunian Objects, and either detect or eliminate large portions of the phase space in the search for Planet 9; and (7) provide a powerful new window into the transient universe on time scales of minutes to years, concurrent with observations from the Vera C. Rubin Observatory of overlapping sky.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

The DESI N -body simulation project – I. Testing the robustness of simulations for the DESI dark time survey

ABSTRACT Analysis of large galaxy surveys requires confidence in the robustness of numerical simulation methods. The simulations are used to construct mock galaxy catalogues to validate data analysis pipelines and identify potential systematics. We compare three N-body simulation codes, abacus, gadget-2, and swift, to investigate the regimes in which their results agree. We run N-body simulations at three different mass resolutions, 6.25 × 108, 2.11 × 109, and 5.00 × 109 h−1 M⊙, matching phases to reduce the noise within the comparisons. We find systematic errors in the halo clustering between different codes are smaller than the Dark Energy Spectroscopic Instrument (DESI) statistical error for $s\ \gt\ 20\ h^{-1}$ Mpc in the correlation function in redshift space. Through the resolution comparison we find that simulations run with a mass resolution of 2.1 × 109 h−1 M⊙ are sufficiently converged for systematic effects in the halo clustering to be smaller than the DESI statistical error at scales larger than $20\ h^{-1}$ Mpc. These findings show that the simulations are robust for extracting cosmological information from large scales which is the key goal of the DESI survey. Comparing matter power spectra, we find the codes agree to within 1 per cent for k ≤ 10 h Mpc−1. We also run a comparison of three initial condition generation codes and find good agreement. In addition, we include a quasi-N-body code, FastPM, since we plan use it for certain DESI analyses. The impact of the halo definition and galaxy–halo relation will be presented in a follow-up study.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

QUIJOTE scientific results – IV. A northern sky survey in intensity and polarization at 10–20 GHz with the multifrequency instrument

ABSTRACT We present QUIJOTE intensity and polarization maps in four frequency bands centred around 11, 13, 17, and 19 GHz, and covering approximately 29 000 deg2, including most of the northern sky region. These maps result from 9000 h of observations taken between May 2013 and June 2018 with the first QUIJOTE multifrequency instrument (MFI), and have angular resolutions of around 1°, and sensitivities in polarization within the range 35–40 µK per 1° beam, being a factor ∼2–4 worse in intensity. We discuss the data processing pipeline employed, and the basic characteristics of the maps in terms of real space statistics and angular power spectra. A number of validation tests have been applied to characterize the accuracy of the calibration and the residual level of systematic effects, finding a conservative overall calibration uncertainty of 5 per cent. We also discuss flux densities for four bright celestial sources (Tau A, Cas A, Cyg A, and 3C274), which are often used as calibrators at microwave frequencies. The polarization signal in our maps is dominated by synchrotron emission. The distribution of spectral index values between the 11 GHz and WMAP 23 GHz map peaks at β = −3.09 with a standard deviation of 0.14. The measured BB/EE ratio at scales of ℓ = 80 is 0.26 ± 0.07 for a Galactic cut |b| > 10°. We find a positive TE correlation for 11 GHz at large angular scales (ℓ ≲ 50), while the EB and TB signals are consistent with zero in the multipole range 30 ≲ ℓ ≲ 150. The maps discussed in this paper are publicly available.

Astronomy & Astrophysics↗
DOE OSTI2026

Stacked reverberation mapping of high-redshift quasars in DESI. I. Feasibility analysis

The broad-line region of quasars has long been probed by reverberation mapping techniques that measure time lags between continuum and broad emission-line variations. Stacked reverberation mapping has been proposed as a less observationally expensive alternative to traditional methods. This ensemble approach also reduces biases from small-number statistics. The Dark Energy Spectroscopic Instrument (DESI) is conducting the most extensive spectroscopic survey of quasars to date. We create mock light curves emulating expected DESI quasar observations at redshifts $1.48\lt z\lt 5.2$ and luminosities $44.68 \le \log \lambda L_{1350 \mathring{\rm A}{}} / \mathrm{erg\, s^{-1}} \le 45.99$ to test stacked reverberation mapping feasibility using sparse spectroscopic data paired with well-sampled photometric data. The pipeline, using the lag estimation code JAVELIN (Just Another Vehicle for Estimating Lags In Nuclei), successfully recovers the simulated C IV lags within 1σ of the true values using spectroscopic light curves composed of only a few spectral epochs (2–10) with irregular cadences. We investigate how observational factors, including C IV flux error magnitude, number of stacked quasars, and spectral epoch count, affect performance. This work motivates a pathway for future stacked reverberation mapping projects with large-scale spectroscopic surveys of quasars having $\ge 2$ spectroscopic observations. Our results suggest an economical alternative for constraining and extending the radius–luminosity relation to higher redshifts and luminosities. Subsequently, this relation can be employed more reliably in single-epoch black hole mass measurements and quasar cosmology in these distant regimes.

quasars: general, quasars: supermassive black hole↗