Search NASA⌕ Search

SEARCH · Search NASA

Results for “Science Pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Optimal decision-making in high-throughput virtual screening pipelines

Screening large pools of molecular candidates to identify those with specific design criteria or targeted properties is demanding in various science and engineering domains. While a high-throughput virtual screening (HTVS) pipeline can provide efficient means to achieving this goal, its design and operation often rely on experts' intuition, potentially resulting in suboptimal performance. In this paper, we fill this critical gap by presenting a systematic framework that can maximize the return on computational investment (ROCI) of such HTVS campaigns. Based on various scenarios, we empirically validate the proposed framework and demonstrate its potential to accelerate scientific discoveries through optimal computational campaigns, especially in the context of virtual screening.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

DRAGraces: A Pipeline for the GRACES High-resolution Spectrograph at Gemini

This paper describes the software Data Reduction and Analysis for GRACES (DRAGraces), which is a pipeline reducing spectra from Gemini Remote Access to the CFHT ESPaDOnS Spectrograph (GRACES) at the Gemini North Telescope. The code is written in the IDL language. It is designed to find all the GRACES frames in a given directory, automatically determine the list of bias, flat, arc, and science frames, and perform the whole reduction and extraction within a few minutes. We compare the output from DRAGraces with that of the Open source Pipeline for ESPaDOnS Reduction and Analysis (OPERA), a pipeline developed at the Canada–France–Hawaii Telescope (CFHT) that also can extract GRACES spectra. Both pipelines were developed completely independently, yet they give very similar extracted spectra. They both have their advantages and disadvantages. For instance, DRAGraces is more straightforward and easy to use and is less likely to be derailed by a parameter that needs to be tweaked, while OPERA offers a more careful extraction that can be significantly superior when the highest resolution is required and when the signal-to-noise ratio is low. One should compare both before deciding which one to use for their science. Yet, both pipelines deliver a fairly comparable resolution power (R ~ 52.8k and 36.6k for DRAGraces and R ~ 58k and 40k for OPERA in high- and low-resolution spectral modes, respectively), wavelength solution, and signal-to-noise ratio per resolution element.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Reviews and syntheses: The promise of big diverse soil data, moving current practices towards future potential

Abstract. In the age of big data, soil data are more available and richer than ever, but – outside of a few large soil survey resources – they remain largely unusable for informing soil management and understanding Earth system processes beyond the original study. Data science has promised a fully reusable research pipeline where data from past studies are used to contextualize new findings and reanalyzed for new insight. Yet synthesis projects encounter challenges at all steps of the data reuse pipeline, including unavailable data, labor-intensive transcription of datasets, incomplete metadata, and a lack of communication between collaborators. Here, using insights from a diversity of soil, data, and climate scientists, we summarize current practices in soil data synthesis across all stages of database creation: availability, input, harmonization, curation, and publication. We then suggest new soil-focused semantic tools to improve existing data pipelines, such as ontologies, vocabulary lists, and community practices. Our goal is to provide the soil data community with an overview of current practices in soil data and where we need to go to fully leverage big data to solve soil problems in the next century.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Undergraduate Women in STEM Internship Program

In collaboration with the Universities Research Association, Inc. (URA), establishment of the Undergraduate Women in STEM Internship pilot program assists Fermi Research Alliance, LLC (FRA) with honoring its commitment to increasing gender, racial and ethnic workforce diversity. This focused initiative is intended to invite, support and yield a qualified pipeline of alumnae underrepresented in FRA’s science and technology management and technical staff positions. Interns in this program spend 10-12 weeks at Fermilab working under the direct leadership, guidance and supervision of scientists, engineers, computing professionals, technicians and staff across all directorates performing hands-on research. In addition, the intern cohort meets with mentors and advisors to grow their professional networks, to take part in engaging and inclusive intellectual discussions, to directly benefit from workplace resources, and to participate in professional development and social engagement opportunities. The design of each research project and the supervision, mentorship and evaluation is conducted by a scientific, engineering, computing professional at Fermilab.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Comparative Study of Large Language Model Architectures on Frontier

Large language models (LLMs) have garnered significant attention in both the AI community and beyond. Among these, the Generative Pre-trained Transformer (GPT) has emerged as the dominant architecture, spawning numerous variants. However, these variants have undergone pre-training under diverse conditions, including variations in input data, data preprocessing, and training methodologies, resulting in a lack of controlled comparative studies. Here we meticulously examine two prominent open-sourced GPT architectures, GPT-NeoX and LLaMA, leveraging the computational power of Frontier, the world’s first Exascale supercomputer. Employing the same materials science text corpus and a comprehensive end-to-end pipeline, we conduct a comparative analysis of their training and downstream performance. Our efforts culminate in achieving state-of-the-art performance on a challenging materials science benchmark. Furthermore, we investigate the computation and energy efficiency, and propose a computationally efficient method for architecture design. To our knowledge, these pre-trained models represent the largest available for materials science. Our findings provide practical guidance for building LLMs on HPC platforms.

Yin, Junqi↗
DOE OSTI2020

Multi-Functional Distributed Fiber Sensors for Pipeline Monitoring and Methane Detections. Final Report

As an abundant and cheap fossil energy source, natural gas has become a significant energy supply to support the United States’ economy. However, the large-scale extraction and utilization of natural gas also impose significant challenges on methane leakage. This problem is exacerbated by aging gas utility delivery systems, including interstate high-pressure pipelines, storage, and transmission facilities. This project aims to develop a cost-effective fiber optical sensing method that can perform multi-parameter real-time measurements of natural gas pipelines across long interrogation distances up to 100 km with 1-meter spatial resolution. This sensing tool can evaluate overall pipeline efficiency and reduce methane emissions for mid-stream methane infrastructures. To accomplish this objective, research and development efforts funded by this project have resulted in the following accomplishments: This project successfully has developed new functional sensory polymer materials using Metal-Organic Frameworks (MOFs) that can be coated on optical fiber through the reel-to-reel coating process. Functional polymer-coated optical fibers can perform sensitive methane detection through evanescence wave interaction and strain-based measurements to achieve 1% detection sensitivities. The new sensors fibers support both distributed measurements and multiplexed fiber sensors array for multi-point measurements. This project developed and optimized a new multi-core optical fiber that supports simultaneous and distributed measurements of strain and temperatures with 1-meter spatial resolutions across up to 100-km interrogation distance. This new fiber, combined with sensory polymercoated fiber, could perform both distributed temperature and methane detections. This project developed a new artificial intelligence big data algorithm approach that can effectively analyze high-resolution data harnessed by distributed fiber sensors to protect natural gas pipelines against external threats and detect internal defects induced by corrosion. Working with our industry partner, this project developed new optical fibers that support fiber sensor fabrications through polymer coating after the fibers are drawn. These new fibers eliminate the need for direct sensor fabrication when the fiber is fabricated on a fiber draw tower, which drastically expands fiber sensors' applicability. This research project has significantly advanced the distributed fiber sensing technology. It will dramatically increase the applicability and adaptability of distributed fiber sensors for a wide array of applications in energy, sustainability, and environmental science, including structural health monitoring of natural gas pipelines, oil infrastructures, hydrogen facilities, and environmental monitoring of carbon storage sites, water supply systems, and others.

03 NATURAL GAS↗
DOE OSTI2023

A high-throughput structural system biology approach to increase structure representation of proteins from Clostridioides difficile

ABSTRACT Clostridioides difficile causes life-threatening gastrointestinal infections. It is a high-risk pathogen due to a lack of effective treatments, antimicrobial resistance, and a poorly conserved genomic core. Herein, we report 30 X-ray structures from a structure genomics pipeline spanning 13 years, representing 10.2% of the X-ray structures for this important pathogen.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

The importance of recruitment and retention in Heliophysics: it’s not just a pipeline problem

A major obstacle in cultivating a robust Heliophysics (and broader scientific) community is the lack of diversity throughout science, technology, engineering, and mathematics (STEM) fields. For many years, this has been understood as a “leaky pipeline” analogy, in which predominately minority students initially interested in STEM gradually fall (or are pushed) out of the field on their way to a scientific research position. However, this ignores critical structural and policy issues which drive even later career Ph.D.s out of a career in Heliophysics. We identify here several systemic problems that inhibit many from participating fully in the Heliophysics community, including soft money pressure, lack of accessibility and equity, power imbalances, lack of accountability, friction in collaboration, and difficulties in forming mentorship bonds. We present several recommendations to empower research-supporting organizations to help create a culture of inclusion, openness, and innovative science.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Wyoming Trails Carbon Hub (WyoTCH)

The Wyoming Trails Carbon Hub (WyoTCH) project completed a front-end engineering and design (FEED) study for a commercial-scale, open-access carbon dioxide (CO 2 ) transport pipeline in Wyoming under U.S. Department of Energy (DOE) Award DEFE0032347, funded through the Bipartisan Infrastructure Law Carbon Capture Technology Program and administered by the National Energy Technology Laboratory. The project’s approach of designing a multi-source, multi-destination pipeline, rather than a dedicated line serving a single project, would lower the barrier to entry for individual CO 2 projects. The projects would leverage Wyoming's concentrated industrial and power generation CO 2 sources, its existing CO 2 pipeline infrastructure, and its extensive CO 2 storage and utilization capacity. This is the project's final technical report.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.

Rettenberger, Luca↗
DOE OSTI2020

Improving the Success of Underrepresented Populations in Computer and Computational Science Research with the CRA-W Women and URMD Grad Cohort Workshops

The Computing Research Association’s Committee on Widening Participation (CRA-WP) aims to increase the number of individual researchers from underrepresented groups in computing (UGC) (including women, underrepresented minorities, and persons with disabilities) who participate and succeed in computer science research at every stage of the research pipeline. Achieving these objectives requires that an increasing number of individuals from UGC start and progress to the next stage. The CRA-WP Grad Cohort Workshops are focused at the graduate level to maximize the likelihood participants will successfully complete their graduate degrees. Factors such as role models, skills, competence, confidence, mentoring, social support, and development of identity as a researcher help students to persist in graduate school, while factors such as sexism, racism, and dissatisfaction with their graduate program may cause them to leave. We, therefore, help first, second, and third year students build their skills, research strategies, and confidence; meet potential mentors from outside their institutions; develop connections with each other and with their research communities; and inform them about strategies for successful publishing, speaking, and advisor management strategies. By targeting early graduate students, we seek to help them stay in graduate school and in research.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

A data engineering approach for sustainable chemical end-of-life management

The presence of chemicals causing significant adverse human health and environmental effects during end-of-life (EoL) stages is a challenge for implementing sustainable management efforts and transitioning towards a safer circular life cycle. Conducting chemical risk evaluation and exposure assessment of potential EoL scenarios can help understand the chemical EoL management chain for its safer utilization in a circular life-cycle environment. However, the first step is to track the chemical flows, estimate releases, and potential exposure pathways. Hence, this work proposes an EoL data engineering approach to perform chemical flow analysis and screening to support risk evaluation and exposure assessment for designing a safer circular life cycle of chemicals. This work uses publicly-available data to identify potential post-recycling scenarios (e.g., industrial processing/use operations), estimate inter-industry chemical transfers, and exposure pathways to chemicals of interest. Furthermore, a case study demonstration shows how the data engineering framework identifies, estimates, and tracks chemical flow transfers from EoL stage facilities (e.g., recycling and recovery) to upstream chemical life cycle stage facilities (e.g., manufacturing). Also, the proposed framework considers current regulatory constraints on closing the recycling loop operations and provides a range of values for the flow allocated to post-recycling uses associated with occupational exposure and fugitive air releases from EoL operations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case

In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

The Target-selection Pipeline for the Dark Energy Spectroscopic Instrument

Abstract In 2021 May, the Dark Energy Spectroscopic Instrument (DESI) began a 5 yr survey of approximately 50 million total extragalactic and Galactic targets. The primary DESI dark-time targets are emission line galaxies, luminous red galaxies, and quasars. In bright time, DESI will focus on two surveys known as the Bright Galaxy Survey and the Milky Way Survey. DESI also observes a selection of “secondary” targets for bespoke science goals. This paper gives an overview of the publicly available pipeline ( desitarget ) used to process targets for DESI observations. Highlights include details of the different DESI survey targeting phases, the targeting ID ( TARGETID ) used to define unique targets, the bitmasks used to indicate a particular type of target, the data model and structure of DESI targeting files, and examples of how to access and use the desitarget code base. This paper will also describe “supporting” DESI target classes, such as standard stars, sky locations, and random catalogs that mimic the angular selection function of DESI targets. The DESI target-selection pipeline is complex and sizable; this paper attempts to summarize the most salient information required to understand and work with DESI targeting data.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Language models for materials discovery and sustainability: Progress, challenges, and opportunities

Significant advancements have been made in one of the most critical branches of artificial intelligence: natural language processing (NLP). These advancements are exemplified by the remarkable success of OpenAI’s GPT-3.5/4 and the recent release of GPT-4.5, which have sparked a global surge of interest akin to an NLP gold rush. Here, in this article, we offer our perspective on the development and application of NLP and large language models (LLMs) in materials science. We begin by presenting an overview of recent advancements in NLP within the broader scientific landscape, with a particular focus on their relevance to materials science. Next, we examine how NLP can facilitate the understanding and design of novel materials and its potential integration with other methodologies. To highlight key challenges and opportunities, we delve into three specific topics: (i) the limitations of LLMs and their implications for materials science applications, (ii) the creation of a fully automated materials discovery pipeline, and (iii) the potential of GPT-like tools to synthesize existing knowledge and aid in the design of sustainable materials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A unified catalogue-level reanalysis of stage-III cosmic shear surveys

ABSTRACT Cosmological parameter constraints from recent galaxy imaging surveys are reaching percent-level accuracy on the effective amplitude of the lensing signal, S8. The upcoming Legacy Survey of Space and Time (LSST) of the Vera C. Rubin Observatory will produce subpercent level measurements of cosmological parameters, providing a milestone test of the ΛCDM model. To supply guidance to the upcoming LSST analysis, it is important to understand thoroughly the results from different recent galaxy imaging surveys and assess their consistencies. In this work, we perform a unified catalogue-level reanalysis of three cosmic shear data sets: the first year data from the Dark Energy Survey (DES-Y1), the 1000 deg2 data set from the Kilo-Degree Survey (KiDS-1000), and the first year data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-Y1). We utilize a pipeline developed and rigorously tested by the LSST Dark Energy Science Collaboration to perform the reanalysis and assess the robustness of the results to analysis choices. We find the S8 constraint to be robust to two different small-scale modelling approaches, and varying choices of cosmological priors. Our unified analysis allows the consistency of the surveys to be rigorously tested, and we find the three surveys to be statistically consistent. Due to the partially overlapping footprint, we model the cross-covariance between KiDS-1000 and HSC-Y1 approximately when combining all three data sets, resulting in a 1.6–1.9 per cent constraint on S8 given different assumptions on the cross-covariance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Future of Water Infrastructure and Innovation Summit

Energy and water systems are interdependent, and the U.S. Department of Energy (DOE) has invested in energy and water for several years, including the Energy-Water Desalination Hub (led by the National Alliance for Water Innovation, NAWI), and research and development (R&D) in resource recovery from wastewater, among other areas. The Advanced Manufacturing Office (AMO) at the U.S. Department of Energy (DOE) held The Future of Water Infrastructure and Innovation Summit to inform the understanding of future opportunities in the water space. The virtual summit was held on October 27 and 28, 2020. The organizers gathered information from a diverse group of relevant water and wastewater stakeholders representing academia, industry, government, nongovernmental organizations, and local/regional utilities. Topics from Day 1 discussions included: desalination, water and wastewater treatment/recovery, produced water, industrial management of water, and hydropower, conveyance, and water systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

SNIa Cosmology Analysis Results from Simulated LSST Images: From Difference Imaging to Constraints on Dark Energy

Abstract The Vera Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to process ∼10 6 transient detections per night. For precision measurements of cosmological parameters and rates, it is critical to understand the detection efficiency, magnitude limits, artifact contamination levels, and biases in the selection and photometry. Here we rigorously test the LSST Difference Image Analysis (DIA) pipeline using simulated images from the Rubin Observatory LSST Dark Energy Science Collaboration Data Challenge (DC2) simulation for the Wide-Fast-Deep survey area. DC2 is the first large-scale (300 deg 2 ) image simulation of a transient survey that includes realistic cadence, variable observing conditions, and CCD image artifacts. We analyze ∼15 deg 2 of DC2 over a 5 yr time span in which artificial point sources from Type Ia supernova (SNIa) light curves have been overlaid onto the images. The magnitude limits per filter are u = 23.66 mag, g = 24.69 mag, r = 24.06 mag, i = 23.45 mag, z = 22.54 mag, and y = 21.62 mag. The artifact contamination levels are ∼90% of all detections, corresponding to ∼1000 artifacts deg –2 in g band, and falling to 300 deg –2 in y band. The photometry has biases <1% for magnitudes 19.5 < m < 23. Our DIA performance on simulated images is similar to that of the Dark Energy Survey difference-imaging pipeline on real images. We also characterize DC2 image properties to produce catalog-level simulations needed for distance bias corrections. We find good agreement between DC2 data and simulations for distributions of signal-to-noise ratio, redshift, and fitted light-curve properties. Applying a realistic SNIa cosmology analysis for redshifts z < 1, we recover the input cosmology parameters to within statistical uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗