Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sample curation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training

With the end of Moore’s law and Dennard scaling, efficient training increasingly requires rethinking data volume. Can we train better models with significantly less data via intelligent subsampling? To explore this, we develop SICKLE, a sparse intelligent curation framework for efficient learning, featuring a novel maximum entropy (MaxEnt) sampling approach, scalable training, and energy benchmarking. We compare MaxEnt with random and phase-space sampling on large direct numerical simulation (DNS) datasets of turbulence. Evaluating SICKLE at scale on Frontier, we show that subsampling as a preprocessing step can, in many cases, improve model accuracy and substantially lower energy consumption, with observed reductions of up to 38×.

Brewer, Wes [ORNL] (ORCID:0000000236393956)↗
DOE OSTI2026

VirJenDB: a FAIR (meta)data and bioinformatics platform for all viruses

High-throughput sequencing has generated an unprecedented volume of data. However, researcher-submitted data in repositories requires extensive curation and quality control for reuse. These tasks are hindered by the multiplicity of repositories, the sheer volume of the data, and the complexity of virus (meta)data curation. To address these challenges, VirJenDB offers a user-friendly platform to facilitate versioned, community-driven curation, and ontology development. Virus sequences were ingested from 16 sources, including ~200 fields of metadata or standards, covering taxonomy, sample, and host information. Up to 85 metadata fields have undergone at least one round of curation, and are linked to 15.4 million virus sequences, with 88 % from those infecting eukaryotes and the remaining infecting prokaryotes. Subsets were created, including a novel collection of 0.91 million viral operational taxonomic unit (vOTU) sequences across all viruses, while keeping the original sequences from each vOTU to facilitate downstream analyses, e.g. sequence variation. The VirJenDB web portal (https://www.virjendb.org) provides HTTPS and Application Programming Interface (API) access to the sequence datasets and metadata, offering a search engine, filtering, download, visualizations, and documentation. VirJenDB aims to connect the phage and eukaryotic virus research communities by supporting webtool integration, meta-analyses, and metadata schema extensions.

Saghaei, Shahram↗
DOE OSTI2022

Physics-informed graph neural networks for predicting cetane number with systematic data quality analysis

Designing alternative fuels for advanced compression ignition engines necessitates a predictive model for cetane number (CN). In this study, the physics-informed graph neural networks are introduced for a reliable CN prediction by considering molecular features pertinent to the physical properties of molecules that affect CN. The reliability of measured data is another key factor to consider for improving the predictive model. Various experimental instruments for measuring CN exist, including standard and non-standard methods. In this regard, a systematic data quality analysis was carried out for the total 630 CNs collected from literature and new measurements in this study using Advanced Fuel Ignition Delay Analyzer (AFIDA). The results from this data curation process were reflected in the model by imposing lower sample weights on the data coming from less reliable measurement techniques. This approach effectively maximized the prediction accuracy while incorporating data from all available sources. Using the sample weights decreased the mean absolute error (MAE) up to 0.8 CN units. The accuracy was also improved by introducing the CN-related physical properties (the number of hydrogen bond donors and acceptors); the test set MAE is 5.74 and 7.01 for the model with and without such properties, respectively. Investigating molecular structural effects on CN was also carried out to gain chemical insights into factors used to design new fuel candidates. The dimensionality reduction analysis of feature vectors showed a clear clustering in terms of functional groups and CN and the structural effect derived from the model was consistent with the physicochemical insights. Finally, this physics-informed model and data curation would be helpful for accurate CN prediction and inform rational fuel design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

EXTRACT: Interactive extraction of environment metadata and term suggestion for metagenomic sample annotation

The microbial and molecular ecology research communities have made substantial progress on developing standards for annotating samples with environment metadata. However, sample manual annotation is a highly labor intensive process and requires familiarity with the terminologies used. We have therefore developed an interactive annotation tool, EXTRACT, which helps curators identify and extract standard-compliant terms for annotation of metagenomic records and other samples. Behind its web-based user interface, the system combines published methods for named entity recognition of environment, organism, tissue and disease terms. The evaluators in the BioCreative V Interactive Annotation Task found the system to be intuitive, useful, well documented and sufficiently accurate to be helpful in spotting relevant text passages and extracting organism and environment terms. Here the comparison of fully manual and text-mining-assisted curation revealed that EXTRACT speeds up annotation by 15–25% and helps curators to detect terms that would otherwise have been missed.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

ShadeLab/PAPER_Howe_2023_switchgrass_MetaT

The raw data (metagenomes and metatranscriptomes) for this study are available in the Joint Genomes Institute Genome Portal (https://genome.jgi.doe.gov/portal/ Project ID 503249) with projects designated by year and product type. The MAG genomes analyzed in this paper are available on NCBI, as bioproject PRJNA800073. Plants and microorganisms form beneficial associations. Understanding plant-microbe interactions will inform microbiome management to enhance crop productivity and resilience to stress. Here, we apply a genome-centric approach to identify ecologically important leaf microbiome members on field-grown switchgrass and miscanthus and to quantify their activities for switchgrass over two growing seasons. We integrate metagenome and metatranscriptome sequencing from 192 leaf samples collected over representative time points in crop phenology. We curated 40 medium- and high-quality metagenome-assembled-genomes (MAGs) and focused analysis on seasonal transcript recruitment to them. Classes represented by these focal MAGs (Actinomycetia, Alpha- and Gamma- Proteobacteria, and Bacteroidota) were active and had increases in transcripts for short-chain dehydrogenase, molybdopterin oxidoreductase, and polyketide cyclase in the late season. The majority of MAGs had activated stress-associated pathways, including trehalose metabolism, indole acetic acid degradation, betaine biosynthesis, and reactive oxygen species degradation, suggesting direct engagement with the host environment. We also detected seasonally activated biosynthetic pathways for terpenes (carotenoids and isoprenoids) and for various non-ribosomal peptide pathways that were poorly annotated. Overall, this study overcame laboratory and bioinformatic challenges associated with field-based leaf metatranscriptome analysis to inform both general and likely specialized activities of these phyllosphere populations. These activities collectively support that leaf-associated bacterial populations are seasonally dynamic, responsive to host cues, and interactively engage in feedback with the plant. This analysis represented quality filtering of metagenomes and metatranscriptomes (data-preparation folder), metagenome assemblies (metagenome-assembly folder) and metagenome-assembled genome binning, curation, refinement, annotation (mag-evaluation folder). Abundances of sequencing libraries were calculated based on reads mapped (mapping folder). Additionallly, analysis of our annotated results are also included (analysis folder).

Howe, Adina↗
DOE OSTI2019

FDA-ARGOS is a database with public quality-controlled reference genomes for diagnostic use and regulatory science

FDA proactively invests in tools to support innovation of emerging technologies, such as infectious disease next generation sequencing (ID-NGS). Here, we introduce FDA-ARGOS quality-controlled reference genomes as a public database for diagnostic purposes and demonstrate its utility on the example of two use cases. We provide quality control metrics for the FDA-ARGOS genomic database resource and outline the need for genome quality gap filling in the public domain. In the first use case, we show more accurate microbial identification of Enterococcus avium from metagenomic samples with FDA-ARGOS reference genomes compared to non-curated GenBank genomes. In the second use case, we demonstrate the utility of FDA-ARGOS reference genomes for Ebola virus target sequence comparison as part of a composite validation strategy for ID-NGS diagnostic tests. The use of FDA-ARGOS as an in silico target sequence comparator tool combined with representative clinical testing could reduce the burden for completing ID-NGS clinical trials

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

$\mathrm{COBRA}$ improves the completeness and contiguity of viral genomes assembled from metagenomes

Viruses are often studied using metagenome-assembled sequences, but genome incompleteness hampers comprehensive and accurate analyses. Contig Overlap Based Re-Assembly (COBRA) resolves assembly breakpoints based on the de Bruijn graph and joins contigs. Here we benchmarked COBRA using ocean and soil viral datasets. COBRA accurately joined the assembled sequences and achieved notably higher genome accuracy than binning tools. From 231 published freshwater metagenomes, we obtained 7,334 bacteriophage clusters, ~83% of which represent new phage species. Notably, ~70% of these were circular, compared with 34% before COBRA analyses. We expanded sampling of huge phages (≥200 kbp), the largest of which was curated to completion (717 kbp). Improved phage genomes from Rotsee Lake provided context for metatranscriptomic data and indicated the in situ activity of huge phages, whiB-encoding phages and cysC- and cysH-encoding phages. COBRA improves viral genome assembly contiguity and completeness, thus the accuracy and reliability of analyses of gene content, diversity and evolution.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

The distribution, diversity and function of predominant Thermoproteales in high‐temperature environments of Yellowstone National Park

Summary High‐temperature environments (> 70°C) contain diverse and abundant members of the crenarchaeal order Thermoproteales. However, a comprehensive study of the distribution and function of diverse members of this group across different habitat types has not been conducted. Consequently, the goals of this study were to determine the distribution of different Thermoproteales genera across geochemically distinct geothermal habitats of Yellowstone National Park, and to identify key functional attributes of major genera that correlate with environmental parameters. Curated sequence assemblies belonging to five genera were characterized in replicate samples of 11 high‐temperature communities ranging in pH from 3 to 9. Thermocladium , Vulcanisaeta and Caldivirga spp. were the primary Thermoproteales populations present in low pH (pH < 5) habitats, whereas Thermoproteus populations were found in mildly‐acidic (pH 5–6) sulfur sediments, and Pyrobaculum populations were confined to higher pH (pH > 6) sulfur sediments and/or filamentous ‘streamer’ communities. Metabolic reconstruction and comparative genomics among assemblies show that these populations are primarily chemoorganotrophs that utilize different electron acceptors depending on geochemical conditions. The presence of potential CO 2 fixation pathways in some Thermoproteales populations appears to be linked with NiFe hydrogenases, which combined with high levels of H 2 in many sulfidic systems, may provide the energy required to fix inorganic C.

Jay, Zackary J.↗
DOE OSTI2022

The Gaia EDR3 view of Johnson-Kron-Cousins standard stars: the curated Landolt and Stetson collections

In the era of large surveys and space missions, it is necessary to rely on large samples of well-characterized stars for inter-calibrating and comparing measurements from different surveys and catalogues. Among the most employed photometric systems, the Johnson-Kron-Cousins has been used for decades and for a large amount of important datasets. Our goal is to profit from the Gaia EDR3 data, Gaia official cross-match algorithm, and Gaia -derived literature catalogues, to provide a well-characterized and clean sample of secondary standards in the Johnson-Kron-Cousins system, as well as a set of transformations between the main photometric systems and the Johnson-Kron-Cousins one. Using Gaia as a reference, as well as data from reddening maps, spectroscopic surveys, and variable stars monitoring surveys, we curated and characterized the widely used Landolt and Stetson collections of more than 200 000 secondary standards, employing classical as well as machine learning techniques. In particular, our atmospheric parameters agree significantly better with spectroscopic ones, compared to other machine learning catalogues. We also cross-matched the curated collections with the major photometric surveys to provide a comprehensive set of reliable measurements in the most widely adopted photometric systems. We provide a curated catalogue of secondary standards in the Johnson-Kron-Cousins system that are well-measured and as free as possible from variable and multiple sources. We characterize the collection in terms of astrophysical parameters, distance, reddening, and radial velocity. We provide a table with the magnitudes of the secondary standards in the most widely used photometric systems (ugriz, grizy, Gaia , HIPPARCOS, Tycho , 2MASS). We finally provide a set of 167 polynomial transformations, valid for dwarfs and giants, metal-poor and metal-rich stars, to transform UBVRI magnitudes in the above photometric systems and vice-versa.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Experimental Data Curation at Large Instrument Facilities with Open Source Software

The National Synchrotron Light Source II operating at Brookhaven National Laboratory since 2014 for the US Department of Energy is one of the newest and brightest storage-ring synchrotron facility in the world. NSLS-II, like other facilities, provides pre-processing of the raw data and some analysis capabilities to its users. We describe the research collaborations and open source infrastructure developed at large instrument facilities such as NSLS-II for the purpose of curating high value scientific data along the early stages of the data lifecycle. Data acquisition and curation tasks include storing experiment configuration, detector metadata, raw data acquisition with infrastructure that converts proprietary instrument formats to industry standards. In addition, we describe a specific effort for discovering sample information at NSLS-II and tracing the provenance of analysis performed on acquired images. We show that curation tasks must be embedded into software along the data life cycle for effectiveness and ease of use, and that loosely defined collaborations evolve around shared open source tools. Finally we discuss best practices for experimental metadata capture in such facilities, data access and the new challenges of scale and complexity posed by AI-based discovery for the synthesis of new materials.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2026

lanl/bacterial-classification

bacterial-classification is a sub repository of the Intelligent Immunity project specific to training and testing machine learning models for bacterial classification (Gram-positive, Gram-negative, and non-bacterial samples). Specifically, this repository aims to compare ML classification performance across different dataset curation strategies.

Mancuso, Marina [Los Alamos National Laboratory]↗
DOE OSTI2014

Metazen – metadata capture for metagenomes

Background: As the impact and prevalence of large-scale metagenomic surveys grow, so does the acute need for more complete and standards compliant metadata. Metadata (data describing data) provides an essential complement to experimental data, helping to answer questions about its source, mode of collection, and reliability. Metadata collection and interpretation have become vital to the genomics and metagenomics communities, but considerable challenges remain, including exchange, curation, and distribution. Currently, tools are available for capturing basic field metadata during sampling, and for storing, updating and viewing it. These tools are not specifically designed for metagenomic surveys; in particular, they lack the appropriate metadata collection templates, a centralized storage repository, and a unique ID linking system that can be used to easily port complete and compatible metagenomic metadata into widely used assembly and sequence analysis tools. Results: Metazen was developed as a comprehensive framework designed to enable metadata capture for metagenomic sequencing projects. Specifically, Metazen provides a rapid, easy-to-use portal to encourage early deposition of project and sample metadata. Conclusion: Metazen is an interactive tool that aids users in recording their metadata in a complete and valid format. A defined set of mandatory fields captures vital information, while the option to add fields provides flexibility.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Exposing new taxonomic variation with inflammation — a murine model-specific genome database for gut microbiome researchers

The murine CBA/J mouse model widely supports immunology and enteric pathogen research. This model has illuminated Salmonella interactions with the gut microbiome since pathogen proliferation does not require disruptive pretreatment of the native microbiota, nor does it become systemic, thereby representing an analog to gastroenteritis disease progression in humans. Despite the value to broad research communities, microbiota in CBA/J mice are not represented in current murine microbiome genome catalogs. Here we present the first microbial and viral genomic catalog of the CBA/J murine gut microbiome. Using fecal microbial communities from untreated and Salmonella-infected, highly inflamed mice, we performed genomic reconstruction to determine the impacts on gut microbiome membership and functional potential. From high depth whole community sequencing (~ 42.4 Gbps/sample), we reconstructed 2281 bacterial and 4516 viral draft genomes. Salmonella challenge significantly altered gut membership in CBA/J mice, revealing 30 genera and 98 species that were conditionally rare and unsampled in non-inflamed mice. Additionally, inflamed communities were depleted in microbial genes that modulate host anti-inflammatory pathways and enriched in genes for respiratory energy generation. Our findings suggest decreases in butyrate concentrations during Salmonella infection corresponded to reductions in the relative abundance in members of the Alistipes. Strain-level comparison of CBA/J microbial genomes to prominent murine gut microbiome databases identified newly sampled lineages in this resource, while comparisons to human gut microbiomes extended the host relevance of dominant CBA/J inflammation-resistant strains. This CBA/J microbiome database provides the first genomic sampling of relevant, uncultivated microorganisms within the gut from this widely used laboratory model. Using this resource, we curated a functional, strain-resolved view on how Salmonella remodels intact murine gut communities, advancing pathobiome understanding beyond inferences from prior amplicon-based approaches. Salmonella-induced inflammation suppressed Alistipes and other dominant members, while rarer commensals like Lactobacillus and Enterococcus endure. The rare and novel species sampled across this inflammation gradient advance the utility of this microbiome resource to benefit the broad research needs of the CBA/J scientific community, and those using murine models for understanding the impact of inflammation on the gut microbiome more generally.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Meta2DB: Curated Shotgun Metagenomic Feature Sets and Metadata for Health State Prediction

Meta2DB is a curated metagenomic and metadata database that provides structurally consistent microbiome taxonomy feature count tables for 13 897 samples across 84 studies, 23 disease states, and 34 geographical locations. All samples were uniformly processed using a streamlined metagenomic classification pipeline that employs a unique and comprehensive reference database indexed to contain all sequences across all kingdoms of life that were present in the NCBI Nucleotide (nt) database retrieved on 4 January 2023. This pipeline leverages high-performance computing (HPC) resources at Lawrence Livermore National Laboratory and was used to process 50TB of publicly available raw metagenomic sequence data. Extensive metadata curation was carried out through a combination of manual curation and automated parsing, producing a consistent inter-study metadata table specifically structured to facilitate training of ML models for prediction of human health.

Kok, C [Lawrence Livermore National Laboratory (LL↗
DOE OSTI2015

Strain-resolved microbial community proteomics reveals simultaneous aerobic and anaerobic function during gastrointestinal tract colonization of a preterm infant

While there has been growing interest in the gut microbiome in recent years, it remains unclear whether closely related species and strains have similar or distinct functional roles and if organisms capable of both aerobic and anaerobic growth do so simultaneously. To investigate these questions, we implemented a high-throughput mass spectrometry-based proteomics approach to identify proteins in fecal samples collected on days of life 13 21 from an infant born at 28 weeks gestation. No prior studies have coupled strain-resolved community metagenomics to proteomics for such a purpose. Sequences were manually curated to resolve the genomes of two strains of Citrobacter that were present during the later stage of colonization. Proteome extracts from fecal samples were processed via a nano-2D-LC-MS/MS and peptides were identified based on information predicted from the genome sequences for the dominant organisms, Serratia and the two Citrobacter strains. These organisms are facultative anaerobes, and proteomic information indicates the utilization of both aerobic and anaerobic metabolisms throughout the time series. This may indicate growth in distinct niches within the gastrointestinal tract. We uncovered differences in the physiology of coexisting Citrobacter strains, including differences in motility and chemotaxis functions. Additionally, for both Citrobacter strains we resolved a community-essential role in vitamin metabolism and a predominant role in propionate production. Finally, in this case study we detected differences between genome abundance and activity levels for the dominant populations. This underlines the value in layering proteomic information over genetic potential.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Training data selection for accuracy and transferability of interatomic potentials

Abstract Advances in machine learning (ML) have enabled the development of interatomic potentials that promise the accuracy of first principles methods and the low-cost, parallel efficiency of empirical potentials. However, ML-based potentials struggle to achieve transferability, i.e., provide consistent accuracy across configurations that differ from those used during training. In order to realize the promise of ML-based potentials, systematic and scalable approaches to generate diverse training sets need to be developed. This work creates a diverse training set for tungsten in an automated manner using an entropy optimization approach. Subsequently, multiple polynomial and neural network potentials are trained on the entropy-optimized dataset. A corresponding set of potentials are trained on an expert-curated dataset for tungsten for comparison. The models trained to the entropy-optimized data exhibited superior transferability compared to the expert-curated models. Furthermore, the models trained to the expert-curated set exhibited a significant decrease in performance when evaluated on out-of-sample configurations.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Improved Microbial Community Characterization of 16S rRNA via Metagenome Hybridization Capture Enrichment

Environmental microbial diversity is often investigated from a molecular perspective using 16S ribosomal RNA (rRNA) gene amplicons and shotgun metagenomics. While amplicon methods are fast, low-cost, and have curated reference databases, they can suffer from amplification bias and are limited in genomic scope. In contrast, shotgun metagenomic methods sample more genomic regions with fewer sequence acquisition biases, but are much more expensive (even with moderate sequencing depth) and computationally challenging. Here, we develop a set of 16S rRNA sequence capture baits that offer a potential middle ground with the advantages from both approaches for investigating microbial communities. These baits cover the diversity of all 16S rRNA sequences available in the Greengenes (v. 13.5) database, with no sequence having <78% sequence identity to at least one bait for all segments of 16S. The use of our baits provide comparable results to 16S amplicon libraries and shotgun metagenomic libraries when assigning taxonomic units from 16S sequences within the metagenomic reads. We demonstrate that 16S rRNA capture baits can be used on a range of microbial samples (i.e., mock communities and rodent fecal samples) to increase the proportion of 16S rRNA sequences (average > 400-fold) and decrease analysis time to obtain consistent community assessments. Furthermore, our study reveals that bioinformatic methods used to analyze sequencing data may have a greater influence on estimates of community composition than library preparation method used, likely due in part to the extent and curation of the reference databases considered. Thus, enriching existing aliquots of shotgun metagenomic libraries and obtaining modest numbers of reads from them offers an efficient orthogonal method for assessment of bacterial community composition.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Detection of Head and Neck Cancer Based on Longitudinal Changes in Serum Protein Abundance

Head and Neck Squamous Cell Carcinoma (HNSCC) is significantly represented in the military population with substantial impact on military operations. Two-thirds of new HNSCC cases are first diagnosed at advanced stage III or IV with lymph node metastases. Thus, there is an urgent need of biomarkers for early detection and risk stratification. Archived serum samples from the Department of Defense Serum Repository provide a unique resource for longitudinal studies of HNSCC in the military and the identification of early detection biomarkers. Methods: We identified 175 patients diagnosed with HNSCC with 175 matched healthy controls and retrieved a total of 978 serum samples drawn at the time of diagnosis, 2 and 4 years prior to diagnosis, and 2 years after diagnosis. Following immunoaffinity depletion, serum samples were analyzed by targeted proteomics assays for multiplexed quantification of a panel of 146 candidate protein biomarkers from the curated literature. Results: We derived a 13-protein signature that distinguishes case versus controls based on longitudinal changes in serum protein concentration. The abundances of each of the 13 proteins remain constant over time in control subjects. The area under the curve for the derived random forest classifier was 0.90. Conclusions: This 13-protein classifier is highly promising for detection of HNSCC prior to overt symptoms. Impact: Use of longitudinal samples has significant potential to identify biomarkers for detection and risk stratification.

59 BASIC BIOLOGICAL SCIENCES↗