Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Optimizing metaproteomics database construction: lessons from a study of the vaginal microbiome

Metaproteomics, a method for untargeted, high-throughput identification of proteins in complex samples, provides functional information about microbial communities and can tie functions to specific taxa. Metaproteomics often generates less data than other omics techniques, but analytical workflows can be improved to increase usable data in metaproteomic outputs. Identification of peptides in the metaproteomic analysis is performed by comparing mass spectra of sample peptides to a reference database of protein sequences. Although these protein databases are an integral part of the metaproteomic analysis, few studies have explored how database composition impacts peptide identification. Here, we used cervicovaginal lavage (CVL) samples from a study of bacterial vaginosis (BV) to compare the performance of databases built using six different strategies. We evaluated broad versus sample-matched databases, as well as databases populated with proteins translated from metagenomic sequencing of the same samples versus sequences from public repositories. Smaller sample-matched databases performed significantly better, driven by the statistical constraints on large databases. Additionally, large databases attributed up to 34% of significant bacterial hits to taxa absent from the sample, as determined orthogonally by 16S rRNA gene sequencing. We also tested a set of hybrid databases which included bacterial proteins from NCBI RefSeq and translated bacterial genes from the samples. These hybrid databases had the best overall performance, identifying 1,068 unique human and 1,418 unique bacterial proteins, ~30% more than a database populated with proteins from typical vaginal bacteria and fungi. Our findings can help guide the optimal identification of proteins while maintaining statistical power for reaching biological conclusions.

59 BASIC BIOLOGICAL SCIENCES↗

Consist v0.1.0

A Python library for provenance tracking, intelligent caching, and data virtualization in scientific simulation workflows. It automatically records code, configuration, and input data to skip redundant computations and enables querying results across many runs without manual bookkeeping. Designed to support multi-model simulation workflows like the BEAM CORE toolset at LBL, but designed to be extensible to a wide range of research workflows. Combines lineage tracking features as provided by OpenLineage with deterministic hashing like SnakeMake, and adds powerful analysis tools on model outputs.

Needell, Zachary [Lawrence Berkeley National Labor↗

Parallel File System I/O Performance Testing On LANL Clusters

These are slides from a presentation on parallel file system I/O performance testing on LANL clusters. I/O is a known bottleneck for HPC applications. Performance optimization of I/O is often required. This summer project entailed integrating IOR under Pavilion and automating the results analysis. The slides cover the following topics: scope of the work, tools utilized, IOR-Pavilion test workflow, build script, IOR parameters, how parameters are passed to IOR, *run_ior: functionality, Python IOR-Output Parser, Splunk data format, Splunk dashboard and features, and future work.

97 MATHEMATICS AND COMPUTING↗

Argonne Leadership Computing Facility (2018 Annual Report)

The Argonne Leadership Computing Facility enables breakthroughs in science and engineering by providing supercomputing resources and expertise to the research community. In 2018, we continued to build up programs and efforts that reinforce our overall simulation, learning, and data analysis capabilities as a facility. We also enhanced our services to better meet our users’ needs and workflow preferences.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Using Selection Pressure as an Asset to Develop Reusable, Adaptable Software Systems

The Goddard Earth Sciences Data and Information Services Center (GES DISC) at NASA has over the years developed and honed several reusable architectural components for supporting large-scale data centers with a large customer base. These include a processing system (S4PM) and an archive system (S4PA) based upon a workflow engine called the Simple Scalable Script based Science Processor (S4P) and an online data visualization and analysis system (Giovanni). These subsystems are currently reused internally in a variety of combinations to implement customized data management on behalf of instrument science teams and other science investigators. Some of these subsystems (S4P and S4PM) have also been reused by other data centers for operational science processing. Our experience has been that development and utilization of robust interoperable and reusable software systems can actually flourish in environments defined by heterogeneous commodity hardware systems the emphasis on value-added customer service and the continual goal for achieving higher cost efficiencies. The repeated internal reuse that is fostered by such an environment encourages and even forces changes to the software that make it more reusable and adaptable. Allowing and even encouraging such selective pressures to software development has been a key factor In the success of S4P and S4PM which are now available to the open source community under the NASA Open source Agreement

Berrick, Stephen↗

An Upgrade of the Aeroheating Software "MINIVER"

Many software packages assist engineers with performing flight vehicle analysis, but some of these packages have gone many years without updates or significant improvements to their workflows. One such software, known as MINIVER, is a powerful yet lightweight tool that is used for aeroheating analyses. However, it is an aging program that has not seen major improvements within the past decade. As part of a collaborative effort with Florida Institute of Technology, MINIVER has received a major user interface overhaul, a change in program language, and will be continually receiving updates to improve its capabilities. The user interface update includes a migration from a command-line interface to that of a graphical user interface supported in the Windows operating system. The organizational structure of the preprocessor has been transformed to clearly defined categories to provide ease of data entry. Helpful tools have been incorporated, including the ability to copy sections of cases as well as a generalized importer which aids in bulk data entry. A visual trajectory editor has been included, as well as a CAD Editor which allows the user to input simplified geometries in order to generate MINIVER cases in bulk. To demonstrate its continued effectiveness, a case involving the JAXA OREX flight vehicle will be included, providing comparisons to captured flight data as well as other computational solutions. The most recent upgrade effort incorporated the use of the CAD Editor, and current efforts are investigating methods to link MINIVER projects with SINDA/Fluint and Thermal Desktop.

Louderback, Pierce M.↗

A Upgrade of the Aeroheating Software "MINIVER"

Many software packages assist engineers with performing flight vehicle analysis, but some of these packages have gone many years without updates or significant improvements to their workflows. One such software package, known as MINIVER, is a powerful yet lightweight tool used for aeroheating analyses. However, it is an aging program that has not seen major improvements within the past decade. As part of a collaborative effort with the Florida Institute of Technology, MINIVER has received a major user interface overhaul, a change in program language, and will be continually receiving updates to improve its capabilities. The user interface update includes a migration from a command-line interface to that of a graphical user interface supported in the Windows operating system. The organizational structure of the pre-processor has been transformed to clearly defined categories to provide ease of data entry. Helpful tools have been incorporated, including the ability to copy sections of cases as well as a generalized importer which aids in bulk data entry. A visual trajectory editor has been included, as well as a CAD Editor which allows the user to input simplified geometries in order to generate MINIVER cases in bulk. To demonstrate its continued effectiveness, a case involving the JAXA OREX flight vehicle will be included, providing comparisons to captured flight data as well as other computational solutions. The most recent upgrade effort incorporated the use of the CAD Editor, and current efforts are investigating methods to link MINIVER projects with SINDA/Fluint and Thermal Desktop.

Louderback, Pierce↗

Dynamic Measurements of the Structural Evolution of Material Defects at the Mesoscale

This is a technical report to be published as part of the FY2021 annual overview package. We have designed experiments and developed analytical methods using images from x-ray and electron microscopy in order to quantify the behavior of crystal dislocation defects at their native nanometer-length and micro-length scales. The results of these analyses are used to directly inform theoretical physics models and guide interpretation of dark field x-ray microscopy (DFXM) images that offer spatial resolution surpassing the resolution of beamline optics. Additionally, we developed new analytical methods to automate the alignment of optics hardware used in both synchrotron and x-ray free electron laser beamline facilities. The tools and workflows developed for this project are now being deployed as proof-of-concept in reaction history analysis (RHA) for future programmatic integration.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Dynamic Waste Isolation Pilot Plant Performance Assessment Tool - 12490

The Waste Isolation Pilot Plant (WIPP) Performance Assessment (PA) methodology comprises a toolbox used to demonstrate regulatory compliance of the repository after facility closure. The PA framework rests upon an extensive suite of computational codes. In some cases, significant alteration of code inputs is a tedious and difficult task. Due to the nature of the application for which they are used, PA codes used in support of WIPP regulatory compliance demonstration must satisfy stringent quality assurance requirements. Consequently, many of the coding practices used during original code development are still implemented today. A more efficient workflow configuration has the potential to alleviate difficulties associated with extensive code input modifications. Here, this potential is assessed via an implementation of a more flexible scientific workflow system for a subset of the codes used in WIPP PA. The scientific workflow approach taken here for a dynamic PA system enables users from disparate backgrounds to dramatically shorten the time between hypothesis and analysis by decreasing the amount of a priori knowledge, from a range of disciplines, needed to execute the code. Having smaller iteration times allows for more ideas to be tested and explored, which leads to safer and more optimized systems. Note that these high-level, dynamic tools are intended only for initial scoping studies on the personal computer of a researcher. Full, regulatory compliance calculations may occur only within a qualified computing environment. However, the WIPP PA tools here may guide future research and indicate regions of the analysis space that are worth further study. This next generation of PA software provides the ability to perform scoping investigations of repository performance quickly and easily, and has an accessible and useful interface to a variety of users, such as fuel cycle systems designers, domain experts such as repository modelers, and policy makers. The purview of this project allows for many opportunities for future work. Foremost among these is the desire to implement the full BRAGFLO suite within the workflow. This will entail porting or wrapping Genmesh, Matset, LHS, and ICSet within Python. Moreover, unifying the two GUIs into a single driver application would be a natural next step. Once the BRAGFLO suite is completed, other portions of WIPP PA could be implemented with corresponding and inter-operable work-flows. Likely first candidates for this are those codes that are similarly computationally intensive, such as the one used to generate complementary cumulative distribution functions used to demonstrate regulatory compliance (code CCDFGF). (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Model data for Flood Frequency Analysis using Stochastic Storm Transposition and an Integrated Surface-Subsurface Hydrological Model

This archived provides scripts and input files used for the implementation of a novel approach to conduct process-based Flood Frequency Analysis using a Stochastic Storm Transposition (SST) and an Integrated Surface-Subsurface Hydrological Model (ISSHM). As a proof-of-concept, this study uses the ISSHM, Advanced Terrestrial Simulator (Amanzi-ATS) model, and the SST model, RainyDay, to conduct flood frequency analysis by simulating the flood response to 5,000 annual synthetic storm events in a ~2000 km2 Southeast Texas watershed.The Watershed Workflow package is implemented in Python3. The Jupyter notebooks can be executed through multiple open-source tools, for example, Anaconda Jupyter Lab, VS Studio Code, etc. Other data files include TXT, CSV, DAT, SBATCH, SHP, TIF, NetCDF, and HDF5 files, which can be read through Python scripts. The input files for the ATS model and RainyDay model have .XML and .SST extensions, respectively, and can be edited in any commonly used text editors.This archive contains:* Scripts and data files essential for generating the ATS model input. It uses the Watershed Workflow package to produce both mesh and ATS input files. * Jupyter notebooks designated for the ATS model evaluation, covering both long-term simulations and 40 rainfall-runoff events.* Input files required to simulate SST storm events using RainyDay.

54 ENVIRONMENTAL SCIENCES↗

Simulating excited-state complex ensembles: Fluorescence and solvatochromism in amine-arene exciplexes

Exciplexes are excited-state complexes formed as a result of partial charge transfer from the donor to the acceptor species when one moiety of the donor–acceptor pair is electronically excited. The arene–amine exciplex formed between oligo-(p-phenylene) (OPP) and triethylamine (TEA) is of interest in the catalytic photoreduction of CO2 because it can compete with complete electron transfer to the OPP catalyst. Therefore, formation of the exciplex can hinder the generation of a radical anion OPP·− necessary for subsequent CO2 reduction. We report an implementation of a workflow automating quantum-chemistry calculations that generate and characterize an ensemble of structures to represent this exciplex state. We use FireWorks, Pymatgen, and Custodian Python packages for high-throughput ensemble generation. The workflow includes time-dependent density functional theory optimization, verification of excited-state minima, and exciplex characterization with natural transition orbitals, exciton analysis, excited-state Mulliken charges, and energy decomposition analysis. Fluorescence spectra computed for these ensembles using Boltzmann-weighted contributions of each structure agree better with experiment than our previous calculations based on a single representative exciplex structure [Kron et al., J. Phys. Chem. A 126, 2319–2329 (2022)]. The ensemble description of the exciplex state also reproduces an experimentally observed red shift of the emission spectrum of [OPP-4–TEA]* relative to [OPP-3–TEA]*. The workflow developed here streamlines otherwise labor-intensive calculations that would require significant user involvement and intervention.

Chemistry↗

Bioinformatics resource manager v2.3: an integrated software environment for systems biology with microRNA and cross-species analysis tools

Background: MicroRNAs (miRNAs) are noncoding RNAs that direct post-transcriptional regulation of protein coding genes. Recent studies have shown miRNAs are important for controlling many biological processes, including nervous system development, and are highly conserved across species. Given their importance, computational tools are necessary for analysis, interpretation and integration of high-throughput (HTP) miRNA data in an increasing number of model species. The Bioinformatics Resource Manager (BRM) v2.3 is a software environment for data management, mining, integration and functional annotation of HTP biological data. In this study, we report recent updates to BRM for miRNA data analysis and cross-species comparisons across datasets. Results: BRM v2.3 has the capability to query predicted miRNA targets from multiple databases, retrieve potential regulatory miRNAs for known genes, integrate experimentally derived miRNA and mRNA datasets, perform ortholog mapping across species, and retrieve annotation and cross-reference identifiers for an expanded number of species. Here we use BRM to show that developmental exposure of zebrafish to 30 uM nicotine from 6–48 hours post fertilization (hpf) results in behavioral hyperactivity in larval zebrafish and alteration of putative miRNA gene targets in whole embryos at developmental stages that encompass early neurogenesis. We show typical workflows for using BRM to integrate experimental zebrafish miRNA and mRNA microarray datasets with example retrievals for zebrafish, including pathway annotation and mapping to human ortholog. Functional analysis of differentially regulated (p<0.05) gene targets in BRM indicates that nicotine exposure disrupts genes involved in neurogenesis, possibly through misregulation of nicotine-sensitive miRNAs. Conclusions: BRM provides the ability to mine complex data for identification of candidate miRNAs or pathways that drive phenotypic outcome and, therefore, is a useful hypothesis generation tool for systems biology. The miRNA workflow in BRM allows for efficient processing of multiple miRNA and mRNA datasets in a single software environment with the added capability to interact with public data sources and visual analytic tools for HTP data analysis at a systems level. BRM is developed using Java™ and other open-source technologies for free distribution (http://www.sysbio.org/dataresources/brm.stm).

59 BASIC BIOLOGICAL SCIENCES↗

ProvLight: Efficient Workflow Provenance Capture on the Edge-to-Cloud Continuum

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and optimizing the performance of such complex Edge-to-Cloud workflows is challenging. Capturing the provenance of key performance indicators, with their related data and processes, may assist in understanding and optimizing workflow executions. However, the capture overhead can be prohibitive, particularly in resource-constrained devices, such as the ones on the IoT/Edge.To address this challenge, based on a performance analysis of existing systems, we propose ProvLight, a tool to enable efficient provenance capture on the IoT/Edge. We leverage simplified data models, data compression and grouping, and lightweight transmission protocols to reduce overheads. We further integrate ProvLight into the E2Clab framework to enable workflow provenance capture across the Edge-to-Cloud Continuum. This integration makes E2Clab a promising platform for the performance optimization of applications through reproducible experiments.We validate ProvLight at a large scale with synthetic workloads on 64 real-life IoT/Edge devices in the FIT IoT LAB testbed. Evaluations show that ProvLight outperforms state-of-the-art systems like ProvLake and DfAnalyzer in resource-constrained devices. ProvLight is 26—37x faster to capture and transmit provenance data; uses 5—7x less CPU; 2x less memory; transmits 2x less data; and consumes 2—2.5x less energy. ProvLight [1] and E2Clab [2] are available as open-source tools.

Rosendo, Daniel↗

Illumina GA IIx& HiSeq 2000 Production Sequenccing and QC Analysis Pipelines at the DOE Joint Genome Institute

The U.S. Department of Energy (DOE) Joint Genome Institute's (JGI) Production Sequencing group is committed to the generation of high-quality genomic DNA sequence to support the mission areas of renewable energy generation, global carbon management, and environmental characterization and clean-up. Within the JGI's Production Sequencing group, a robust Illumina Genome Analyzer and HiSeq pipeline has been established. Optimization of the sesequencer pipelines has been ongoing with the aim of continual process improvement of the laboratory workflow, reducing operational costs and project cycle times to increases ample throughput, and improving the overall quality of the sequence generated. A sequence QC analysis pipeline has been implemented to automatically generate read and assembly level quality metrics. The foremost of these optimization projects, along with sequencing and operational strategies, throughput numbers, and sequencing quality results will be presented.

59 BASIC BIOLOGICAL SCIENCES↗

Automated Experimental Data Analysis at the National Ignition Facility

The National Ignition Facility (NIF) at the Lawrence Livermore National Laboratory is a 192-beam 1.8 MJ ultraviolet laser system designed to support high-energy-density science, including demonstration of inertial confinement fusion ignition. After each target shot lasting {approx}20 ns, scientists require data acquisition, analysis and display within 30 minutes from more than 20 specialized high-speed diagnostic instruments. These diagnostics measure critical x-ray, optical and nuclear phenomena during target burn to quantify ignition results and compare to computational models. All diagnostic data (hundreds of Gbytes) are automatically transferred to an Oracle database that triggers the NIF Shot Data Analysis (SDA) Engine, which distributes the signal and image processing tasks to a Linux cluster. The SDA Engine integrates commercial workflow tools and messaging technologies into a scientific software architecture that is highly parallel, scalable, and flexible. Results are archived in the database for scientist approval and displayed using a web-based tool. The unique architecture and functionality of the SDA Engine will be presented along with an example.

42 ENGINEERING↗

AI-Enhanced Computational Tools for Entry Systems Modeling

To advance the understanding of complex atmospheric entry phenomena, NASA’s Entry Systems Modeling (ESM) team [1] has developed high-fidelity computational tools addressing multiscale challenges, from material microstructures to full-scale heatshield response. This abstract highlights a subset of ESM tools, focusing on AI integration to enhance workflows and predictive modeling. - PuMA [2] computes effective material properties from high-resolution micro-CT scans, supporting TPS analysis for NASA missions. - TomoSAM [3] automates 3D tomography dataset segmentation for PuMA using the Segment Anything Model, reducing manual effort and improving accuracy. - PATO [4] models porous reactive materials under extreme conditions, with advancements such as unified solvers, mechanical erosion, and TPS coatings for NASA missions. - arcjetCV [5] employs deep learning to analyze arc jet test footage, measuring recession rates, shape changes, and shock standoff distances, bridging simulations, and experiments to reveal TPS ablation behavior. - ARCHeS [6] simulates arc heater plasma flows, modeling turbulence, radiation, and electromagnetic interactions to optimize arc heater performance, validate TPS under extreme conditions, and serve as a foundation for developing digital twins of arc heater facilities. - SPARTA [7] simulates rarefied hypersonic flows and gas-surface interactions for planetary entry missions, leveraging GPU architectures for scalable and efficient aerothermal and ablation analyses. AI-driven solutions, such as deep learning segmentation, have streamlined workflows in ESM tools and still hold significant potential to further accelerate processes and enhance automation in entry systems modeling. [1] Haskins, J.B. (2023), [2] Ferguson, J.C. (2018), [3] Meurisse, J.B.E. (2018), [4] Semeraro, F. (2023), [5] Quintart, A. (2024) [6] Meurisse, J.B.E. (2022), [7] Plimpton, S.J. (2019)

Predictive Modeling↗

Investigation of Bipropellant Plume-Induced Contamination Effects on Coverglass Materials

Contamination and degradation of external spacecraft materials by unburned and partially combusted species from bipropellant thruster plumes has long been observed as a key component of the induced space environment. Space shuttle flight experiments and returned flight hardware from the International Space Station (ISS) have both experienced microscopic impact features induced by high-velocity thruster plume droplets. Analytical results have shown that droplet impingement angle relative to a receiving surface plays a key role in the surface damage. Although impacts with normal impingement angles contribute more severely to surface degradation than highly oblique angles, surface effects at higher impingement angles should not be dismissed. Thruster plume-induced materials degradation is a complex phenomenon that depends on a variety of parameters, including but not limited to material type, system temperature and pressure, plume composition, and thruster firing specifications such as number of pulses, pulse duration, and sample distance from the thruster. For space applications, attaining the vacuum pressure and temperature conditions necessary for flight-like plume expansion and exposure conditions is not a trivial task. The German Aerospace Center (Deutsches Zentrum für Luft- und Raumfahrt, DLR) is a facility uniquely capable of simulating such conditions. Test coupons were exposed to bipropellant thruster firings under high vacuum at the DLR facility. Percent area coverage (PAC) and droplet size distributions were evaluated for the uncoated and coated solar array coverglass materials over a range of impingement angles (0̊ to 75̊). A post-test imaging workflow was developed that aimed to quantify changes in sample surface morphology obtained from scanning electron microscopy (SEM) images using the Image Processing and Analysis in Java (ImageJ) tool; an opensource image processing software. The goal was to create a framework through which to evaluate the effect of bipropellant-induced PAC and droplet size distribution on solar array coverglass optical transmission losses. Understanding this relationship is important because optical transmission losses are known to lead to current reduction in solar power generation systems. In addition to the development of surface characterization workflows, valuable lessons learned as they pertain to future investigations and experiments will be discussed. The authors hope that sharing these lessons will facilitate more utilization of DLR’s unique capabilities as well as open the conversation for how best to address experimental characterization of flight-like plume expansion and its impacts on materials surface degradation effects.

Gateway↗

Multi-Scale Characterization of Porosity and Cracks in Silicon Carbide Cladding after Transient Reactor Test Facility Irradiation

Silicon carbide (SiC) ceramic matrix composite (CMC) cladding is currently being pursued as one of the leading candidates for accident-tolerant fuel (ATF) cladding for light water reactor applications. The morphology of fabrication defects, including the size and shape of voids, is one of the key challenges that impacts cladding performance and guarantees reactor safety. Therefore, quantification of defects’ size, location, distribution, and leak paths is critical to determining SiC CMC in-core performance. This research aims to provide quantitative insight into the defect’s distribution under multi-scale characterization at different length scales before and after different Transient Reactor Test Facility (TREAT) irradiation tests. A non-destructive multi-scale evaluation of irradiated SiC will help to assess critical microstructural defects from production and/or experimental testing to better understand and predict overall cladding performance. X-ray computed tomography (XCT), a non-destructive, data-rich characterization technique, is combined with lower length scale electronic microscopic characterization, which provides microscale morphology and structural characterization. This paper discusses a fully automatic workflow to detect and analyze SiC-SiC defects using image processing techniques on 3D X-ray images. Following the XCT data analysis, advanced characterizations from focused ion beam (FIB) and transmission electron microscopy (TEM) were conducted to verify the findings from the XCT data, especially quantitative results from local nano-scale TEM 3D tomography data, which were utilized to complement the 3D XCT results. In this work, three SiC samples (two irradiated and one unirradiated) provided by General Atomics are investigated. The irradiated samples were irradiated in a way that was expected to induce cracking, and indeed, the automated workflow developed in this work was able to successfully identify and characterize the defects formation in the irradiated samples while detecting no observed cracking in the unirradiated sample. These results demonstrate the value of automated XCT tools to better understand the damage and damage propagation in SiC-SiC structures for nuclear applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗