Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING↗

Fluorescent amplification for next generation sequencing (FA-NGS) library preparation

BACKGROUND: Next generation sequencing (NGS) has become a universal practice in modern molecular biology. As the throughput of sequencing experiments increases, the preparation of conventional multiplexed libraries becomes more labor intensive. Conventional library preparation typically requires quality control (QC) testing for individual libraries such as amplification success evaluation and quantification, none of which occur until the end of the library preparation process. RESULTS: In this study, we address the need for a more streamlined high-throughput NGS workflow by tethering real-time quantitative PCR (qPCR) to conventional workflows to save time and implement single tube and single reagent QC. We modified two distinct library preparation workflows by replacing PCR and quantification with qPCR using SYBR Green I. qPCR enabled individual library quantification for pooling in a single tube without the need for additional reagents. Additionally, a melting curve analysis was implemented as an intermediate QC test to confirm successful amplification. Sequencing analysis showed comparable percent reads for each indexed library, demonstrating that pooling calculations based on qPCR allow for an even representation of sequencing reads. To aid the modified workflow, a software toolkit was developed and used to generate pooling instructions and analyze qPCR and melting curve data. CONCLUSIONS: We successfully applied fluorescent amplification for next generation sequencing (FA-NGS) library preparation to both plasmids and bacterial genomes. As a result of using qPCR for quantification and proceeding directly to library pooling, the modified library preparation workflow has fewer overall steps. Therefore, we speculate that the FA-NGS workflow has less risk of user error. The melting curve analysis provides the necessary QC test to identify and troubleshoot library failures prior to sequencing. While this study demonstrates the value of FA-NGS for plasmid or gDNA libraries, we speculate that its versatility could lead to successful application across other library types.

59 BASIC BIOLOGICAL SCIENCES↗

Cell-Type-Specific Proteomics Analysis of a Small Number of Plant Cells by Integrating Laser Capture Microdissection with a Nanodroplet Sample Processing Platform

Plant organs and tissues contain multiple cell types, which are well organized in 3-dimensional structure to efficiently perform physiological functions such as homeostasis, response to environmental perturbation, pathogen infection. It is critically important to perform molecular measurements at the cell-type-specific level to discover mechanisms and unique features of cell populations that govern differentiation and respond to external perturbations. Although mass spectrometry-based proteomics has been demonstrated as an enabling discovery tool to study plant physiology, conventional approaches require millions of cells to generate robust biological conclusions. Such requirements mask the cell-to-cell heterogeneities and limit the comprehensive profiling of plant proteins at spatially resolved and cell-type-specific resolutions. This protocol describes a recently-developed proteomics workflow for studying a small number of plant cells by integrating laser capture microdissection, microfluidic nanodroplet-based sample preparation, with ultrasensitive liquid chromatography-mass spectrometry. Using poplar as a model tree species, we provide detailed protocols, including plant tissue harvest, tissue preparation, cryosectioning, laser microdissection, protein digestion, mass spectrometry measurement, and data analysis. We show the workflow enables the precise identification and quantification of thousands of proteins from hundreds of isolated plant root and leaf cells.

59 BASIC BIOLOGICAL SCIENCES↗

Daylight simulation workflows incorporating measured bidirectional scattering distribution functions

Daylight predictions of architectural spaces depend on good estimates of light transfer through skylights, windows and other fenestration systems. For clear glazing and painted surfaces, parametric transmission and reflection models have proven adequate, but there are many cases where light-scattering, semi-specular shading and daylighting materials defy simple characterization. Something as commonplace as fabric roller shades and venetian blinds may turn daylight prediction into guesswork, and numerous advanced systems on the market tuned specifically to enhance daylight are not sufficiently characterized to distinguish their performance. In this paper, we describe new tools available to handle novel and specialized fabrics, materials, and devices using data-driven modelling of bi-directional scattering distribution functions (BSDFs). These representations are usually tabulated at constant or adjustable angular resolution for efficient point-in-time and annual daylight simulations. We describe a variety of BSDF simulation workflows, including some of the tools and methods that make advanced analysis possible, and highlight some of the current challenges. We conclude with a discussion of future work and how such data might be created and shared worldwide.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Uncertainty-Aware Machine Learning for Small-Angle X-ray Scattering Analysis in Autonomous Experimentation

Small-angle X-ray scattering (SAXS) is a powerful high-throughput characterization tool for probing nanoscale structure in native sample environments, providing real-time morphological information such as nanoparticle size and shape during synthesis. However, automated SAXS data analysis for extracting meaningful structural parameters is non-trivial and remains a bottleneck in closed-loop experimentation towards autonomous materials discovery, which demands fast, reliable, and uncertainty-aware data analysis. Here, we develop a machine-learning approach for automated SAXS analysis tailored to closed-loop nanoparticle synthesis. A Random Forest (RF) regression model is trained on 100,000 synthetic SAXS curves generated from polydisperse spherical nanoparticles with realistic background contributions. Using normalized one-dimensional SAXS intensity profiles as input, the RF model directly predicts nanoparticle radius, size polydispersity, and background parameters, while the ensemble standard deviation across trees provides built-in uncertainty quantification (UQ). On synthetic data, we show that combining fit-quality metrics (R 2 , MAE) with thresholds on prediction uncertainty reliably identifies accurate parameter estimates without access to ground truth. We then apply the trained model to 365 experimental SAXS profiles of citrate-reduced gold nanoparticles synthesized using an automated droplet-flow microreactor with in situ SAXS at a synchrotron beamline, classifying the results into high- and low-confidence subsets based on UQ metrics. Finally, we integrate RF-based SAXS analysis into a simulated closed-loop optimization campaign using Gaussian process Bayesian optimization to minimize nanoparticle polydispersity, benchmarking against conventional automated Levenberg–Marquardt fitting. The RF-guided campaign exhibits substantially faster convergence and lower relative opportunity cost (∼0.07 vs ∼0.3), demonstrating that uncertainty-aware machine-learning SAXS analysis significantly enhances the efficiency and robustness of autonomous nanomaterials synthesis workflows.

Bayesian optimization↗

Resin-assisted enrichment of thiols as a general strategy for proteomic profiling of cysteine-based reversible modifications

Reversible modifications on cysteine thiols play a significant role in redox signaling and regulation. A number of reversible redox modifications, including disulfide formation, S-nitrosylation, and S-glutathionylation, have been recognized for their significance in various physiological and pathological processes. Here we describe in detail a resin-assisted thiol-affinity enrichment protocol for both biochemical and proteomics applications. This protocol serves as a general approach for specific isolation of thiol-containing proteins or peptides derived from reversible redox-modified proteins. This approach utilizes thiol-affinity resins to directly capture thiol-containing proteins or peptides through a disulfide exchange reaction followed by on-resin protein digestion and on-resin multiplexed isobaric labeling to facilitate LC-MS/MS based quantitative site-specific analysis of redox modifications. The overall approach requires a much simpler workflow with increased specificity compared to the commonly used biotin switch technique. By coupling different selective reduction strategies, the resin-assisted approach provides the researcher with a useful tool capable of enriching different types of reversible modifications on protein thiols. Procedures for selective enrichment and analyses of S-nitrosylation and total reversible cysteine oxidation are presented to demonstrate the utility of this general strategy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Interface instabilities in hafnium hydride entrained iron metal matrix composites

The chemical interactions in Fe–HfH 2 metal matrix composites (MMCs) are studied across multiple length scales to elucidate the decomposition of the parent phases and corresponding reaction zone physics during direct current sintering. Fe–HfH 2 composites were synthesized with increasing as-mixed hydride contents of Fe–25% HfH 2 , Fe–40% HfH 2 , Fe–55% HfH 2 , and Fe–70% HfH 2 (all in vol. %) to demonstrate the ability to achieve sintered MMCs with target hydride contents. Samples were probed across multiple length scales through a multi-modal workflow employing x-ray diffraction, scanning electron microscopy and segmentation analysis, and synchrotron techniques including hard x-ray fluorescence mapping and nanoprobe x-ray absorption near-edge structure measurements. Under the selected sintering temperature and pressure conditions, hydrogen evolution is seen to evolve through parallel paths: thermal decomposition from during the transformation of HfH 2 to HfH x<2 and through subsequent reaction with the Fe matrix leading to intermetallic phase formation. Specifically, HfFe and HfFe 2 intermetallic formation accelerates the release of hydrogen with a subsequent HfO 2 phase forming at grain boundaries. For this MMC, the consumption or loss of hydrogen can be considerable in compacts with initial hydride loading of 25%–40% HfH 2 approaching 83% hydrogen loss for the lower volume fraction composites. Increasing the volume fraction of HfH 2 to 70% enhanced the retained hydrogen content to 53% and attributed to the reduced interfacial area intrinsic to the increased HfH 2 loading in this MMC.

36 MATERIALS SCIENCE↗

msdlive-cli-distro

MSD-LIVE, the MultiSector Dynamics – Living, Intuitive, Value-adding, Environment, is a flexible and scalable data and code management system combined with a distributed computational platform that will enable MSD researchers to document and archive their data, run their models and analysis tools, and share their data, software, and multi-model workflows within a robust Community of Practice. MSD-LIVE will facilitate a new open, collaborative, resource-rich, technology-facilitated, community-driven way of doing MSD research.

Lansing, Carina↗

Improved Fast Reactor Capability of Griffin in FY23

Griffin is a MOOSE based reactor multiphysics analysis application jointly developed by Idaho National Laboratory and Argonne National Laboratory under the DOE-NE NEAMS program. In FY23, we enhanced capabilities required for fast reactor analysis. This effort included primarily updating the cross-section generation workflow using MC2-3 for various reactor configurations, such as homogeneous, duct-heterogeneous, ring-heterogeneous, and fully-heterogeneous geometries. In addition, we initiated the implementation of a multi-cycle depletion and shuffling capability. To support fast reactor simulation capabilities, we significantly improved the performance of the DFEM-SN-based R-Z transport solver to efficiently solve ultrafine group (over 1000 groups) transport problems. Additionally, the performance of HFEM-PN was improved by introducing red-black iteration, the cmfd acceleration technique, and various optimizations. We also completed the pin power reconstruction capability to support multiphysics simulations while identifying and addressing issues associated with SPH equivalence parameter approach. These enhanced capabilities for fast reactor core simulations, specially HFEM-PN and pin power reconstruction features, were applied to benchmark problems involving ABTR and ABR-1000. These applications showcased excellent agreement with Monte Carlo and other code solutions in terms of eigenvalue, control rod worth, and assembly and pin powers.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

From Ensemble Climate to Ensemble Impacts

Many climate-risk tools rely on ensemble mean projections or endpoint climate snapshots to characterize future hazards. Although convenient for communication, these representations remove the statistical, temporal, and physical information that real infrastructure systems respond to. Infrastructure degradation and failure arise from extremes, sequences, cumulative stress, compound hazards, and nonlinear fragility relationships, none of which survive ensemble averaging or temporal compression. Power-system failure statistics and cascading failure models further show that infrastructure risk is dominated by tail events and path-dependent dynamics rather than by mean conditions. This paper demonstrates why ensemble mean or endpoint-only climate representations are mathematically and physically inconsistent with engineering-grade risk analysis. We outline a model-resolved, time-series-based workflow that preserves extremes, variability, and sequencing by propagating each climate-model realization independently through hazard formation, exposure, fragility, and cascading failure mechanisms. Taking the ensemble of impacts—rather than the ensemble of climate—provides a defensible, physically coherent foundation for infrastructure resilience planning, regulatory compliance, and long-term investment decisions.

54 - ENVIRONMENTAL SCIENCES/GLOBAL CLIMATE CHANGE ↗

Active Flash: Out-of-core Data Analytics on Flash Storage

Next generation science will increasingly come to rely on the ability to perform efficient, on-the-fly analytics of data generated by high-performance computing (HPC) simulations, modeling complex physical phenomena. Scientific computing workflows are stymied by the traditional chaining of simulation and data analysis, creating multiple rounds of redundant reads and writes to the storage system, which grows in cost with the ever-increasing gap between compute and storage speeds in HPC clusters. Recent HPC acquisitions have introduced compute node-local flash storage as a means to alleviate this I/O bottleneck. We propose a novel approach, Active Flash, to expedite data analysis pipelines by migrating to the location of the data, the flash device itself. We argue that Active Flash has the potential to enable true out-of-core data analytics by freeing up both the compute core and the associated main memory. By performing analysis locally, dependence on limited bandwidth to a central storage system is reduced, while allowing this analysis to proceed in parallel with the main application. In addition, offloading work from the host to the more power-efficient controller reduces peak system power usage, which is already in the megawatt range and poses a major barrier to HPC system scalability. We propose an architecture for Active Flash, explore energy and performance trade-offs in moving computation from host to storage, demonstrate the ability of appropriate embedded controllers to perform data analysis and reduction tasks at speeds sufficient for this application, and present a simulation study of Active Flash scheduling policies. These results show the viability of the Active Flash model, and its capability to potentially have a transformative impact on scientific data analysis.

99 GENERAL AND MISCELLANEOUS↗

Automating data analysis for hydrogen/deuterium exchange mass spectrometry using data-independent acquisition methodology

We present a hydrogen/deuterium exchange workflow coupled to tandem mass spectrometry (HX-MS 2 ) that supports the acquisition of peptide fragment ions alongside their peptide precursors. The approach enables true auto-curation of HX data by mining a rich set of deuterated fragments, generated by collisional-induced dissociation (CID), to simultaneously confirm the peptide ID and authenticate MS 1 -based deuteration calculations. The high redundancy provided by the fragments supports a confidence assessment of deuterium calculations using a combinatorial strategy. The approach requires data-independent acquisition (DIA) methods that are available on most MS platforms, making the switch to HX-MS 2 straightforward. Importantly, we find that HX-DIA enables a proteomics-grade approach and wide-spread applications. Considerable time is saved through auto-curation and complex samples can now be characterized and at higher throughput. We illustrate these advantages in a drug binding analysis of the ultra-large protein kinase DNA-PKcs, isolated directly from mammalian cells.

59 BASIC BIOLOGICAL SCIENCES↗

Tigres Workflow Library: Supporting Scientific Pipelines on HPC Systems

The growth in scientific data volumes has resulted in the need for new tools that enable users to operate on and analyze data on large-scale resources. In the last decade, a number of scientific workflow tools have emerged. These tools often target distributed environments, and often need expert help to compose and execute the workflows. Data-intensive workflows are often ad-hoc, they involve an iterative development process that includes users composing and testing their workflows on desktops, and scaling up to larger systems. In this paper, we present the design and implementation of Tigres, a workflow library that supports the iterative workflow development cycle of data-intensive workflows. Tigres provides an application programming interface to a set of programming templates i.e., sequence, parallel, split, merge, that can be used to compose and execute computational and data pipelines. We discuss the results of our evaluation of scientific and synthetic workflows showing Tigres performs with minimal template overheads (mean of 13 seconds over all experiments). We also discuss various factors (e.g., I/O performance, execution mechanisms) that affect the performance of scientific workflows on HPC systems.

97 MATHEMATICS AND COMPUTING↗

A Scientific Data Processing Framework for Time Series NetCDF Data

ARM Data Integrator (ADI) is a framework to streamline the development of scientific algorithms that analyze time-series NetCDF data, and to improve the content and consistency of the output data products produced by these algorithms. ADI achieves these goals by automating the process of retrieving and preparing data for analysis, supporting the definition of output data products through a graphical interface, and providing a modular, flexible software development architecture. The input data, preprocessing, and output data specifications are defined through a graphical interface and stored in a database. ADI also includes a workflow for data integration, a library of software modules to support the workflow, and a source code generator that produces C, IDL and Python templates. Data preparation support includes automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog. The variable and attribute definitions of the existing data products can be used to build new output data products. In addition, the rules that make up the ARM archive’s data standards are laid on top of the view of the new data product providing the user with a visual cue indicating where their output violates an archive standard. The necessary configurations are stored in a database that is accessed by the ADI libraries. This paper discusses the ADI framework, its supporting components, and how ADI can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Atmospheric Science↗

The Nasa SRA Process as It Relates to Open-Source Workflows Developed for GeneLab Data Processing

To release open, standards-compliant processed data sets in the Open Science Data Repository (OSDR), the GeneLab Data Processing team works with the scientific community through the OSDR Analysis Working Groups to design and build open-source data processing pipelines. Once baselined internally, these pipelines are wrapped into workflows and published on the NASA GeneLab Data Processing public GitHub repository along with detailed instructions for installation and use. Each workflow must be approved through NASA's Software Release Authorization (SRA) process prior to publishing. However, the SRA process lacks sufficient documentation and clarity regarding which forms are applicable for new open-source software that utilizes publicly available 3rd party tools, and the SRA process can take several months to complete, making sharing software outside of NASA cumbersome and in contradiction with the concept of Open Science. Furthermore, the SRA process was designed as a one-size fits all approach and thus many of the questions asked are not applicable to our open-source workflows. Here we describe the software provided on the NASA GeneLab Data Processing GitHub repository, summarize our experiences with the SRA process to release these software, and propose a more stream-lined approach for review of open-source projects.

Software Release Authorization↗

The NASA SRA Process as it Relates to Open-Source Workflows Developed for GeneLab Data Processing

To release open, standards-compliant processed data sets in the Open Science Data Repository (OSDR), the GeneLab Data Processing team works with the scientific community through the OSDR Analysis Working Groups to design and build open-source data processing pipelines. Once baselined internally, these pipelines are wrapped into workflows and published on the NASA GeneLab Data Processing public GitHub repository along with detailed instructions for installation and use. Each workflow must be approved through NASA's Software Release Authorization (SRA) process prior to publishing. However, the SRA process lacks sufficient documentation and clarity regarding which forms are applicable for new open-source software that utilizes publicly available 3rd party tools, and the SRA process can take several months to complete, making sharing software outside of NASA cumbersome and in contradiction with the concept of Open Science. Furthermore, the SRA process was designed as a one-size fits all approach and thus many of the questions asked are not applicable to our open-source workflows. Here we describe the software provided on the NASA GeneLab Data Processing GitHub repository, summarize our experiences with the SRA process to release these software, and propose a more stream-lined approach for review of open-source projects.

Software Release Authorization↗

Reduced Order Models Generation for HTGRs Pebble Shuffling Procedure Optimization Studies

This report provides an initial study for producing reduced-order models (ROMs) of pebble-bed high temperature gas reactor (HTGR) models for the purposes of design optimization. As an initial study, this work is meant to be exploratory---identifying useful workflows and methods for ROM generation---and not meant to be a catch-all analysis of HTGR ROM generation and usage for optimization. This report summarizes three tasks performed in Fiscal Year 2022: 1) the creation of HTGR model, 2) the sensitivity analysis of model design parameters, and 3) an introduction to ROM generation techniques. The representative HTGR model created in this work is a multiphysics equilibrium-core using the BlueCRAB (comprehensive reactor analysis bundle) reactor analysis application, coupling four physical phenomena: neutronics, streamline depletion, porous flow thermal hydraulics, and pebble heat conduction. Part of the model creation was identifying some design parameters and quantities of interest that are relevant in an optimization analysis and adjustable in the model. The sensitivity analysis utilized a polynomial chaos expansion methodology to compute global sensitivity metrics. This analysis showed that thermal hydraulics parameters and quantities of interest had a relatively small impact on simulation results. Finally, the ROM generation work involved exploring three different ROM methodologies: polynomial regression, a Gaussian process, and artificial neural networks. Using a cross-validation technique to characterize ROM performance, the Gaussian process and single-layer artificial neural networks showed the most promising results. Overall, this study was insightful and the lessons learned will be invaluable for the eventual development of an HTGR design optimization workflow.

97 MATHEMATICS AND COMPUTING↗

Incorporating geological structure into sensitivity analysis of subsurface contaminant transport

Simulating subsurface contaminant transport at the kilometer-scale often entails modeling reactive flow and transport within and through complex geologic structures. These structures are typically meshed by hand and as a result geologic structure is usually represented by one or a few deterministically generated geological models for uncertainty studies of flow and transport in the subsurface. Uncertainty in geologic structure can have a significant impact on contaminant transport. In this study, the impact of geologic structure on contaminant tracer transport in a shale formation is investigated for a simplified generic deep geologic repository for permanent disposal of spent nuclear fuel. An open-source modeling framework is used to perform a sensitivity analysis study on transport of two tracers from a generic spent nuclear fuel repository with uncertain location of the interfaces between the stratum of the geologic structure. The automated workflow uses sampled realizations of the geological structural model in addition to uncertain flow parameters in a nested sensitivity analysis. Concentration of the tracers at observation points within, in line with, and downstream of the repository are used as the quantities of interest for determining model sensitivity to input parameters and geological realization. Finally, the results of the study indicate that the location of strata interfaces in the geological structure has a first-order impact on tracer transport in the example shale formation, and that this impact may be greater than that of the uncertain flow parameters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗