Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

RhizoNet segments plant roots to assess biomass and growth for enabling self-driving labs

Abstract Flatbed scanners are commonly used for root analysis, but typical manual segmentation methods are time-consuming and prone to errors, especially in large-scale, multi-plant studies. Furthermore, the complex nature of root structures combined with noisy backgrounds in images complicates automated analysis. Addressing these challenges, this article introduces RhizoNet, a deep learning-based workflow to semantically segment plant root scans. Utilizing a sophisticated Residual U-Net architecture, RhizoNet enhances prediction accuracy and employs a convex hull operation for delineation of the primary root component. Its main objective is to accurately segment root biomass and monitor its growth over time. RhizoNet processes color scans of plants grown in a hydroponic system known as EcoFAB, subjected to specific nutritional treatments. The root detection model using RhizoNet demonstrates strong generalization in the validation tests of all experiments despite variable treatments. The main contributions are the standardization of root segmentation and phenotyping, systematic and accelerated analysis of thousands of images, significantly aiding in the precise assessment of root growth dynamics under varying plant conditions, and offering a path toward self-driving labs.

59 BASIC BIOLOGICAL SCIENCES↗

SU-C-9A-02: Structured Noise Index as An Automated Quality Control for Nuclear Medicine: A Two Year Experience

Purpose: Flood-field uniformity evaluation is an essential element in the assessment of nuclear medicine (NM) gamma cameras. It serves as the central element of the quality control (QC) program, acquired and analyzed on a daily basis prior to clinical imaging. Uniformity images are traditionally analyzed using pixel value-based metrics which often fail to capture subtle structure and patterns caused by changes in gamma camera performance requiring additional visual inspection which is subjective and time demanding. The goal of this project was to develop and implement a robust QC metrology for NM that is effective in identifying non-uniformity issues, reporting issues in a timely manner for efficient correction prior to clinical involvement, all incorporated into an automated effortless workflow, and to characterize the program over a two year period. Methods: A new quantitative uniformity analysis metric was developed based on 2D noise power spectrum metrology and confirmed based on expert observer visual analysis. The metric, termed Structured Noise Index (SNI) was then integrated into an automated program to analyze, archive, and report on daily NM QC uniformity images. The effectiveness of the program was evaluated over a period of 2 years. Results: The SNI metric successfully identified visually apparent non-uniformities overlooked by the pixel valuebased analysis methods. Implementation of the program has resulted in nonuniformity identification in about 12% of daily flood images. In addition, due to the vigilance of staff response, the percentage of days exceeding trigger value shows a decline over time. Conclusion: The SNI provides a robust quantification of the NM performance of gamma camera uniformity. It operates seamlessly across a fleet of multiple camera models. The automated process provides effective workflow within the NM spectra between physicist, technologist, and clinical engineer. The reliability of this process has made it the preferred platform for NM uniformity analysis.

07 ISOTOPE AND RADIATION SOURCES↗

Implementing JEDI into NASA GMAO’s Real Time Production Suite

NASA’s Global Modeling and Assimilation Office (GMAO) has prepared their first production system involving the Joint Effort for Data assimilation Integration (JEDI) framework. In this system the central analysis, that drives the deterministic forecast, will be provided using JEDI. This talk outlines the phased approach to implementing JEDI into production that GMAO has designed, and how this approach will allow for a careful analysis of the system against the existing data assimilation framework (GSI). In the first phase of implementation the existing data assimilation system will perform certain actions that are still under development in JEDI. These include thinning the observations and producing satellite bias correction coefficients. JEDI is hooked up to the existing workflow so a single line switch can activate whether the existing or JEDI-based analysis is cycled. Outside of the monumental effort to construct JEDI that is ongoing at the Joint Center for Satellite Data Assimilation (JCSDA), GMAO have undertaken two areas of considerable effort. The talk will describe these efforts and highlight the main challenges that have been encountered. The first area of work is to implement the background error model from the existing data assimilation system into JEDI. The second is to validate the observing system in JEDI against the one in GSI, which has involved several new features being added to the observation operators in JEDI. While the longer-term plans involve trying to improve on the GSI in these two areas, GMAO is keen to have JEDI start from a trusted baseline. This is also key to implementing JEDI quickly so other priorities, such as increasing the number of model levels, can be easily worked on in parallel. GMAO is actively working on a framework to shepherd in the next generation coupled data assimilation system and model. As JEDI is implemented for the first time the plan is to ambitiously cycle through implementations, frequently bringing JEDI features to production. Details of these plans will be given in the talk and we will highlight key implementation and product milestones that we hope to achieve, as well as touch on the development environment that we will use to support frequent refreshing of the production system.

JEDI↗

Comparative Analysis of Imaging and Measurements of Micrometer-Scale Fracture Aperture Fields Within a Heterogeneous Rock Using PET and X-ray CT

Knowledge of the spatial distribution of fracture apertures is essential for reliable characterization of flow and transport processes in fractured systems and for better understanding of physicochemical matrix–fracture interactions. Here, we propose and test two image-based methods, thereby extending the current experimental capabilities to characterize aperture size distribution in structurally heterogeneous geologic porous media noninvasively. The first approach utilizes an inversion method based on the dataset acquired from positron emission tomography (PET) and the second approach considers an extension of the classic missing attenuation technique that relies on clinical X-ray computed tomography (X-ray CT). Independent sets of imaging experiments are conducted on a fractured basalt core with heterogeneous matrix properties and aperture distributions to compare the two methodologies. A repeat of each experiment is conducted to verify the proposed workflows. The performance of these two imaging techniques is systematically evaluated through the analysis of signal-to-noise ratio, minimum fracture size detectability, and measurement errors. While both approaches provide a reliable estimation of fracture aperture distributions, PET yields a signal-to-noise ratio that is substantially higher than the corresponding X-ray CT measurements. Furthermore, uncertainties of the aperture values for PET are considerably lower ($\bar {\sigma}_{\text {d}} = 15\%$) compared to those obtained from X-ray CT ($\bar {\sigma}_{\text {d}} = 29\%$), allowing for the detection of minimum aperture sizes of 20 $\mu$m with 70% confidence level. Finally, these approaches provide key experimental tools for better understanding dynamic hydromechanical fracture properties in geologic systems.

58 GEOSCIENCES↗

Geospatial Data Workflow Orchestration and Architecture

In an era characterized by explosive growth in geospatial data, the selection of appropriate technologies for data storage, processing, and orchestration is critical for organizations aiming to maintain competitive advantages. This white paper provides a comprehensive analysis of how Oak Ridge National Laboratory (ORNL) has effectively employed various cloud technologies, including containerized applications, container orchestrators, and workflow orchestrators, to develop robust geospatial data processing solutions. We explore the fundamental concepts behind these technologies and compare multiple deployment models tailored to diverse use cases. Our findings conclude that while Kubernetes has emerged as the preferred platform for truly scalable and fault-tolerant production workflows, the choice of workflow orchestration tool requires careful consideration of team needs, pipeline complexity, and deployment environments. This paper aims to serve as a strategic guide for organizations leveraging geospatial data, articulating the balance between technology choices and practical implementation to enhance workflow efficacy and scalability.

97 MATHEMATICS AND COMPUTING↗

DOE JGI Metagenome Workflow

The DOE Joint Genome Institute (JGI) Metagenome Workflow performs metagenome data processing, including assembly; structural, functional, and taxonomic annotation; and binning of metagenomic data sets that are subsequently included into the Integrated Microbial Genomes and Microbiomes (IMG/M) (I.-M. A. Chen, K. Chu, K. Palaniappan, A. Ratner, et al., Nucleic Acids Res, 49:D751–D763, 2021, https://doi.org/10.1093/nar/gkaa939) comparative analysis system and provided for download via the JGI data portal (https://genome.jgi.doe.gov/portal/). This workflow scales to run on thousands of metagenome samples per year, which can vary by the complexity of microbial communities and sequencing depth. Here, we describe the different tools, databases, and parameters used at different steps of the workflow to help with the interpretation of metagenome data available in IMG and to enable researchers to apply this workflow to their own data. We use 20 publicly available sediment metagenomes to illustrate the computing requirements for the different steps and highlight the typical results of data processing. The workflow modules for read filtering and metagenome assembly are available as a workflow description language (WDL) file (https://code.jgi.doe.gov/BFoster/jgi_meta_wdl). The workflow modules for annotation and binning are provided as a service to the user community at https://img.jgi.doe.gov/submit and require filling out the project and associated metadata descriptions in the Genomes OnLine Database (GOLD) (S. Mukherjee, D. Stamatis, J. Bertsch, G. Ovchinnikova, et al., Nucleic Acids Res, 49:D723–D733, 2021, https://doi.org/10.1093/nar/gkaa983).

59 BASIC BIOLOGICAL SCIENCES↗

Bioinformatics Resource Manager: A systems biology web tool for microRNA and omics data integration

Background: The Bioinformatics Resource Manager (BRM) is a web-based tool developed to facilitate identifier conversion and data integration for Homo sapiens (human), Mus musculus (mouse), Rattus norvegicus (rat), Danio rerio (zebrafish), and Macaca mulatta (macaque), as well as perform orthologous conversions among the supported species. In addition to providing a robust means of identifier conversion, BRM also incorporates a suite of miRNA-target databases upon which to query target genes or to perform reverse target lookups using gene identifiers. Results: BRM has the capability to perform cross-species identifier lookups across common identifier types, directly integrate datasets across platform or species by performing identifier retrievals in the background, and retrieve miRNA targets from multiple databases simultaneously and integrate the resulting gene targets with experimental mRNA data. Here we use workflows provided in BRM to integrate RNAseq data across species to identify common biomarkers of exposure after treatment of human lung cells and zebrafish to benzo[a]pyrene (BAP). We further use the miRNA Target workflow to experimentally determine the role of miRNAs as regulators of BAP toxicity and identify the predicted functional consequences of miRNA-target regulation in our system. The output from BRM can easily and directly be uploaded to freely available visualization tools for further analysis. From these examples, we were able to identify an important role for several miRNAs as potential regulators of BAP toxicity in human lung cells associated with cell migration, cell communication, cell junction assembly and regulation of cell death. Conclusions: Overall, BRM provides bioinformatics tools to assist biologists having minimal programming skills with analysis and integration of high-content omics’ data from various transcriptomic and proteomic platforms. BRM workflows were developed in Java and other open-source technologies and are served publicly using Apache Tomcat at https://cbb.pnnl.gov/brm/.

bioinformatics, MicroRNA, systems biology, Genomic↗

Scientific Process Automation and Workflow Management

We introduce and describe scientific workflows, i.e., executable descriptions of automatable scientific processes such as computational science simulations and data analyses. Scientific workflows are often expressed in terms of tasks and their (data ow) dependencies. This chapter first provides an overview of the characteristic features of scientific workflows and outlines their life cycle. A detailed case study highlights workflow challenges and solutions in simulation management. We then provide a brief overview of how some concrete systems support the various phases of the workflow life cycle, i.e., design, resource management, execution, and provenance management. We conclude with a discussion on community-based workflow sharing.

97 MATHEMATICS AND COMPUTING↗

Characterizing, Modeling, and Accurately Simulating Power and Energy Consumption of I/O-intensive Scientific Workflows

While distributed computing infrastructures can provide infrastructure-level techniques for managing energy consumption, application-level energy consumption models have also been developed to support energy-efficient scheduling and resource provisioning algorithms. In this work, we analyze the accuracy of a widely-used application-level model that has been developed and used in the context of scientific workflow executions. To this end, we profile two production scientific workflows on a distributed platform instrumented with power meters. We then conduct an analysis of power and energy consumption measurements. This analysis shows that power consumption is not linearly related to CPU utilization and that I/O operations significantly impact power, and thus energy, consumption. We then propose a power consumption model that accounts for I/O operations, including the impact of waiting for these operations to complete, and for concurrent task executions on multi-socket, multi-core compute nodes. We implement our proposed model as part of a simulator that allows us to draw direct comparisons between real-world and modeled power and energy consumption. Here, we find that our model has high accuracy when compared to real-world executions. Furthermore, our model improves accuracy by about two orders of magnitude when compared to the traditional models used in the energy-efficient workflow scheduling literature.

97 MATHEMATICS AND COMPUTING↗

Q2 Report for FY25 Theory and Simulation Performance Target: Development of an integrated modeling framework for fusion reactor design and assessment

This report describes the work and activities carried out towards the completion of each of the following milestones in FY25 Q2: 1. Demonstrate workflow for generating self-consistent CESOL plasma profiles + first wall and divertor loading prediction and generate the CAT plasma and neutron loading needed for further engineering analysis: $\circ$ Run CESOL with BOUT++/Hermes-3 and immersed boundary condition to directly map to wall: • Run BOUT++/Hermes-3 through the IPS workflow to find radial particle and energy diffusivities to match either the Eich or the physics-based scaling of the SOL heat flux width, and • Expand source of first wall heat flux to include charged particles, neutrals, and radiation from the core+edge. 2. Generate medium fidelity parametrized CAD: $\circ$ Develop the TRACER tool to read an existing CAD, regenerate the geometry based on vertex location and connectivity information, define vertex translation and parameters needed for scaling the CAD, and $\circ$ Utilize the FreeGS code to determine CAT PF coil placement, including minimizing the number of coils, coil current, and electromechanical stresses. 3. Utilize plasma loading for engineering analysis: $\circ$ Couple the plasma loading to input for OpenFOAM and demonstrate initial test of thermal analysis of CAT first wall loading with typical DCLL blanket component cooling boundary conditions. 4. Demonstrate nuclear analysis: $\circ$ Apply initial analysis of tritium transport in DCLL blanket by evaluating spatially resolved tritium generation rates, tritium diffusion and convection.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗

QuaSiMo: A composable library to program hybrid workflows for quantum simulation

Abstract A composable design scheme is presented for the development of hybrid quantum/classical algorithms and workflows for applications of quantum simulation. The proposed object‐oriented approach is based on constructing an expressive set of common data structures and methods that enables programming of a broad variety of complex hybrid quantum simulation applications. The abstract core of the scheme is distilled from the analysis of the current quantum simulation algorithms. Subsequently, it allows synthesis of new hybrid algorithms and workflows via the extension, specialisation, and dynamic customisation of the abstract core classes defined by the proposed design. The design scheme is implemented using the hardware‐agnostic programming language QCOR into the QuaSiMo library. To validate the implementation, the authors test and show its utility on commercial quantum processors from IBM and Rigetti, running some prototypical quantum simulations.

97 MATHEMATICS AND COMPUTING↗

Large-Scale and Deep Quantitative Proteome Profiling Using Isobaric Labeling Coupled with Two-Dimensional LC-MS/MS

Comprehensive, quantitative information on abundances of proteins and their post-translational modifications (PTMs) can potentially provide novel biological insights into diseases pathogenesis and therapeutic intervention. Herein, we introduce a quantitative strategy utilizing isobaric stable isotope-labelling techniques combined with two-dimensional liquid chromatography-tandem mass spectrometry (2D-LC-MS/MS) for large-scale, deep quantitative proteome profiling of biological samples or clinical specimens such as tumor tissues. The workflow includes isobaric labeling of tryptic peptides for multiplexed and accurate quantitative analysis, basic reversed-phase LC fractionation and concatenation for reduced sample complexity, and nano-LC coupled to high resolution and high mass accuracy MS analysis for high confidence identification and quantification of proteins. This proteomic analysis strategy has been successfully applied for in-depth quantitative proteomic analysis of tumor samples, and can also be used for integrated proteome and PTM characterization, as well as comprehensive quantitative proteomic analysis across samples from large clinical cohorts.

Environmental Molecular Sciences Laboratory↗

EpiK: A Knowledge Base for Epidemiological Modeling and Analytics of Infectious Diseases

Computational epidemiology seeks to develop computational methods to study the distribution and determinants of health-related states or events (including disease), and the application of this study to the control of diseases and other health problems. Recent advances in computing and data sciences have led to the development of innovative modeling environments to support this important goal. The datasets used to drive the dynamic models as well as the data produced by these models presents unique challenges owing to their size, heterogeneity and diversity. These datasets form the basis of effective and easy to use decision support and analytical environments. As a result, it is important to develop scalable data management systems to store, manage and integrate these datasets. In this paper, we develop EpiK —a knowledge base that facilitates the development of decision support and analytical environments to support epidemic science. An important goal is to develop a framework that links the input as well as output datasets to facilitate effective spatio-temporal and social reasoning that is critical in planning and intervention analysis before and during an epidemic. The data management framework links modeling workflow data and its metadata using a controlled vocabulary. The metadata captures information about storage, the mapping between the linked model and the physical layout, and relationships to support services. EpiK is designed to support agent-based modeling and analytics frameworks—aggregate models can be seen as special cases and are thus supported. We use semantic web technologies to create a representation of the datasets that encapsulates both the location and the schema heterogeneity. The choice of RDF as a representation language is motivated by the diversity and growth of the datasets that need to be integrated. A query bank is developed—the queries capture a broad range of questions that can be posed and answered during a typical case study pertaining to disease outbreaks. The queries are constructed using SPARQL Protocol and RDF Query Language (SPARQL) over the EpiK. EpiK can hide schema and location heterogeneity while efficiently supporting queries that span the computational epidemiology modeling pipeline: from model construction to simulation output. As a result, we show that the performance of benchmark queries varies significantly with respect to the choice of hardware underlying the database and resource description framework (RDF) engine.

60 APPLIED LIFE SCIENCES↗

Broadband impedance modeling and single bunch instabilities estimations of the advanced light source upgrade project

We report the Advanced Light Source Upgrade (ALS-U) is a 4th generation diffraction-limited soft x-ray radiation source, consisting of a new accumulator ring (AR) and a new storage ring (SR). In both rings coupling-impedance driven instabilities need careful evaluation to ensure meeting the machine’s high-performance goals. This paper presents the workflow followed in building the impedance models and the beam-stability analysis based on those models. We follow the commonly accepted approach of separating the resistive-wall and the geometric parts of the impedance; the former is obtained by analytical formulas, the latter by numerical electro-magnetic codes (primarily CST Studio software) with perfectly-conducting boundary conditions. Impedance budgets are established and pseudo-Green functions calculated to be used in beam dynamics studies. We also present various ways to cross-check simulation results for reliable impedance modeling. Finally, the crucial single-bunch instability current thresholds for various operation modes are determined and discussed.

07 ISOTOPE AND RADIATION SOURCES↗

High-resolution hourly surrogate modeling framework for physics-based large-scale building stock modeling

Surrogate modeling can play a key role in reducing high computational burdens for large-scale physics-based modeling and uncertainty quantification. With the rapid development of large-scale building stock energy modeling, surrogate modeling has also begun to be widely applied in this field; however, most existing surrogate models lack hourly time resolution for regional-scale modeling, which is essential for understanding building demand profiles and grid impacts. Further, there is generally a lack of necessary data and feature engineering frameworks specific to building modeling for efficiently managing large datasets and complex computations. Furthermore, this paper proposes a modeling framework for large-scale (city-/region-scale), high-resolution, high-fidelity surrogate building stock energy models. Our developed framework consists of six modules: (1) building stock energy modeling (ComStock TM and ResStock TM ), (2) data engineering for large simulation data, (3) high performance computing workflow, (4) feature engineering, (5) machine learning model development, and (6) model performance evaluation. Two case studies apply the developed framework in both residential and commercial building stock analysis to demonstrate its computational efficiency and surrogate modeling accuracies. Results show that surrogate models, when efficiently trained using the HPC workflow module, reach a high level of modeling accuracy for two case studies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Simulating charged defects at database scale

Point defects have a strong influence on the physical properties of materials, often dominating the electronic and optical behavior in semiconductors and insulators. The simulation and analysis of point defects is, therefore, crucial for understanding the growth and operation of materials, especially for optoelectronics applications. In this work, we present a general-purpose Python framework for the analysis of point defects in crystalline materials as well as a generalized workflow for their treatment with high-throughput simulations. The distinguishing feature of our approach is an emphasis on a unique, unit cell, structure-only, definition of point defects which decouples the defect definition, and the specific supercell representation used to simulate the defect. This allows the results of first-principles calculations to be aggregated into a database without extensive provenance information and is a crucial step in building a persistent database of point defects that can grow over time, a key component toward realizing the idea of a “defect genome” that can yield more complex relationships governing the behavior of defects in materials. We demonstrate several examples of the approach for three technologically relevant materials and highlight current pitfalls that must be considered when employing these methodologies as well as their potential solutions.

36 MATERIALS SCIENCE↗

Simulating and benchmarking neutron total scattering instrumentation from inception of events to reduced and fitted data

In the design and realization of modern neutron scattering instrumentation, particularly when designing beamline concepts from the ground up, it is desirable to fully benchmark against realistically simulated data. This is especially true for total scattering beamlines, where the future deliverable data is to be analysed in both reciprocal- and real-space representations, and needs must be carefully balanced to ensure sufficient range, resolution and flux of the instrument. An approach to optimize the design of neutron scattering instrumentation via a workflow including ray-tracing simulations, event-based data reduction, heuristic analysis and fitting against realistically simulated spectra is demonstrated here. The case of the DISCOVER beamline concept at the Spallation Neutron Source is used as an example. The results of the calculations are benchmarked through simulation of existing instrumentation and subsequent direct comparison with measured data. Finally, on the basis of the validated models, the ability to explore design characteristics for future beamline concepts or future instrument improvements is demonstrated through the examples of detector tube size and detector layout.

47 OTHER INSTRUMENTATION↗