Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

Developing an Automated Microscopic Traffic Simulation Scenario Generation Tool

Traffic simulation is an effective tool for urban planners, traffic engineers, and researchers to study traffic. In particular, microscopic traffic simulation, which simulates individual vehicles’ movements within a transportation network, has demonstrated its importance in analyzing and managing transportation systems. However, integrating data from various sources, generating traffic scenarios, and importing information into traffic simulators to conduct microscopic simulations have always been a challenge. This paper presents a solution to overcome this challenge: RealTwin, a comprehensive tool for automated scenario generation for microscopic traffic simulation. Following a streamlined scenario generation and calibration workflow, RealTwin effectively bridges gaps between traffic data from various sources and traffic simulators, making microscopic traffic simulation more accessible for researchers and engineers across various levels of expertise. Using RealTwin to generate a real-world traffic scenario in Simulation of Urban Mobility (SUMO), VISSIM, and AIMSUN, RealTwin’s ability is demonstrated in the construction of realistic and consistent traffic scenarios in different simulators. Furthermore, this paper introduces and illustrates RealTwin’s capability for technology (e.g., autonomous vehicle) scenario generation. This feature can contribute to more comprehensive microscopic simulations, facilitating the analysis of potential effects of various technological innovations on mobility, energy efficiency, and safety. Finally, RealTwin is used to calibrate a simulation in SUMO. In conclusion, the calibration module enhances RealTwin’s ability to generate consistent simulations across different platforms and more realistic simulations that reflect real-world traffic operations.

autonomous vehicle↗

Weather from 250 Miles Up: Visualizing Precipitation Satellite Data (and Other Weather Applications) Using CesiumJS

Geospatial weather visualization remains predominately a two-dimensional endeavor. Even popular advanced tools like the Nullschool Earth display 2-dimensional fields on a 3-dimensional globe. Yet much of the observational data and model output contains detailed three-dimensional fields. In 2014, NASA and JAXA (Japanese Space Agency) launched the Global Precipitation Measurement (GPM) satellite. Its two instruments, the Dual-frequency Precipitation Radar (DPR) and GPM Microwave Imager (GMI) observe much of the Earth's atmosphere between 65 degrees North Latitude and 65 degrees South Latitude. As part of the analysis and visualization tools developed by the Precipitation Processing System (PPS) Group at NASA Goddard, a series of CesiumJS [Using Cesium Markup Language (CZML), JavaScript (JS) and JavaScript Object Notation (JSON)] -based globe viewers have been developed to improve data acquisition decision making and to enhance scientific investigation of the satellite data. Other demos have also been built to illustrate the capabilities of CesiumJS in presenting atmospheric data, including model forecasts of hurricanes, observed surface radar data, and gridded analyses of global precipitation. This talk will present these websites and the various workflows used to convert binary satellite and model data into a form easily integrated with CesiumJS.

web applications↗

A View from Above: Cloud Plots to Visualize Global Metabolomic Data

Global metabolomics describes the comprehensive analysis of small molecules in a biological system without bias. With mass spectrometry-based methods, global metabolomic data sets typically comprise thousands of peaks, each of which is associated with a mass-to-charge ratio, retention time, fold change, p-value, and relative intensity. Although several visualization schemes have been used for metabolomic data, most commonly used representations exclude important data dimensions and therefore limit interpretation of global data sets. Given that metabolite identification through tandem mass spectrometry data acquisition is a time-limiting step of the untargeted metabolomic workflow, simultaneous visualization of these parameters from large sets of data could facilitate compound identification and data interpretation. Here, we present such a visualization scheme of global metabolomic data using a so-called “cloud plot” to represent multidimensional data from septic mice. While much attention has been dedicated to lipid compounds as potential biomarkers for sepsis, the cloud plot shows that alterations in hydrophilic metabolites may provide an early signature of the disease prior to the onset of clinical symptoms. The cloud plot is an effective representation of global mass spectrometry-based metabolomic data, and we describe how to extract it as standard output from our XCMS metabolomic software.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Adapting a Low-Cost and Open-Source Commercial Pipetting Robot for Nanoliter Liquid Handling

Nanoliter liquid handling capabilities in bioanalytical workflows can reduce reagent costs and improve sample processing efficiency. Here we report the successful modification of a low-cost commercially available pipetting robot, the Opentrons 1 (OT1), using inexpensive 3D-printed parts to accommodate low-nanoliter volumes. The pipetting accuracy and precision of the modified OT1 for 50 nL volumes of water was 0.2% and 2%, respectively. The accuracy and precision at 20 nL was 1% and 3.8%, respectively. The platform was successfully applied to the preparation of low-nanogram proteomic samples for liquid chromatography-mass spectrometry analysis. The modified OT1 is thus an effective platform for nanoliter liquid handling and, at a total cost of less than $6000 including the commercial liquid handler and all modifications, is far less expensive and more versatile than other platforms with similar capabilities, placing this technology within reach of a far broader scientific community.

47 OTHER INSTRUMENTATION↗

Phylogenomic discovery and engineering of nitrogen fixation into the bioenergy woody crop poplar

Biological nitrogen fixation (BNF) is a key process enabling plants in specific lineages to convert atmospheric dinitrogen (N₂) into bioavailable ammonia through symbioses with diazotrophic microbes. Expanding this capability beyond native nitrogen-fixing clades into non-nodulating crops would reduce synthetic fertilizer use, lowering energy inputs and environmental impacts in agriculture. Supported by DOE Funding Award DE-SC0018247, the NitFix project advanced foundational knowledge required to engineer root-nodule symbioses in new host species. The team generated the most comprehensive phylogenomic analysis to date of all known nodulating lineages, resolving the evolutionary history of nitrogen-fixing symbiosis and identifying core gene suites retained across nodulating taxa. Through multimodal genomics, transcriptomics, and functional analyses in Medicago truncatula and related species, the project mapped regulatory networks underlying nodule organogenesis, bacterial infection, and nitrogen-fixation efficiency. Key discoveries include the identification of conserved signaling modules for rhizobial recognition, transcription factors controlling nodule differentiation, and metabolic pathways integrating fixed nitrogen into plant growth. The project also developed enabling tools—including optimized transformation pipelines, gene-editing workflows, and imaging-based phenotyping—to accelerate engineering efforts in emerging models. Together, these results refine the mechanistic framework of symbiotic nitrogen fixation and highlight transferable components essential for rewiring these traits into non-nodulating crops.

59 BASIC BIOLOGICAL SCIENCES↗

Optimal Efficiency and Operational Cost Savings: A Framework for Automated Rooftop PV Placement

Residential energy consumers are charged based on a utility rate structure, such as net metering or feed-in tariff. To lower consumers' electricity bills, expensive batteries are deployed to reduce the electricity fed from the grid during peak hours. However, strategic photovoltaic (PV) panel placement enables the reduction of operational energy cost while considering the spatial feasibility and efficiency for hosting rooftop PV. In this paper, we present a framework to automatically identify the optimal location of rooftop PV panels on residential buildings. Our framework integrates multiple workflows, including energy and environmental simulation, parametric modeling, and optimization to identify the ideal location of PV panels to balance the demand and supply at a building and community scale. These workflows are linked using the Grasshopper plug-in for Rhinoceros CAD software. The framework includes two different workflows, each satisfying a target for optimal PV placement: (a) maximizing PV panel efficiency, where users aim to maximize energy generation, and (b) minimizing operational energy cost, where "best'' panels are selected considering utility rates for operational energy cost. Our framework is demonstrated in a residential community in Fort Collins, Colorado, to generate the optimal PV placement for each of the two aforementioned targets. Results from the two workflows are compared to illustrate the effect of PV location and orientation on solar energy production efficiency and operational energy cost. The developed workflows are introduced as tools within the Grasshopper plug-in to investigate the solar potential of rooftop PV panels while taking into account factors such as contextual shading, utility rate structures, and buildings' energy demand profiles.

30 DIRECT ENERGY CONVERSION↗

Geochemical and Microstructural Characterization of Shale Rock: A Workflow for Site Evaluation for Energy–Fluids Storage

Shales are a central component of petroleum systems, as source, seal, and unconventional reservoir rocks. Unlike traditional unconventional shale, a newly emerging Caney Shale play is regarded as an unconventional of unconventional shales (UUS), due to its high content of fine-grained materials, lower reservoir porosity, dominance of nanopores, and a scarcity of visible natural fractures. Other developed unconventional shales such as the Woodford and Barnett have larger average pore size, higher porosity, and extensive natural fractures at core scale that contribute to reservoir quality. In this work, the Caney Shale was cored in entirety to characterize its interbedded ductile and reservoir intervals and establish criteria for their recognition. Representative ductile and reservoir intervals known as D2 and R3, respectively, were selected for detailed analysis including variations in elemental composition, mineralogy, facies, and the presence of natural fractures at well and core scales using X-ray fluorescence, X-ray diffraction, and thin section and core description. Characteristics of microstructure and microgeochemistry at nano- and microscales are compared using field emission scanning electron microscopy with energy dispersive spectroscopy and lowpressure nitrogen adsorption isotherms with fractal dimension analysis. The ductile (detrital clay-rich) member D2 is characterized by higher concentrations of Ti and Al and lower Si, while the reservoir R3 (possibly biogenic silica-accumulated) is characterized by lower Ti and Al and higher Si. Eight mixed carbonate–siliciclastic facies are recognized, and R3 shows a higher heterogeneity of facies stacking and average fracture abundance than D2. Further, R3 shows a more microscopically heterogeneous fabric/texture of matrix and a higher microporosity than D2 that has a higher pore surface heterogeneity. A fundamental understanding of the compositional and microstructural characteristics of UUS and further ductile/reservoir intervals will allow for a better assessment of reservoir quality, more effective production of hydrocarbons, and optimized selection of safe caprocks in carbon sequestration and subsurface hydrogen storage.

58 GEOSCIENCES↗

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has been deployed in occupied residential neighborhood. This system enables automatic data collection, learning, optimization, and dispatches signals to neighborhood devices. HVAC optimization is based on model predictive control (MPC). Since the operational performance of MPC depends on model forecasting accuracy, it is crucial to evaluate the model continuously and modify or retrain it as necessary. In this research, we developed an automated workflow to evaluate the performance of temperature and power forecasts based on measured data in the real world. This will provide researchers with a deeper understanding of the model and how it can be improved.

Lebakula, Viswadeep↗

CRAB3: Establishing a new generation of services for distributed analysis at CMS

In CMS Computing the highest priorities for analysis tools are the improvement of the end users ability to produce and publish reliable samples and analysis results as well as a transition to a sustainable development and operations model. To achieve these goals CMS decided to incorporate analysis processing into the same framework as data and simulation processing. This strategy foresees that all workload tools (TierO, Tier1, production, analysis) share a common core with long term maintainability as well as the standardization of the operator interfaces. The re-engineered analysis workload manager, called CRAB3, makes use of newer technologies, such as RESTFul based web services and NoSQL Databases, aiming to increase the scalability and reliability of the system. As opposed to CRAB2, in CRAB3 all work is centrally injected and managed in a global queue. A pool of agents, which can be geographically distributed, consumes work from the central services serving the user tasks. The new architecture of CRAB substantially changes the deployment model and operations activities. In this paper we present the implementation of CRAB3, emphasizing how the new architecture improves the workflow automation and simplifies maintainability. In particular, we will highlight the impact of the new design on daily operations.

Cinquilli, M.↗

Visolis Microbial Chemical Intermediate Library Screening (CRADA Final Report)

Visolis is developing a commercial process for the bioproduction of a chemical intermediate, towards the derivative production of a portfolio of bio-based chemicals with large application potential, from drop-in commodity chemicals, to innovative specialty chemical offerings, to materials for multiple end markets and industries, which will ultimately benefit consumers and the public. Visolis already has several variants of a microbe that produce the chemical intermediate at distinct levels (i.e. high, medium, and low). They are currently pursuing transcriptomics analysis for some of these strains, towards a better understanding of the biology behind what makes certain strains perform better than others. There exist genome-scale library approaches for the microbe that could be used to screen gene disruption, overexpression, or repression candidates for perturbations to the production of the chemical intermediate. These approaches often reveal opportunities for further production improvement that are not otherwise accessible using hypothesis-driven metabolic engineering approaches. However, Visolis, while it could generate or procure such genome-scale libraries, does not have the automated strain engineering workflows required to screen thousands of variants, obtaining a production phenotype and a genotype for each. The purpose of this collaboration is to use LBNL and SNL capabilities to enable Visolis to effectively screen thousands of genome-scale library strain variants for phenotype/genotype relationships that will complement Visolis’ transcriptomic investigations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A 4D Synchrotron X-Ray-Tomography Study of the Formation of Hydrocarbon- Migration Pathways in Heated Organic-Rich Shale

Recovery of oil from oil shales and the natural primary migration of hydrocarbons are closely related processes that have received renewed interest in recent years because of the ever tightening supply of conventional hydrocarbons and the growing production of hydrocarbons from low-permeability tight rocks. Quantitative models for conversion of kerogen into oil and gas and the timing of hydrocarbon generation have been well documented. However, lack of consensus about the kinetics of hydrocarbon formation in source rocks, expulsion timing, and how the resulting hydrocarbons escape from or are retained in the source rocks motivates further investigation. In particular, many mechanisms have been proposed for the transport of hydrocarbons from the rocks in which they are generated into adjacent rocks with higher permeabilities and smaller capillary entry pressures, and a better understanding of this complex process (primary migration) is needed. To characterize these processes, it is imperative to use the latest technological advances. In this study, it is shown how insights into hydrocarbon migration in source rocks can be obtained by using sequential high-resolution synchrotron X-ray tomography. Three-dimensional images of several immature "shale" samples were constructed at resolutions close to 5 um. This is sufficient to resolve the source-rock structure down to the grain level, but very-fine-grained silt particles, clay particles, and colloids cannot be resolved. Samples used in this investigation came from the R-8 unit in the upper part of the Green River shale, which is organic rich, varved, lacustrine marl formed in Eocene Lake Uinta, USA. One Green River shale sample was heated in situ up to 400 degrees C as X-ray-tomography images were recorded. The other samples were scanned before and after heating at 400 degrees C. During the heating phase, the organic matter was decomposed, and gas was released. Gas expulsion from the low-permeability shales was coupled with formation of microcracks. The main technical difficulty was numerical extraction of microcracks that have apertures in the 5- to 30-um range (with 5 um being the resolution limit) from a large 3D volume of X-ray attenuation data. The main goal of the work presented here is to develop a methodology to process these 3D data and image the cracks. This methodology is based on several levels of spatial filtering and automatic recognition of connected domains. Supportive petrographic and thermogravimetric data were an important complement to this study. An investigation of the strain field using 2D image correlation analyses was also performed. As one application of the 4D (space + time) microtomography and the developed workflow, we show that fluid generation was accompanied by crack formation. Under different conditions, in the subsurface, this might provide paths for primary migration.

3D image processing↗

SU-F-J-53: A 3D Printed Phantom for the Use of Daily Quality Assurance Alignment Tests

Purpose: To discuss experiences and results for a 3D printed QA phantom used for daily alignment purposes for a six degrees-of-freedom (6DoF) table Methods: A 3D model was created using a fused deposition modeling (FDM) printer using free online computer-aided design (CAD) software. The model has been under use for daily QA alignment tests for a 6DoF couch. An aligned and angled baseplate were also printed in order to introduce known angles for 6DoF corrections during image-guidance. Unique registration contours were created on the faces of the phantom in order to achieve a better cone-beam computed tomography (CBCT) match using an auto-registration algorithm. A BB was also introduced at the center of the phantom in order to deliver an integrated daily Winston-Lutz (WL) test. Translational, rotational, and WL results were tabulated over one month. Results: The ’honeycomb’ structure of the print was apparent in the EPID images for the WL test, which affected the results of the analysis software. This was fixed by inserting a cube made of polyoxymethylene within the 3D phantom that encompass the BB. Auto-registration results for the three translational and three rotational from a known offset to the BB isocenter consistently fell within 1 mm and 0.2°, respectively. WL tests resulted in an average of 0.71 ± 0.14 mm. Conclusion: 3D printed models allow for accurate builds that can be customized to a variety of clinical needs. Results from translational, rotational, and WL show consistent results over a month’s time. Given its relatively cheap and streamlined workflow, 3D printing could be implemented into any clinic looking to create customized phantoms.

60 APPLIED LIFE SCIENCES↗

A Codesign Framework for Online Data Analysis and Reduction

In this paper we discuss our design of a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for performing parametric studies on coupled applications. Cheetah facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage vs. compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design choices of Cheetah by using a reaction-diffusion simulation (Gray-Scott) paired with an analysis application to demonstrate initial results of fine-grained process placement on Summit, a pre-exascale supercomputer at Oak Ridge National Laboratory.

Mehta, Kshitij↗

Frequent Fulcrum Functions: The Basics of SCALE’s Graphical User Interface [Slides]

This tutorial introduces the Fulcrum graphical user interface and the basic functions that enhance the common activities of creating, editing, navigating, executing, and visualizing SCALE input files. This tutorial will help you become familiar with the Fulcrum input file text editor and the integrated input development environment features of autocompletion, automatic checking, cursor context, and input navigation. In addition, the Fulcrum and SCALE runtime environment will be reviewed to improve the understanding of job execution workflow. This tutorial does not cover data and geometry plotting. Please see the Advanced User Interface Capabilities tutorial for details regarding plotting data and geometry. No prior experience with SCALE is required. You can follow along using SCALE 6.2 or 6.3-beta.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Supercomputers, Clouds and Grids powered by BigPanDA for Brain studies

The PanDA WMS - Production and Distributed Analysis Workload Management System - has been developed and used by the ATLAS experiment at the LHC (Large Hadron Collider) for all data processing and analysis challenges. BigPanDA is an extension of the PanDA WMS to run ATLAS and non-ATLAS applications on Leadership Class Facilities and supercomputers, as well as traditional grid and cloud resources. The success of the BigPanDA project has drawn attention from other compute intensive sciences such as biology. In 2017, a pilot project was started between BigPanDA and the Blue Brain Project (BBP) of the Ecole Polytechnique Federal de Lausanne (EPFL) located in Lausanne, Switzerland. This proof of concept project is aimed at demonstrating the efficient application of the BigPanDA system to support the complex scientific workflow of the BBP, which relies on using a mix of desktop, cluster and supercomputers to reconstruct and simulate accurate models of brain tissue.

Computer Science↗

TX$^2$: Transformer eXplainability and eXploration

The Transformer eXplainability and eXploration (Martindale & Stewart, 2021), or TX 2 software package, is a library designed for artificial intelligence researchers to better understand the performance of transformer models (Vaswani et al., 2017) used for sequence classification. The tool is capable of integrating with a trained transformer model and a dataset split into training and testing populations to produce an ipywidget (Project Jupyter Contributors, 2021) dashboard with a number of visualizations to understand model performance with an emphasis on explainability and interpretability. The TX 2 package is primarily intended to integrate into a workflow centered around Jupyter Notebooks (Kluyver et al., 2016), and currently assumes the use of PyTorch (Paszke et al., 2019) and Hugging Face transformers library (Wolf et al., 2020). The dashboard includes visualization and data exploration features to aid researchers, including an interactive UMAP embedding graph (McInnes et al., 2018) to understand classification clusters, a word salience map that can be updated as researchers alter textual entries in near real time, a set of tools to understand word frequency and importance based on the clusters in the UMAP embedding graph, and a set of traditional confusion matrix analysis tools.

97 MATHEMATICS AND COMPUTING↗

Curifactory: A research experiment manager

Curifactory is a command line tool and framework for organizing Python experiment code, configuration parameters, and results. It is an opinionated and lightweight approach to workflow management infrastructure and is primarily intended to support researchers conducting experiments on one machine. This software was developed to support the reproducibility of results for several data science projects in the Nuclear Nonproliferation Division at Oak Ridge National Laboratory. Curifactory is intended to be a general framework and is not specific to machine learning or data science. It can aid in any field in which experiments are primarily computation-based studies and can be implemented in Python (e.g., high-energy physics, astronomy, computational chemistry). Here, the design emphasizes the automated caching of intermediate data analysis artifacts to speed up development involving computationally intensive tasks. It also allows for data provenance and experiment reproduction. Individual experiment runs are tracked through logs and their output reports, and entire copies of a run with all cached data and metadata can be exported for others to run using Curifactory on another machine. Curifactory experiments can either be integrated into a project from the beginning or can be written on top of an existing codebase without needing significant modification. A few important views of the Curifactory library can be seen in Figure 1.

97 MATHEMATICS AND COMPUTING↗

PV Operations Software Transparency: A PVMAC Industry Snapshot

The rapid growth of photovoltaic (PV) deployment has increased reliance on software platforms for monitoring, workflow automation, diagnostics, and performance analytics. As these tools play a central role in asset management and operations and maintenance (O&M), greater transparency in methodologies, data handling, and validation practices benefits the broader PV ecosystem. To better understand current practices and identify opportunities for improved clarity and interoperability, 24 software providers contributed detailed responses through the PV O&M Analytics Collaborative (PVMAC) initiative, the first structured questionnaire of its kind in the industry, covering onboarding, interoperability, data quality, diagnostics, AI/ML, and other operational categories. These providers represent over 1.1 TW of solar assets under management. The analysis shows broad adoption of digital twins, AI/ML, and API integrations, but also highlights challenges in onboarding processes, inconsistent definitions and methodologies, variability in key performance indicator (KPI) calculations, and limited independent validation. Greater standardization, clearer documentation, and stronger validation frameworks could improve transparency, comparability, and trust across PV operations software platforms.

14 SOLAR ENERGY↗