Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

The diverse use of clouds by CMS

The resources CMS is using are increasingly being offered as clouds. In Run 2 of the LHC the majority of CMS CERN resources, both in Meyrin and at the Wigner Computing Centre, will be presented as cloud resources on which CMS will have to build its own infrastructure. This infrastructure will need to run all of the CMS workflows including: Tier 0, production and user analysis. In addition, the CMS High Level Trigger will provide a compute resource comparable in scale to the total offered by the CMS Tier 1 sites, when it is not running as part of the trigger system. During these periods a cloud infrastructure will be overlaid on this resource, making it accessible for general CMS use. Finally, CMS is starting to utilise cloud resources being offered by individual institutes and is gaining experience to facilitate the use of opportunistically available cloud resources. Lastly, we present a snap shot of this infrastructure and its operation at the time of the CHEP2015 conference.

97 MATHEMATICS AND COMPUTING↗

Integration Of PanDA Workload Management System With Supercomputers for ATLAS and Data Intensive Science

The.LHC, operating at CERN, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. While PanDA currently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, LHC data taking runs require more resources than grid can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, in particular with Titan supercomputer at Oak Ridge Leadership Computing Facility. Current approach utilizes modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single threaded workloads in parallel on LCFs multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms for ALICE and ATLAS experiments and it is in full pro duction for the ATLAS since September 2015. We will present our current accomplishments with running PanDA at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

97 MATHEMATICS AND COMPUTING↗

Skin dose mapping for fluoroscopically guided interventions

Purpose: To introduce a new skin dose mapping software system for interventional fluoroscopy dose assessment and to analyze the benefits and limitations of patient-phantom matching. Methods: In this study, a new software system was developed for visualizing patient skin dose during interventional fluoroscopy procedures. The system works by translating the reference point air kerma to the location of the patient's skin, which is represented by a computational model. In order to orient the model with the x-ray source, geometric parameters found within the radiation dose structured report (RDSR) are used along with a limited number of in-clinic measurements. The output of the system is a visual indication of skin dose mapped onto an anthropomorphic model at a resolution of 5 mm. In order to determine if patient-dependent and patient-sculpted models increase accuracy, peak skin dose was calculated for each of 26 patient-specific models and compared with doses calculated using an elliptical stylized model, a reference hybrid model, a matched patient-dependent model and one patient-sculpted model. Results were analyzed in terms of a percent difference using the doses calculated using the patient-specific model as the true standard. Results: Anthropometric matching, including the use of both patient-dependent and patient-sculpted phantoms, was shown most beneficial for left lateral and anterior-posterior projections. In these cases, the percent difference using a reference model was between 8 and 20%, using a patient-dependent model between 7 and 15%, and using a patient-sculpted model between 3 and 7%. Under the table tube configurations produced errors less than 5% in most situations due to the flattening affects of the table and pad, and the fact that table height is the main determination of source-to-skin distance for these configurations. In addition to these results, several skin dose maps were produced and a prototype display system was placed on the in-clinic monitor of an interventional fluoroscopy system. Conclusions: The skin dose mapping program developed in this work represents a new tool that, as the RDSR becomes available through automated export or real-time streaming, can provide the interventional physician information needed to modify behavior when clinically appropriate. The program is nonproprietary and transferable, and also functions independent to the software systems already installed on the control room workstation. The next step will be clinical implementation where the workflow will be optimized along with further analysis of real-time capabilities.

61 RADIATION PROTECTION AND DOSIMETRY↗

INTEGRATION OF PANDA WORKLOAD MANAGEMENT SYSTEM WITH SUPERCOMPUTERS

Abstract The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the funda- mental nature of matter and the basic forces that shape our universe, and were recently credited for the dis- covery of a Higgs boson. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 140 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data cen- ters are physically scattered all over the world. While PanDA currently uses more than 250000 cores with a peak performance of 0.3+ petaFLOPS, next LHC data taking runs will require more resources than Grid computing can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, Europe and Russia (in particular with Titan supercomputer at Oak Ridge Leadership Com- puting Facility (OLCF), Supercomputer at the National Research Center Kurchatov Institute , IT4 in Ostrava, and others). The current approach utilizes a modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single- threaded workloads in parallel on Titan s multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms. We will present our current accom- plishments in running PanDA WMS at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facility s infrastructure for High Energy and Nuclear Physics, as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

De, K↗

Big Data as a Service from an Urban Information System

Big Data has already proven itself as a valuable tool that lets geographers and urban researchers utilize large data re- sources to generate new insights. However, wider adoption of Big Data techniques in these areas is impeded by a number of difficulties in both knowledge discovery and data and sci- ence production. Typically users face such problems as dis- parate and scattered data, data management, spatial search- ing, insufficient computational capacity for data-driven anal- ysis and modelling, and the lack of tools to quickly visual- ize and summarize large data and analysis results. Here we propose an architecture for an Urban Information Sys- tem (UrbIS) that mitigates these problems by utilizing the Big Data as a Service (BDaaS) concept. With technolog- ical roots in High-performance Computing (HPC), BDaaS is based on the idea of outsourcing computations to dif- ferent computing paradigms, scalable to super-computers. UrbIS aims to incorporate federated metadata search, in- tegrated modeling and analysis, and geovisualization into a single seamless workflow. The system is under active devel- opment and is built around various emerging technologies that include hybrid and NoSQL databases, massively par- allel systems, GPGPU computing, and WebGL-based geo- graphic visualization. UrbIS is designed to facilitate using Big Data across multiple cities to better understand how ur- ban areas impact the environment and how climate change and other environmental change impact urban areas.

Sorokine, Alexandre↗

Characterization and Quantification of Radiation-Induced Clusters/Precipitates in RPV Steels Using STEM-EDS and Machine Learning

Over the operational lifespan of a nuclear reactor, reactor pressure vessel (RPV) steels are subjected to significant neutron irradiation, resulting in complex microstructural changes and the consequent degradation of mechanical properties. Various physically motivated correlation models have been developed to predict neutron irradiation-induced embrittlement of RPVs under different irradiation conditions. However, the efficient and accurate characterizations and quantification of radiation-induced clusters in RPVs are still challenging, which will affect the precision of the predictive models for embrittlement of RPV components. In the DOE Visiting Faculty Program (VFP) research work at Oak Ridge National Lab (ORNL), I integrate machine learning to aid Scanning Transmission Electron Microscopy – Energy Dispersive X-ray Spectroscopy (STEM-EDS) analyses, which improve the characterization and quantification of radiation-induced clusters in RPV steels, thereby enabling more accurate predictions of material behavior under irradiation. The surveillance base- and welded- RPV steels were annealed at various temperatures of 340 °C, 450 °C and 500 °C for up to 168 hours, respectively. Afterwards, I have characterized radiation-induced clusters using advanced STEM-EDS techniques and subsequently applying machine learning algorithms to analyze and refine STEM-EDS datasets, enhancing the quantification of clusters compositions and distributions. In the end, an efficient workflow for integrating STEM-EDS data analysis with machine learning to address challenges including noise reduction has been developed. The completion of this VFP work will support bridge critical gaps in the accurate quantification of radiation-induced clusters in RPV steels using STEM-EDS and support the development of more precise models for predicting RPV embrittlement in the Light Water Reactor Sustainability program supported by Department of Energy and enhancing the collaboration between ORNL and Alred University. The outcome of the VFP project will leverage a few research papers submission to peer-reviewed journals in the relevant scientific field and a few oral presentations at national and international conferences.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The NCRC Grid Scheduling Environment

In support of the NCRC, a joint computing center between NOAA and ORNL, a grid-based scheduling infrastructure was designed to allow geographically separate computing resources to be used as production resources in climate and weather research workflows. These workflows require job coordination between the two centers in order to provide a complete workflow of data staging, computation, post-analysis and archival. This paper details the design, implementation and initial production phase of the infrastructure and lessons learned from the process.

99 GENERAL AND MISCELLANEOUS↗

Integration Of PanDA Workload Management System With Supercomputers for ATLAS and Data Intensive Science

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. While PanDA currently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, LHC data taking runs require more resources than Grid computing can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, Europe and Russia (in particular with Titan supercomputer at Oak Ridge Leadership Computing Facility (OLCF), MIRA supercomputer at Argonne Leadership Computing Facilities (ALCF), Supercomputer at the National Research Center Kurchatov Institute , IT4 in Ostrava and others). Current approach utilizes modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single threaded workloads in parallel on LCFs multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms for ALICE and ATLAS experiments and it is in full production for the ATLAS experiment since September 2015. We will present our current accomplishments with running PanDA WMS at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

Data-intensive science↗

BASTet (Berkeley Analysis and Storage Toolkit)

BASTet is an advanced software library written in Python. BASTet serves as the analysis and storage library for the OpenMSI project. BASTet is an integrate framework for: i) storage of spectral imaging data, ii) storage of derived analysis data, iii) provenance of analyses, iv) integration and execution of analyses via complex workflows. BASTet implements the API for the HDF5 storage format used by OpenMSI. Analyses that are developed using BASTet benefit from direct integration with storage format, automatic tracking of provenance, and direct integration with command-line and workflow execution tools. BASTet also defines interfaces to enable developers to directly integrate their analysis with OpenMSI's web-based viewing infrastruture without having to know OpenMSI. BASTet also provides numerous helper classes and tools to assist with the conversion of data files, ease parallel implementation of analysis algorithms, ease interaction with web-based functions, description methods for data reduction. BASTet also includes detailed developer documentation, user tutorials, iPython notebooks, and other supporting documents.

Bowen, Benjamin↗

BigPanDA: PanDA Workload Management System and its Applications beyond ATLAS

Modern experiments collect peta-scale volumes of data and utilize vast, geographically distributed computing infrastructure that serves thousands of scientists around the world. Requirements for rapid, near real-time data processing, fast analysis cycles and need to run massive detector simulations to support data analysis pose special premium on efficient use of available computational resources. A sophisticated Workload Management System (WMS) is needed to coordinate the distribution and processing of data and jobs in such environment. The ATLAS experiment at CERN uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. While PanDAcurrently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, it runs around 2 million jobs per day on hundreds of Grid sites and serving thousands of ATLAS users. In 2017 about 1.5 exabytes of data were processed with PanDA.In 2012 BigPanDA project project was started with aim to introduce new types of computing resources into ATLAS computing infrastructure, but also to offering PanDA features to different data-intensive applications for projects and experiments outside of ATLAS and High-Energy and Nuclear Physics. In this article we will present accomplishments and discuss possible directions for future work.

Svirin, Pavlo↗

A Method for Integrating an UBEM with GIS for Spatiotemporal Visualization and Analysis

Leveraging Geographic Information Systems (GIS) for spatiotemporal visualization and analysis of simulated UBEM datasets and real-world data simultaneously can assist in identifying opportunities, as well as potential barriers, to energy efficient and climate adaptation strategies. However, current GIS-based models that support interactive exploration of adaptation strategies and future scenarios are scarce and do not easily incorporate building energy use data for visual analysis over time. This paper describes a workflow to integrate simulated building energy consumption data associated with variable energy efficiency scenarios within a GIS platform for interactive spatiotemporal visualization to support climate adaptation decision-making. The contribution of the work presented is in the ability to selectively view and analyze simulated building energy performance data layered with other real-world geospatial data through an automated feedback loop between an UBEM and ArcGIS. An interactive interface is designed in ArcGIS to enable users to explore building performance scenarios spatially and over time. Using a downtown neighborhood in Syracuse, New York, USA, as a case study, preliminary results demonstrate how the workflow provides insight into existing energy use issues and potential for implementing strategies such as energy load shifting or building retrofits. A discussion includes opportunities as well as challenges to the workflow in facilitating understanding of urban energy model outputs by multiple stakeholders in evaluating potential energy efficient strategies.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗

Defect Thermodynamics and Transport Properties of Perovskite and Fluorite Materials for Solid-Oxide and Proton Conducting Oxide Cells Evaluated Based on Density Functional Theory Modeling

Density functional theory based defect thermodynamic modeling was performed to determine the effect of humidity and H2/O2 gas pressure on various defect chemistry and transport properties of perovskite and fluorite oxides for solid-oxide and proton-conducting-oxide cell applications, with inclusion of the electronic-conducting oxides (as electrodes) and insulating oxides (as electrolytes). Automatic defect generation workflow and first-principles charged defect analysis were implemented on NETL Joule supercomputer for modeling defect equilibria and transport properties of insulating oxides as electrolytes in SOCs and proton-conducting ceramic cells. A GNU Octave defect model subroutines were developed to facilitate defect modeling of electronic conducting oxides in a wide range of operating conditions guided by modeling and experiments. The model includes the hydride defect formation reaction under reducing conditions and allows to incorporate nonstoichiometry effects on the defect thermodynamic parameters. The developed model serves as a platform to facilitate fundamental understanding of the defect thermodynamics in SOC oxide materials and can be used as a novel tool in computational materials screening for SOC and other energy applications.

Lee, Yueh-Lin↗

Predictive Capability Maturity Model Demonstration for Cylindrical Cavity Coupling Using Gemma in the Next Generation Workflow

The predictive capability maturity model (PCMM) uses the expert elicitation process to generate credibility evidence for a particular analysis. To ensure Gemma has the capability to efficiently produce this credibility evidence, next generation workflows (NGW) are created for the solution verification, calibration/validation, and input uncertainty quantification portions of the PCMM assessment. These workflows are then used on the Higgins cylinder problem, which is representative of applications involving external-to-internal electromagnetic field coupling through a slot. The uncertainties calculated using these workflows are then used to calculate the validation comparison error and the validation uncertainty for the model following the American Society of Mechanical Engineers (ASME) verification and validation (V&V) 20 standard. These workflows will enable analysts to iterate each element of PCMM more efficiently than if completed without using a NGW workflow. An example of this iterative process is shown in Section 7.2.

42 ENGINEERING↗

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗

Data and scripts associated with: “Burn severity and vegetation type control phosphorus concentration, molecular composition, and mobilization”

This data package is associated with the publication “Burn severity and vegetation type control phosphorus concentration, molecular composition, and mobilization” published in European Geophysical Union - Biogeosciences (Barnes et al. 2025). This study investigates how phosphorus (P) biogeochemistry is altered by burn severity in contrasting types of vegetation chars. This data package documents the workflow used to process and generate the main figures and statistics in the manuscript. The R scripts reference minimally processed P nuclear magnetic resonance (P-NMR) and X-ray absorption near edge structure (P-XANES) data, as well as fully processed data including total elemental composition of the solid chars, total elemental composition of the char leachates (particulate and aqueous phases), and leachate aqueous phase molybdate reactive P concentration. These source data and associated metadata can be found on ESS-DIVE at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1894135 (Grieger et al. 2022; v3). Files and scripts included in this data package finish the processing workflow for P-NMR and P-XANES data. These data can be used to gain a better understanding of bulk chemical changes in chars and their leachates, as well as detailed molecular changes to P. This data package is associated with the GitHub repository found at https://github.com/river-corridors-sfa/rcsfa-RC3-BSLE_P. This data package is comprised of a “data” folder and a series of data processing and analysis scripts. Details on how to recreate the workflow can be found in the Critical Details section of the readme and the “workflow_readme.md” file. The file-level metadata file (file ending in “flmd.csv”) lists all files contained in this data package and descriptions for each. The data dictionary (file ending in “dd.csv”) describes all tabular data columns and their respective definitions and units.

54 ENVIRONMENTAL SCIENCES↗

Adaptive workflow for simulation of RF heaters

Accurate RF (Radio Frequency) simulations of fusion systems like ITER require the definition of high-fidelity analysis geometries that include detailed antenna, reactor wall, and physics regions. Here, this paper will describe a workflow for the execution of adaptive high-performance simulations of RF fusion systems. In this workflow, the simulation input consists of a CAD model attributed with the needed analysis attributes. The analysis mesh is automatically generated and the analysis steps are executed using the time-harmonic Maxwell's equations solved using high-order Nédélec finite elements. A patch recovery-based error estimator is used to drive a conforming mesh adaptation procedure.

97 MATHEMATICS AND COMPUTING↗

Prediction and Analysis of Utah FORGE Injection Activities using a Coupled Thermo-hydro-mechanical and Earthquake (THM+E) Modeling Workflow

A coupled thermo-hydro-mechanical (THM) numerical workflow that is capable of modeling seismic slip is critical for the successful development of enhanced geothermal systems (EGS). By integrating key physical processes, this workflow enables accurate simulation of temperature and pressure diffusions, stress changes, and induced seismicity. As a result, it serves as a vital tool for predicting induced seismicity and optimizing reservoir stimulation strategies. The Utah FORGE (Frontier Observatory for Research in Geothermal Energy) project, located near Milford, Utah, is a U.S. Department of Energy initiative aimed at advancing EGS technology. In April 2024, eight new stimulation stages (Stages 3R-10) were conducted in well 16A (injection well) subsequent to the first series of stimulation (Stages 1-3) performed in April, 2022. To monitor the induced seismicity, geophones were deployed in wells 58-32, 56-32, and 78B-32, while fiber optic cables were also installed in wells 16B, 78-32, and 78B-32 to collect microseismic data and detect frac hits Preliminary analyses of microseismic catalogs and fiber optic data suggest that the stimulated fractures in Stages 3R–6 closely align with that generated during Stage 3, indicating that the new stimulations were likely reactivating the previously stimulated fracture. To better understand the underlying process, a comprehensive modeling approach that can accurately capture thermal, hydrological, mechanical, and seismic responses is essential. In this work, we propose and utilize a coupled thermo-hydro-mechanical and earthquake (THM+E) simulation workflow to numerically investigate the stimulation activities on well 16A. The specific objective is to confirm whether the new stimulation stages (Stages 3R–6) reactivated fractures previously stimulated during Stage 3. For this purpose, we perform THM+E simulations individually for Stages 3, 3R, 4, and 5, incorporating the discrete fracture networks (DFNs) created by the plane-fitting technique based on the microseismic catalogs. The simulation workflow consists of two separate models: a THM model and an earthquake model, coupled in a one-way manner. Detailed descriptions of the workflow are provided in Section 3. Simulation results are presented in terms of injection pressure, permeability evolution, and predicted seismic catalogs, which are then compared with field data for further analyses. This report is structured as follows. In Section 2, we present detailed analyses of the field data and propose the hypothesis that the new stimulation stages (Stages 3R–6) were probably reactivating the previously stimulated fractures in Stage 3. In Section 3, we introduce the coupled THM+E workflow and the problem setup to validate our hypothesis, followed by the simulation results for each stage in Section 4. Meanwhile, discussions are included to analyze the model predictions and their comparison with field data. Lastly, we conclude the report and outline future plans in Section 5.

15 GEOTHERMAL ENERGY↗