Search NASA⌕ Search

SEARCH · Search NASA

Results for “Visual data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Demonstration and Evaluation of Explainable and Trustworthy Predictive Technology for Condition-based Maintenance

The domestic nuclear power plant (NPP) fleet has historically relied on labor-intensive and time-consuming predictive maintenance (PdM) programs, thus driving up operation and maintenance (O&M) costs to achieve high-capacity factors. Artificial intelligence (AI) and machine-learning (ML) can help simplify complex problems such as diagnosing equipment degradation to enable more effective decision-making efforts. The benefits of AI will be felt through more efficient plant O&M, improved work processes, and better integration of people and technology. Together, these benefits hold the promise to make nuclear power more sustainable by reducing O&M costs while improving employee engagement. While AI and ML technologies hold significant promise for the nuclear industry, there are challenges or barriers to their adoption. Explainability and trustworthiness of AI are two salient challenges that need to be addressed for wider deployment of these technologies in NPPs. This research focuses specifically on addressing the explainability and trustworthiness of AI technologies to advance the human, technical, and organization (HTO) readiness levels in adopting a risk-informed PdM strategy at commercial NPPs. In addition, this approach can be adapted to enhance the acceptability of AI in other nuclear applications with a few application-specific modifications. The technical approach ensuring wider adoption of AI technologies was developed by Idaho National Laboratory (INL)—in collaboration with Public Service Enterprise Group (PSEG), Nuclear, LLC—by utilizing the circulating water system (CWS) at two PSEG-owned plant sites for demonstration. Focused user studies were performed in collaboration with subject matter experts (SMEs) from PSEG and other nuclear domains to enhance human and organization readiness by building trust in AI-informed technologies. VIsualization for PrEdictive maintenance Recommendation (VIPER)—a Battelle Energy Alliance, LLC, copyrighted software—was developed and expanded to provide a user-centric visualization by incorporating inputs from the collaborating utility, human factors engineering guidelines, and data analysts. The VIPER software enables users, who may be unfamiliar with ML in general, to be interactively engaged by asking technical questions about PdM, work orders, diagnosis results and their confidence levels, the kind of data being used, and the types of ML algorithms employed. This interactive engagement enhances explainability and builds trust. One of the enabling accomplishments was the integration of large language models (LLMs), both text-based and vision-based, in the VIPER software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

EVI-LOCATE User Manual

One of the longest stages in the deployment of electric vehicle supply equipment (EVSE) is the initial planning of the infrastructure itself. Engineers and fleet experts from the National Renewable Energy Laboratory (NREL) have supported dozens of charging infrastructure site plans over the past couple decades, including the generation of site schematics, determinations of electric capacity, and estimates for likely costs. As the market for electric vehicles (EVs) has matured, this approach should no longer require a time and personnel intensive process. In order to shorten the time taken to develop site plans and cost estimates, NREL developed a tool that fleet managers, facility managers, electricians, EVSE installers, and members of the public can use to develop initial schematics and ballpark pricing for charging station installations. The Electric Vehicle Infrastructure - Locally Optimized Charger Assessment Tool and Estimator (EVI-LOCATE) provides a structured and consistent way for users to enter information about their planned EVSE project in a relatively simple web-based format. EVI-LOCATE then calculates electrical equipment capacity, wiring runs, and project costs. It produces a site diagram optimized around surface characteristics with differential trenching costs for softscape such as grass compared to hardscape such as asphalt that can be adjusted by users in the tool. It also stores the resulting site plans and costs in a dashboard for access at a later date, including plan revisions if necessary. This document guides users through the EVI-LOCATE screens and associated questions. It contains tip text boxes throughout on how best to interface with the tool and find additional information or context. The appendices contain the assumptions and calculations underpinning the tool. Much of the information for EVI-LOCATE was gathered through industry engagements with EVSE installers, invoices from completed EVSE installations, Gordian's RS Means construction data, and the General Services Administration blanket purchase agreement for EVSE. For a visual tutorial of the tool, users can watch EVI-LOCATE Step-by-Step Video. The tool itself is available at https://evi-locate.nrel.gov.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

THE NUCLEAR ACTIVITIES OF NEARBY S0 GALAXIES

We present a study of nuclear activities in nearby S0 galaxies. After cross-matching the Sloan Digital Sky Survey Data Release 7 with the Third Reference Catalog of Bright Galaxies (RC3) and visually checking the SDSS images, we derive a sample of 583 S0 galaxies with the central spectrophotometric information. In order to separate nebular emission lines from the underlying stellar contribution, we fit the stellar population model to the SDSS spectra of these S0 galaxies. According to the BPT diagram, we find that 8% of S0 galaxies show central star-forming activity, while the fractions of Seyfert, Composite, and low-ionization nuclear emission-line regions (LINERs) are 2%, 8%, and 21.4%, respectively. We also find that star-forming S0s have the lowest stellar masses, over one magnitude lower than the others, and that the active S0s are mainly located in the sparse environment, while the normal S0s are located in the dense environment, which might suggest that the environment plays an important role in quenching star formation and/or AGN activity in S0 galaxies. By performing bulge-disk decomposition of 45 star-forming S0s in g - and r -bands with the 2D fitting software Galfit, as well as exploiting the catalog of 2D photometric decompositions of Meert et al., we find that the bulges of approximately one-third of star-forming S0 galaxies (16/45) are bluer than their disks, while for other types of S0s the bulge and disk components show similar color distributions. Besides, the Sérsic index of most star-forming S0s bulges is less than two, while for normal S0s, it is between two and six.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Summary of FUTURIX-FTA Non-destructive Examination

A summary of results from the non-destructive examination of the FUTURIX-FTA irradiation are presented. This irradiation was conducted under true fast spectrum conditions in the Phenix reactor. Baseline non-destructive examinations of these tests have been completed at this time. Results from visual examination, neutron radiography, gamma spectrometry, and dimensional inspection have been collected. The data collected from this irradiation will be compared to sister irradiations performed in pseudo-fast spectrum conditions at the INL Advanced Test Reactor helping to confirm fuel performance behavior observed in Advanced Test Reactor irradiations is representative of fast reactor conditions. All indications from the non-destructive examinations performed on the FUTURIX-FTA elements indicate a successful irradiation with fuel performance in line with expectations. The intact state of the nitride fuel is especially notable as these pellets were fragile after fabrication, but they appear to have survived the irradiation and extensive shipping well. These rodlets will undergo further examination to include gamma tomography to investigate the radial fission product distribution, fission gas release analysis, optical metallography, microhardness testing, and chemical burnup analysis. If possible, cross sections from optical metallography may also be examined by more advanced techniques such as scanning electron microscopy and transmission electron microscopy of specific sites through the use of focused ion beam lift outs. The results of all these examinations will be compared with the results from the AFC-1B, AFC-I1D, AFC-IF, AFC-1G, AFC-1H and AFC-LAE irradiations. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2016

A Lyapunov Function Based Remedial Action Screening Tool Using Real-Time Data

This report summarizes the outcome of a research project that comprised the development of a Lyapunov function based remedial action screening tool using real-time data (L-RAS). The L-RAS is an advanced computational tool that is intended to assist system operators in making real-time redispatch decisions to preserve power grid stability. The tool relies on screening contingencies using a homotopy method based on Lyapunov functions to avoid, to the extent possible, the use of time domain simulations. This enables transient stability evaluation at real-time speed without the use of massively parallel computational resources. The project combined the following components. 1. Development of a methodology for contingency screening using a homotopy method based on Lyapunov functions and real-time data. 2. Development of a methodology for recommending remedial actions based on the screening results. 3. Development of a visualization and operator interaction interface. 4. Testing of screening tool, validation of control actions, and demonstration of project outcomes on a representative real system simulated on a Real-Time Digital Simulator (RTDS) cluster. The project was led by Michigan State University (MSU), where the theoretical models including homotopy-based screening, trajectory correction using real-time data, and remedial action were developed and implemented in the form of research-grade software. Los Alamos National Laboratory (LANL) contributed to the development of energy margin sensitivity dynamics, which constituted a part of the remedial action portfolio. Florida State University (FSU) and Southern California Edison (SCE) developed a model of the SCE system that was implemented on FSU's RTDS cluster to simulate real-time data that was streamed over the internet to MSU where the L-RAS tool was executed and remedial actions were communicated back to FSU to execute stabilizing controls on the simulated system. LCG Consulting developed the visualization and operator interaction interface, based on specifications provided by MSU. The project was performed from October 2012 to December 2016, at the end of which the L-RAS tool, as described above, was completed and demonstrated. The project resulted in the following innovations and contributions: (a) the L-RAS software prototype, tested on a simulated system, vetted by utility personnel, and potentially ready for wider testing and commercialization; (b) an RTDS-based test bed that can be used for future research in the field; (c) a suite of breakthrough theoretical contributions to the field of power system stability and control; and (d) a new tool for visualization of power system stability margins. While detailed descriptions of the development and implementation of the various project components have been provided in the quarterly reports, this final report provides an overview of the complete project, and is demonstrated using public domain test systems commonly used in the literature. The SCE system, and demonstrations thereon, are not included in this report due to Critical Energy Infrastructure Information (CEII) restrictions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

A Visual Analytic Platform for Interactive Validation of Human Mobility Simulations

Human mobility insights guide domain experts in an array of decisions, including critical infrastructure design, disaster response, epidemic modeling, national security, and policy making. Due to the inherent noise and privacy concerns in real-world individual-level mobility data, it is often preferred to leverage simulators that generate synthetic mobility data instead. However, it is critical to inspect and validate the output of such simulators to ensure the synthetic data is aligned with the characteristics of the population and the area of interest known to domain experts. While there exist many quantitative approaches for validating synthetic data, we argue it is also important to also validate such data qualitatively to capture aspects that are known to domain experts but difficult to quantify. In this work, we demonstrate a visual analytic platform that empowers domain experts to interact with their simulation outputs along spatial and temporal dimensions. By augmenting automated techniques and human skills, our visual analytic platform is a step towards interactive capabilities for model steering and quality control of mobility simulators.

Monadjemi, Shayan↗
DOE OSTI2019

Machine learning in electronic-quantum-matter imaging experiments

For centuries, the scientific discovery process has been based on systematic human observation and analysis of natural phenomena. Today, however, automated instrumentation and large-scale data acquisition are generating datasets of such large volume and complexity as to defy conventional scientific methodology. Radically different scientific approaches are needed, and machine learning (ML) shows great promise for research fields such as materials science. Given the success of ML in the analysis of synthetic data representing electronic quantum matter (EQM), the next challenge is to apply this approach to experimental data—for example, to the arrays of complex electronic-structure images17 obtained from atomic-scale visualization of EQM. Here we report the development and training of a suite of artificial neural networks (ANNs) designed to recognize different types of order hidden in such EQM image arrays. These ANNs are used to analyse an archive of experimentally derived EQM image arrays from carrier-doped copper oxide Mott insulators. In these noisy and complex data, the ANNs discover the existence of a lattice-commensurate, four-unit-cell periodic, translational-symmetry-breaking EQM state. Further, the ANNs determine that this state is unidirectional, revealing a coincident nematic EQM state. Here, strong-coupling theories of electronic liquid crystals are consistent with these observations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Internet of things and operational technology detection and visualization platform

A computer-implemented method of monitoring activity of devices in a network is provided. The method comprises passively collecting data regarding how the devices access the network, and for each device on the network, identifying all other devices on the network with which the device communicates. All communication traffic from the devices to outside the network is identified. A determination is made if there are any required updates and if patches for the devices execute in a fashion defined as safe. A number of risk indicators for privacy risks are determined according to device communication within the network, device communication to outside the network, and update and patch execution. A visualization of any identified risk factors is displayed to a user through a user interface.

Urias, Vincent↗
DOE OSTI2016

SU-F-J-72: A Clinical Usable Integrated Contouring Quality Evaluation Software for Radiotherapy

Purpose: To introduce the Auto Contour Evaluation (ACE) software, which is the clinical usable, user friendly, efficient and all-in-one toolbox for automatically identify common contouring errors in radiotherapy treatment planning using supervised machine learning techniques. Methods: ACE is developed with C# using Microsoft .Net framework and Windows Presentation Foundation (WPF) for elegant GUI design and smooth GUI transition animations through the integration of graphics engines and high dots per inch (DPI) settings on modern high resolution monitors. The industrial standard software design pattern, Model-View-ViewModel (MVVM) pattern, is chosen to be the major architecture of ACE for neat coding structure, deep modularization, easy maintainability and seamless communication with other clinical software. ACE consists of 1) a patient data importing module integrated with clinical patient database server, 2) a 2D DICOM image and RT structure simultaneously displaying module, 3) a 3D RT structure visualization module using Visualization Toolkit or VTK library and 4) a contour evaluation module using supervised pattern recognition algorithms to detect contouring errors and display detection results. ACE relies on supervised learning algorithms to handle all image processing and data processing jobs. Implementations of related algorithms are powered by Accord.Net scientific computing library for better efficiency and effectiveness. Results: ACE can take patient’s CT images and RT structures from commercial treatment planning software via direct user input or from patients’ database. All functionalities including 2D and 3D image visualization and RT contours error detection have been demonstrated with real clinical patient cases. Conclusion: ACE implements supervised learning algorithms and combines image processing and graphical visualization modules for RT contours verification. ACE has great potential for automated radiotherapy contouring quality verification. Structured with MVVM pattern, it is highly maintainable and extensible, and support smooth connections with other clinical software tools.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Underlying Data for the EVI-RoadTrip Web Tool

The dataset contains simulation-based charging infrastructure outputs that are visualized on the EVI-RoadTrip webtool. The outputs are aggregated to lower spatial resolution (e.g., state-level, corridor-level).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Data for "Divergent urban land trajectories under alternative population projections within the shared socioeconomic pathways"

Datasets supporting findings and visualizations behind McManamay et al. (2024) Divergent urban land trajectories under alternative population projections within the shared socioeconomic pathways. Environmental Research Letters, DOI: 10.1088/1748-9326/ad2eec Using a spatial modeling experiment at high resolution (1-km), this study compared how two alternative US population projections, varying in the spatially explicit nature of demographic patterns and migration, affect urban land dynamics simulated by the Spatially Explicit, Long-term, Empirical City development (SELECT) model for SSP2, SSP3, and SSP5. The numerical experiment, inputs and outputs are fully described in McManamay et al. (2024). The datasets summarize SELECT model simulations within urban areas and rural areas of the conterminous United States. For code to reproduce the results, please refer to https://github.com/IMMM-SFA/mcmanamay_etal_2024_erl Please refer to the README file provided in Files for more details. Descriptions of the datasets are provided below. Dataset(s) Descriptions: Urban_Land_delta_UA_County.csv: Urban land area for original (default) population, updated population, and urban land delta (difference between the two) according to Shared Socioeconomic Pathways (SSPs) and year. Urban land is summarized for U.S. counties (FIPS code) and urban areas (GEOID) as unique areas within various counties. JO_Gao_pop_ufdelta.csv: Comparison of population differences and urban land differences between the origial (default) and updated population projections. City_Case_studies.csv: Differences in urban land areas arising from different population projections summarized for selected cities (Atlanta, Los Angeles, Houston, and New York) and their surrounding rural areas UA_county_FID.zip: Zipped folder of .tiff file depicting unique combination of urban areas and US counties used for summarizing urban land differences in urban and rural areas based on different population projections. ULD_clusters.zip: Zipped folder of .csv files depicting normalized changes in urban land delta (difference in urban land arising from population projections) and the respective Ward's hierarchical clusters, which group urban and rural areas based on similarities in temporal trends. Urban_Percent_change_2100.zip: Zipped folder of .csv files depicting percent changes in urban land area for year 2100 based on differences in the original (default) population and updated population. Each file is for SSPs and urban or rural areas.

Land↗
DOE OSTI2017

In Situ Summarization with VTK-m

Summarization and compression at current and future scales requires a framework for developing and benchmarking algorithms. We present a framework created by integrating existing, production-ready projects and provide timings of two particular algorithms that serve as exemplars for summarization: a wavelet-based data reduction filter and a generator for creating image-like databases of extracted features (isocontours in this case). Both support browser-based, post-hoc, interactive visualization of the summary for decision-making. A study of their weak-scaling on a distributed multi-GPU system is included in this article.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

A source-synchronous filter for uncorrelated receiver traces from a swept-frequency seismic source

We have developed a novel algorithm to reduce noise in signals obtained from swept-frequency sources by removing out-of-band external noise sources and distortion caused from unwanted harmonics. The algorithm is designed to condition nonstationary signals for which traditional frequency-domain methods for removing noise have been less effective. The source synchronous filter (SSF) is a time-varying narrow band filter, which is synchronized with the frequency of the source signal at all times. Because the bandwidth of the filter needs to account for the source-to-receiver propagation delay and the sweep rate, SSF works best with slow sweep rates and moveout-adjusted waveforms to compensate for source-receiver delays. The SSF algorithm was applied to data collected during a field test at the University of California Santa Barbara’s Garner Valley downhole array site in Southern California. At the site, a 45 kN shaker was mounted on top of a one-story structure and swept from 0 to 10 Hz and back over 60 s (producing useful seismic waves greater than 1.6 Hz). The seismic data were captured with small accelerometer and geophone arrays and with a distributed acoustic sensing array, which is a fiber-optic-based technique for the monitoring of elastic waves. The result of the application of SSF on the field data is a set of undistorted and uncorrelated traces that can be used in different applications, such as measuring phase velocities of surface waves or applying convolution operations with the encoder source function to obtain traveltimes. Lastly, the results from the SSF were used with a visual phase alignment tool to facilitate developing dispersion curves and as a prefilter to improve the interpretation of the data.

58 GEOSCIENCES↗
DOE OSTI2016

Structure and Conductivity of Semiconducting Polymer Hydrogels

Poly(fluorene-alt-thiophene) (PFT) is a conjugated polyelectrolyte that self-assembles into rod-like micelles in water, with the conjugated polymer backbone running along the length of the micelle. At modest concentrations (-10 mg/mL in aqueous solutions), PFT forms hydrogels, and this work focuses on understanding the structure and intermolecular interactions in those gel networks. The network structure can be directly visualized using cryo electron microscopy. Oscillatory rheology studies further tell us about connectivity within the gel network, and the data are consistent with a picture where polymer chains bridge between micelles to hold the network together. Addition of tetrahydrofuran (THF) to the gels breaks those connections, but once the THF is removed, the gel becomes stronger than it was before, presumably due to the creation of a more interconnected nanoscale architecture. Small polymer oligomers can also passivate the bridging polymer chains, breaking connections between micelles and dramatically weakening the hydrogel network. Fits to solution-phase small-angle X-ray scattering data using a Dammin bead model support the hypothesis of a bridging connection between PFT micelles, even in dilute aqueous solutions. Finally, time-resolved microwave conductivity measurements on dried samples show an increase in carrier mobility after THF annealing of the PFT gel, likely due to increased connectivity within the polymer network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Pass-efficient methods for compression of high-dimensional turbulent flow data

The future of high-performance computing, specifically on future Exascale computers, will presumably see memory capacity and bandwidth fail to keep pace with data generated, for instance, from massively parallel partial differential equation (PDE) systems. Current strategies proposed to address this bottleneck entail the omission of large fractions of data, as well as the incorporation of in situ compression algorithms to avoid overuse of memory. To ensure that post-processing operations are successful, this must be done in a way that a sufficiently accurate representation of the solution is stored. Moreover, in situations where the input/output system becomes a bottleneck in analysis, visualization, etc., or the execution of the PDE solver is expensive, the number of passes made over the data must be minimized. In the interest of addressing this problem, this work focuses on the utility of pass-efficient, parallelizable, low-rank, matrix decomposition methods in compressing high-dimensional simulation data from turbulent flows. Additionally, a particular emphasis is placed on using coarse representation of the data – compatible with the PDE discretization grid – to accelerate the construction of the low-rank factorization. This includes the presentation of a novel single-pass matrix decomposition algorithm for computing the so-called interpolative decomposition. The methods are described extensively and numerical experiments on two turbulent channel flow data are performed. In the first (unladen) channel flow case, compression factors exceeding 400 are achieved while maintaining accuracy with respect to first- and second-order flow statistics. In the particle-laden case, compression factors of 100 are achieved and the compressed data is used to recover particle velocities. These results show that these compression methods can enable efficient computation of various quantities of interest in both the carrier and disperse phases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2018

Energy Cost Savings of Systems-Based Building Retrofits: A Study of Three Integrated Lighting Systems in Comparison with Component Based Retrofits

Most building retrofit projects are still component-based in that they typically address only one piece or type of equipment at a time. Systems-based retrofits that seek to address multiple components in an integrated manner have the potential to provide significantly greater energy savings. Lawrence Berkeley National Laboratory (LBNL) partnered with several utilities to develop and evaluate three different integrated retrofit packages involving lighting systems: automated shading with daylight dimming controls, workstation-specific lighting with daylight controls, and task/ambient lighting with plug load occupancy controls. Specifically, our analysis sought to quantify the marginal benefits of these systems (energy savings as well as lighting performance and visual comfort) relative to component based approaches. The analysis was based on a combination of measured performance data from LBNL’s FLEXLAB® test facility and energy simulations. All three systems were compared to a simple fluorescent-to-LED retrofit, which represents the component-based approach. While the simple LED upgrade provides significant lighting energy savings of 63%, the systems yielded energy savings of 81-93%, which equates to additional savings of 49-82% over the simple LED upgrade. All systems tested provided satisfactory visual comfort as well, indicating good potential for market acceptance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

MetaboDirect: an analytical pipeline for the processing of FT-ICR MS-based metabolomic data

Background: Microbiomes are now recognized as the main drivers of ecosystem function ranging from the oceans and soils to humans and bioreactors. However, a grand challenge in microbiome science is to characterize and quantify the chemical currencies of organic matter (i.e., metabolites) that microbes respond to and alter. Critical to this has been the development of Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR MS), which has drastically increased molecular characterization of complex organic matter samples, but challenges users with hundreds of millions of data points where readily available, user-friendly, and customizable software tools are lacking. Results: Here, we build on years of analytical experience with diverse sample types to develop MetaboDirect, an open-source, command-line-based pipeline for the analysis (e.g., chemodiversity analysis, multivariate statistics), visualization (e.g., Van Krevelen diagrams, elemental and molecular class composition plots), and presentation of direct injection high-resolution FT-ICR MS data sets after molecular formula assignment has been performed. When compared to other available FT-ICR MS software, MetaboDirect is superior in that it requires a single line of code to launch a fully automated framework for the generation and visualization of a wide range of plots, with minimal coding experience required. Among the tools evaluated, MetaboDirect is also uniquely able to automatically generate biochemical transformation networks (ab initio) based on mass differences (mass difference network-based approach) that provide an experimental assessment of metabolite connections within a given sample or a complex metabolic system, thereby providing important information about the nature of the samples and the set of microbial reactions or pathways that gave rise to them. Finally, for more experienced users, MetaboDirect allows users to customize plots, outputs, and analyses. Conclusion: Application of MetaboDirect to FT-ICR MS-based metabolomic data sets from a marine phage-bacterial infection experiment and a Sphagnum leachate microbiome incubation experiment showcase the exploration capabilities of the pipeline that will enable the research community to evaluate and interpret their data in greater depth and in less time. It will further advance our knowledge of how microbial communities influence and are influenced by the chemical makeup of the surrounding system. The source code and User’s guide of MetaboDirect are freely available through (https://github.com/Coayala/MetaboDirect) and (https://metabodirect.readthedocs.io/en/latest/), respectively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Sim-Situ: A Framework for the Faithful Simulation of in situ Processing

The amount of data generated by numerical simulations in various scientific domains led to a fundamental redesign of how the analysis and visualization of simulation outputs are performed. The throughput and capacity of storage subsystems have not evolved as fast as the computing power in extreme-scale supercomputers, making the classical post-hoc approach highly inefficient. In situ processing has then emerged as a solution in which simulation and data analysis/visualization are intertwined for better performance and greater interactivity.Determining the best allocation, i.e., how many resources to allocate to simulation and analysis respectively, mapping, i.e., where and at which frequency to run the analysis/visualization, and data transfer mode is a complex task whose performance assessment is crucial to the efficient execution of in situ processing. However, such a performance evaluation of different strategies usually relies either on directly running them on the targeted execution environments, which can rapidly become extremely time- and resource-consuming, or on resorting to simplified models of the components of an in situ application, which can lack of realism. In both cases, the validity of the performance evaluation is limited.In this paper, we present Sim-Situ, a simulation-based framework for the faithful performance evaluation of in situ processing strategies. We designed Sim-Situ to reflect the typical features of in situ processing systems. Thanks to its modular design, Sim-situ has the necessary flexibility to easily and faithfully evaluate the behavior and performance of various allocation, mapping, and data transfer strategies. We illustrate the simulation capabilities of Sim-Situ on a Molecular Dynamics use case. We study the impact of different strategies on performance and show how users can leverage Sim-Situ to determine interesting tradeoffs when adding analysis/visualization components to their application.

Honoré, Valentin↗