SEARCH · Search NASA

Results for “Visual data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

All sources NASA NTRS DOE OSTI

DOE OSTI2024

A Visual Analytic Platform for Interactive Validation of Human Mobility Simulations

Human mobility insights guide domain experts in an array of decisions, including critical infrastructure design, disaster response, epidemic modeling, national security, and policy making. Due to the inherent noise and privacy concerns in real-world individual-level mobility data, it is often preferred to leverage simulators that generate synthetic mobility data instead. However, it is critical to inspect and validate the output of such simulators to ensure the synthetic data is aligned with the characteristics of the population and the area of interest known to domain experts. While there exist many quantitative approaches for validating synthetic data, we argue it is also important to also validate such data qualitatively to capture aspects that are known to domain experts but difficult to quantify. In this work, we demonstrate a visual analytic platform that empowers domain experts to interact with their simulation outputs along spatial and temporal dimensions. By augmenting automated techniques and human skills, our visual analytic platform is a step towards interactive capabilities for model steering and quality control of mobility simulators.

Monadjemi, Shayan↗

DOE OSTI2024

Internet of things and operational technology detection and visualization platform

A computer-implemented method of monitoring activity of devices in a network is provided. The method comprises passively collecting data regarding how the devices access the network, and for each device on the network, identifying all other devices on the network with which the device communicates. All communication traffic from the devices to outside the network is identified. A determination is made if there are any required updates and if patches for the devices execute in a fashion defined as safe. A number of risk indicators for privacy risks are determined according to device communication within the network, device communication to outside the network, and update and patch execution. A visualization of any identified risk factors is displayed to a user through a user interface.

Urias, Vincent↗

DOE OSTI2026

Underlying Data for the EVI-RoadTrip Web Tool

The dataset contains simulation-based charging infrastructure outputs that are visualized on the EVI-RoadTrip webtool. The outputs are aggregated to lower spatial resolution (e.g., state-level, corridor-level).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Data for "Divergent urban land trajectories under alternative population projections within the shared socioeconomic pathways"

Datasets supporting findings and visualizations behind McManamay et al. (2024) Divergent urban land trajectories under alternative population projections within the shared socioeconomic pathways. Environmental Research Letters, DOI: 10.1088/1748-9326/ad2eec Using a spatial modeling experiment at high resolution (1-km), this study compared how two alternative US population projections, varying in the spatially explicit nature of demographic patterns and migration, affect urban land dynamics simulated by the Spatially Explicit, Long-term, Empirical City development (SELECT) model for SSP2, SSP3, and SSP5. The numerical experiment, inputs and outputs are fully described in McManamay et al. (2024). The datasets summarize SELECT model simulations within urban areas and rural areas of the conterminous United States. For code to reproduce the results, please refer to https://github.com/IMMM-SFA/mcmanamay_etal_2024_erl Please refer to the README file provided in Files for more details. Descriptions of the datasets are provided below. Dataset(s) Descriptions: Urban_Land_delta_UA_County.csv: Urban land area for original (default) population, updated population, and urban land delta (difference between the two) according to Shared Socioeconomic Pathways (SSPs) and year. Urban land is summarized for U.S. counties (FIPS code) and urban areas (GEOID) as unique areas within various counties. JO_Gao_pop_ufdelta.csv: Comparison of population differences and urban land differences between the origial (default) and updated population projections. City_Case_studies.csv: Differences in urban land areas arising from different population projections summarized for selected cities (Atlanta, Los Angeles, Houston, and New York) and their surrounding rural areas UA_county_FID.zip: Zipped folder of .tiff file depicting unique combination of urban areas and US counties used for summarizing urban land differences in urban and rural areas based on different population projections. ULD_clusters.zip: Zipped folder of .csv files depicting normalized changes in urban land delta (difference in urban land arising from population projections) and the respective Ward's hierarchical clusters, which group urban and rural areas based on similarities in temporal trends. Urban_Percent_change_2100.zip: Zipped folder of .csv files depicting percent changes in urban land area for year 2100 based on differences in the original (default) population and updated population. Each file is for SSPs and urban or rural areas.

Land↗

DOE OSTI2020

Pass-efficient methods for compression of high-dimensional turbulent flow data

The future of high-performance computing, specifically on future Exascale computers, will presumably see memory capacity and bandwidth fail to keep pace with data generated, for instance, from massively parallel partial differential equation (PDE) systems. Current strategies proposed to address this bottleneck entail the omission of large fractions of data, as well as the incorporation of in situ compression algorithms to avoid overuse of memory. To ensure that post-processing operations are successful, this must be done in a way that a sufficiently accurate representation of the solution is stored. Moreover, in situations where the input/output system becomes a bottleneck in analysis, visualization, etc., or the execution of the PDE solver is expensive, the number of passes made over the data must be minimized. In the interest of addressing this problem, this work focuses on the utility of pass-efficient, parallelizable, low-rank, matrix decomposition methods in compressing high-dimensional simulation data from turbulent flows. Additionally, a particular emphasis is placed on using coarse representation of the data – compatible with the PDE discretization grid – to accelerate the construction of the low-rank factorization. This includes the presentation of a novel single-pass matrix decomposition algorithm for computing the so-called interpolative decomposition. The methods are described extensively and numerical experiments on two turbulent channel flow data are performed. In the first (unladen) channel flow case, compression factors exceeding 400 are achieved while maintaining accuracy with respect to first- and second-order flow statistics. In the particle-laden case, compression factors of 100 are achieved and the compressed data is used to recover particle velocities. These results show that these compression methods can enable efficient computation of various quantities of interest in both the carrier and disperse phases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

MetaboDirect: an analytical pipeline for the processing of FT-ICR MS-based metabolomic data

Background: Microbiomes are now recognized as the main drivers of ecosystem function ranging from the oceans and soils to humans and bioreactors. However, a grand challenge in microbiome science is to characterize and quantify the chemical currencies of organic matter (i.e., metabolites) that microbes respond to and alter. Critical to this has been the development of Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR MS), which has drastically increased molecular characterization of complex organic matter samples, but challenges users with hundreds of millions of data points where readily available, user-friendly, and customizable software tools are lacking. Results: Here, we build on years of analytical experience with diverse sample types to develop MetaboDirect, an open-source, command-line-based pipeline for the analysis (e.g., chemodiversity analysis, multivariate statistics), visualization (e.g., Van Krevelen diagrams, elemental and molecular class composition plots), and presentation of direct injection high-resolution FT-ICR MS data sets after molecular formula assignment has been performed. When compared to other available FT-ICR MS software, MetaboDirect is superior in that it requires a single line of code to launch a fully automated framework for the generation and visualization of a wide range of plots, with minimal coding experience required. Among the tools evaluated, MetaboDirect is also uniquely able to automatically generate biochemical transformation networks (ab initio) based on mass differences (mass difference network-based approach) that provide an experimental assessment of metabolite connections within a given sample or a complex metabolic system, thereby providing important information about the nature of the samples and the set of microbial reactions or pathways that gave rise to them. Finally, for more experienced users, MetaboDirect allows users to customize plots, outputs, and analyses. Conclusion: Application of MetaboDirect to FT-ICR MS-based metabolomic data sets from a marine phage-bacterial infection experiment and a Sphagnum leachate microbiome incubation experiment showcase the exploration capabilities of the pipeline that will enable the research community to evaluate and interpret their data in greater depth and in less time. It will further advance our knowledge of how microbial communities influence and are influenced by the chemical makeup of the surrounding system. The source code and User’s guide of MetaboDirect are freely available through (https://github.com/Coayala/MetaboDirect) and (https://metabodirect.readthedocs.io/en/latest/), respectively.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Sim-Situ: A Framework for the Faithful Simulation of in situ Processing

The amount of data generated by numerical simulations in various scientific domains led to a fundamental redesign of how the analysis and visualization of simulation outputs are performed. The throughput and capacity of storage subsystems have not evolved as fast as the computing power in extreme-scale supercomputers, making the classical post-hoc approach highly inefficient. In situ processing has then emerged as a solution in which simulation and data analysis/visualization are intertwined for better performance and greater interactivity.Determining the best allocation, i.e., how many resources to allocate to simulation and analysis respectively, mapping, i.e., where and at which frequency to run the analysis/visualization, and data transfer mode is a complex task whose performance assessment is crucial to the efficient execution of in situ processing. However, such a performance evaluation of different strategies usually relies either on directly running them on the targeted execution environments, which can rapidly become extremely time- and resource-consuming, or on resorting to simplified models of the components of an in situ application, which can lack of realism. In both cases, the validity of the performance evaluation is limited.In this paper, we present Sim-Situ, a simulation-based framework for the faithful performance evaluation of in situ processing strategies. We designed Sim-Situ to reflect the typical features of in situ processing systems. Thanks to its modular design, Sim-situ has the necessary flexibility to easily and faithfully evaluate the behavior and performance of various allocation, mapping, and data transfer strategies. We illustrate the simulation capabilities of Sim-Situ on a Molecular Dynamics use case. We study the impact of different strategies on performance and show how users can leverage Sim-Situ to determine interesting tradeoffs when adding analysis/visualization components to their application.

Honoré, Valentin↗

DOE OSTI2025

Fast HARDI Uncertainty Quantification and Visualization with Spherical Sampling

In this paper, we study uncertainty quantification and visualization of orientation distribution functions (ODF), which corresponds to the diffusion profile of high angular resolution diffusion imaging (HARDI) data. The shape inclusion probability (SIP) function is the state‐of‐the‐art method for capturing the uncertainty of ODF ensembles. The current method of computing the SIP function with a volumetric basis exhibits high computational and memory costs, which can be a bottleneck to integrating uncertainty into HARDI visualization techniques and tools. We propose a novel spherical sampling framework for faster computation of the SIP function with lower memory usage and increased accuracy. In particular, we propose direct extraction of SIP isosurfaces, which represent confidence intervals indicating spatial uncertainty of HARDI glyphs, by performing spherical sampling of ODFs. Our spherical sampling approach requires much less sampling than the state‐of‐the‐art volume sampling method, thus providing significantly enhanced performance, scalability, and the ability to perform implicit ray tracing. Our experiments demonstrate that the SIP isosurfaces extracted with our spherical sampling approach can achieve up to 8164× speedup, 37282× memory reduction, and 50.2% less SIP isosurface error compared to the classical volume sampling approach. We demonstrate the efficacy of our methods through experiments on synthetic and human‐brain HARDI datasets.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

LiDAR-Based Point Cloud Data Processing

The presentation includes the procedures of utilizing LiDAR-based point cloud data in WebGL applications, such as capturing data, processing data, importing point cloud into Unity software, and improving application performance. It uses IRC BLD 603 Lab B-12 as an example. It'll be presented at Viz n Learn workshop which is a collaboration series between INL's Applied Visualization Laboratory (AVL) and University of Wyoming (UW)'s Shell 3D Visualization center. Each session will highlight 2 projects from each institution monthly, followed by discussion on areas of collaborative interest and action.

3D↗

DOE OSTI2024

Interface stability of ultrasonic additively manufactured Zircaloy-4 during hydrothermal corrosion

Simulated pressurized water reactor conditions (330 °C, 15.6 MPa, ~20 ppb oxygen) without irradiation were used to investigate the hydrothermal corrosion behavior of ultrasonic additively manufactured Zircaloy-4 up to 1000 h. X-ray computed tomography allowed for visualization of defects from processing and their progression after corrosion experiments. The specimens were found to have clear variability in the mass change data, compared to typical wrought Zircaloy-4 specimens. The variation in the mass change after exposure was attributed to weld defects connected to the specimen surface which allowed ingress of oxidant into the samples. Defects visualized by computed tomography were found via metallography and characterized. In conclusion, ultrasonic additively manufactured Zircaloy-4 was found to have comparable corrosion behavior as wrought Zircaloy-4 for specimens which did not have clear surface defects along weld interfaces.

36 MATERIALS SCIENCE↗

DOE OSTI2021

DeepShadows: Separating low surface brightness galaxies from artifacts using deep learning

Searches for low-surface-brightness galaxies (LSBGs) in galaxy surveys are plagued by the presence of a large number of artifacts (e.g., objects blended in the diffuse light from stars and galaxies, Galactic cirrus, star-forming regions in the arms of spiral galaxies, etc.) that have to be rejected through time consuming visual inspection. In future surveys, which are expected to collect hundreds of petabytes of data and detect billions of objects, such an approach will not be feasible. We investigate the use of convolutional neural networks (CNNs) for the problem of separating LSBGs from artifacts in survey images. We take advantage of the fact that we have available a large number of labeled LSBGs and artifacts from the Dark Energy Survey, that we use to train, validate, and test a CNN model. That model, which we call DeepShadows , achieves a test accuracy of 92.0%, a significant improvement relative to feature-based machine learning models. We also study the ability to use transfer learning to adapt this model to classify objects from the deeper Hyper-Suprime-Cam survey, and we show that after the model is retrained on a very small sample from the new survey, it can reach an accuracy of 87.6%. Finally, these results demonstrate that CNNs offer a very promising path in the quest to study the low-surface-brightness universe.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Uniformity and volume-representativity of consecutive submillimetre wafers of shale for SANS and USANS investigations

(Ultra) Small Angle Neutron Scattering (SANS/USANS) is a non-destructive technique suitable for characterization of porous structures from nano- to micro-pore size (1 nm to 20 μm), which has been widely used to characterize accessible and inaccessible porosity in tight unconventional hydrocarbon reservoirs (e.g., shales). Here, in this study, SANS and USANS are used to examine the degree of nano- to micropore uniformity of the rock body on sub-millimetre to centimetre scale. This study presents a test of the hypothesis of volume representativity of pore structure information measured by SANS and USANS for shale wafers (0.22–1 mm) cut from six North American unconventional shale cores of different maturities (New Albany Shale and Marcellus Shale). Experimental reproducibility of USANS is further investigated for two wafers measured using various acquisition times. All samples show that fluctuations of the relative intensity generally decrease from the USANS Q-range (pore size from around 200 nm to 20 μm) to most of the SANS Q-range (pore size from around 5 nm to 700 nm), and peaks in the SANS large-Q region (for pores smaller than about 5 nm). There is a positive correlation between the spatial fluctuation of the relative SANS intensity and the scattering power of shales. In addition, the scattering intensity and its fluctuations is larger for the less mature shale cores. Shale is known to be highly heterogenous and the hypothesis of uniformity does not apply at sub-millimetre scale even for samples that appear homogeneous at visual inspection. This study presents an approach to minimise the variation through sample selection, data interpretation methodology and instrumental reproducibility tests. The best values of the microstructural spatial uniformity for the apparently homogeneous sections of a core (i.e., the SANS and USANS intensity variation) is less than ±10%.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2024

Investigating Mountain Watershed Headwater‐To‐Groundwater Connections, Water Sources, and Storage Selection Behavior With Dynamic‐Flux Particle Tracking

Abstract Climate change will impact mountain watershed streamflow both directly—with changing precipitation amounts and variability—and indirectly—through temperature shifts altering snowpack, melt, and evapotranspiration. To understand how these complex processes will affect ecosystem functioning and water resources, we need tools to distinguish connections between water sources (rain/snowmelt), groundwater storage, and exit fluxes (streamflow/evapotranspiration), and to determine how these connections change seasonally and as climate shifts. Here, we develop novel watershed‐scale approaches to understand water source, storage, and exit flux connections using a dynamic‐flux particle tracking model (EcoSLIM) applied in California's Cosumnes Watershed, which connects the Sierra Nevada and Central Valley. This work develops new visualizations and applications to provide mechanistic understanding that underpins the interpretation of isotopic field data at watershed scales to distinguish sources, flow paths, residence times, and storage selection. In our simulations, streamflow comes primarily from snow‐derived water while evapotranspiration generally comes from rain. Most streamflow starts above 1,000 m while evapotranspiration is sourced relatively evenly across the watershed and is generally younger than streamflow. Modeled streamflow consists primarily of water sourced from precipitation in the previous 5 years but before the current water year, while ET consists primarily of water from precipitation in the current water year. ET, and to a lesser extent streamflow, are both younger than water in groundwater storage. However, snowmelt‐derived streamflow preferentially discharges older water from snow‐derived storage. Dynamic‐flux particle tracking and new approaches presented here enable novel model‐tracer comparisons in large‐scale watersheds to better understand watershed behavior in a changing climate.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

MPC4CLR (Model-Predictive-Control-for-Critical-Load-Restoration-in-Power-Distribution-Systems) [SWR-22-24]

Model predictive control (MPC) is a system or process control technique for making decisions under uncertainty via rolling look-ahead optimizations at each control step where only the current step decisions are applied, and the rest are discarded. In this work, we developed an MPC for a critical load restoration (CLR) in power distribution systems to recover system service (electricity delivery) following an extreme event-triggered substation outage. The method considers the problem of controlling distributed energy resources (DERs) of the distribution system with the objective of achieving maximum load pick up while satisfying distribution network flow and voltage constraints. A linearized optimal power flow (OPF) model is employed to represent the physics of the network. The problem formulation is augmented with a ramping (up) reserve product for the DERs to ensure improved and upward monotonic load restoration as time evolves. Simulation analysis and performance tests are performed using a modified IEEE 13-bus test feeder integrated with wind, solar, microturbine, and energy storage battery. The software is developed using various software packages in Julia and Python. The MPC model is implemented using the JuMP optimization language in Julia while the data analytics including renewable generation and load demand forecasts, running the MPC simulation and visualizations is performed in Python.

Eseye, Abinet Tesfaye↗

DOE OSTI2025

CyRRL (Cyber Resilient Reinforcement Learning for grid voltage control) [SWR-24-115]

This codebase contains a multi-agent, actor-critic reinforcement learning implementation for cyber-resilient grid voltage control. It uses a 123-bus OpenDSS system as the environment, with three-phase power flow translating nodal power injections into solved nodal voltages. The reward function penalizes deviations from nominal voltage as well as reactive power dispatch, while encouraging agents to take actions that result in fast convergence to nominal conditions. The codebase models false data injection attacks and includes functionality for training, testing, hyper-parameter tuning, and visualization.

Murphy, Sinnott [National Renewable Energy Laborat↗

DOE OSTI2020

Ordovician-Cambrian Units: Hierarchical Evaluation of Geologic Carbon Storage Resource Estimates

The Indiana Geological and Water Survey (IGWS) led subtask 1.1 to assess the regional distribution and estimate the storage capacity of Ordovician-Cambrian stratigraphic units located within the partnership region. A comprehensive data set of wireline logs and petrophysical information was used to generate these interpretations. These data include core analysis for porosity and permeability, mercury injection capillary pressure (MICP), and existing well data including location and stratigraphic information. This report includes storage resource estimates (SREs) for three potential storage reservoirs(limestone and dolostone from the Upper Ordovician Trenton Limestone/Black River Group and equivalent units, the Middle Ordovician St. Peter Sandstone, and primary target reservoir rocks of the Lower Ordovician and Upper Cambrian Knox Supergroup and equivalent units) calculated using six methodologies: (1) a fixed value of porosity of 10 percent in all units evaluated; (2) a unique average porosity (per well) from wireline-derived porosity (neutron, sonic, and/or density porosity for each unit); (3) porosity values from core analysis; (4) a depth-dependent porosity model (Knox Supergroup only); (5) porosity based on a model based on petrophysical facies; and (6) SREs using National Energy Technology Laboratory’s CO2 Storage prospeCtive Resource Estimation Excel aNalysis (CO2-SCREEN beta V2). All methods used the same values for thickness for each unit. However, the areal extent of each assessment was limited by the data available for each method. Estimated volumes were calculated in 1-by-1 kilometer grid cells and summarized as county and total stratigraphic unit volumes. The resultant SREs mass are displayed using boxplots, which allow for comparing data statistics (mean values and variability) between methods. Differences observed in SRE results from the six methods are mainly attributable to differences in the data and conceptual models used to interpret or estimate porosity in each method. Based on this systematic variability between methods, it is inferred that methods 1, 4, and 6 are best used for regional-scale reconnaissance estimates of storage capacity while methods 2, 3, and 5 are more appropriate for local scales where more data is required. All estimates are data-density dependent and different methods require different amounts of data for reasonable assessments. ArcMap 10.5.1 software was used to portray SREs to help visualize spatial variance of estimates for each methodology, and more importantly, to highlight those areas having the greatest total storage potential estimates.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2020

A Community Energy Operations and Planning System: Concept, Use cases, Metrics, and Benefits

Community and city leaders are interested in achieving sustainability goals, providing resilient energy infrastructure, and improving economic competitiveness. Community-level data acquisition and analysis can provide energy and associated benefits that are not possible at the single building level. However, there is a lack of organizational structure, common semantic data models, interoperable systems, and methods to support data-driven decision-making for community-scale energy supply and demand systems. We explored the need and opportunity for a Community Energy Operations and Planning System (Community EOPS), a potential data exchange platform. We conducted “customer discovery” interviews, and reviewed literature, public tools, and technology platforms to identify key energy data “users” and use cases in communities. The key users of the Community EOPS could be developers of mixed-use districts, corporate, defense and university campus energy managers, and city managers of cities that own their energy utility. The value could be for community planning and reporting (for energy data-integrated land use planning and community infrastructure investments in microgrids, storage, district heating and cooling), energy efficiency (leveraging optimizations for community scale energy supply and demand), flexible load management (grid-edge load management to offset, shift, and flatten loads for multiple buildings and EV fleets), cost savings and revenue generation (participating in grid services), and social benefits such as energy resilience, equity, and awareness. We developed a conceptual Community EOPS architecture with recommendations for streamlined and prioritized data acquisition, sharing, and integration driven by prioritized use cases, common metrics, and actionable visualizations that can provide value to a community’s users.

Singh, Reshma↗

DOE OSTI2026

Machine Learning-Based Anomaly Detection for PMT Data Quality Monitoring in the SBN and DUNE

Maintaining high-quality detector data is essential for achieving the scientific objectives of the Short-Baseline Neutrino (SBN) Program at Fermilab. Current data quality monitoring (DQM) procedures rely primarily on threshold-based metrics and manual inspection of detector monitoring plots, making the detection of subtle or gradually developing anomalies both time-consuming and dependent on expert interpretation. This project developed and evaluated a machine-learning workflow for automatically identifying anomalous photomultiplier tube (PMT) channels in the Short-Baseline Near Detector (SBND) using optical-hit amplitude data. A Python-based analysis program was developed to process ROOT files, extract statistical features describing individual PMT amplitude distributions, and generate feature vectors for anomaly detection. These features were used to train an Isolation Forest model using data representing normal detector operation. The trained model was subsequently applied to independent detector runs to identify channels exhibiting statistically unusual behavior relative to the learned reference response. To support expert interpretation, the workflow generated complementary diagnostic products, including anomaly score distributions, normalized amplitude comparisons, decision-tree visualizations, and principal component analysis (PCA) projections. This project demonstrated the feasibility of integrating unsupervised machine learning into detector data-quality monitoring and developed a complete workflow for automated PMT performance assessment to aid expert-driven review. Beyond its technical contributions, the VFP appointment fostered a research collaboration between Aurora University and Fermilab and provided direct workforce development benefits by training the visiting faculty member in detector-scale machine-learning methods that are now being incorporated into undergraduate coursework and research. The methodology developed here provides a foundation for future applications to ProtoDUNE and other liquid argon time projection chamber (LArTPC) detectors, contributing to ongoing efforts to improve detector reliability, reduce manual monitoring requirements, and enable scalable data quality monitoring for future large-scale neutrino experiments, including the Deep Underground Neutrino Experiment (DUNE).

Colón Santana, Juan A. [Unlisted, US, IL]↗