Visualizing Clustering and Uncertainty Analysis with Multivariate Longitudinal Data.
Abstract not provided.
Chen, Maximillian Gene↗
SEARCH · Search NASA
Results for “Data visualization and analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Visualizing Clustering and Uncertainty Analysis with Multivariate Longitudinal Data.
Abstract not provided.
Chen, Maximillian Gene↗
Visualizing Clustering and Uncertainty Analysis with Multivariate Longitudinal Data.
Abstract not provided.
Chen, Maximillian Gene↗
Use of the Tool to Support Renewable Energy Auctions Processes (RE Data Explorer)
Renewable energy auctions are now a common competitive approach to procure low-cost renewable power around the world. Ensuring a successful auction process increasingly depends on the capabilities of auction designers and participants to identify actionable and defensible insights from large data sets (on renewable energy resources and complementary data) to both attract potential investors and address stakeholder concerns. The Renewable Energy (RE) Data Explorer is a user-friendly geospatial analysis tool for analyzing renewable energy potential and informing decisions. Developed by the National Renewable Energy Laboratory (NREL) and supported by the U.S. Agency for International Development (USAID), RE Data Explorer performs visualization and analysis of renewable energy potential that can be customized for different scenarios. RE Data Explorer can support prospecting, integrated planning, policymaking, and other decision-making activities to accelerate renewable energy deployment. The broader RE Explorer website provides guidance and information to link the RE Data Explorer geospatial analysis tool to key decision areas. This document provides information on how the RE Data Explorer can be used to support renewable energy auction processes.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Use of the Tool to Support Renewable Energy Project Development (RE Data Explorer)
The Renewable Energy (RE) Data Explorer is a user-friendly, geospatial analysis tool for analyzing renewable energy potential and informing decisions. Developed by the National Renewable Energy Laboratory (NREL) and supported by the U.S. Agency for International Development (USAID), RE Data Explorer performs visualization and analysis of renewable energy potential that can be customized for different scenarios. RE Data Explorer can support prospecting, integrated planning, policymaking, and other decision-making activities to accelerate renewable energy deployment. This document provides information on how the RE Data Explorer can support private sector utility-scale renewable energy project development.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
SSTDR and FDR Detection of Un-Energized and Energized Cable Anomalies Including Thermal Degradation Using Machine Learning
Historically, cables are initially qualified for nuclear power plant use for 40 years. As plants extend their operating license to 60 and 80 years, continued use of these cables must shift to a performance-based approach since it is cost prohibitive to completely replace cables that are likely still capable of performing their design function. A variety of cable tests are available and are commonly applied during outages when the cables can be taken out of service. Frequency domain reflectometry (FDR) is one of these test methods that is being more broadly accepted and used because it not only detects anomalies along the cable with a low-voltage signal that does not stress the cable insulation, but the technique also locates the anomalies. This supports follow-up local inspection and local repair or partial replacement of a damaged cable segment. Currently, FDR testing is only applied to cables that are taken out of service since the test instrument would be damaged by operational voltages. A related technology that has found some acceptance in the aircraft and rail industry is spread spectrum time domain reflectometry (SSTDR). This technology has been implemented with a custom commercial instrument by LiveWire Innovation that is designed to operate on live cables up to 1000 volts and with a bandwidth of 48 MHz. Initial evaluation by the Pacific Northwest National Laboratory (PNNL) of the Live Wire system indicated that a broader bandwidth (BW) SSTDR may be better for many kinds of flaws. This led PNNL to develop an SSTDR laboratory instrument suitable for tests up to 500 MHz bandwidth. Testing on energized cables is also desirable for online monitoring systems so an inductive clamshell coupler was developed that allows energized cables to be tested up to at least 5 kV and likely higher voltage levels. Dielectric spectroscopy and tan delta testing plus various laboratory destructive tests were included in this data acquisition campaign directed to feed a machine learning (ML) study. With these kinds of developments, online energized cable tests may be possible with industrial adoption of such hardware advances but it will be completely impractical to have highly skilled data analysts continually examine these complex signals for indications of damage or compromised conditions. If online testing is to be implemented in new test hardware, it must be accompanied by software that can interpret the signals and alert plant operators of changing or degraded conditions. The thermally aged, shielded cable investigated here was separately treated for ML analysis. Visual analysis of electrical data showed generally increasing peaks where the cable entered and exited the oven. These peaks were not exactly aligned with expected locations, but these differences were attributed to velocity of propagation calibration errors. Only supervised ML was applied to the thermally aged data as this data was only available shortly before the committed publication date of this report. The supervised ML was structured to divide the 0 to 70-day responses as ‘normal’ from 0 to 35 days or ‘anomalous’ from 36 to 70 days, based on cable tensile elongation at break (EAB) insulation characterization. Using 80% of the data for training and 20% for testing, the supervised ML predicted normal versus anomalous was 70% accurate. Important conclusions include: • Accuracy to predict the presence of cable damage is improved from the 2023 effort by more training data. Weighted accuracies for comparisons among the instruments ranged from 67 to 89 % for unsupervised ML and 71 to 99% for supervised ML. • Based on the synthetic data tests, the unsupervised models are more generalizable to unseen anomalies. The Multi-Layer Perceptron classifier (MLP) model reported as high as 99.7% accuracy on the test data, but this dropped to 58.3% when tested on the synthetic data. In contrast, the unsupervised Pointwise model only achieved 89.7% accuracy on the experimental data but reported 78.3% accuracy on the synthetic data. • The best anomaly indicators are higher frequency (400 MHz BW) FDR data. Other tests may be interesting but for this study, this was the best predicter.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Web-Based Visual Analytics for Social Media
Social media provides a rich source of data that reflects current trends and public opinion on a multitude of topics. The data can be harvested from Twitter, Facebook, Blogs, and other social applications. The high rate of adoption of social media has created a domain that has an ever expanding volume of data that make it difficult to use the raw data for analysis. Information visual analytics is key in drawing out features of interest in social media. The Scalable Reasoning System is an application that couples a back end server performing analysis algorithms and an intuitive front end visualization to allow for investigation. We provide a componentized system that can be rapidly adapted to customer needs such that the information they are most interested in is brought to their attention through the application. To this end, we have developed a social media application for use by emergency operations for the city of Seattle to show current weather and traffic trends which is important for their tasks.
99 GENERAL AND MISCELLANEOUS↗
Quantum Computing and Visualization: A Disruptive Technological Change Ahead
The focus of this Visualization Viewpoints article is to provide some background on quantum computing (QC), to explore ideas related to how visualization helps in understanding QC, and examine how QC might be useful for visualization with the growth and maturation of both technologies in the future. In a quickly evolving technology landscape, QC is emerging as a promising pathway to overcome the growth limits in classical computing. In some cases, QC platforms offer the potential to vastly outperform the familiar classical computer by solving problems more quickly or that may be intractable on any known classical platform. As further performance gains for classical computing platforms are limited by diminishing Moore’s Law scaling, QC platforms might be viewed as a potential successor to the current field of exascale-class platforms. Importantly, while present-day QC hardware platforms are still limited in scale, the field of quantum computing is robust and rapidly advancing in terms of hardware capabilities, software environments for developing quantum algorithms, and educational programs for training the next generation of scientists and engineers. After a brief introduction to QC concepts, the focus of this article is to explore the interplay between the fields of visualization and QC. First, visualization has played a role in QC by providing the means to show representations of the quantum state of single-qubits in superposition states and multiple-qubits in entangled states. Second, there are a number of ways in which the field of visual data exploration and analysis may potentially benefit from this disruptive new technology though there are challenges going forward.
97 MATHEMATICS AND COMPUTING↗
Neutron imaging analysis using jupyter Python notebook
Abstract Independently of the image modality (x-rays, neutrons, etc), image data analysis requires normalization, a preprocessing step. While the normalization can sometimes easily be generalized, the analysis is, in most cases, specific to an experiment and a sample. Although many tools (MATLAB, ImageJ, VG Studio…) offer a large collection of pre-programmed image analysis tools, they usually require a learning step that can be lengthy depending on the skills of the end user. We have implemented Jupyter Python notebooks to allow easy and straightforward data analysis, along with live interaction with the data. Jupyter notebooks require little programming knowledge and the steep learning curve is bypassed. Most importantly, each notebook can be tailored to a specific experiment and sample with minimized effort. Here, we present the pros and cons of the main methods to analyse data and show the reason why we have found that Jupyter Python notebooks are well suited for imaging data processing, visualization and analysis.
Bilheux, Jean-Christophe (ORCID:0000000321726487)↗
I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey
Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.
97 MATHEMATICS AND COMPUTING↗
ParNCL and ParGAL: Data-parallel Tools for Postprocessing of Large-scale Earth Science Data
Earth science high-performance applications often require extensive analysis of their output in order to complete the scien- tific goals or produce a visual image or animation. Often this analysis cannot be done in situ because it requires calculating time-series statistics from state sampled over the entire length of the run or analyzing the relationship between similar time series from previous simulations or observations. Many of the tools used for this postprocessing are not themselves high- performance applications, but the new Parallel Gridded Analysis Library (ParGAL) provides high-performance data-parallel versions of several common analysis algorithms for data from a structured or unstructured grid simulation. The library builds on several scalable systems, including the Mesh Oriented DataBase (MOAB), a library for representing mesh data that sup- ports structured, unstructured finite element, and polyhedral grids; the Parallel-NetCDF (PNetCDF) library; and Intrepid, an extensible library for computing operators (such as gradient, curl, and divergence) acting on discretized fields. We have used ParGAL to implement a parallel version of the NCAR Command Language (NCL) a scripting language widely used in the climate community for analysis and visualization. The data-parallel algorithms in ParGAL/ParNCL are both higher performing and more flexible than their serial counterparts.
97 MATHEMATICS AND COMPUTING↗
macroMS: Image-Guided Analysis of Random Objects by Matrix-Assisted Laser Desorption/Ionization Time-of-Flight Mass Spectrometry
Mass spectrometry imaging is well-suited to characterizing sample surfaces for their chemical content in a spatially resolved manner. However, when the surface contains small objects with significant empty spaces between them, more efficient approaches to sample acquisition are possible. Image-guided mass spectrometry (MS) enables high-throughput analysis of a diverse range of sample types, such as microbial colonies, liquid microdroplets, and others, by recognizing and analyzing selected location targets in an image. Here, we describe an imaging protocol and macroMS, an online software suite that can be used to enhance MS measurements of macroscopic samples that are imaged by a camera or a flatbed scanner. Furthermore, the web-based tool enables users to find and filter targets from the optical images, correct optical distortion issues for improved spatial location of selected targets, input the custom geometry files into an MS device to acquire spectra at the selected locations, and finally, perform limited data analysis and use visualization tools to aid locating samples containing compounds of interest. Using the macroMS suite, an enzyme mutant library of Saccharomyces cerevisiae and nL droplet arrays of Escherichia coli and Pseudomonas fluorescens have been assayed at a rate of ~2 s/sample.
47 OTHER INSTRUMENTATION↗
Evaluation of Portable Programming Models to Accelerate LArTPC Detector Simulations
The Liquid Argon Time Projection Chamber (LArTPC) technology is widely used in high energy physics experiments, including the upcoming Deep Underground Neutrino Experiment (DUNE). Accurately simulating LArTPC detector responses is essential for analysis algorithm development and physics model interpretations. Accurate LArTPC detector response simulations are computationally demanding, and can become a bottleneck in the analysis workflow. Compute devices such as General-Purpose Graphics Processing Units (GPGPUs) have the potential to substantially accelerate simulations compared to traditional CPU-only processing. The software development for these compute accelerators often carries the cost of specialized code refactorization and porting to match the target hardware architecture. With the rapid evolution and increased diversity of the computer architecture landscape, it is highly desirable to have a portable solution that also maintains reasonable performance. We report our ongoing effort in evaluating Kokkos as a basis for this portable programming model using LArTPC simulations in the context of the Wire-Cell Toolkit, a C++ library for LArTPC simulations, data analysis, reconstruction and visualization.
47 OTHER INSTRUMENTATION↗
TR-XPS Realtime Analysis Tool (ArroyoXPS) v0.1
The ALS has developed a Time-Resolved X-ray Photoelectron Spectroscopy (TR-XPS) technique, which involves applying a specific pattern of voltage curves to a sample while measuring XPS peaks. This pattern is repeated over multiple cycles, and changes in the material's response provide valuable scientific insights. Traditionally, file-based analysis workflows have been used: scans are run for a predetermined time, and after one or more scans are complete, calculations are made. ArroyoXPS changes this by offering in-experiment scan and analysis, allowing researchers to gain insights before a scan is finished. This enables them to adjust experimental parameters quickly, potentially saving valuable beamtime. ArroyoXPS includes tools for integrating with beamline control systems, performing analysis, and visualizing scan data in a web browser.
McReynolds, Dylan [Lawrence Berkeley National Labo↗
SDAV Institute Final report
Final report of the Scalable Data Management, Analysis and Visualization Institute
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
Compiler and Runtime Approaches to Enable Large-Scale Irregular Programs. Final report, July 2013 - July 2019
While regular algorithms, characterized by operations on dense matrices and arrays, have long been the mainstay of scientific, high-performance computing, irregular algorithms, which feature unpredictable accesses to pointer-based data structures, are becoming increasingly common in high performance computing, arising in graph analysis, data mining and visualization, among other domains. Unfortunately, the defining characteristics of irregular applications, their dynamic, unpredictable, data-dependent access patterns and data layouts, make achieving high performance on large scale systems difficult. Scaling applications to peta- and exa-scale requires carefully controlling communication and data movement and placement, an inherently difficult task when access patterns and data layouts are unpredictable! Most irregular applications that attain high performance must be painstakingly hand-written and hand-tuned, with few common principles or paradigms uniting various implementations and easing future development. Despite the increasing importance of irregular applications, there is little programmer knowledge, and even less compiler ability, devoted to optimizing them. This project aims to solve these problems. By allowing programmers to write irregular applications in high level forms, with at most a few annotations highlighting key structural properties, programmers can focus on developing their algorithms and methods. The compiler and run-time system can take on the tedious task of optimizing the application for execution at large scales, and can automatically provide efficient implementations. This will provide portability and ease maintenance for existing irregular applications, but, more importantly, open up whole new domains of computational science to large-scale, high-performance simulation codes.
97 MATHEMATICS AND COMPUTING↗
2019 Quantum Materials Young Investigators Workshop Report
The fourth edition of the workshop “Quantum Materials Young Investigators” was held June 6-7, 2019 at the Oak Ridge National Laboratory (ORNL). This workshop followed up on previous meetings that took place at ORNL starting in 2016. This important series of annual workshops, organized by Adam Aczel and Stuart Calder, ensures continuous engagement with the early career principal investigators (PIs) of the quantum materials neutron scattering community. Through a series of short scientific talks presented by the external PIs, members of the Neutron Scattering Division (NSD) learn about their scientific interests and needs. Presentations from ORNL staff members also help to inform the external PIs about the current state of ORNL’s quantum materials neutron scattering program. Topics covered include the current instrument suites, sample environment, data reduction, visualization, and analysis, and future neutron scattering and complementary capabilities. Feedback is solicited from the external PIs in all these key areas and communicated to NSD management in the form of a workshop report. This workshop series also helps to foster collaborations between NSD scientists and the research groups of the external PIs and plays an important role in attracting new neutron scattering users.
43 PARTICLE ACCELERATORS↗
Diagnostic and predictive capabilities of the TCR digital platform
The Transformational Challenge Reactor program is leveraging additive manufacturing technologies to fabricate the nuclear components required to assemble a microreactor core. Compared with traditional manufacturing processes, additive manufacturing allows for direct observation of the interior of the component during manufacturing. This unique capability promises significant possibilities for creating a new paradigm for nuclear component qualification by leveraging in-situ process data. This report describes FY21 efforts to predict material tensile properties based on data collected during the laser powder bed fusion printing process. The primary focus of this report is the test campaign designed to generate the large quantities of training data required to implement artificial intelligence algorithms that can predict these material properties. Preliminary prediction results and a demonstration of the overall data collection, analysis, and visualization pipeline are also provided.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗