Programming and Performance Visualization Tools
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Gyrokinetic simulations of plasma microturbulence in tokamaks are challenging to visualize because the compute grid follows the magnetic field lines that spiral around the torus. We have overcome this challenge by developing three new approaches that improve visualization of gyrokinetics. Our techniques work directly with the topology of magnetic flux surfaces where the simulation stores variables in concentric rings on poloidal planes (vertical cross sections of the torus). Our visualization preview step triangulates each consecutive pair of rings to display the data on a poloidal plane. The second visualization technique follows spiral field lines around the torus and constructs polygons to visualize a flux surface. Third, the poloidal triangles are connected between planes to form prisms that compose a 3-D model of the entire torus. The visualization workflow produces detailed geometry that matches the high resolution, irregular compute grid for every time step. The surface and solid models are displayed in scientific visualization programs to effectively explore and communicate the results, including fluctuation of electron density, ion temperature, and electrostatic potential. Highly detailed renderings verify plasma behavior along magnetic field lines over time.
In modern Machine Learning, model training is an iterative, experimental process that can consume enormous computation resources and developer time. To aid in that process, experienced model developers log and visualize program variables during training runs. Exhaustive logging of all variables is infeasible, so developers are left to choose between slowing down training via extensive conservative logging, or letting training run fast via minimalist optimistic logging that may omit key information. As a compromise, optimistic logging can be accompanied by program checkpoints; this allows developers to add log statements post-hoc, and "replay" desired log statements from checkpoint---a process we refer to as hindsight logging. Unfortunately, hindsight logging raises tricky problems in data management and software engineering. Done poorly, hindsight logging can waste resources and generate technical debt embodied in multiple variants of training code. In this paper, we present methodologies for efficient and effective logging practices for model training, with a focus on techniques for hindsight logging. Our goal is for experienced model developers to learn and adopt these practices. To make this easier, we provide an open-source suite of tools for Fast Low-Overhead Recovery (flor) that embodies our design across three tasks: (i) efficient background logging in Python, (ii) adaptive periodic checkpointing, and (iii) an instrumentation library that codifies hindsight logging for efficient and automatic record-replay of model-training. Model developers can use each flor tool separately as they see fit, or they can use flor in hands-free mode, entrusting it to instrument their code end-to-end for efficient record-replay. Our solutions leverage techniques from physiological transaction logs and recovery in database systems. Evaluations on modern ML benchmarks demonstrate that flor can produce fast checkpointing with small user-specifiable overheads (e.g. 7%), and still provide hindsight log replay times orders of magnitude faster than restarting training from scratch.
The M-9 Shock and Detonation Physics group executes experiments on gun and explosive platforms with large numbers of oscilloscopes used for data acquisition. The data acquisition from these oscilloscopes was automated many years ago using a custom piece of software called RunDig . The default save format from this software is a custom structure referred to as "NUM-DAT" format. This file format includes a text ".DAT" file which is a header file used to interpret the binary ".NUM" file which contains the oscilloscope data. The data save format was originally developed by John Vorthman and has been in use by M-9 personnel for over 20 years. This data format has been used for archiving data from experiments performed by M-9 personnel at TA-40, TA-39, and the TA-55 Impact Test Facility. Numerous custom analysis and visualization programs have also been developed, and continue to be used, that utilize this data format. This document describes the NUM-DAT format and provides code examples for reading the format and converting it to other formats.
We develop a workflow, implemented as a plugin to the molecular visualization program VMD, that can fix ring penetrations with minimal user input. LongBondEliminator, detects ring piercing artifacts by the long, strained bonds that are the local minimum energy conformation during minimization for some assembled simulation system. The LongBondEliminator tool then automatically treats regions near these long bonds using multiple biases applied through NAMD. By combining biases implemented through the collective variables module, density-based forces, and alchemical techniques in NAMD, LongBondEliminator will iteratively alleviate long bonds found within molecular simulation systems. Through three concrete examples with increasing complexity, a lignin polymer, an viral capsid assembly, and a large, highly glycosylated protein aggrecan, we demonstrate the utility for this method in eliminating ring penetrations from classical MD simulation systems. The tool is available via gitlab as a VMD plugin, and has been developed to be generically useful across a variety of biomolecular simulations.
How early sensory experience during “critical periods” of postnatal life affects the organization of the mammalian neocortex at the resolution of neuronal cell types is poorly understood. We previously reported that the functional and molecular profiles of layer 2/3 (L2/3) cell types in the primary visual cortex (V1) are vision-dependent [S. Chenget al.,Cell185, 311–327.e24 (2022)]. Here, we characterize the spatial organization of L2/3 cell types with and without visual experience. Spatial transcriptomic profiling based on 500 genes recapitulates the zonation of L2/3 cell types along the pial–ventricular axis in V1. By applying multitasking theory, we suggest that the spatial zonation of L2/3 cell types is linked to the continuous nature of their gene expression profiles, which can be represented as a 2D manifold bounded by three archetypal cell types. By comparing normally reared and dark reared L2/3 cells, we show that visual deprivation-induced transcriptomic changes comprise two independent gene programs. The first, induced specifically in the visual cortex, includes immediate-early genes and genes associated with metabolic processes. It manifests as a change in cell state that is orthogonal to cell-type-specific gene expression programs. By contrast, the second program impacts L2/3 cell-type identity, regulating a subset of cell-type-specific genes and shifting the distribution of cells within the L2/3 cell-type manifold. Through an integrated analysis of spatial transcriptomics with single-nucleus RNA-seq data, we describe how vision patterns cortical L2/3 cell types during the critical period.
The goal of Kitware’s work has been the study of a unified data-driven approach for programming applications and in situ analysis and visualization. We have especially focused on understanding the interplay between data-centric programming model requirements at extreme-scale and the overall impact of those requirements on the design, capabilities, flexibility, and implementation details for both applications and the supporting in situ infrastructure. We have successfully demonstrated the use of pipeline abstractions within Legion and developed a number of algorithms that were integrated within the Legion simulation framework. This report focuses on describing milestones, mainly those focusing on exploring pipeline abstractions in the context of the Legion programming model.
Nuclear power plants are experiencing significant cost challenges to remain competitive with other energy-generation utilities. Unlike other industries, the cost of operation and maintenance activities is mostly attributed to workforce costs. To mitigate this, nuclear power plant stakeholders are increasingly interested in the development and deployment of machine learning methods to potentially automate or augment manually intensive tasks to reduce costs, especially for monitoring activities. One monitoring function that is visually demanding and that can occur frequently to meet the requirements of a fire protection program is visually monitoring an area for fire occurrence. Currently, fire watch activities consist of a worker physically stationed at a given location with the sole responsibility of observing a given area to ensure a fire is detected and mitigated promptly. This effort focused on the development and evaluation of a suitable deep convolutional neural network to classify individual video frames at a sub-second frequency for the occurrence of “fire” and “no fire” in varying industrial environments similar to nuclear power plants. It is believed that a trained neural network model could be integrated with existing facility video surveillance camera feeds to generate alerts when fire inferences occur in individual frames captured at sub-second temporal resolutions. Extensive effort was dedicated to identifying and curating suitable imagery training data representing varying environments and scene settings with and without flame features to maximize generalization in nuclear power plant environments. The data collection effort resulted in the aggregation of a large, labeled image library exceeding 12,000 images to support model training for diverse industrial environments. A deep neural network model incorporating parallel multi-scale capabilities was developed and trained to support accurate image-based detection of flame incidents of varying sizes and spectral feature properties within heterogeneous scenes. Analysis results show that the trained model can achieve high inference accuracy despite heterogeneous scene environments and components. Testing accuracy exceeded 95.0 percent with very low false positive and false negative inferences.
To comply with U.S. Nuclear Regulatory Commission (NRC) regulations, licensees and entities authorized under Title 10 of the Code of Federal Regulations (CFR) Part 26 Section 26.3 (§ 26.3) are required to have fitness-for-duty (FFD) programs. Under § 26.3, the expectation of these FFD programs is to provide reasonable assurance that individuals who are granted unescorted access to nuclear power reactor protected areas and Category I fuel cycle facility material control areas are trustworthy, will perform their tasks in a reliable manner, are not under the influence of any substance, legal or illegal, that may impair their ability to perform their duties, and are not mentally or physically impaired from any cause that can adversely affect their ability to safely and competently perform their duties. Pacific Northwest National Laboratory (PNNL) was tasked with developing a performance monitoring program to risk inform NRC inspection and policy regarding quantitative FFD performance data. To meet this need, PNNL developed methodologies that could be implemented within a performance monitoring program. Throughout this report, these methodologies are referred to as comparative metrics. The NRC provided PNNL with 2016–2019 data from annual reporting forms and single positive test forms provided by licensees and other entities. For most of the comparative metrics, the analyses required customized processing, such as creating filtering fields, adding data fields and summaries, and joining datasets. The comparative metrics developed include: random testing rate, random policy violation rate, pre-access policy violation rate, subversion attempt rate, and number of policy violations by labor category. The comparative metrics can be used for parsing and visualizing FFD program data and monitoring FFD performance at the labor category, facility, licensee, and industry levels to risk inform NRC inspection and policy with regard to the FFD data currently collected from licensees and other entities that implement Part 26 requirements. Furthermore, these developed comparative metrics allow a more in-depth look at the FFD programs for the industry to discern trends and patterns that may warrant changes at an industry level and to inform policy decisions. These analyses should be refreshed as new FFD data become available.
XtalCAMP is a software package based on the MATLAB platform, which is suitable for, but not limited to, the analysis and visualization of scanning Laue X-ray micro-/nanodiffraction data. The main objective of the software is to provide complementary functionalities to the Laue indexing software packages used at several synchrotron beamlines. Here, the graphical user interfaces allow the easy analysis of characteristic microstructure features, including real-time intensity mapping for a quick examination of phase, grain and defect distribution, 2D color-coded mapping of microstructural properties from the output of other Laue indexing software, crystal orientation visualization, grain boundary characterization based on orientation/misorientation calculation, principal strain/stress analysis, and strain ellipsoid representation, as well as a series of additional toolkits. As an example, XtalCAMP is applied to the microstructural investigation of a solution-heat-treated Ni-based superalloy manufactured using a laser 3D-printing technique, and a deformed natural quartzite from Val Bregaglia in the Central Alps.
In this project we considered a number of variants of parallel computations of data analysis and visualization techniques for large-scale simulations and their ensembles with the goal of achieving in situ analytics.
The Department of Energy (DOE) requires that Savannah River Remediation LLC (SRR), the Liquid Waste contractor, maintain a robust and timely Structural Integrity Program for waste tanks that are leak-tight and for waste tanks that have leaked or are suspect. These requirements are promulgated in DOE Manual 435.1-1, Section II.Q.(2). A key aspect of SRR's implementation of these requirements is its annual tank inspection program. In 2018, the SRR Visual and In-Service Inspection Program used two visual imagery techniques to ascertain the integrity of the Savannah River Site (SRS) waste tanks: high resolution digital photography and closed-circuit television. The primary inspection method made use of direct photograph techniques, e.g., making a series of photographs providing detailed views of the tank and wide-angle photography for obtaining overviews of large areas. Closed-circuit television was then typically used to further investigate conditions found during the initial inspection. During 2018, a total of 4,853 photographs were taken and 47 video inspections were performed as part of this inspection program. Of the 51 waste tank systems at SRS that were designed, constructed, and placed into active service storing radioactive liquid waste, 43 remain in active service. Eight tanks have been cleaned, stabilized by filling with engineered grout, and removed from service (also known as operationally closed) -Tanks 5, 6, and 12 (Type I tanks); Tank 16 (Type II tank); and Tanks 17, 18, 19, and 20 (Type IV tanks). For the 43 waste tanks, inspections were successfully conducted in 2018 through all accessible annulus risers and inspection ports for nine Type I tanks, three Type II tanks, and 27 Type III/IIIA tanks; at least one inspection was made in the interior of four Type IV tanks (i.e., the tanks without annular spaces) above the liquid level in the tank. Rainwater continues periodically to be observed migrating into the annuli of some tanks. Evidence of this infiltration was primarily noted by observation of surface stains, and occasionally by calciferous deposits, changed configuration of salt deposits in the associated annulus, and mild surface corrosion. The conditions of the 43 tanks remained essentially unchanged from the conditions reported in 2017. The one key exception was the identification of eight new cracks in the Tank 15 primary tank wall. These newly identified cracks are located at 65, 67, 70, 76, 150, 152, 176 inches and 200 inches above the tank bottom. The identified cracks in Tank 15 do not constitute an impact on the structural integrity of the tank, as evaluated and confirmed in the referenced report, SRNS-STI-2008-00028, A Structural Impact Assessment of Flaws Detected During Ultrasonic Examination of Tank 15, and calculation, T-CLC-H-00890, Calculation of Critical Crack Lengths in HLW Tank 15. The 2018 inspection program confirmed the structural integrity and waste confinement capability of all 43 waste tanks.
This test report provides the results of radiation tolerance robustness testing that was performed on samples of robotic components and an ultrasonic guided wave air-slot sensor that represent components/sub-systems of the Robotic Air-slot Volumetric Inspection System (RAVIS) that has been engineered for volumetric inspection of Hanford tank bottom plates via under-tank refractory pad air-slots. The specific components tested for 1) functionality during active irradiation and 2) tolerance to cumulative radiation dose (until failure or upon reaching a cumulative dose test limit) were: • four samples each of a printed circuit board (PCB) and direct current (DC) motor, which are robotic components, and • 26 ultrasonic piezoelectric elements (samples) inside an air-slot sensor. The robotic components are part of the RAVIS air-slot inspection crawler drive control system that is responsible for remote communication with and actuation of the air-slot inspection crawler. The failure of either of these components during under-tank deployment would require manual retrieval via the crawler’s tether, which risks damage to the robot/refractory/tank. Preemptive replacement of the components at appropriately conservative dose/time intervals informed by failure dose would reduce the likelihood of under-tank failure. The components were included in radiation tolerance testing to quantify their failure doses to inform replacement intervals. The air-slot sensor is responsible for collecting ultrasonic inspection data (scan images) for the tank bottom plates during under-tank deployment. Compromised signal quality due to elevated noise levels caused by gamma radiation would compromise inspection performance. The air-slot sensor was included in radiation tolerance testing to quantify the impact of active irradiation on sensor signal quality. The irradiation and in-situ functional tests of the PCBs, DC motors and air-slot sensor took place in June and July 2020 at the Pacific Northwest National Laboratory. Testing was performed at a gamma dose rate near 300 rad/hr., which, in the absence of under-tank dose rate data, has been conservatively estimated to be the upper-bound dose rate beneath the primary tanks at Hanford. Irradiation took place at elevated temperatures of 150-200°F to determine failure doses that reflect the compounding effects of gamma radiation and heat. The test results revealed: • The DC motors can tolerate being actively irradiated at the high dose rate at 200°F and can tolerate a cumulative dose of 300,000 rad, that which would be incurred after 5 years of service at the 300 rad/hr dose rate. The component therefore meets minimum and preferred radiation tolerance and lifecycle requirements for robotic components. • The air-slot sensor can tolerate being actively irradiated at the high dose rate at 150°F and can tolerate a cumulative dose of 60,000 rad, that which would be incurred after 1 year of service at the 300 rad/hr dose rate. The sensor therefore meets minimum radiation tolerance and lifecycle requirements. • The PCB can tolerate being actively irradiated at the high dose rate, but can only tolerate a cumulative dose of 19,000 rad at 150-200°F. The PCB does not meet minimum radiation tolerance and lifecycle requirements; however, because the component is considered replaceable, it can be replaced before a cumulative dose of 19,000 rad is reached, determined through either monitoring with a dosimeter or scheduled time intervals that are calculated based on conservative estimates of under-tank dose rates.
In 2012, Congress passed P.L. 112-149, Insular Areas Act of 2011, which amended the Compact of Free Association Amendments Act of 2003 by assigning Cactus Crater containment monitoring and reporting requirements to the Secretary of Energy (Secretary). Effective January 1, 2012, the Secretary was required to “periodically (but not less frequently than every 4 years) conduct -- (I) a visual study of the concrete exterior of the Cactus Crater Containment Structure on Runit Island; and (II) a radiochemical analysis of the groundwater surrounding and in the Cactus Crater Containment Structure on Runit Island.” 48 U.S.C. 1921b(f)(1)(B)(i). The Secretary was also directed to submit to Congress a report describing the results of each visual survey and the radiochemical analysis and “a determination on whether the surveys and analyses indicate any significant change in the health risks to the people of Enewetak from the contaminants within the Cactus Crater Containment Structure.” 48 U.S.C. 1921b(f)(1)(B)(ii)(II).
The Department of Energy (DOE) H-Canyon Facility at the Savannah River Site (SRS) is operated by Savannah River Nuclear Solutions (SRNS). The Facility Structural Integrity Program [1] provides a process to inspect, evaluate, and document the conditions of passive safety related structural systems and components, their degradation mechanisms and their impact on the safety envelope. The Structural Integrity Program performs periodic visual inspections to confirm the systems and components can perform their safety function and recommend corrective actions before the function is compromised. The H-Canyon Exhaust Tunnel is part of the H-Canyon Ventilation System and is periodically inspected under the Structural Integrity Program. The Tunnel performs a Safety Class passive design feature function that is available 100% of the time. The underground reinforced concrete Tunnel directs Canyon process air from the Canyon to the Sand Filter System. The radiological and chemical airborne activity coupled with the physical configuration of the tunnel precludes a manned entry into the tunnel to perform the inspection. Unlike active systems that can be subjected to physical testing to confirm capability, qualification calculations, including modeling, is performed to assess passive design feature capabilities relative to operational, accident and natural phenomena hazards events. Input for these calculations come from knowledge of field conditions, design drawings and conservative assumptions. The knowledge of field conditions comes from concrete and soil testing activities as well as inspection data. The use of cameras on crawlers to obtain inspection data and how that data is used in qualification calculations is the focus of this discussion. Remote Tunnel inspections have been performed using cameras on a stick, referred to as pole cameras, prior to Calendar Year 2003 (CY2003). Since CY2003, six camera equipped crawlers have been used. Crawlers have evolved and improved by incorporating lessons learned from the previous inspections. The latest 2019 crawler successfully traveled the entire length of the tunnel between the Canyon and Sand Filter System and captured images that were previously unseen, thus providing key visual data for the Structural Integrity Program report [2]. The inspection data serves as 1) input to qualification calculations, 2) validates current conditions remain bounded by qualification calculations, and 3) documents a record of change over time. This data is vital for the effective evaluation of the tunnel structure and aids with predicting the life cycle service life safety envelope to protect the public, environment, and facility worker. The goal of the 2019 deployment was to use a more robust vehicle to ensure travel over obstacles, perform the inspection with higher resolution cameras, and have the ability to elevate the cameras to view surfaces previously obscured by abandon-in-place ducts in the tunnel. The inspection information will serve to strengthen the input basis for qualification calculations, versus using excessive conservative calculation assumptions. This 2019 inspection was compared with previous crawler visual evidence to identify change over time to project remaining service life and confirm field conditions remain bounded by qualification calculations. The results of the 2019 Exhaust Tunnel inspection continue to improve and provide a firm basis to make sound engineering judgements regarding tunnel capability and approaches in projecting remaining service life with an aging system and component. (authors)
Hundreds of sorption working pair equilibrium measurements have been reported in the literature, and many experimental results have been fitted to equilibrium equations. However, an open database does not exist for the equilibrium equations. Therefore, this work compiled 438 published equilibrium equations of sorption working pairs into an open-source database called SorpPropLib. SorpPropLib is accessible from six programming environments commonly used in sorption cycle simulation (C++, Excel®, Python®, Matlab®, Modelica® and Lab-VIEW™). Plotting capabilities allow fast cycle visualization in each programming environment. Thereby, the open-source database SorpPropLib aims to enable and encourage easy data sharing to advance sorption research.
Originally, Rocky Flats transuranic (TRU) waste was managed from waste streams that were composed of similar chemical constituents and were generated from identical processes. Early waste processing at Idaho National Laboratory (INL) maintained the Rocky Flats record until INL began generating their own item description codes (IDCs). Ultimately TRU waste management at INL was driven to combine wastes from all IDCs that were assigned by Rocky Flats to a summary category group regardless of whether the chemical constituents in the waste were known or not. At this point, the Waste Isolation Pilot Plant (WIPP) certified program requirements to process the TRU waste according to waste streams was nearly eliminated. In April 2018, operations in the Sludge Repackage Project (SRP) area were halted by a radiological materials release accident in which drums containing waste experienced a loss of containment after over-pressurization occurred. Four SRP drums, repackaged in the Accelerated Retrieval Project (ARP) V area, had an adverse, delayed chemical reaction event occur when prohibited materials from one container were mixed with chemically-incompatible materials from other containers in the repackaging process. This incident was the direct result of processing unknowns under a protocol where the components of the waste were added to incompatible materials resulting in a run-away reaction. After a Difficult Waste Team (DWT) and Los Alamos National Laboratory – Carlsbad Operations (LANL-CO) subject matter expert (SME) visit in September 2019, it was determined by the team that all of the work observed on the September visit was performed upstream of the certified program and that the Visual Examination (VE) and other methods typically used by the certified program were being used for Acceptable Knowledge (AK) augmentation. This augmentation was needed in order to determine what the constituents in the waste might be, and is based primarily on collections of VE results. The waste at INL that is being processed in what is considered to be the Priority 2 (yellow) and Priority 3 (red) lists either needs AK to be completed before certified characterization can occur or is waiting to be processed because the waste has been mixed with unknown wastes resulting in a lack of information that could have impact of the ability to certify and ship the waste to the WIPP.
The datasets described herein provide the foundation for a decision support prototype (DSP) toolkit aimed at assisting stakeholders in determining evidence of which aspects of river ecosystems have been impacted by hydropower. The DSP toolkit and its application are presented and described in the article “Evidence-based indicator approach to guide preliminary environmental impact assessments of hydropower development” [1]. Development of the DSP and the output for decision support centralize around 42 river function indicators describing the dimensionality of river ecosystems through six main categories: biota and biodiversity, water quality, hydrology, geomorphology, land cover, and river connectivity. Three main tools are represented in the DSP: A science-based questionnaire (SBQ), an environmental envelope model (EEM), and a river function linkage assessment tool (RFLAT). The SBQ is a structured survey-style questionnaire whose objective is to provide evidence of which indicators have been impacted by hydropower. Based on a global literature review, 140 questions were developed from general hypotheses regarding the impacts of dams on rivers. The EEM is a model to predict the likelihood of hydropower impacting indicators based on a several variables. The intended use of the EEM is for situations of new hydropower development where results of the SBQ are incomplete or highly uncertain. The EEM was developed through the compilation of a dataset containing attributes of dams, reservoirs, and geospatial information on environmental concerns, which was combined with data on ecological indicators documented at those sites through literature review. The model operates through 247 “envelopes” and weighting factors, representing the individual effect of each variable on each indicator, all available through spreadsheets. Finally, the RFLAT is a tool to examine causal relationships amongst indicators. Inter-indicator relationships were hypothesized based on literature review and summarized into node and edge datasets to represent the structure of a graphical network. Bayes theorem was used estimate conditional probabilities of inter-indicator relationships based on the output of the SBQ. Nodes and edges were imported into R programming environment to visualize ecological indicator networks. The datasets can be expanded upon and enriched with more detailed questions for the SBQ, building upon the EEM with to develop more sophisticated models, and identifying new relationships for the RFALT. Additionally, once the tools are applied to numerous hydropower developments, the output of the tools (e.g. evidence of impacted indicators) becomes a very useful dataset for meta-analyses of hydropower impacts.