Search NASA⌕ Search

SEARCH · Search NASA

Results for “video systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

178 records · Page 10

Bench Testing Data and Report for an Early Prototype Pitch Resonator WEC

This dataset encompasses data and documentation from bench tests conducted on an early prototype of a "pitch resonator" wave energy converter (WEC). The testing aimed to validate numerical models and reduce risks associated with the pitch resonator concept, which is designed to convert the pitching and rolling motions of a buoy into electrical power. The project's goal is to provide supplementary power, in the range of 10-100 watts, to the National Science Foundation's Ocean Observatories Initiative Pioneer Array. Two distinct testing phases are documented: one using a single degree of freedom (1DOF) test rig, and another employing a six degree of freedom (6DOF) Stewart platform, known as the Large Amplitude Motion Platform (LAMP). These tests assessed various factors, such as system performance in different motion scenarios, the torque exerted by wave forces, and the impact of mounting configurations. The dataset includes raw test data in MATLAB (.mat) format, detailed metadata, and a report describing the experimental procedures and preliminary findings.

16 TIDAL AND WAVE POWER↗

Vehicular Re-Identification from Uncontrolled Multiple Views

Vehicle re-identification (re-ID) across disparate sensing modalities remains a fundamental challenge for transportation research. In this work, we introduce a deep multi-view vehicle re-ID framework that leverages Siamese networks to compare pairs of vehicle images and produce matching scores, enabling robust association across drastically different viewpoints such as those from UAVs, surveillance cameras, and ground sensors. The model exploits convolutional neural networks to learn features that remain discriminative under changes in angle, distance, and illumination, supporting more generalizable re-ID performance. As part of this effort, we also developed an automated pipeline to synchronize roadside and UAV video streams, producing a multi-perspective dataset that complements preexisting real collections and a synthetic dataset generated in this study. Together, these contributions advance the capability to re-identify vehicles across wide viewing baselines; establish a foundation for scalable, reproducible research in vehicle re-ID; and open pathways for future applications, such as inferring routine behaviors, movement patterns, and daily habits of the individual associated with the vehicle.

convolutional neural networks↗

Diagnostics: Chapter 8 of the special issue: on the path to tokamak burning plasma operation

This chapter presents the activity conducted by the ITPA topical group (TG) on Diagnostics over about the last 15 years. Following a general introduction of the ITER Diagnostics led by their measurement roles, the document is organized in several subchapters detailing the design support, research and development activity conducted by each of the specialist working groups (WGs) of the TG. Please note that the magnetic diagnostics were supported at the TG without a specific WG. Their status is included in the general introduction. In the following some highlights of the subchapter’s contents are provided. Recent advances in ITER first wall (FW) diagnostics for the measurements of plasma-metallic wall interaction in support of the ITER research plan are reported. An InfraRed imaging Video Bolometer for ITER has been developed and tested on several tokamaks to measure the radiated power loss. A laser-induced breakdown spectroscopy (LIBS) technique which utilizes a pulsed laser beam to ablate locally by forming a crater, will measure local tritium inventory in the FW material. Real-time Residual Gas Analyzers will measure the neutral gas composition in a divertor port and an equatorial port during plasma operation. Due to the full metallic FW environment, the plasma-wall interaction in ITER will face several challenges such as the compromised radiated power and divertor heat flux measurements by reflection. Ray tracing and analysis codes have been developed to eliminate and correct the effects of reflection in the measurements. The characteristics of the reflecting surfaces depending on the roughness and angle of the incidence have been measured by dedicated experiments, and the results were applied to the reflection elimination. For the measurement of the metallic impurity radiation induced by eroded metallic atoms, a vacuum ultraviolet spectrometer has been developed and tested. An extensive thermonuclear diagnostic suite will be required to support the operation of ITER and the planned experimental program for future burning plasma experiments. Due to the harsh environmental conditions, the implementation of diagnostic systems in ITER is a major challenge. These conditions include high levels of neutron and gamma fluxes, neutron heating, particle bombardment. Therefore, the selection and design of diagnostic systems must take into account a number of phenomena previously unseen in diagnostic design. For this reason, the measurement of neutrons and confined or lost fast ions, with particular emphasis on alpha particles, is critical to ITER. The diagnostics associated with these measurements will be important for future plasma-burning experiments at ITER. The high neutron emission and very large plasma size in ITER make neutron diagnostics the main diagnostic method used to measure plasma parameters such as fusion power, fusion power density, ion temperature, energy of fast ions and their spatial distributions in the plasma core. Active spectroscopy techniques are methods where a neutral particle beam is injected into the plasma and information on plasma parameters is extracted from the measurement of line emission resulting from the beam-plasma interaction, either by plasma ions or by beam atoms. Spatial localization is achieved by crossing the beamline and multiple observation lines. The ITER plasma will be a high temperature, moderately dense, fully ionized collisional plasma. The plasma facing surfaces are principally metallic being fashioned from beryllium or tungsten but many other elements, arising from either structural or from operational needs, may enter this plasma. The energy range of the emitted photons range from meV (infra-red) to multi keV (x-rays) and originate from all areas of the plasma volume. The primary role of passive emission diagnostics is to identify what is in the plasma from spectral signatures. Extracting quantitative information from these measurements such as impurity content, ion temperature, rotation, degree of detachment and radiated power depends on calibrated instruments, a physics model of the atomic and molecular processes and plasma transport and an analysis workflow that takes into account environmental effects such as reflections. The particular needs for ITER have prompted a multi-machine, many-year effort to address all these aspects and this chapter reviews the work on diagnostic design, experiments and new analysis techniques. An overview of the laser diagnostics to be implemented on ITER is also provided in this paper. This includes descriptions of the Thomson scattering in the core, edge and divertor regions, polarimetry and interferometry diagnostics used for measuring plasma density and also measurements of helium density in the divertor using Laser Induced Flourescence. Techniques which can allow improvements on current measurements are also addressed in particular expanding poloidal polarimetry measurements to measure field fluctuations and proposed use of dispersion interferometery which has a number of advantages over existing methods. This paper identifies particular areas where further research and testing on existing tokamaks is useful even at this advanced stage to inform the design of diagnostics for ITER. Outstanding areas of concern for the implementation of laser diagnostics, in particular with a view to reliable operation are identified. An overview of the latest developments of microwave diagnostic systems and techniques is given. The primary focus is the contributions for ITER—the next step burning plasma experiment—which is supplemented by describing recent progress of techniques applicable for fusion experiments beyond ITER. The contributions are intentionally kept concise, and are being supplemented by a rich list of references for further studies. Radiation induced effects are receiving continuous and well-deserved attention of the ITER diagnostic community and they are in many cases one of the primary design drivers of the ITER diagnostic systems. The paper summarizes recent progress in this area focusing primarily on the ITER diagnostics but in some cases provides also outlook for the possible solutions for even more demanding radiation environment of fusion reactors beyond ITER. Despite advancements in the area of modeling and simulation of various radiation induced effects, experimental testing in a nuclear environment as close as possible to the target one is still seen as unavoidable for proper qualification of particular diagnostic functional elements. Recent advancement within three diagnostic areas: optical diagnostics, magnetics and bolometers is covered. Encouraging results on qualification of silica glass vacuum window assemblies are presented. In the area of magnetic sensors, progress of irradiation tests performed on ITER in-vessel LTCC inductive sensors is presented with outlook for novel technological approaches to inductive sensors utilizing thick printing and photolithography technologies being highlighted. Summary of advancements in the area of steady state magnetic field sensors based on Hall effect is given. New results of neutron irradiation test of the ITER borosilicate glass inserts for vacuum electrical feedthroughs are summarized finding negligible swelling at target level of neutron fluence. Off-line irradiation tests of fiber optic current sensors for plasma current measurement demonstrated that both for gamma doses up to 5 MGy and a total neutron fluence up to 10 15 cm −2 , radiation induced changes are still compatible with required measurement accuracy on ITER. The ITER bolometers are given as an example how considering radiation effects may influence the diagnostic design. Finally, outlook for future main R&D directions is outlined. All optical and laser-based diagnostics in ITER will be using mirrors to guide plasma radiation toward detectors, cameras and sensors. In the hostile plasma, radiation and particle environment the optical characteristics of diagnostic mirrors will degrade directly affecting the entire performance of involved diagnostic systems. An assessment of factors affecting mirror performance is provided. Among the prime adverse factors are deposition of plasma impurities, sputtering of mirror surface and steam ingress in the vicinity of mirrors. Within the International Tokamak Physics Activity with active support by ITER central team and domestic agencies, the structured research and development (R&D) program on mitigation of risks for diagnostic mirrors is underway. Within this program the mirror material development, the passive mitigation of mirror degradation by using diagnostic ducts and shutters along with an active mirror recovery program comprising the in-situ mirror cleaning and calibration is underway. Recent developments in diagnostic mirror R&D are described in this Chapter along with an example of their implementation of R&D solutions in ITER Infrared Thermography diagnostic. An assessment of still open engineering and physics questions, considerations on mirror risks during an early phase of ITER operation are given along with an overview of diagnostic mirror evolution in the late ITER operation stage toward the demonstration fusion power plant. Several crucial areas of diagnostic R&D outlined in ITER Research Plan are addressed. The basic control groups in a fusion reactor can be broken-down in five categories: (1) plasma position, magnetic configuration, and plasma current control, (2) profile control and confinement optimization, (3) MHD control and suppression, (4) edge dissipation control, radiation and plasma exhaust control and (5) break-down optimization. These categories are coupled via the physics (a control action in one domain will affect the other domains) and via shared actuators (e.g. ECRH for impurity accumulation avoidance, current density distribution control and MHD suppression). Consequently, a supervisory control system should determine the priority of the various control tasks, their couplings, and the interfaces with the safety and interlock system. For the systematic development of the various controllers taking the complexity of the plasma and the control system into account, a model-based approach is required. A short historical overview is given of the developments in systems and control theory and control engineering with special emphasis on those developments that are most relevant for Nuclear Fusion research and operation. An overview is given of the state of the field of fusion plasma control for the control categories. It will be shown how synthetic diagnostics are being developed in ITER and how they are used in diagnostic design and design validation and how they can be in model-based controller synthesis using relatively simple models. In modern control methods, multiple diagnostics are used to constrain relatively simple models. The constrained models provide an estimate for the state. This opens the route to state controllers, such as model predictive control. A major challenge in nuclear fusion research is the coherent combination of data from heterogeneous diagnostics and modeling codes for machine control and safety as well as physics studies. Measured data from different diagnostics often provide information about the same subset of physical parameters. Additionally, information provided by some diagnostics might be needed for the analysis of other diagnostics. A joint analysis of complementary and redundant data allows, e.g. to improve the reliability of parameter estimation, to increase the spatial and temporal resolution of profiles, to obtain synergistic effects, to consider diagnostics interdependencies and to find and resolve data inconsistencies. Physics-based modeling and parameter relationships provide additional information improving the treatment of ill-posed inversion problems. A coherent combination of all kind of available information within a probabilistic framework allows for improved data analysis results. The concept of integrated data analysis (IDA) in the framework of Bayesian probability theory is outlined and contrasted with conventional data analysis. Components of the probabilistic approach are summarized and specific ingredients beneficial for data analysis at fusion devices are discussed.

ITER↗

Non-invasive (non-contact) measurements of human thermal physiology signals and thermal comfort/discomfort poses -A review

Heating, ventilation and air-conditioning (HVAC) systems have been adopted to create comfortable, healthy and safe indoor environments. In the control loop, the technical feature of the human demand-oriented supply can help operate HVAC effectively. Among many technical options, real time monitoring based on feedback signals from end users has been frequently reported as a critical technology to confirm optimizing building performance. Recent studies have incorporated human thermal physiology signals and thermal comfort/discomfort status as real-time feedback signals. A series of human subject experiments used to be conducted by primarily adopting subjective questionnaire surveys in a lab-setting study, which is limited in the application for reality. With the help of advanced technologies, physiological signals have been detected, measured and processed by using multiple technical formats, such as wearable sensors. Nevertheless, they mostly require physical contacts with the skin surface in spite of the small physical dimension and compatibility with other wearable accessories, such as goggles, and intelligent bracelets. Most recently, a low cost small infrared camera has been adopted for monitoring human facial images, which could detect the facial skin temperature and blood perfusion in a contactless way. Also, according to latest pilot studies, a conventional digital camera can generate infrared images with the help of new methods, such as the Euler video magnification technology. Human thermal comfort/discomfort poses can also be detected by video methods without contacting human bodies and be analyzed by the skeleton keypoints model. Here, new sensing technologies were summarized, their cons and pros were discussed, and extended applications for the demand-oriented ventilation were also reviewed as potential development and applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Open-Source Data for MAC-POSTS: Mobility Data Analytics Center - Prediction, Optimization, and Simulation Toolkit for Transportation Systems

MAC-POSTS (Mobility Data Analytics Center - Prediction, Optimization, and Simulation toolkit for Transportation Systems) is a toolkit for dynamic transportation network modeling. Developed by the Mobility Data Analytics Center (MAC) at Carnegie Mellon University, this package implements many classic dynamic transportation network models, as well as new models proposed by MAC members. It has served as one building block for many other models and research projects. As such, this package used to be treated as an internal research project of the MAC lab, and admittedly, the code base is messy, and the interface is hard to use. However, we are working hard to make it a generally usable and useful toolkit for dynamic transportation network modeling. We would really appreciate any feedback, comments, suggestions, or criticisms.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamic Behavior of Natural Seep Vents: Analysis of Field and Laboratory Observations and Modeling (Final Scientific/Technical Report)

In this project, we have analyzed data collected by the U.S. Department of Energy (DOE), National Energy Technology Laboratory (NETL) in a high pressure water tunnel (HPWT) and data from two research cruises to natural seeps in the Gulf of Mexico to adapt and validate a numerical model to predict the dynamics of natural seeps in the deep oceans. The HPWT data include video observations of the shrinkage rate of individual methane and natural gas bubbles under simulated deep-water conditions. Field data were collected during two cruises by the Gulf Integrated Spill Research (GISR) Consortium led by Texas A&M University and funded by the Gulf of Mexico Research Initiative (GoMRI). These data included in situ observations from a remotely operated vehicle (ROV) of gas bubbles at two natural seep sites in the Gulf and acoustic observations of the natural seep bubble flares in the ocean water column. The acoustic data were from multibeam echosounders, one mounted in a forward-looking orientation on the ROV and another mounted down-looking in the haul of the ship. All of these laboratory and field data were focused on the dynamics of natural gas bubbles at temperatures and pressures favorable for clathrate hydrate formation between the gas and water. Our analyses of this data focused on understanding the mechanisms responsible for gas bubble dissolution within the hydrate stability zone (HSZ) of the oceans. Ice-like hydrate shells may form on the bubble-water interface under these conditions, and it was unknown how this might affect the mass transfer of gas into the ocean. We were able to extract bubble shrinkage rates from the HPWT datasets. Using this data we determined that mass transfer coefficients with and without a hydrate shell match empirical values for bubbles in contaminated systems (so-called dirty bubbles contaminated by naturally occurring surfactants). We also showed that free gas, and not gas hydrate, is the dominant dissolving phase when the hydrate sub-cooling is below 11 degree Celsius (temperature difference between hydrate the hydrate formation temperature and ambient temperator) or the pressure is reducing as bubbles rise through the ocean water column. Using this mass transfer model, our numerical model of bubble dissolution matched the over 200 HPWT experiments with an average error of 10% for predicting the bubble size at the end of an experiment. From field data in the literature, we also observed that gas bubbles dissolve faster when they are initially released, following mass transfer coefficients for so-called clean-bubbles (those not yet contaminated by surfactants). Shortly after release within the HSZ, a hydrate shell forms on the bubble-water interface, and the mass transfer reduces to rates matching those of dirty bubbles. We correlated this transition time from clean to dirty bubble behavior with the initial bubble surface area and the hydrate sub-cooling. With this model for hydrate formation time and using the mass transfer coefficients deduced from the HPWT data, we validated our numerical model for predicting the rise heights of natural seep flares in the oceans. Flare heights are commonly observed in haul-mounted acoustic multibeam data. The numerical model predicts bubbles to rise high in the ocean water column owing to the slower mass transfer rates for dirty bubbles that accompany the majority of their rise time. We found that the numerical model predictions matched the observed flare heights within 5% to 10% accuracy when we compared the rise heights of the largest bubbles released from the seafloor with the bubbles acoustically visible in the multibeam data. Bubbles become acoustically transparent as they shrink to sizes of order 1 mm in diameter for the multibeam frequencies used in the field. The forward-looking multibeam on the ROV also provided data on the lateral spreading of bubbles in natural seep flares. Our analysis of this data showed that spreading follows a diffusion process, with the effective diffusivity correlating with the wobbling length scale of these ellipsoidal bubbles. When we apply this diffusivity in a random displacement model of bubble spreading, our numerical simulations match closely the lateral spread observed by the M3 in the ocean water column. Finally, we compared the seep model predictions for the acoustic properties of these natural seep plumes with that observed by the acoustic instruments in the field. The M3 and EM 302 observations were converted to relative values of target strength using a calibration we obtained in the laboratory for the M3 and using an algorithm from the manufacturer for the EM 302. Comparing the numerical seep model to these data, we obtain good agreement over the whole height of rise of these bubble flares. This further validates the numerical model. Overall, our validated seep model captures the key dynamics of gas bubbles released from natural seeps in the oceans and helps to predict the fate of methane in the water column.

03 NATURAL GAS↗

Analysis of the Shattered Pellet Injection Fragment Plumes Generated by Machine Specific Shatter Tube Designs

Shattered pellet injector systems have been installed on DIII-D, JET, and KSTAR and used to experimentally determine the effectiveness of the shattered pellet injection (SPI) process in mitigating the deleterious effects of a tokamak plasma disruption. Pellets are fired, and before entering the plasma, strike a bent tube known as a shatter tube causing the pellet to shatter. The process of pellet fragmentation is a chaotic process that can be described in terms of fragment size distribution through a statistical model that incorporates the effects of the pellet material and impact characteristics. In addition to the fragment size distribution, the shatter plume has other characteristics of interest, such as a fragment velocity distribution and temporal mass evolution. The fragment velocity distribution is important because it is needed to accurately model the spread and location of the ablation and the deposition of impurities in the plasma over time. The temporal mass evolution is necessary to determine the time-resolved delivery of mass to the plasma.Due to installation constraints, the shatter tube currently installed on JET has a unique geometry with a modest S-bend followed by a 20-deg bend at the end of the tube. The DIII-D and KSTAR shatter tube design is a simple tube bent through an angle of 20 deg followed by a straight section. The resulting shatter sprays from the JET shatter tube and a 20-deg miter bend shatter tube were experimentally characterized for various pellet materials and speeds. Laboratory testing of these shatter tubes allows for the use of fast cameras to capture the fragment spray traveling through a large vacuum chamber. These high-speed videos of the shatter plumes allow the fragment size distribution, temporal mass evolution, and velocity distribution of the fragments within the plume to be determined. Overall, this paper presents a comparison of the unique geometry of the JET shatter tube to the miter bend geometries used for shattering and some insight into the variables that may be adjusted to produce the optimal shatter spray. The impact of entrained propellant gas on the resulting shatter spray was examined during testing.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Affinity propagation clustering of full-field, high-spatial-dimensional measurements for robust output-only modal identification: A proof-of-concept study

Determination of the model order is a challenging problem in system identification, especially in output-only or operational modal identification where some modes are weakly excited. While existing methods such as the stabilization diagram method (spectral information) are effective, they do not scale to high-dimensional data, which is usually needed for high-fidelity characterization of structural dynamics and has been made available in the emerging full-field measurement techniques using optical methods such as photogrammetry and laser vibrometers. In this proof-of-concept study we present a new non-parametric, data-driven approach for robust output-only identification of high-spatial-dimensional modal parameters of basic structures by efficiently processing and interactively exploiting the full-field measurement (i.e., very dense spatial measurement points). Specifically, we first over-estimate the system model once, producing a pool of candidate modes associated with their modal frequencies and full-field, high-spatial-dimensional mode shapes. This is accomplished by a data-driven method termed affinity propagation clustering (APC), where the active clusters, which are the active modes in our formulations, emerge from the "message-passing" procedure and does not require a pre-determination of the cluster number (mode or model order). Next, rather than using the spectral information to distinguish the physical and spurious modes in the stabilization diagram method, we exploit and visualize the spatial, full-field mode shape associated with each candidate mode to do so. We conduct extensive experiments on basic structural models with comparisons to a few existing methods. The results indicate that the new method is computationally efficient for identifying high-spatial-dimensional modal parameters, and robust to identify weak modes by exploiting the full-field measurement. We also discuss its applicability and limitations for structures with complex geometry (shapes).

42 ENGINEERING↗

Using dorsal surface for individual identification of dairy calves through 3D deep learning algorithms

Advances in machine learning techniques have allowed the development of computer vision systems (CVS) that can accurately predict several phenotypes of interest for livestock operations. In this context, 3D images taken from a top-down view are particularly useful for estimating body condition score, growth development, and body biometrics in cattle. Frequently, such CVS rely on identification (ID) systems, such as electronic tags, as a way to match animal ID and the predicted phenotype. However, the same 3D images used to predict body weight and other animal biometrics could be adopted for animal recognition as well. Such alternative would optimize CVS to recognize animal ID and monitor growth development simultaneously while leveraging the same hardware infrastructure. Furthermore, this strategy could be used to recognize animals with similar color patterns. Nonetheless, growing animals are continuously changing body shape, which could limit its use as an invariant feature for pattern recognition. Thus, the objectives of this study were: (1) to compare algorithms for different 3D object representations to identify individual animals; and (2) to evaluate how short-term changes in body shape due to animal growth affect the predictive performance of these algorithms. For objective 1, the algorithms were trained (n = 4,558) and tested (n = 1,139) using images from 38 Holstein calves. For objective 2, we designed three different experiments using images (n = 2,347) from five Holstein calves taken over six weeks during their growing period, always training and testing on different weeks. Each experiment evaluated how changing a different parameter of the image capturing procedure affected the predictive ability of the trained algorithms. In the first experiment, we varied the total number of images per animal in the training set; in the second experiment, we varied the number of weeks while keeping a fixed number of images in the training set; and in the third experiment, we skipped weeks between images in the training and test sets. The F 1 score for objective (1) was up to 0.804 when testing with the last frames of each video, and up to 0.959 when using random frames for testing. For objective (2), the F 1 score was up to 0.947 for the first experiment when using 130 images per animal; up to 0.979 for the second experiment when using all five weeks; and up to 0.917 when not skipping weeks between training and testing. In conclusion, these results show that deep learning algorithms can be used to identify individual animals through their dorsal area 3D surfaces, and, from our experiments using calves in their growing period, that they are robust enough to account for changes in body shape and size, making them a promising tool for animal recognition during growth.

3D neural networks↗

Status Update on TRAC: A DOE-EM Tool for Tracking Groundwater Cleanup and Progress Toward Site Closure - 20245

The U.S. Department of Energy (DOE) Office of Environmental Management (EM) uses a customized, web-based mapping tool called TRAC (Tracking Restoration and Closure) to communicate information on plume sizes, remedial approaches, regulatory drivers, exit strategies, and long-term stewardship requirements at all sites within the DOE-EM complex. The web-based GIS story maps provide robust geospatial visualization of plumes at DOE sites using an intuitive interface that allows users to explore the plume maps, explanatory text, photographs, and video. This collection of story maps not only communicates information for each individual site, but also summarizes pertinent metrics on cleanup and remaining contaminants across all EM sites. This paper describes a new design within TRAC for communicating metrics on plume status, regulatory cleanup progress, and technology implementation. A principal benefit of TRAC is the ability to view individual pieces of data at a time, permitting targeted questions to be addressed, such as the status of regulatory decisions, site cleanup priorities, and site closure needs for each site within the DOE-EM complex. TRAC manages communication and supports decision-making through knowledge access, data and information transparency and traceability, and inclusive participation. It serves as a common resource that provides consistent information for DOE managers, site personnel, regulators and stakeholders. Because long-term stewardship of legacy waste sites requires ongoing coordination and communication among DOE, regulators, and stakeholders, TRAC can also be used to help transition EM sites to the Office of Legacy Management at site closure. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Intelligent Process Visualization through Nuclear Operation Process Modeling, Reasoning, and Object Detection from Field Videos (Final Report)

This report is a deliverable for the “Final Report” task of DOE NEET Project 19-16790, "Context-Aware Safety Information Display for Nuclear Field Workers." This project's overall goal is to test the hypothesis that integrating computer vision and process reasoning methods will enable proactive visualization of the safe operation and maintenance processes of Nuclear Power Plants (NPP) for field workers. Augmented Reality (AR) glasses adopting such proactive safety information visualization techniques can significantly increase personnel safety and reduce the NPP’s operating costs. The current practice of monitoring NPPs requires workers to switch between digital models, data, and physical workspaces in identifying relevant but potentially occluded objects and in assessing the risks of operation and maintenance processes. On the other hand, frequently changed field conditions require field workers to report to supervisors for real-time guidance. Such guidance is essential to ensure that changing conditions will not invalidate or endanger the work order and other ongoing processes that may jeopardize NPP operations. Additionally, incorrect recognition of equipment objects can result in communication errors and safety problems. AR techniques can assist engineers in viewing the physical workspaces with objects labeled with detailed operation procedures and safety reminders during field operations. The project team developed an “Intelligent Context-Aware Safety Information Display” (ICAD) for supporting Nuclear Power Plant (NPP) field workers in achieving safe and efficient execution of a series of operational tasks in uncertain and changing workspaces of an NPP. Before designing the ICAD-AR prototype, the project team synthesized NPP operational knowledge models through literature review studies, surveys, interviews with domain experts, and knowledge modeling. The project team conducted an extensive study of the operational procedures of various NPPs, and digital technologies that can support the safe and efficient execution of those procedures in different NPP operational contexts. This literature review helped the project team conduct surveys and interviews with nuclear engineers and field workers to identify three categories of information. The NPP knowledge modeling efforts reveal that the three categories of information identified have different levels of importance in a typical procedure of carrying out a series of tasks to achieve a specific NPP operation goal (e.g., shutdown, mode changes). These three categories of information include 1) Workspace dynamics – the changing spatial arrangements of workspaces, tools, protection equipment, and supporting materials, 2) Workflow prognostics – the dynamic dependencies between different parts of an NPP that functionally support and influence each other in terms of safety and efficiency, and 3) Hazards – objects and spaces that contain hazardous materials or physical conditions that can pose risks to workers or mechanical systems. The project team has profiled the importance levels of these categories of information into a knowledge model. This knowledge model specifies what types of information are more critical for a given task in a given workspace so that computers can automatically identify critical objects and sensors in a scene for delivering context-ware safety information to field workers through AR devices. Significant research development of this project results in technical research outcomes and a prototyping system that illustrates the technical feasibility of establishing an ICAD-AR system supporting the proactive safety information display for nuclear field workers. This final report summarizes the project team’s technological achievements in the past three years. Overall, the project team completed the development and integration of five techniques into a prototype ICAD Augmented Reality (ICAD-AR) system and demonstrated the developed system’s real-time execution in a mechanical room. The project team completed the analysis of using this prototype in other types of workspaces based on 3D image data and digital design models collected from two additional workspaces (a water treatment plant and a flow loop training facility). The integrated techniques include 1) Natural Language Processing (NLP) algorithms supporting the generation and updates of nuclear fieldwork process models based on text analysis of work packages and operation manuals; 2) sensor log analysis for predicting control actions in given sensor reading contexts; 3) computer vision algorithms for automatic localization and navigation of workers; 4) object detection algorithms for identifying task-related objects and correlated sensors for safety checking; 5) AR technique as a platform for supporting the integration. The testing results of these five techniques have shown that 1) the sensor log analysis model can predict the next control action with an accuracy of 0.883; 2) the trained natural language processing model can extract more than 80% of the critical information from paper-based procedures (PBPs); 3) the navigation algorithm with the integration of Visual Inertial Odometry (VIO) and Non-Recursive Bayesian Filter methods make operator’s trajectory estimation resilient to drift error; 4) the computer vision algorithm can detect task-specific and safety-critical objects with an average accuracy of 95.3%. The project team used work procedures collected from a flow loop training facility and two datasets collected from two mechanical rooms simulating the workspaces of NPPs to demonstrate the technical capabilities of the developed ICAD-AR prototype. The demonstration validated the technical feasibility of establishing the ICAD-AR system for nuclear field workers and identified the challenges in 1) automatic text analysis of work packages; 2) use of limited samples of sensor logs for predicting the proper timings of control actions; 3) reliably tracking workers and their task progress in mechanical rooms with many similar objects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Automated Classification of Vehicle Movements at Signalized Intersections Using Vehicle Trajectories

Accurate vehicle movement classification through signalized intersections is of paramount importance to the analysis of intersection performance and the optimization of traffic control strategies. Conventional techniques for tracking vehicle turning movements depend on infrastructure-based strategies like human counts, loop detectors, and video analytics, all of which are costly, prone to errors, and spatially constrained. High-frequency trajectory data can be utilized to determine vehicle movement patterns in a scalable and infrastructure-independent method due to the adoption of connected vehicles (CVs). In recent years, several studies have utilized connected vehicle data to generate performance measures. Most of the trajectory-based performance measures approaches, however, require map matching-i.e., extracting geospatial references from maps to identify the movements that individual vehicles make at a signalized intersection. These approaches are often time-consuming and hinder scalability since geographic features need to be provided for an analysis to be conducted. Map matching methods are prone to errors as different map versions change these geographic features. This research presents a novel automatic classification pipeline that uses CV trajectory data to classify vehicle movements at signalized crossings, specifically pass-through left-turn and right-turn maneuvers. The process starts by filtering trips that cross a spatial bounding box that has been defined at the target intersection. Approach and departure headings for each trajectory crossing the boundary are computed and are clustered together to identify dominant movements. The proposed algorithm is used to classify the movement of vehicles at 10 intersections in the state of California, and the results indicate that the algorithm can classify movements at these intersections with varying traffic volumes and road network configurations, all in a map-less framework with no need for conflation of vehicle trajectories to a digital base map.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Review of Existing Test Methods for Occupancy Sensors

One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict their performance in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies, have come on the market over the years, with claims of improved performance compared to their predecessors; yet in practice, their performance has led to neither high deployment nor high user satisfaction in any significant application, nor has it differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them have typically been loosely described and incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a well-described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, also additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recent published, well-described test methods for characterizing occupancy sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates the best techniques for characterizing sensor performance in indoor spaces and identifies test method gaps that need to be filled in order to evaluate emerging technologies and products.

47 OTHER INSTRUMENTATION↗