Search NASA⌕ Search

Engineering topics

Karnowski, Thomas

Publications and source records attributed to Karnowski, Thomas.

At least 19 records

The role of driver head pose dynamics and instantaneous driving in safety critical events: Application of computer vision in naturalistic driving

This paper investigates the role of driver behavior especially head pose dynamics in safety–critical events (SCEs). Using a large dataset collected in a naturalistic driving study, this paper analyzes the head pose dynamics and driving behavior in moments leading up to crashes or near-crashes. The study uses advanced computer vision and mixed logit modeling techniques to identify patterns and relationships between drivers’ head pose dynamics and crash involvement. The results suggest that driver-head pose dynamics, especially poses that indicate distraction and movement volatility, are important factors that can contribute to undesirable safety outcomes. Marginal effects show that angular deviation for head pose dynamics indicated by yaw, pitch and roll increase the likelihood of crash intensity by 4.56%, 4.92% and 8.26% respectively. Furthermore, traffic flow and lane changing also contribute to increase in likelihood of crash intensity. These findings provide new insights into pre-crash factors, especially human factors and safety–critical events. The study highlights the importance of considering human factors in designing driver assistance systems and developing safer vehicles. This research contributes by examining naturalistic driving data at the microscopic level with early detection of behaviors that lead to SCEs and provides a basis for future research on automation.

33 ADVANCED PROPULSION SYSTEMS↗

Exploring Object Detection and Image Classification Tasks for Niche Use Case in Naturalistic Driving Studies

Naturalistic driving studies consist of drivers using their personal vehicles and provide valuable real-world data, but privacy issues must be handled very carefully. Drivers sign a consent form when they elect to participate, but passengers do not for a variety of practical reasons. However, their privacy must still be protected. One large study includes a blurred image of the entire cabin which allows reviewers to find passengers in the vehicle; this protects the privacy but still allows a means of answering questions regarding the impact of passengers on driver behavior. A method for automatically counting the passengers would have scientific value for transportation researchers. We investigated different image analysis methods for automatically locating and counting the non-drivers including simple face detection and fine-tuned methods for image classification and a published object detection method. We also compared the image classification using convolutional neural network and vision transformer backbones. Our studies show the image classification method appears to work the best in terms of absolute performance, although we note the closed nature of our dataset and nature of the imagery makes the application somewhat niche and object detection methods also have advantages. We perform some analysis to support our conclusion.

Peruski, Ryan↗

An Evaluation of Three Dimensional Scene Reconstruction Tools for Safeguards Applications

Over the past 5 years, advances in digital imaging and image processing have enabled everyday computing hardware, such as that found on laptops and even phones, to easily create 3D models of scenes from a series of still images. This field is broadly known as photogrammetry. For safeguards applications, a safeguards inspector could evaluate a 3D model of a facility (such as an enrichment plant or the top of a reactor) constructed from multiple photos instead of reviewing each photo individually. This report compares the detailed capabilities of a particular commercial offering (Quidient) that Oak Ridge National Laboratory (ORNL) has investigated in depth with the general capabilities provided in the industry and recommends areas where the general technology could be pursued for potential safeguards applications.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Locating Operational Events of the Cooling Tower of a Nuclear Reactor with a Very Local Seismic Network

Geolocation of emergent seismic signals is challenging at close distances. Here, we used three-component data from a seismic network and a targeted experiment at a research nuclear reactor to locate seismic sources. Utilizing known events collected during the targeted experiment, we were able to infer source locations with seismic amplitudes and polarization characteristics of the data. Although the resolution of the source location is not perfect, the seismic amplitudes and polarization analysis offer useful constraints. For the known events, the source region inferred with our analysis includes the true source locations. Synthetic tests indicate the resolution is largely due to limited data coverage and measurement uncertainties because the synthetic tests show similar results compared with the field data. We identified the source of the unknown event through spectrum cross correlation between the signals from the known events and an unknown event. Our findings were confirmed by operational staff at the facility. When the propagation medium properties (i.e., seismic velocity and quality factor for attenuation) are known, our analysis can be applied to continuous data from a seismic array to infer both source amplitude and location. If the medium properties are not known, a targeted experiment can be conducted to estimate them.

58 GEOSCIENCES↗

Training data selection for event classification in a highly variable environment

A problem of interest for nuclear nonproliferation is monitoring activities at nuclear facilities, where proliferation events may only take place a few times and often under variable conditions. Machine learning has revolutionized data analytics by enabling the use of measurable signatures to generate predictive models of facility operations. However, traditional methods for training these models require large, reliable data sets with labeled observations, a challenge for nonproliferation. Highly variable conditions further complicate this as events from training data may have occurred in conditions quite different from the event of interest. Our hypothesis is that when events occur in a highly variable environment, careful training data selection for each test event could outperform the standard approach of using all available training data. We developed a method to optimize training data selection for the given test event and applied it to predicting the power level of the High Flux Isotope Reactor (HFIR) at Oak Ridge National Laboratory. In this study, the reactor startup exhibits variability between occurrences due to natural variability in environmental conditions and operational procedures. Using a combination of analysis techniques, a similitude assessment was performed on data collected from HFIR to isolate clusters that were optimal for training a predictive model. Concepts such as dynamic time warping and Jaccard similarity were used in conjunction with clustering analysis. In order to validate this approach, the model was trained on every combination of unique training events and the predictive performance was compared to the performance using a subset of the training data selected by isolated clusters found through the similitude assessment.

Iyer, A↗

Leveraging gradient weighted class activation mapping to improve classification effectiveness: Case study in transportation infrastructure characterization

Roadway “corners†are common for pedestrian use, whether designated with markings or not. Different types of markings have been deployed, ranging from simple parallel lines to more complex designs. Understanding the impact of different types of crosswalks is important for public safety. In this work we explore methods to improve the logging of marked crosswalk types. We used the Roadway Information Database from the Second Strategic Highway Research Project and used active learning methods with transfer learning to identify the crosswalk types (marked or unmarked). Upon completion we found our classifiers were unable to perform above roughly 94% correct classifications. To improve their efficacy, we separated the crosswalks into their “fine grained†types and used Gradient-Weighted Class Activation Mapping to isolate and study the features that classified the crosswalks. We compared this with sampled manually marked crosswalks and present findings. We believe this use case can represent a process to improve the active learning method for some visual machine learning applications.

Karnowski, Thomas↗

Variable frequency response testbed to validate protective relays up to 20 kHz☆

Microgrids operate in islanding or utility grid mode. In islanding mode, distributed energy sources with power electronics inverters can generate fault currents over a wide range of frequencies. To gain a better understanding of the nature of these events, it is crucial to measure currents at frequencies of up to 20 kHz at transient states with protective relays. Protective relays at these frequency responses should be tested prior to being installed in microgrids. However, testing at high-frequency currents cannot be done with Relay Test Equipment (RTE) that generate signals up to 50th Harmonic for 60 Hz (3 kHz). In this study, a frequency response method and testbed for high-frequency currents of up to 20.16 kHz was developed and tested. The testbed utilized a RTE and High-Frequency Power Source/ Amplifier. Furthermore, frequency relay experiments were run at frequencies of up to 1 and 20.16 kHz at a current magnitude of 0.1 and 0.5 A, respectively. The events were collected, and the current magnitude and frequency were plotted at time and frequency domain, respectively. The study of current magnitude and frequencies of up to 20.16 kHz for two overcurrent relays was performed and validated the variable frequency testbed and methodology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Investigating the relation between instantaneous driving decisions and safety critical events in naturalistic driving environment

The availability of large-scale naturalistic driving data provides enormous opportunities for studying relationships between instantaneous driving decisions prior to involvement in safety critical events (SCEs). This study investigates the role of driving instability prior to involvement in SCEs. While past research has studied crash types and their contributing factors, the role of pre-crash behavior in such events has not been explored as extensively. The research demonstrates how measures and analysis of driving volatility can be leading indicators of crashes and contribute to enhancing safety. Highly detailed microscopic data from naturalistic driving are used to provide the analytic framework to rigorously analyze the behavioral dimensions and driving instability that can lead to different types of SCEs such as roadway departures, rear end collisions, and sideswipes. Modeling results reveal a positive association between volatility and involvement in SCEs. Specifically, increases in both lateral and longitudinal volatilities represented by Bollinger bands and vehicular jerk lead to higher likelihoods of involvement in SCEs. Further, driver behavior related factors such as aggressive driving and lane changing also increases the likelihood of involvement in SCEs. Driver distraction, as represented by the duration of secondary tasks, also increases the risk of SCEs. Likewise, traffic flow parameters play a critical role in safety risk. The risk of involvement in SCEs decreases under free flow traffic conditions and increases under unstable traffic flow. Further, the model shows prediction accuracy of 88.1 % and 85.7 % for training and validation data. These results have implications for proactive safety and providing in-vehicle warnings and alerts to prevent the occurrence of such SCEs.

99 GENERAL AND MISCELLANEOUS↗

A Publicly Available, Annotated Dataset for Naturalistic Driving Study and Computer Vision Algorithm Development

Oak Ridge National Laboratory developed and implemented a data collection effort to create a dataset for use in evaluating and testing algorithms for analyzing driver behavior under controlled settings for support of the Federal Highway Administration’s Exploratory Advanced Research Program. This collection is called the ORNL Naturalistic Driving Study Sample (ONDSS). The dataset is designed to emulate aspects of the Second Strategic Highway Research Project (SHRP2), which contained a massive naturalistic driving study (NDS) with over 3000 drivers between 2010 and 2013 using their personal vehicles, with over 4300 person-years of data collected [HANKEY].

42 ENGINEERING↗

Methods and Comparisons Between Computer Vision and Radar Based Vehicle Location

Measuring vehicle locations relative to a driver's vehicle is a critical component in the analysis of driving data from both postanalysis (such as in naturalistic driving studies) or in autonomous vehicle navigation. In this work we describe a method to estimate vehicle positions from a forward-looking video camera using intrinsic camera calibration, estimates of extrinsic parameters, and a convolutional neural network trained to detect and locate vehicles in video data. We compare the measurements we achieve with this method with ground truth and with radar data available from a naturalistic driving study. We identify regions where video is preferred, where radar is preferred, and explore trade-offs between the two methods in regions where the preference is more ambiguous. We describe applications of these measurements for transportation analysis.

Aykac, Deniz↗

An Integrated Platform for Collaborative Data Analytics

While collaboration among data scientists is a key to organizational productivity, data analysts face significant barriers to achieving this end, including data sharing, accessing and configuring the required computational environment, and a unified method of sharing knowledge. Each of these barriers to collaboration is related to the fundamental question of knowledge management “how can organizations use knowledge more effectively?”. In this paper, we consider the problem of knowledge management in collaborative data analytics and present ShareAL, an integrated knowledge management platform, as a solution to that problem. The ShareAL platform consists of three core components: a full stack web application, a dashboard for analyzing streaming data and a High Performance Computing (HPC) cluster for performing real time analysis. Prior research has not applied knowledge management to collaborative analytics or developed a platform with the same capabilities as ShareAL. ShareAL overcomes the barriers data scientists face to collaboration by providing intuitive sharing of data and analytics via the web application, a shared computing environment via the HPC cluster and knowledge sharing and collaboration via a real time messaging application.

Oesch, T↗

Using Low-Cost “Garage Band” Recording Technology for Acquiring High Resolution High-Speed Data

The Oak Ridge National Laboratory (ORNL) has developed and tested a novel system architecture for acquiring high fidelity high-speed data. The approach uses a consumer grade audio recording device that is normally associated with “garage band” recording of music. ORNL has coupled this low-cost data acquisition hardware with computing technology running open-source software. The main advantage of this approach is per-channel cost; an instrument grade data acquisition system typically costs between $800 to $2000 per channel compared to less than $50 per channel for these consumer grade components. Three systems, each featuring four channels, have been deployed for acquiring data from geophones and the electrical supply system that supports the High Flux Isotope Reactor (HFIR) and the Radiochemical Engineering Development Center (REDC) at ORNL. Each channel samples at 96 kHz at 24-bit resolution. The deployed systems operate continuously 24/7 and produce about 4 terabytes of data per month per system. This paper provides a technical overview of this approach, its implementation, and some preliminary results from qualification testing. This work was conducted in support of the Multi-Informatics for Nuclear Operations Scenarios (MINOS).Keywords: Data acquisition Measurement Informatics

Wetherington Jr, G↗

Reactor Power Level Estimation by Fusing Multi-Modal Sensor Measurements

Estimates of the power level of a nuclear reactor based on measurements from an independent monitoring sensor system can help in the compliance verification of its declared operations. We present a three-level fusion method to estimate the power level of a nuclear reactor using features derived from infrared, electromagnetic, and acoustic sensor measurements collected in proximity to the reactor. Based on a simplified analytical model of the secondary coolant system of the reactor, we identify partial regression functions of the power level in terms of the temperature difference between inlet and outlet of coolant pipes, and the activity levels of four fans and four pumps, which are estimated as features from the sensor measurements. The power level estimator employs a combination of aggregate and complementary fusion steps at three levels to incorporate the multi-modal features in a structure that reflects the secondary cooling system and its partial regression functions. Using the measurements from a test campaign at an operational reactor, we show that this estimator achieves 3.47% or lower root mean square error under 5-fold cross validation. More generally, these results illustrate a progressive reduction in estimation error as additional modalities are appropriately incorporated, and that the fuser outperforms single modality features and their sub-combinations.

Rao, Nageswara↗

Oak Ridge National Laboratory Current Magnitude and Frequency Response of SIPROTEC Relays

This project examined the current magnitude and frequency response of 7SJ61 and 7SJ62 SIPROTEC relays. The measured sample frequencies for the 7SJ61 and 7SJS62 relays were 800 and 960 Hz, respectively. The relays were tested at frequencies of up to 1 and 20.16 kHz. Two experiments were run in a lab environment. The first experiment was run at frequencies of up to 1 kHz every 10 Hz. The second one was run at frequencies of up to 20.16 kHz every 200 and 240 Hz (common factors of sample rate frequency) for the 7SJ61 and 7SJ62 SIPROTEC relays, respectively. Both experiments were set at a current magnitude of 0.1 and 0.5 Arms. A testbed with a Relay Test Equipment (RTE) was set to run the experiment at frequencies of up to 1 kHz, while a testbed with a RTE and High Frequency Power Source/ Amplifier (HFPS/A) was set to run at frequencies of up to 20.16 kHz. Currents of 0.1 and 0.5 Arms at different frequencies were connected at Phase A of the relays, and a current of 1 Arms (60 Hz) was connected at Phase B of relays. The 1 Arms current allowed the relays to trip and saved their record events by setting both relays at a definite-time overcurrent protection function. The record events were collected after the 7SJ61 and 7SJ62 relays tripped, and the current magnitude and frequency were plotted. The record events from the relays were collected using the DIGSI® 4 software. The SYNCHROWAVE® Event and MATLAB® software were then used to plot the current magnitude and frequency, respectively, from the relay record events. The current magnitude and frequency were plotted at time and frequency domain, respectively.The 7SJ61 and 7SJ62 relays measured source frequencies of up to 400 and 480 Hz, respectively. The percentage error of frequency for the relays increased after 400 and 480 Hz, respectively. The 7SJ62 relay with 0.1 and 0.5 Arms measured the alias frequency up to 1440 Hz. The 7SJ61 relay with 0.1 and 0.5 Arms measured the alias frequency up to 1000 and 1200 Hz, respectively. At frequencies higher than the alias frequency, the relays measured a DC amplitude current instead of an AC amplitude current. In the DC amplitude current zone, non-desired frequencies were measured by both relays. The current magnitude intensity (dB) for the 7SJ61 and 7SJ62 relays from 1 to 20.16 kHz were plotted. The current magnitude intensity for the 7SJ61 relay decreased up to 2600 and 1200 Hz for 0.5 and 0.1 Arms tests, respectively. However, the current magnitude intensity for the 7SJ62 relay decreased up to 4800 and 2640 Hz for 0.5 and 0.1 Arms tests, respectively. The current magnitude and frequency response study for the 7SJ61 and 7SJ62 relays was performed satisfactorily, observing the source, alias, and non-desired measured frequency zones for both relays.

24 POWER TRANSMISSION AND DISTRIBUTION↗