Search NASA⌕ Search

Engineering topics

Aykac, Deniz

Publications and source records attributed to Aykac, Deniz.

At least 19 records

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.

Bolme, David↗

Long-Range Biometric Identification in Real World Scenarios: A Comprehensive Evaluation Framework Based on Missions

The considerable body of data available for evaluating biometric recognition systems in Research and Development (R&D) environments has contributed to the increasingly common problem of target performance mismatch. Biometric algorithms are frequently tested against data that may not reflect the real world applications they target. From a Testing and Evaluation (T&E) standpoint, this domain mismatch causes difficulty assessing when improvements in State-of-the-Art (SOTA) research actually translate to improved applied outcomes. This problem can be addressed with thoughtful preparation of data and experimental methods to reflect specific use-cases and scenarios.To that end, this paper evaluates research solutions for identifying individuals at ranges and altitudes, which could support various application areas such as counterterrorism, protection of critical infrastructure facilities, military force protection, and border security. We address challenges including image quality issues and reliance on face recognition as the sole biometric modality. By fusing face and body features, we propose developing robust biometric systems for effective long-range identification from both the ground and steep pitch angles. Preliminary results show promising progress in whole-body recognition. This paper presents these early findings and discusses potential future directions for advancing long-range biometric identification systems based on mission-driven metrics.

Aykac, Deniz↗

Exploring Object Detection and Image Classification Tasks for Niche Use Case in Naturalistic Driving Studies

Naturalistic driving studies consist of drivers using their personal vehicles and provide valuable real-world data, but privacy issues must be handled very carefully. Drivers sign a consent form when they elect to participate, but passengers do not for a variety of practical reasons. However, their privacy must still be protected. One large study includes a blurred image of the entire cabin which allows reviewers to find passengers in the vehicle; this protects the privacy but still allows a means of answering questions regarding the impact of passengers on driver behavior. A method for automatically counting the passengers would have scientific value for transportation researchers. We investigated different image analysis methods for automatically locating and counting the non-drivers including simple face detection and fine-tuned methods for image classification and a published object detection method. We also compared the image classification using convolutional neural network and vision transformer backbones. Our studies show the image classification method appears to work the best in terms of absolute performance, although we note the closed nature of our dataset and nature of the imagery makes the application somewhat niche and object detection methods also have advantages. We perform some analysis to support our conclusion.

Peruski, Ryan↗

Expanding Accurate Person Recognition to New Altitudes and Ranges: The BRIAR Dataset

Face recognition technology has advanced significantly in recent years due largely to the availability of large and increasingly complex training datasets for use in deep learning models. These datasets, however, typically comprise images scraped from news sites or social media plat-forms and, therefore, have limited utility in more advanced security, forensics, and military applications. These applications require lower resolution, longer ranges, and ele-vated viewpoints. To meet these critical needs, we collected and curated the first and second subsets of a large multi-modal biometric dataset designed for use in the research and development (R&D) of biometric recognition technolo-gies under extremely challenging conditions. Thus far, the dataset includes more than 350,000 still images and over 1,300 hours of video footage of approximately 1,000 sub-jects. To collect this data, we used Nikon DSLR cameras, a variety of commercial surveillance cameras, specialized long-rage R&D cameras, and Group 1 and Group 2 UAV platforms. The goal is to support the development of algorithms capable of accurately recognizing people at ranges up to 1,000 m and from high angles of elevation. These ad-vances will include improvements to the state of the art in face recognition and will support new research in the area of whole-body recognition using methods based on gait and anthropometry. This paper describes methods used to col-lect and curate the dataset, and the dataset's characteristics at the current stage.

Brogan, Joel↗

Database to Enable Facial Analysis for Driving Studies (DEFADS)

Naturalistic Driving Studies (NDS) collect and utilize data on drivers in real-world environments in instrumented vehicles. A common problem with such studies is driver privacy. In this work we collected a dataset of 77 human subjects performing scripted driving-related activities. We used three camera systems for the collection, including two high-resolution webcam devices as well as a third system from an actual NDS (the Second Strategic Highway Research Project, or SHRP2). This report covers the data collection process and summarizes the dataset, which will be made publicly available to researchers under a data usage license.

97 MATHEMATICS AND COMPUTING↗

Leveraging gradient weighted class activation mapping to improve classification effectiveness: Case study in transportation infrastructure characterization

Roadway “corners†are common for pedestrian use, whether designated with markings or not. Different types of markings have been deployed, ranging from simple parallel lines to more complex designs. Understanding the impact of different types of crosswalks is important for public safety. In this work we explore methods to improve the logging of marked crosswalk types. We used the Roadway Information Database from the Second Strategic Highway Research Project and used active learning methods with transfer learning to identify the crosswalk types (marked or unmarked). Upon completion we found our classifiers were unable to perform above roughly 94% correct classifications. To improve their efficacy, we separated the crosswalks into their “fine grained†types and used Gradient-Weighted Class Activation Mapping to isolate and study the features that classified the crosswalks. We compared this with sampled manually marked crosswalks and present findings. We believe this use case can represent a process to improve the active learning method for some visual machine learning applications.

Karnowski, Thomas↗

A Publicly Available, Annotated Dataset for Naturalistic Driving Study and Computer Vision Algorithm Development

Oak Ridge National Laboratory developed and implemented a data collection effort to create a dataset for use in evaluating and testing algorithms for analyzing driver behavior under controlled settings for support of the Federal Highway Administration’s Exploratory Advanced Research Program. This collection is called the ORNL Naturalistic Driving Study Sample (ONDSS). The dataset is designed to emulate aspects of the Second Strategic Highway Research Project (SHRP2), which contained a massive naturalistic driving study (NDS) with over 3000 drivers between 2010 and 2013 using their personal vehicles, with over 4300 person-years of data collected [HANKEY].

42 ENGINEERING↗

Methods and Comparisons Between Computer Vision and Radar Based Vehicle Location

Measuring vehicle locations relative to a driver's vehicle is a critical component in the analysis of driving data from both postanalysis (such as in naturalistic driving studies) or in autonomous vehicle navigation. In this work we describe a method to estimate vehicle positions from a forward-looking video camera using intrinsic camera calibration, estimates of extrinsic parameters, and a convolutional neural network trained to detect and locate vehicles in video data. We compare the measurements we achieve with this method with ground truth and with radar data available from a naturalistic driving study. We identify regions where video is preferred, where radar is preferred, and explore trade-offs between the two methods in regions where the preference is more ambiguous. We describe applications of these measurements for transportation analysis.

Aykac, Deniz↗

3D Tomography and Image Processing Using Fast Neutrons Final Report

This document is the final report for project OR16-ML-3DTomography-PD3Jb, “3D Tomography and Image Processing Using Fast Neutrons.” This project was motivated by the availability of three-dimensional (3D) tomographic neutron transmission and induced-reaction data following the development of associated-particle imaging (API) systems with two-dimensional (2D) or “area” neutron detectors such as the Advanced Portable Neutron Imaging System, which is capable of simultaneous measurement of transmission and induced-reaction neutrons.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Investigating Camera Calibration Methods for Naturalistic Driving Studies

Naturalistic driving studies typically utilize a variety of sensors, including radar, kinematic sensors, and video cameras. While the main objective of such sensors is typically safety focused, with a goal of recording accidents and near accidents for later review, the instrumentation provides a valuable resource for a variety of transportation research. Some applications, however, require additional processing to improve the utility of the data. In this work, we describe a computer vision procedure for calibrating front view cameras for the Second Strategic Highway Research Project. A longitudinal stability study of the estimated parameters across a small sample set of cameras is presented along with a proposed procedure for calibrating a larger number of cameras from the study. A simple use case is presented as one example of the utility of this work. Finally, we discuss plans for calibrating the complete set of approximately 3000 cameras from this study.

Paone, Jeffrey R.↗

Progress Update on Segmentation of Neutron Tomographic Images, 2018

The present report documents the techniques developed to segment fast-neutron tomographic images of objects consisting of assemblies of machined parts with distinct boundaries. This report satisfies the fiscal year 2018 technical deliverable for project OR16-3DTomography-PD3Jb, “3D Tomography and Image Processing Using Fast Neutrons,” to report on the extension of geometric shape-finding algorithms to three dimensions. The project has two overall goals. The first of these goals is to extend associated-particle fast-neutron transmission and, particularly, induced-reaction tomographic imaging algorithms to three dimensions. This aspect of the project is beyond the scope of this report. The second goal is to automatically segment the resultant tomographic images into constituent parts and then extract information about the parts, such as the class of shape and potentially the shape parameters. This report describes progress for the image segmentation part of the project. Imaging techniques have been developed as high-confidence methods for confirming the presence and configuration of special nuclear materials (SNM). This high confidence is achieved at the cost of revealing considerable information that may be undesirable to share with the operator of the equipment. One potential way to make use of the high-confidence of imaging methods without revealing imaging data is to employ automated analysis that can extract meaningful attributes of the SNM without showing imaging data to the operator. An essential step of this automated analysis is the segmentation of the image into its constituent parts. For example, a three-dimensional (3D) fast-neutron tomographic image of an assembly containing uranium could be reconstructed and then segmented into discrete parts. The properties of a constituent part identified as uranium would be of interest and could be extracted. For instance, the volume and density of the part would together determine its mass. Moreover, its shape might be expected to fall into a particular geometric class, such as a cube, cylinder, or sphere, and the parameters of the shape (such as side length, height, or diameter) would be expected to fall in a given range. In such an analysis, automated identification of the boundaries and properties of the uranium part is an essential step. A key goal of the present work is to infer the boundaries of objects in fast-neutron tomographic images via the general method of image segmentation. Development of this capability can be broken into more manageable steps, including 1. operator-guided segmentation of two-dimensional (2D) fast-neutron tomographic images, 2. operator-guided segmentation of 3D fast-neutron tomographic images, 3. development of automated segmentation algorithms, and 4. extraction of shape parameters from constituent volumes in 3D. In the first year, the project team reported progress on the first step. Last year, progress on the second step, the extension into 3D, was reported with application to simulated data. The present report describes additional progress on the second step, and progress toward the third step, automated segmentation algorithms. In particular, a multiphase level set approach for image segmentation in three dimensions has been applied to measured 3D data for the first time. Activities related to the fourth step will also be reported, but it will focus on estimation of 3D volumes rather than shape parameters. In this report, the steps before image segmentation will be described, and the multiphase level sets approach to image segmentation will be briefly reviewed. This will be followed by a discussion of the issues encountered when applying the level set technique to measured 3D transmission images, and then a description of the inclusion of induced-reaction data will be provided. Finally, segmentation results for various measured target assemblies will be presented and the image segmentation portion of this project will be summarized and future directions will be discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Oak Ridge National Laboratory Progress Update on Segmentation of Neutron Tomographic Images, 2017

The present report documents progress regarding segmentation of fast-neutron tomographic images of objects consisting of assemblies of machined parts with distinct boundaries. This report satisfies the fiscal year 2017 technical deliverable for project OR16-3DTomography-PD3Jb, “3D Tomography and Image Processing Using Fast Neutrons,” to report on the extension of geometric shape-finding algorithms to three dimensions. The project has two overall goals. The first of these goals is to extend associated particle fast neutron transmission and, particularly, induced-reaction tomographic imaging algorithms to three dimensions. The second of these goals is to automatically segment the resultant tomographic images into constituent parts, and then extract information about the parts, such as the class of shape and potentially the shape parameters. This report addresses continued progress in the component of the project concerned with image segmentation.

3D tomography↗

Baseline Face Detection, Head Pose Estimation, and Coarse Direction Detection for Facial Data in the SHRP2 Naturalistic Driving Study

Keeping a driver focused on the road is one of the most critical steps in insuring the safe operation of a vehicle. The Strategic Highway Research Program 2 (SHRP2) has over 3,100 recorded videos of volunteer drivers during a period of 2 years. This extensive naturalistic driving study (NDS) contains over one million hours of video and associated data that could aid safety researchers in understanding where the driver s attention is focused. Manual analysis of this data is infeasible, therefore efforts are underway to develop automated feature extraction algorithms to process and characterize the data. The real-world nature, volume, and acquisition conditions are unmatched in the transportation community, but there are also challenges because the data has relatively low resolution, high compression rates, and differing illumination conditions. A smaller dataset, the head pose validation study, is available which used the same recording equipment as SHRP2 but is more easily accessible with less privacy constraints. In this work we report initial head pose accuracy using commercial and open source face pose estimation algorithms on the head pose validation data set.

Paone, Jeffrey R↗

Statistical Characterization and Segmentation of Drusen in Fundus Images

Age related Macular Degeneration (AMD) is a disease of the retina associated with aging. AMD progression in patients is characterized by drusen, pigmentation changes, and geographic atrophy, which can be seen using fundus imagery. The level of AMD is characterized by standard scaling methods, which can be somewhat subjective in practice. In this work we propose a statistical image processing approach to segment drusen with the ultimate goal of characterizing the AMD progression in a data set of longitudinal images. The method characterizes retinal structures with a statistical model of the colors in the retina image. When comparing the segmentation results of the method between longitudinal images with known AMD progression and those without, the method detects progression in our longitudinal data set with an area under the receiver operating characteristics curve of 0.99.

59 BASIC BIOLOGICAL SCIENCES↗

Combining Image and Non-Image Data for Automatic Detection of Retina Disease in a Telemedicine Network

A telemedicine network with retina cameras and automated quality control, physiological feature location, and lesion/anomaly detection is a low-cost way of achieving broad-based screening for diabetic retinopathy (DR) and other eye diseases. In the process of a routine eye-screening examination, other non-image data is often available which may be useful in automated diagnosis of disease. In this work, we report on the results of combining this non-image data with image data, using the protocol and processing steps of a prototype system for automated disease diagnosis of retina examinations from a telemedicine network. The system includes quality assessments, automated physiology detection, and automated lesion detection to create an archive of known cases. Non-image data such as diabetes onset date and hemoglobin A1c (HgA1c) for each patient examination are included as well, and the system is used to create a content-based image retrieval engine capable of automated diagnosis of disease into 'normal' and 'abnormal' categories. The system achieves a sensitivity and specificity of 91.2% and 71.6% using hold-one-out validation testing.

59 BASIC BIOLOGICAL SCIENCES↗

Retina Image Screening and Analysis Software Version 2.0

The software allows physicians or researchers to ground-truth images of retinas, identifying key physiological features and lesions that are indicative of disease. The software features methods to automatically detect the physiological features and lesions. The software contains code to measure the quality of images received from a telemedicine network; create and populate a database for a telemedicine network; review and report the diagnosis of a set of images; and also contains components to transmit images from a Zeiss camera to the network through SFTP.

Tobin, Jr., Kenneth W.↗