Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine visions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Rifle-like camera for long distance face recognition

An improved long-range facial recognition system is provided. The facial recognition system includes an integrated, rifle-like mounting platform with modular and interchangeable components, including a machine-vision camera, a facial recognition module, and an aiming scope. The mounting platform includes an elongated frame, a hand grip, a shoulder stock, and an underbody support attachment for an optional bipod. The mounting platform provides an intuitive, shoulder-operated support structure for stabilizing the machine-vision camera and reducing vibrations that otherwise inhibit long distance imaging.

Bolme, David S.↗
DOE OSTI2024

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗
DOE OSTI2020

Generalized and Mechanistic PV Module Performance Prediction From Computer Vision and Machine Learning on Electroluminescence Images

Electroluminescence (EL) imaging of photovoltiac (PV) modules offers high-speed, high-resolution information about device performance, affording opportunities for greater insight and efficiency in module characterization across manufacturing, research and development, and power plant operations and management. Predicting module electrical properties from EL image features is a critical step toward these applications. In this article, we demonstrate quantification of both generalized and performance mechanism-specific EL image features, using pixel intensity-based and machine learning classification algorithms. From EL image features, we build predictive models for PV module power and series resistance, using time-series current-voltage (I-V) and EL data obtained stepwise on five brands of modules spanning three Si cell types through two accelerated exposures: damp heat (DH) (85°C/85% RH) and thermal cycling (TC) (IEC 61215). Overall, 195 pairs of EL images and I-V characteristics were analyzed, yielding 11700 individual PV cell images. A convolutional neural network was built to classify cells by the severity of busbar corrosion with high accuracy (95%). Generalized power predictive models estimated the maximum power of PV modules from EL images with high confidence and an adjusted-R 2 of 0.88, across all module brands and cell types in extended DH and TC exposures. Mechanistic degradation prediction was demonstrated by quantification of busbar corrosion in EL images of three module brands in DH, and subsequent modeling of series resistance using these mechanism-specific EL image features. For modules exhibiting busbar corrosion, we demonstrated series resistance predictive models with adjusted-R 2 of up to 0.73.

14 SOLAR ENERGY↗
DOE OSTI2020

Machine Vision-based Robot Manipulators for Nuclear Applications - 20370

Decommissioning and dismantling of nuclear facilities are major challenges facing the nuclear industry. Robot manipulators with capabilities of restoring nuclear structures and significantly prolonging nuclear power generation in addition to their applications in decommissioning and dismantling (D and D) would immensely ease the above-mentioned challenge. Ability to remotely sense/monitor and analyze dangerous and hazardous environments such as nuclear reactors as well as performing reparatory tasks in such environments using robot manipulators require additional information from vision sensors. Structural sample collection and inspection as well as restoration require object and position information. Computer vision is used to obtain precise 3D position information. The current work uses the Sawyer robot with the integrated Cognex camera. The research presents an approach to facilitate and improve operations in a nuclear reactor using robotic vision control. The vision control system is modeled with Augmented Image Space-based visual servoing approach. Results showing accurate robot control. Object recognition is used to recognize the image and calculate it poses. To transform coordinates of the object's pose from the camera frame to the robotic frame transformation matrices are employed. Future work will employ a 3D camera (with depth information) using Denso robot. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Integrating Machine-learning-assisted Computer Vision with RICH System

Developments in artificial intelligence have vastly expanded the capabilities of robots. Currently, the Spallation Neutron Source (SNS) beamlines at Oak Ridge National Lab (ORNL) have robotic sample loaders to increase the efficiency of running experiments. However, they require retraining if anything about the situation changes, e.g., where the samples are, and cannot notice if errors occur. So, the viability of using computer vision and machine learning to enhance these sample loaders’ functionality was investigated. In this project, the RICH system with a Dobot CR3 6-axis robot present at the VULCAN beamline assisted by an Intel Realsense D435i camera, a unique camera that enables convenient translation of 2D pixel coordinates to 3D world points, was programmed to load ceramic crucibles into a thermogravimetric analyzer (TGA) furnace. An algorithm was constructed in Python with three major phases planned: (1) obtaining a sample, (2) moving it to the target location, and then (3) bringing the sample back to its original location once the experiment finished. In the first phase, the algorithm would dynamically detect sample locations using ArUco markers to recognize the samples’ general location and a custom-trained yolov5 object detection model to locate the crucibles’ centers. Afterward, the robot would be directed to pick up samples based on the crucibles’ calculated positions. In the second phase, the robot would move the sample to a secondary point, reorient its grip, and place the sample at the target location. In the final phase, the robot would determine whether the sample was intact and would bring it back to its original place if it was or raise an alarm. Using this algorithm, the robot was able to pick up different types of crucibles at varying positions. These results indicate that integrating machine-learning-assisted computer vision with robotic sample loaders can result in effective autonomous detection of samples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

FCIC FY18 LT-baseline Feedstock Images

Set of images taken during pilot plant dilute-acid hydrolysis preatreatment reactor operation. Images were taken with a GoPro Hero 5 with rectilinear lens facing downwards on a weigh-belt instrument. Image period was every 30 seconds during operation. This image set is connected to a journal article titled "Real-Time Biomass Feedstock Particle Quality Detection Using Image Analysis and Machine Vision", http://dx.doi.org/10.1007/s13399-020-00904-w.

09 BIOMASS FUELS↗
DOE OSTI2024

Hot, cold, or just right? An infrared biometric sensor to improve occupant comfort and reduce overcooling in buildings via closed-loop control

To improve occupant comfort and save energy in buildings, we have developed a closed-loop air conditioning (AC) sensor-controller that predicts occupant thermal sensation from the thermographic measurement of skin temperature distribution, then uses this information to reduce overcooling (cooling-energy overuse that discomforts occupants) by regulating AC output. Taking measures to protect privacy, it combines thermal-infrared (TIR) and color (visible spectrum) cameras with machine vision to measure the skin-surface temperature profile. Since the human thermoregulation system uses skin blood flow to maintain thermoneutrality, the distribution of skin temperature can be used to predict warm, neutral, and cool thermal states. We conducted a series of human-subject thermal-sensation trials in cold-to-hot environments, measuring skin temperatures and recording thermal sensation votes. We then trained random-forest classification machine-learning models (classifiers) to estimate thermal sensation from skin temperatures or skin-temperature differences. The estimated thermal sensation was input to a proportional integral (PI) control algorithm for the AC, targeting a sensation level between neutral and warm. Our sensor-controller includes a sensor assembly, server software, and client software. The server software orients the cameras and transmits images to the client software, which in turn assesses occupant skin temperature distribution, estimates occupant thermal sensation, and controls AC operation. A demonstration conducted in a conference room in an office building near Houston, TX showed that our system reduced overcooling, decreasing AC load by 42% when the room was occupied while improving occupant comfort (fraction of “comfortable” votes) by 15 percentage points.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

CRADA Number NFE-19-07847 with MantaPoole Technologies (CRADA Final Report)

As the world becomes more automated, smart and autonomous systems that utilize advanced 3D machine vision are becoming ever more prevalent. To function autonomously, these smart machines need to be able to identify the “what” and “where” of their application by capturing color and depth information. The color information provides the needed contrast information to identify the “what” of a scene while the depth information allows the smart machine to identify “where” an object in a 3D environment is. To capture both the color and depth information using only a single sensor, MantaPoole Technologies (MPT) is developing a new type of 3D light field camera. The approach leverages MPT’s active micro-optics technology which when aligned and placed over an imaging detector are designed to act as an advanced optical filter that controls the direction of light that reaches the underlying pixels.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Extrusion parameter control optimization for DIW 3D printing using image analysis techniques

Material extrusion is a well-recognized facet of additive manufacturing that involves the fabrication of parts through the deposition of structural material from an extrusion head from a bulk supply. In the subdivision of Direct Ink Writing (DIW) additive manufacturing, challenges arise when the structural material is flowable, synchronous extrusion control and tool movement becomes critical for achieving high-quality parts with low defect populations. DIW techniques are most used in laboratory settings using expensive custom instruments and may require specialized 3D slicing software. Here, in this study, the fabrication of an inexpensive, consumer-friendly progressive cavity pump dispensing system is detailed, in which can create high-quality parts by executing G-code commands produced from a commercial slicing software. The precision and repeatability of the movement-synchronized material extrusion is demonstrated through a series of optimization schemes, entailing the alteration of various control parameters, which directly affect the extrusion properties demonstrated during a print. In situ diagnostics were implemented to evaluate the results of the established optimization experiment. Using a machine vision technique, images of the optimization prints are processed. Following this, a supervised machine learning model was trained to autonomously judge whether or not the extrusion parameters produced a passing or failing result. The machine learning scheme serves as a preliminary benchmark for future layer-by-layer evaluation of more complex DIW parts. The construction of the printer and development of in situ characterization capabilities demonstrates the ability for this printer to create high-fidelity DIW parts for a fraction of the price of other systems.

42 ENGINEERING↗
DOE OSTI2026

Developing a Deep Learning-Computer Vision Framework to Monitor Avian Interactions with Solar Energy Facility Infrastructure (Final Technical Report)

The project addressed an inability to monitor avian interactions with photovoltaic (PV) solar energy facilities necessary for understanding PV solar impacts on birds. In the project, machine-vision technology that continuously monitors avian activities at PV solar facilities was developed. The technology includes four machine-learning (ML) models, each of which accomplishes a specific task in detecting birds and classifying their activities in live or recorded videos—detecting and tracking moving objects, differentiating birds from other objects, detecting bird collisions with solar panels, and classifying non-collision bird activities around PV facilities. Major project outcomes include adoption by two of DOE SETO’s SolWEB projects, providing novel observational data on birds to promote co-location of PV solar development and habitat conservation, known as ecovoltaics.

14 SOLAR ENERGY↗
DOE OSTI2024

Abrasive Waterjet Machining

The abrasive waterjet machining process was introduced in the 1980s as a new cutting tool; the process has the ability to cut almost any material. Currently, the AWJ process is used in many world-class factories, producing parts for use in daily life. A description of this process and its influencing parameters are first presented in this paper, along with process models for the AWJ tool itself and also for the jet–material interaction. The AWJ material removal process occurs through the high-velocity impact of abrasive particles, whose tips micromachine the material at the microscopic scale, with no thermal or mechanical adverse effects. The macro-characteristics of the cut surface, such as its taper, trailback, and waviness, are discussed, along with methods of improving the geometrical accuracy of the cut parts using these attributes. For example, dynamic angular compensation is used to correct for the taper and undercut in shape cutting. The surface finish is controlled by the cutting speed, hydraulic, and abrasive parameters using software and process models built into the controllers of CNC machines. In addition to shape cutting, edge trimming is presented, with a focus on the carbon fiber composites used in aircraft and automotive structures, where special AWJ tools and manipulators are used. Examples of the precision cutting of microelectronic and solar cell parts are discussed to describe the special techniques that are used, such as machine vision and vacuum-assist, which have been found to be essential to the integrity and accuracy of cut parts. The use of the AWJ machining process was extended to other applications, such as drilling, boring, milling, turning, and surface modification, which are presented in this paper as actual industrial applications. To demonstrate the versatility of the AWJ machining process, the data in this paper were selected to cover a wide range of materials, such as metal, glass, composites, and ceramics, and also a wide range of thicknesses, from 1 mm to 600 mm. The trends of Industry 4.0 and 5.0, AI, and IoT are also presented.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Spectral kernel machines with electrically tunable photodetectors

Spectral machine vision collects spectral and spatial information as three-dimensional hypercubes and digitally processes them, which causes a data bottleneck, limiting power efficiency, frame rate, and spectral-spatial resolution. This work introduces spectral kernel machines (SKMs) to overcome these bottlenecks. SKM directly compresses spectral analysis through the output photocurrent and learns from example objects to identify and classify new samples in a "sniff-and-seek" mode. We experimentally demonstrated SKMs with electrically tunable bipolar black phosphorus-molybdenum disulfide (bP-MoS2) photodiodes in the near- and mid-infrared band and silicon photoconductors in the visible band, performing versatile intelligent tasks from chemometrics to semiconductor metrology. This architecture consumed substantially less power and was more than an order of magnitude faster than existing solutions for hyperspectral image analysis, defining an intelligent imaging and sensing paradigm with intriguing possibilities.

Zhang, Dehui↗
DOE OSTI2020

High precision control and deep learning-based corn stand counting algorithms for agricultural robot

This paper presents high precision control and deep learning-based corn stand counting algorithms for a low-cost, ultra-compact 3D printed and autonomous field robot for agricultural operations. Currently, plant traits, such as emergence rate, biomass, vigor, and stand counting, are measured manually. This is highly labor-intensive and prone to errors. The robot, termed TerraSentia, is designed to automate the measurement of plant traits for efficient phenotyping as an alternative to manual measurements. In this paper, we formulate a Nonlinear Moving Horizon Estimator that identifies key terrain parameters using onboard robot sensors and a learning-based Nonlinear Model Predictive Control that ensures high precision path tracking in the presence of unknown wheel-terrain interaction. Moreover, we develop a machine vision algorithm designed to enable an ultra-compact ground robot to count corn stands by driving through the fields autonomously. The algorithm leverages a deep network to detect corn plants in images, and a visual tracking model to re-identify detected objects at different time steps. We collected data from 53 corn plots in various fields for corn plants around 14 days after emergence (stage V3 - V4). The robot predictions have agreed well with the ground truth with C robot =1.02×C human -0.86 and a correlation coefficient R=0.96. The mean relative error given by the algorithm is -3.78%, and the standard deviation is 6.76%. These results indicate a first and significant step towards autonomous robot-based real-time phenotyping using low-cost, ultra-compact ground robots for corn and potentially other crops.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Universal Polarization Transformations: Spatial Programming of Polarization Scattering Matrices Using a Deep Learning‐Designed Diffractive Polarization Transformer

Abstract Controlled synthesis of optical fields having nonuniform polarization distributions presents a challenging task. Here, a universal polarization transformer is demonstrated that can synthesize a large set of arbitrarily‐selected, complex‐valued polarization scattering matrices between the polarization states at different positions within its input and output field‐of‐views (FOVs). This framework comprises 2D arrays of linear polarizers positioned between isotropic diffractive layers, each containing tens of thousands of diffractive features with optimizable transmission coefficients. After its deep learning‐based training, this diffractive polarization transformer can successfully implement N i N o = 10 000 different spatially‐encoded polarization scattering matrices with negligible error, where N i and N o represent the number of pixels in the input and output FOVs, respectively. This universal polarization transformation framework is experimentally validated in the terahertz spectrum by fabricating wire‐grid polarizers and integrating them with 3D‐printed diffractive layers to form a physical polarization transformer. Through this set‐up, an all‐optical polarization permutation operation of spatially‐varying polarization fields is demonstrated, and distinct spatially‐encoded polarization scattering matrices are simultaneously implemented between the input and output FOVs of a compact diffractive processor. This framework opens up new avenues for developing novel devices for universal polarization control and may find applications in, e.g., remote sensing, medical imaging, security, material inspection, and machine vision.

Optical neural networks↗
DOE OSTI2021

Multi-spatio-temporal scales PIV in a turbulent buoyant jet discharging in a linearly stratified environment

Time-resolved particle image velocimetry is implemented with a camera array and several laser sheets; this results in a multi-spatio-temporal scale system that is modular and flexible. The setup is optimized to capture global flow features, while locally resolving in space and time near the Kolmogorov scale. The apparatus relies extensively on machine vision CMOS cameras; they are inexpensive and stream to computer hard drive with virtually continuous time-resolved records (up to one hour for the current system). This leads to statistically converged data and also helps in minimizing down time between experimental runs. Details of the implementation and design of experiment are reported. The system instruments a vertical buoyant jet discharging in a linearly stratified environment. Refractive index matched aqueous solutions enable precise optical deployment. The density difference is 3% and the fluids have similar dynamic viscosity. The jet Reynolds number is 2.00 x 10 4 and is above the mixing transition. Such flows are typically challenging to instrument and few velocity field data are available to date. The velocity statistics are reported as well as first insights gained from the campaign.

42 ENGINEERING↗
DOE OSTI2020

Influence of geochemical reactions on the creep behavior of Mt. Simon sandstone

The capture and subsurface storage of carbon dioxide is a sustainable option that is currently pursued worldwide to mitigate greenhouse gas effect. However, predicting the long-term mechanical integrity of CO 2 underground storage systems remains a challenge. To address that question, it is essential to understand the influence of fluid-rock chemo-mechanical interactions on the long-term and on the time-dependent mechanical properties. In turn, the long-term mechanical response and the time-dependent mechanical behavior can be represented by the creep response. We investigate the impact of CO 2 -induced geochemical reaction on the creep response of Mt. Simon sandstone with a 50–400 micron grain size. We perform static and dynamic flow experiments on Mt. Simon sandstone specimens under geological conditions, at a temperature of T = 50 - 53 °C and for CO 2 pressures of P = 8:62; 17:2 MPa under both static flow and dynamic flow-through conditions. After aging, we employ creep indentation testing, high-resolution SEM-EDS, computer vision, machine learning, and micromechanics modeling to probe changes on the microstructure and mechanical properties. Following both static and dynamic flow-through experiments, we observe a 10–22% decrease in quartz volume fraction and an increase in both the microporosity (7–28%) and nanoporosity (60–65%). Additional CO 2 -induced microstructural changes include an enlargement of pore throats and the formation of channels. These observations point to the presence of CO 2 -induced K-feldspar dissolution and clay dissolution reactions. Here, the macroscopic creep behavior is logarithmic and the macroscopic creep modulus varies depending on the microporosity and the relative quartz and feldspar content. As a result of these geochemical reactions and of the related microstructural changes, a 55-60% decrease in the macroscopic logarithmic creep modulus is predicted.

58 GEOSCIENCES↗
DOE OSTI2022

Multi-pitch nano-accuracy surface profiler for strongly curved X-ray mirror metrology

We present our recent research and development effort on the Multi-Pitch Nano-accuracy Surface Profiler (MPNSP). This metrology instrument is developed to characterize strongly curved X-ray mirrors proposed to achieve diffraction-limited soft X-ray focusing for scientific applications at the synchrotron beamlines. The measurement process consists of forward-and-backward scans on the test mirror surface along its tangential direction at multiple pitch angles. Our research and development in this work aim to take the challenge of measuring strongly curved X-ray mirrors with a typical total slope range ≳10 mrad, while maintaining the Root Mean Square (RMS) value of measurement repeatability and self-consistency at 50 nrad RMS level. We first introduce the mechanical design, followed by a brief review of the mathematical model and the optimization algorithm for the MPNSP technique. By detecting the rotation axis of the mirror pitch with a machine vision approach, we can determine and then reduce the vertical distance between the pitch rotation axis and the test mirror surface to a sub-mm level. In addition, we describe a practical data acquisition procedure for strongly curved X-ray mirrors with a total slope range larger than the slope measuring range of the autocollimator used in the instrument. As a result, the proposed MPNSP measurements with different mirror orientations achieve remarkable self-consistency and reproducibility of < 50 nrad RMS in slope and < 0.5 nm RMS in height.

42 ENGINEERING↗