Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Improvements in Optical Surface Measurement Using Reflected Computer Vision Targets

Since 2021, NREL has been developing a system to measure heliostats by measuring the deflection of printed computer vision targets, called the Reflected Target Non-intrusive Assessment (ReTNA) [6], [7]. While this system will have lower resolution than a fringe deflectometry system, it has several important advantages that make it a complimentary technology: 2D surface slope measurement can be generated from a single image, it can operate in ambient lighting, target points can be directly located in 3D space with photogrammetry allowing for a non-flat target, and it's well suited to using a smaller target, and multiple images to measure larger optical surfaces. ReTNA has undergone several significant changes and improvements, described below. This talk will summarize new system layouts designed for commercial use, new computer vision algorithms used to automate the analysis process and validation campaigns for the ReTNA software.

computer vision↗
DOE OSTI2023

Vision-based localization for cooperative robot-CNC hybrid manufacturing

Wire and arc additive manufacturing (WAAM) has shown promise in recent years for producing large-scale parts with higher deposition rates than other additive processes. WAAM is often combined with subtractive machining to form a hybrid manufacturing process. This hybrid process can be realized by retrofitting computer numerical control (CNC) machines with deposition heads, adding spindles and deposition heads to robots, or developing part localization methods to transfer parts from an additive cell to a CNC machine. Here, a novel, robot-CNC hybrid configuration is introduced where a maneuverable robot is placed in front of a CNC machine to deposit material within the machine envelop. Furthermore, this method removes the need for part localization and the extensive machine modifications required for retrofitting; however, the problem of robot localization is also added. In this work, the effects of error in vision-based, contactless robot localization on machining parameters in a robot-machine hybrid process were studied. Performance was characterized on an implementation of this system using classical computer vision techniques. In addition, machining simulations were conducted to evaluate the effects of image-induced error on chip thickness, material removal rate, and machining allowance. Initial tests show that computer vision could adequately locate a robot for the hybrid WAAM process within .5 mm.

Hybrid manufacturing↗
DOE OSTI2024

Analysis of Automated Transit Network Systems with Battery-Electric Vehicles in Automated Mobility Districts: Preprint

The paper provides an overview of the insights and findings of the National Renewable Energy Laboratory's (NREL) ongoing research on the implementation of automated mobility districts (AMDs). AMD is a term coined by NREL to describe a geographically defined district or major activity center located in a dense urban setting with mobility applications provided by automated/autonomous vehicle (AV) systems spanning internal circulation and first-mile/last-mile connections to regional transportation hubs. Research over the past five years has focused on understanding the evolution of AMDs, beginning with demonstrations of automated shuttles prior to the pandemic, to more integrated on-demand mobility systems currently in initial stages of deployment. Initial insights and findings from earlier studies include the need for designation of a "jurisdiction having authority," a clear vision of a complete system to provide end-to-end mobility services, and the requisite intelligent infrastructure to complement AV technology. NREL's most recent Phase III research investigates station boarding/alighting (curb) issues, the full electrification of fleets, and the need for a systems engineering methodology (SEM) to properly analyze the complexities resulting from the convergence of automation, on-demand mobility, and electrification of the transit systems within the AMD. The paper reviews the findings of AMD research conducted during Phase I, II, and III, with special emphasis on Phase III results with respect to a descriptive example of the proposed SEM when a "digital twin" analytical model is used to simulate the transport fleet's battery-electric vehicle miles of travel and associated duty cycles through a rigorous analytical assessment with a comprehensive modeling process.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Cycle-by-cycle Delay Estimation at Signalized Intersections by using Machine Learning and Simulated Video Detection Data

Accurate estimation of delay is crucial for efficient traffic signal operations. Estimation of delay in the real-time manner using traditional loop detectors requires advanced detectors (in addition to stop-bar detection). In cases when this detection layout is not in place, delay estimates are approximated with a lower accuracy. Video detection is one of the most frequently deployed detection systems at signalized intersections in recent years. In most cases video detection operates in the same way as traditional inductive loops. However, when coupled with computer vision algorithms, video detection systems could be used to retrieve additional information (e.g., vehicular arrivals and departures) that cannot be taken out from the conventional systems (e.g., long stop-bar loop detectors). Although present for several decades, video detection data were not frequently examined for delay estimation purposes. In this study, we proposed a novel delay estimation model which can be developed with only data from stop-bar video detectors. Relevant data were collected from a simulation model of 11 signalized intersections at downtown Chattanooga, TN and processed to create needed inputs for model development. With the use of multigene genetic programming the authors developed a delay model that outperforms accuracy of multi regression model. Furthermore, authors evaluated the developed model by comparison with the other benchmark delay models, such as HCM and approach delay model. It was found that the developed MGGP delay model outperforms benchmark models for a wide range of traffic and signal operation conditions.

Erdagi, Ismet Goksad↗
DOE OSTI2026

Advancements in reflected target nonintrusive assessment (ReTNA) for large optical surface measurement

Reflected computer vision targets are a powerful tool for measurement of mirror surface shape, with several important advantages over traditional fringe deflectometry methods. This method was first presented in 2021 and has undergone significant improvement and demonstration since. We describe a new baseline system using reflected computer vision targets, and present results from a large-scale measurement campaign conducted on both commercial heliostats and test mirrors in the laboratory. Calibration of the measurement system with photogrammetry allows for accurate measurement without careful control of target shape or camera position. Overall, the results show that a baseline setup using this method achieves measurement uncertainties in the slope error root-mean-square less than ±0.11 milliradian due to a series of repeatability conditions, varying sample position, rotation, lighting, camera settings, and system rebuild and recalibration. We present a detailed description of the setup, the results generated by this measurement tool, repeated measurement results, and the strengths and limitations of this metrology system.

14 SOLAR ENERGY↗
DOE OSTI2022

SAFE-OCC: A novelty detection framework for Convolutional Neural Network sensors and its application in process control

Herein we present a novelty detection framework for Convolutional Neural Network (CNN) sensors that we call Sensor-Activated Feature Extraction One-Class Classification (SAFE-OCC). We show that this framework enables the safe use of computer vision sensors in process control architectures. Emergent control applications use CNN models to map visual data to a state signal that can be interpreted by the controller. Incorporating such sensors introduces a significant system operation vulnerability because CNN sensors can exhibit high prediction errors when exposed to novel (abnormal) visual data. Unfortunately, identifying such novelties in real-time is nontrivial. To address this issue, the SAFE-OCC framework leverages the convolutional blocks of the CNN to create an effective feature space to conduct novelty detection using a desired one-class classification technique. This approach engenders a feature space that directly corresponds to that used by the CNN sensor and avoids the need to derive an independent latent space. We demonstrate the effectiveness of SAFE-OCC via simulated control environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Automated Lane Centering: An Off-the-Shelf Computer Vision Product vs. Infrastructure-Based Chip-Enabled Raised Pavement Markers

Safe autonomous vehicle (AV) operations depend on an accurate perception of the driving environment, which necessitates the use of a variety of sensors. Computational algorithms must then process all of this sensor data, which typically results in a high on-vehicle computational load. For example, existing lane markings are designed for human drivers, can fade over time, and can be contradictory in construction zones, which require specialized sensing and computational processing in an AV. But, this standard process can be avoided if the lane information is simply transmitted directly to the AV. High definition maps and road side units (RSUs) can be used for direct data transmission to the AV, but can be prohibitively expensive to establish and maintain. Additionally, to ensure robust and safe AV operations, more redundancy is beneficial. A cost-effective and passive solution is essential to address this need effectively. In this research, we propose a new infrastructure information source (IIS), chip-enabled raised pavement markers (CERPMs), which provide environmental data to the AV while also decreasing the AV compute load and the associated increase in vehicle energy use. CERPMs are installed in place of traditional ubiquitous raised pavement markers along road lane lines to transmit geospatial information along with the speed limit using long range wide area network (LoRaWAN) protocol directly to nearby vehicles. This information is then compared to the Mobileye commercial off-the-shelf traditional system that uses computer vision processing of lane markings. Our perception subsystem processes the raw data from both CEPRMs and Mobileye to generate a viable path required for a lane centering (LC) application. To evaluate the detection performance of both systems, we consider three test routes with varying conditions. Our results show that the Mobileye system failed to detect lane markings when the road curvature exceeded ±0.016 m -1 . For the steep curvature test scenario, it could only detect lane markings on both sides of the road for just 6.7% of the given test route. On the other hand, the CERPMs transmit the programmed geospatial information to the perception subsystem on the vehicle to generate a reference trajectory required for vehicle control. The CERPMs successfully generated the reference trajectory for vehicle control in all test scenarios. Moreover, the CERPMs can be detected up to 340 m from the vehicle’s position. Our overall conclusion is that CERPM technology is viable and that it has the potential to address the operational robustness and energy efficiency concerns plaguing the current generation of AVs.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Cooling Matters: Benchmarking Large Language Models and Vision-Language Models on Liquid-Cooled Versus Air-Cooled H100 GPU Systems

The unprecedented growth in artificial intelligence (AI) workloads, recently dominated by large language models (LLMs) and vision-language models (VLMs), has intensified power and cooling demands in data centers. This study benchmarks LLMs and VLMs on two HGX nodes, each with 8× NVIDIA H100 graphics processing units (GPUs), using liquid and air cooling. Leveraging GPU Burn, Weights & Biases, and IPMItool, we collect detailed thermal, power, and computation data. Results show that the liquid-cooled systems maintain GPU temperatures between 41-50$^\circ$C, while the air-cooled counterparts fluctuate between 54-72$^\circ$C under load. This thermal stability of liquid-cooled systems yields 17% higher performance (54 TFLOPs/ GPU vs. 46 TFLOPs/GPU), performance-per-watt, reduced energy overhead, and greater system efficiency than the air-cooled counterparts. These findings underscore the energy and sustainability benefits of liquid cooling, offering a compelling path forward for hyperscale data centers seeking to optimize AI infrastructure. https://github.com/iscaas/Cooling-Matters.

Latif, Imran↗
DOE OSTI2022

Designing Resilience for Advanced Energy Systems

Advancements in energy technologies are making the grid more powerful, more efficient, and cleaner. As these promising innovations flourish across our communities, it is essential that our nation's infrastructure also becomes more resilient. Natural disasters, cyberattacks, user error, and a changing climate all present risks that could have devastating consequences. Individual emergencies are unique, but holistic planning and proactive measures can harden the grid and help anticipate and respond to any number of threats. The National Renewable Energy Laboratory (NREL) is at the forefront of this transition, establishing a vision for resilient energy systems today, and in the future.

energy disruption↗
DOE OSTI2021

A Review of Cyber-Physical Security for Photovoltaic Systems

In this paper, the challenges and a future vision of the cyber-physical security of photovoltaic (PV) systems are discussed from a firmware, network, PV converter controls, and grid security perspective. The vulnerabilities of PV systems are investigated under a variety of cyber-attacks, ranging from data integrity attacks to software-based attacks. A success rate metric is designed to evaluate the impact and facilitate decision making. Model-based and data-driven methods for threat detection and mitigation are summarized. In addition, the blockchain technology that addresses cyber-attacks in software and cyber networks is described. Simulation and experimental results that show the impact of cyber-attacks at the converter (device) and grid (system) levels are presented. Finally, potential research opportunities are discussed for next-generation, cyber-secure power electronics systems. These opportunities include multi-scale controllability, self-/event-triggering control, artificial intelligence/machine learning, hot patching, and online security. As of today, this study will be one of the few comprehensive studies in this emerging and fast-growing area.

14 SOLAR ENERGY↗
DOE OSTI2024

The role of driver head pose dynamics and instantaneous driving in safety critical events: Application of computer vision in naturalistic driving

This paper investigates the role of driver behavior especially head pose dynamics in safety–critical events (SCEs). Using a large dataset collected in a naturalistic driving study, this paper analyzes the head pose dynamics and driving behavior in moments leading up to crashes or near-crashes. The study uses advanced computer vision and mixed logit modeling techniques to identify patterns and relationships between drivers’ head pose dynamics and crash involvement. The results suggest that driver-head pose dynamics, especially poses that indicate distraction and movement volatility, are important factors that can contribute to undesirable safety outcomes. Marginal effects show that angular deviation for head pose dynamics indicated by yaw, pitch and roll increase the likelihood of crash intensity by 4.56%, 4.92% and 8.26% respectively. Furthermore, traffic flow and lane changing also contribute to increase in likelihood of crash intensity. These findings provide new insights into pre-crash factors, especially human factors and safety–critical events. The study highlights the importance of considering human factors in designing driver assistance systems and developing safer vehicles. This research contributes by examining naturalistic driving data at the microscopic level with early detection of behaviors that lead to SCEs and provides a basis for future research on automation.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Endogeneity of pedestrian survival time and emergency medical service response time: Variations across disadvantaged and non-disadvantaged communities

The Vision Zero-Safe Systems Approach prioritizes fast access to Emergency Medical Services (EMS) to improve the survivability of road users in transportation crashes, especially concerning the recent increase in pedestrian-involved crashes. Pedestrian crashes resulting in immediate or early death are considerably more severe than those taking longer. The time gap between injury and fatality is known as survival time, and it heavily relies on EMS response time. The characteristics of the crash location may be associated with EMS response and survival time. A US Department of Transportation initiative identifies communities often facing challenges. Six disadvantaged community (DAC) indicators, including economy, environment, equity, health, resilience, and transportation access, enable an analysis of how survival and EMS response times vary across DACs and non-DACs. To this end, this study created a unique and comprehensive database by linking DACs data with 2017–2021 pedestrian-involved fatal crashes. This study utilizes two-stage residual inclusion models with segmentation for DACs and non-DACs accounting for the endogenous relationship between EMS response and pedestrian survival time. The results indicate that EMS response time is higher and pedestrian survival time is lower in DACs than in non-DACs. A delayed EMS response time is associated with a greater reduction in survival time in DACs compared to non-DACs. Factors, e.g., nighttime and interstate crashes, contribute to higher EMS response time, while pedestrian drugs, driver speeding, and hit-and-run behaviors are associated with a greater reduction in survival time in DACs than non-DACs. Finally, the implications of the findings are discussed in the paper.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Automated tabletop exfoliation and identification of monolayer graphene flakes

Over the past two decades, graphene has been intensively studied because of its remarkable mechanical, optical, and electronic properties. Initial studies were enabled by manual “Scotch Tape” exfoliation; nearly two decades later, this method is still widely used to obtain chemically pristine flakes of graphene and other 2D van der Waals materials. Unfortunately, the yield of large, pristine flakes with uniform thickness is inconsistent. Thus, significant time and effort are required to exfoliate and locate flakes suitable for fabricating multilayer van der Waals heterostructures. Here, we describe a relatively affordable tabletop device (the “eXfoliator”) that can reproducibly control key parameters and largely automate the exfoliation process. In a typical exfoliation run, the eXfoliator produces 3 or more large (≥ 400 μm 2 ) high-quality graphene monolayer flakes, allowing new users to produce such flakes at a rate comparable to manual exfoliation by an experienced user. Furthermore, we use an automated mapping system and a computer vision algorithm to locate candidate flakes. Our results provide a starting point for future research efforts to identify more precisely which parameters matter for the success of exfoliation and to optimize them.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Verifiable Fuel Cycle Simulation

The Verifiable Fuel Cycle Simulation (VISION) is a system-dynamics model of the entire nuclear fuel cycle, from mining to disposal, using user-defined deployment scenarios, fuel recipes, and recycling parameters. It is written in the PowerSim simulation environment and utilized MS Excel to manage data inputs and outputs.

Hays, RossD (0000000184587539)↗
DOE OSTI2026

Improvements in Mirror Surface Measurement with Reflected Computer Vision Targets

Over the last several years, NREL has been developing a system to measure large optical surfaces of heliostat mirrors by reflecting computer vision targets. An advantage of this system, called Reflected Target Nonintrusive Assessment (ReTNA), is that it lends itself well to stitching together many images, each reflecting only part of a larger heliostat. In the last few months, this was taken to a new extreme, with a small target (<5m2) being used to measure a >25m2 long focal length heliostat. These measurements were compared with traditional fringe deflectometry methods, which require a >50m2 target, and photogrammetry. The strengths, weaknesses and limitations of ReTNA are discussed. An estimated uncertainty in this new measurement is presented, along with software improvements and a new wireless data collection system. A bill of materials for this measurement system is presented, which has been designed to use all low-cost, off-the-shelf components. Finally, the next steps for future ReTNA development are presented. Overall, ReTNA can be a valuable optics measurement system, complimentary to existing measurement techniques available for large reflective surfaces.

14 SOLAR ENERGY↗
DOE OSTI2021

Clean Grid Vision: A U.S. Perspective - Chapter 1. Clean Grid Scenarios

Chapter 1: Clean Grid Scenarios serves as a broad introduction to the type of future power systems envisioned in the Clean Grid Vision: one with high penetrations of variable renewable energy generation (for example, more than 53% nationally and up to 73% in the Eastern Interconnection) and significant share of natural gas. Our study shows that the conterminous United States has adequate resources to support such systems with current technologies, and these systems can be operated cost-effectively to meet all sub-hourly demand and reserve requirements.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Infrared-Fused Vision-Based Thermoregulation Performance Estimation for Personal Thermal Comfort-Driven HVAC System Controls

Thermal comfort is one of the primary factors influencing occupant health, well-being, and productivity in buildings. Existing thermal comfort systems require occupants to frequently communicate their comfort vote via a survey which is impractical as a long-term solution. Here, we present a novel thermal infrared-fused computer vision sensing method to capture thermoregulation performance in a non-intrusive and non-invasive manner. In this method, we align thermal and visible images, detect facial segments (i.e., nose, eyes, face boundary), and accordingly read the temperatures from the appropriate coordinates in the thermal image. We focus on the human face since it is often clearly visible to cameras and is not merged into a hot background (unlike hands). We use a regularized Gaussian Mixture model to track the thermoregulation changes over time and apply a heuristic algorithm to extract hot and cold indices. We present a personalized and a generalized comfort modeling method, selected based on the availability of the occupant historical indices measurements in a neutral environment, and use the time-series of the hot and cold indices to define corrections to HVAC system operations in the form of setpoint constraints. To evaluate the efficacy of our proposed approach in responding to thermal stimuli, we designed a series of controlled experiments to simulate exposure to cold and hot environments. While applying personalized modeling showed an acceptable average accuracy of 91.3%, the generalized model’s average accuracy was only 65.2%. This shows the importance of having access to physiological records in modeling and assessing comfort. We also found that individual differences should be considered in selecting the cooling and heating rates when some knowledge of the occupant’s overall thermal preference is available.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗