SEARCH · Search NASA

Results for “Vision Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Plant Design for a Developing Bioeconomy Workshop Report: Frontier Science for the Bioeconomy Workshop Series

Recent advances in fundamental plant biology research, synthetic biology, and artificial intelligence (AI) are unlocking powerful new capabilities in plant biodesign, offering unprecedented potential to reimagine plants as programmable platforms for resource-efficient production of bioenergy, biomaterials, chemicals, and more. The U.S. Department of Energy (DOE) convened the Plant Design for a Developing Bioeconomy virtual workshop on March 12 through 14, 2025, to bring together leaders across plant science, engineering, and computation to assess the current landscape and define a bold vision for future research. Discussions during the workshop built upon findings included in DOE’s Biological and Environmental Research (BER) workshop report Overcoming Barriers in Plant Transformation: A Focus on Bioenergy Crops (U.S. DOE 2024; genomicscience. energy.gov/plant-transformation). Participants identified critical knowledge gaps, technical barriers, and emerging opportunities in the design and engineering of plant systems to support a robust, resilient domestic bioeconomy aligned with DOE’s mission.

09 BIOMASS FUELS↗

DOE OSTI2025

Spatial description of dislocation nucleation in the shock response of single-crystal aluminum

Nonequilibrium molecular dynamics simulations of shock loaded single-crystal Al in the $\langle$100$\rangle$, $\langle$110$\rangle$, $\langle$111$\rangle$, and $\langle$123$\rangle$ orientations are conducted to study elastic and plastic shockwave formation and details associated with dislocation activity. A computer vision-based approach is implemented to capture the presence of dislocations and describe their spatial characteristics in the zone of nucleation behind the propagating shockwave. The methodology developed relies on the sequences of images extracted during shock loading that show dislocation activity within a cross section of the sample. Results reveal that the spacing between activated slip systems is orientation dependent and exhibits a modest reduction for the $\langle$100$\rangle$ and $\langle$111$\rangle$ orientations as shock pressure increases. Comparisons are made to existing theoretical models. Such relationships between shock pressure and dislocation activity, extracted from molecular dynamics simulations, can be used to inform higher length scale simulations or modeling of dislocation-based plasticity during shock.

36 MATERIALS SCIENCE↗

DOE OSTI2024

"A" is for Ammonia: Why and How Fertilizer May Power the Planet [Slides]

Ammonia (chemical formula NH 3 ) is so pervasive in our history that human beings simply wouldn't exist without it: 4 billion people on this planet are fed by food grown using ammonia fertilizer, but this powerful molecule consumes nearly 2% of the world's energy supply to be produced at an industrial scale. This talk will first explore the energy challenges of ammonia's current means of industrial production, followed by a new vision for its synthesis using only renewable electricity, air and water, and opportunities to use ammonia as a hydrogen source. Fertilizer may one day fuel more than just our mouths.

08 HYDROGEN↗

DOE OSTI2025

Report of the 2025 Workshop on Next-Generation Ecosystems for Scientific Computing: Harnessing Community, Software, and AI for Cross-Disciplinary Team Science

This report summarizes insights from the 2025 Workshop on Next-Generation Ecosystems for Scientific Computing: Harnessing Community, Software, and AI for Cross-Disciplinary Team Science, which convened more than 40 experts from national laboratories, academia, industry, and community organizations to chart a path toward more powerful, sustainable, and collaborative scientific software ecosystems. To address urgent challenges at the intersection of high-performance computing (HPC), AI, and scientific software, participants envisioned agile, robust ecosystems built through socio-technical co-design—the intentional integration of social and technical components as interdependent parts of a unified strategy. This approach combines advances in AI, HPC, and software with new models for cross-disciplinary collaboration, training, and workforce development. Key recommendations include building modular, trustworthy AI-enabled scientific software systems; enabling scientific teams to integrate AI systems into their workflows while preserving human creativity, trust, and scientific rigor; and creating innovative training pipelines that keep pace with rapid technological change. Pilot projects were identified as near-term catalysts, with initial priorities focused on hybrid AI/HPC infrastructure, cross-disciplinary collaboration and pedagogy, responsible AI guidelines, and prototyping of public-private partnerships. This report presents a vision of next-generation ecosystems for scientific computing where AI, software, hardware, and human expertise are interwoven to drive discovery, expand access, strengthen the workforce, and accelerate scientific progress.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Raw_data_Batch_I: Lisle to Waterfall Glen

Date of collection: May 11, 2023 Location: DuPage County, IL This dataset contains lidar and vision data collected between Lisle, IL, and the Waterfall Glen parking lot. The vehicle started near Cass School District 63, headed east along IL 34. The vehicle then turned south along IL 83 until Interstate 55. Finally, the vehicle turned southwest along I 55 until Exit 273A and headed toward the Waterfall Glen parking lot. The data contains the following Robot Operating System (ROS) topics: - /Central_Camera_blurred – Image flow from coaxial camera heading, vehicle front. - /Left_Camera_blurred – Image flow from left camera, 60° from central camera on the left side. - /Right_Camera_blurred – Image flow from right camera, 60° from central camera on the right side. - /camera0/camera_info – Intrinsic and distortion information of left camera. - /camera0/projection_matrix – Extrinsic matrix of left camera from lidar. - /camera2/camera_info – Intrinsic and distortion information of central camera. - /camera2/projection_matrix – Extrinsic matrix of central camera from lidar. - /camera5/camera_info – Intrinsic and distortion information of right camera. - /camera5/projection_matrix – Extrinsic matrix of right camera from lidar. - /novatel/oem7/bestpos – Latitude, longitude, and elevation information from NovAtel GNSS-INS system. - /points_raw – VLP-32 lidar point cloud. - /tf – Vehicle base frame. The data are organized into a data description file and one or more ROS .bag files, dependent on original file size. The data description file provides information about the data collection date, location, and detailed mapping, while the .bag file(s) contain the actual data. Please note that for the purpose of securing personally identifiable information, all license plates and faces included in this publication have been intentionally blurred during real-time processing. ![lisle waterfall image](lisle-waterfall.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2025

Data Quality Monitoring for the Hadron Calorimeters Using Transfer Learning for Anomaly Detection

The proliferation of sensors brings an immense volume of spatio-temporal (ST) data in many domains, including monitoring, diagnostics, and prognostics applications. Data curation is a time-consuming process for a large volume of data, making it challenging and expensive to deploy data analytics platforms in new environments. Transfer learning (TL) mechanisms promise to mitigate data sparsity and model complexity by utilizing pre-trained models for a new task. Despite the triumph of TL in fields like computer vision and natural language processing, efforts on complex ST models for anomaly detection (AD) applications are limited. In this study, we present the potential of TL within the context of high-dimensional ST AD with a hybrid autoencoder architecture, incorporating convolutional, graph, and recurrent neural networks. Motivated by the need for improved model accuracy and robustness, particularly in scenarios with limited training data on systems with thousands of sensors, this research investigates the transferability of models trained on different sections of the Hadron Calorimeter of the Compact Muon Solenoid experiment at CERN. The key contributions of the study include exploring TL’s potential and limitations within the context of encoder and decoder networks, revealing insights into model initialization and training configurations that enhance performance while substantially reducing trainable parameters and mitigating data contamination effects.

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

Playa de Ponce's Advancements in Energy Affordability and Reliability

Un Nuevo Amanecer Inc. (UNA), a community-based nonprofit organization, partnered with the U.S. Department of Energy's Energy Technology Innovation Partnership Project (ETIPP) to develop a Strategic Energy Plan (SEP) for the community of Playa de Ponce on the southern coast of Puerto Rico. The SEP provides a community-driven roadmap to improve local energy systems by identifying shared priorities, strategies, and actions that support a more reliable, affordable, and resilient energy future. Over a seven-month period, researchers from the National Laboratory of the Rockies (NLR) worked with UNA, the Puerto Rico Hispanic Federation, community leaders, and residents to gather input through engagement workshops held in March and June 2025. These discussions helped define the community's energy vision and identify key challenges, including high electricity costs, unreliable service during extreme weather events, and risks to public health and safety - particularly for the community's aging population. This fact sheet summarizes the key elements of the Strategic Energy Plan, including four priority strategies organized around three focus areas identified by the community: energy reliability, safety and security, and stakeholder participation, education, and capacity building. Together, these strategies outline actionable pathways to strengthen Playa de Ponce's energy resilience and support long-term community goals. The plan serves as a shared reference for community members, local organizations, and government partners working to advance energy solutions in Playa de Ponce and complements broader municipal and island-wide planning efforts.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Playa de Ponce's Advancements in Energy Affordability and Reliability (Spanish Translation)

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Automated Programmable Logic Controller Memory Forensics Using RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and Internet-based technologies has enhanced industrial control system operations but have inadvertently increased their vulnerabilities to cyber attacks. When an industrial control system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies. Memory forensics is critical in the incident analysis process to ascertain what occurred. Approaches for analyzing the persistent memory in industrial control devices are limited and almost nonexistent for volatile memory. This chapter proposes an automated methodology for programmable logic controller memory dump analysis using computer vision and deep learning techniques. The methodology converts the sequences of bytes in a programmable logic controller memory dump to red-green-blue pixels and employs a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. The trained model is employed to automatically segment new memory images and identify forensic artifacts. Evaluation of the methodology on a Schneider Electric Modicon M221 programmable logic controller under code injection and code modification attacks demonstrates its ability to detect attack artifacts in memory dumps.

Asmar Awad, Rima [ORNL] (ORCID:0000000233407742)↗

DOE OSTI2026

Developing a Digital Twin for SRF Cavity Assembly at Fermilab

When assembling Superconducting Radio Frequency (SRF) Cavities, maintaining an environment devoid of particulates like dust and other small particles is essential. If a single spec of dust enters the cavity a significant degradation of performance can occur. To avoid a cavity failure Fermilab assembles the SRF cavities within a ISO-4 (Class 10) environment. This environment though is still susceptible to foreign contaminants when technicians enter and new components are added to the cleanroom. To reduce the risk even more Fermilab has introduced a cobot manipulator into the cleanroom environment to speed up the assembly time which will reduce the time that the technicians operate in the cleanroom. But, this still leaves the potential of contaminants to enter the cleanroom if new components need to be tested within the cleanroom. This project aims to lay the groundwork to develop a Digital Twin environment of the cleanroom to aid in manufacturing processes and testing. In its simplest form, a digital twin is a bidirectional link between a physical system and its digital counterpart or twin. NVIDIA Isaac Sim is used as the digital twin foundation for the digital representation of the cleanroom, specifically for the UR16e assembly area. A simulated UR16e was used to validate the performance of Isaac Sim as a testing environment by comparing the tool center points (TCP) positional data between the simulated and digital representation of the UR16e. Due to a new vision based robotic assembly process being introduced to the cleanroom a digital representation of the physical camera was tested and validated to ensure that it will produce close to the same outcome as the physical environment. The TCP comparison results showed a peak translational error of approximately 0.1mm and rotational errors of up to 8 between the simulated and digital UR16es. While the camera validation performed with high repeatability across multiple runs, it still requires minor tuning before it can accurately replicate a physical camera.

Imburgia, Joseph [Northern Illinois U.]↗

DOE OSTI2026

Methods development towards automated, physics-informed, quantitative quality control of TRISO-SiC

Tristructural-isotropic (TRISO) fuel particles have been developed as a high-performance fuel for use in high-temperature gas-cooled reactor (HTGR) systems due to their high efficiency and stability under both normal and off-normal conditions. Broader deployment of this technology in advanced nuclear applications may benefit from quantitative quality assurance and quality control (QA/QC) methods that directly link TRISO properties to downstream performance. A key TRISO property is the SiC layer microstructure, which influences fission product retention during irradiation. However, existing QA/QC for the TRISO-SiC microstructure comprises only a qualitative visual inspection; therefore, there is a clear opportunity for the development of quantitative methods for TRISO QA/QC. Here, to this end, previous work has demonstrated an image processing approach to grain boundary (GB) identification and subsequent extraction of microstructural metrics; however, extensive twinning within the SiC layer complicates such analyses because twin GBs significantly influence microstructural metrics but are not expected to contribute to fission product transport. This study presents the initial development, training, and testing of an ML-based image segmentation algorithm designed to identify and remove twin GBs from standard backscattered electron micrographs, providing an industrially applicable, quantitative, and physically meaningful QA/QC approach for the TRISO-SiC microstructure. Although pixel-wise performance metrics for the twin predictions are low, the change in grain area and the number of GB pixels after twin removal predicted by the ML workflow are within 1% of the true values calculated using crystallographic data. This suggests that the model is well capable of predicting overall twin boundary structures and grain morphology, and continued advancement of this approach could enable automated, scalable, and physics-informed QA/QC for TRISO-SiC microstructures, supporting the reliable qualification of coated particle fuels for next-generation reactor systems.

Computer vision↗

DOE OSTI2026

Raw_data_Batch_I: Randall Road

Date of collection: June 3, 2022 Location: Randall Road, DuPage County, IL Content: “North to South” “South to North” This data set contains lidar and vision data collected along Randall Road in DuPage County, Illinois. The “South to North” folder starts at 1480 N. Orchard Road, Aurora, IL 60506, headed north along Randall Road until 238 N. Randall Road, St. Charles, IL 60174. The “North to South” folder starts from 238 N. Randall Road, St. Charles, IL 60174, headed south along Randall Road until 1480 N. Orchard Road, Aurora, IL. The data contains the following Robot Operating System (ROS) topics: - /Central_Camera_blurred – Image flow from coaxial camera heading, vehicle front. - /Left_Camera_blurred – Image flow from left camera, 60° from central camera on the left side. - /Right_Camera_blurred – Image flow from right camera, 60° from central camera on the right side. - /camera0/camera_info – Intrinsic and distortion information of left camera. - /camera0/projection_matrix – Extrinsic matrix of left camera from lidar. - /camera2/camera_info – Intrinsic and distortion information of central camera. - /camera2/projection_matrix – Extrinsic matrix of central camera from lidar. - /camera5/camera_info – Intrinsic and distortion information of right camera. - /camera5/projection_matrix – Extrinsic matrix of right camera from lidar. - /novatel/oem7/bestpos – Latitude, longitude, and elevation information from NovAtel GNSS-INS system. - /points_raw – VLP-32 lidar point cloud. - /tf – Vehicle base frame. The data are organized into a data description file and one or more ROS .bag files, dependent on original file size. The data description file provides information about the data collection date, location, and detailed mapping, while the .bag file(s) contain the actual data. Please note that for the purpose of securing personally identifiable information, all license plates and faces included in this publication have been intentionally blurred during real-time processing. ![randall road image](randall-road.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

Raw_data_Batch_I: Downers Grove to Darien

Date of collection: May 11, 2023 Location: Downers Grove to Darien, IL This dataset contains lidar and vision data collected in Downers Grove and Darien, IL. The vehicle started in Downers Grove at the intersection of Main and Ogden, headed east. At the intersection of Odgen and IL 83, it then headed south until IL 33 and then west along IL 33 until the intersection of IL 33 and Lemont Road. It then headed north along Lemont Road/Main Street until the intersection of Main and Ogden. The data contains the following Robot Operating System (ROS) topics: - /Central_Camera_blurred – Image flow from coaxial camera heading, vehicle front. - /Left_Camera_blurred – Image flow from left camera, 60° from central camera on the left side. - /Right_Camera_blurred – Image flow from right camera, 60° from central camera on the right side. - /camera0/camera_info – Intrinsic and distortion information of left camera. - /camera0/projection_matrix – Extrinsic matrix of left camera from lidar. - /camera2/camera_info – Intrinsic and distortion information of central camera. - /camera2/projection_matrix – Extrinsic matrix of central camera from lidar. - /camera5/camera_info – Intrinsic and distortion information of right camera. - /camera5/projection_matrix – Extrinsic matrix of right camera from lidar. - /novatel/oem7/bestpos – Latitude, longitude, and elevation information from NovAtel GNSS-INS system. - /points_raw – VLP-32 lidar point cloud. - /tf – Vehicle base frame. The data are organized into a data description file and one or more ROS .bag files, dependent on original file size. The data description file provides information about the data collection date, location, and detailed mapping, while the .bag file(s) contain the actual data. Please note that for the purpose of securing personally identifiable information, all license plates and faces included in this publication have been intentionally blurred during real-time processing. ![downers grove image](downers-grove-darien.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Using scalable computer vision to automate high-throughput semiconductor characterization

Abstract High-throughput materials synthesis methods, crucial for discovering novel functional materials, face a bottleneck in property characterization. These high-throughput synthesis tools produce 10 4 samples per hour using ink-based deposition while most characterization methods are either slow (conventional rates of 10 1 samples per hour) or rigid (e.g., designed for standard thin films), resulting in a bottleneck. To address this, we propose automated characterization (autocharacterization) tools that leverage adaptive computer vision for an 85x faster throughput compared to non-automated workflows. Our tools include a generalizable composition mapping tool and two scalable autocharacterization algorithms that: (1) autonomously compute the band gaps of 200 compositions in 6 minutes, and (2) autonomously compute the environmental stability of 200 compositions in 20 minutes, achieving 98.5% and 96.9% accuracy, respectively, when benchmarked against domain expert manual evaluation. These tools, demonstrated on the formamidinium (FA) and methylammonium (MA) mixed-cation perovskite system FA 1−x MA x PbI 3 , 0 ≤ x ≤ 1, significantly accelerate the characterization process, synchronizing it closer to the rate of high-throughput synthesis.

Science & Technology - Other Topics↗

DOE OSTI2026

In-line measurements of below-the-surface food deformation during drying with an interference-based optical fiber strain sensor

Real-time measurements of food deformation are important for quality control in drying, yet they pose significant challenges. In this study, we developed an interference-based optical fiber strain sensor to enable in-line, continuous, below-the-surface strain measurements in drying of soft food samples. Compared to a strain resolution of 8 × 10 -4 at zero strain and 7.2 × 10 -3 at 0.20 strain reported in our previously published work, the present study achieves markedly improved resolutions of 1.3 × 10 -4 at zero strain and 7.8 × 10 -4 at 0.25 strain, which strains are the lower and higher boundaries of the dynamic range, respectively. This nearly order-of-magnitude improvement is attributed to the unique interference-based sensing mechanism, no need for calibration to convert optical signals to strain, and the system-design-enabled immunity to fiber-disk misalignments and light source intensity fluctuations. To demonstrate the in-line process monitoring, deformation measurements of fresh banana slices and sugar cookie doughs were carried out in a benchtop oven and an industrial-scale hot-air pilot dryer, respectively. In both dryers, strain measurements were continuously measured during the whole drying process at various depths and radii below the sample surfaces, with the strains up to 25%. Computer vision was used only in the benchtop drying to confirm the faithfulness of the fiber sensor measurements and cannot provide below-the-surface measurements. The measured spatiotemporal deformation allowed us to confirm the shell-hardening effect and to determine the speed and location of large deformation changes in the whole drying process, the latter of which is related to the sample cracking. To the best of the authors’ knowledge, this study is the first to report on an interferometry-based fiber sensor to measure food deformation. This sensor and the sensing mechanism have high potential for real-time process monitoring and control to prevent over-drying or cracking during drying processes.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Employing artificial intelligence to steer exascale workflows with colmena

Computational workflows are a common class of application on supercomputers, yet the loosely coupled and heterogeneous nature of workflows often fails to take full advantage of their capabilities. We created Colmena to leverage the massive parallelism of a supercomputer by using Artificial Intelligence (AI) to learn from and adapt a workflow as it executes. Colmena allows scientists to define how their application should respond to events (e.g., task completion) as a series of cooperative agents. In this paper, we describe the design of Colmena, the challenges we overcame while deploying applications on exascale systems, and the science workflows we have enhanced through interweaving AI. The scaling challenges we discuss include developing steering strategies that maximize node utilization, introducing data fabrics that reduce communication overhead of data-intensive tasks, and implementing workflow tasks that cache costly operations between invocations. These innovations coupled with a variety of application patterns accessible through our agent-based steering model have enabled science advances in chemistry, biophysics, and materials science using different types of AI. In conclusion, our vision is that Colmena will spur creative solutions that harness AI across many domains of scientific computing.

Workflows↗

DOE OSTI2026

Raw_data_Batch_I: Garfield Ridge

Date of collection: May 4, 2023 Location: Garfield Ridge, Chicago, IL This data set contains lidar and vision data collected in Garfield Ridge, Chicago. The vehicle started from the intersection of Garfield Ridge and S. Harlem, headed east until S. Central Ave. The vehicle headed south along S. Central Ave. until West 60th Street, headed west, and turned north along S. Austin Ave. until it turned west onto W. 59th Street. The vehicle then headed north along S. Harlem Ave. and returned to the intersection of Garfield Ridge and S. Harlem. The data contains the following Robot Operating System (ROS) topics: - /Central_Camera_blurred – Image flow from coaxial camera heading, vehicle front. - /Left_Camera_blurred – Image flow from left camera, 60° from central camera on the left side. - /Right_Camera_blurred – Image flow from right camera, 60° from central camera on the right side. - /camera0/camera_info – Intrinsic and distortion information of left camera. - /camera0/projection_matrix – Extrinsic matrix of left camera from lidar. - /camera2/camera_info – Intrinsic and distortion information of central camera. - /camera2/projection_matrix – Extrinsic matrix of central camera from lidar. - /camera5/camera_info – Intrinsic and distortion information of right camera. - /camera5/projection_matrix – Extrinsic matrix of right camera from lidar. - /novatel/oem7/bestpos – Latitude, longitude, and elevation information from NovAtel GNSS-INS system. - /points_raw – VLP-32 lidar point cloud. - /tf – Vehicle base frame. The data are organized into a data description file and one or more ROS .bag files, dependent on original file size. The data description file provides information about the data collection date, location, and detailed mapping, while the .bag file(s) contain the actual data. Please note that for the purpose of securing personally identifiable information, all license plates and faces included in this publication have been intentionally blurred during real-time processing. ![garfield ridge image](garfield-ridge.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2025

"A" is for Ammonia: Why and How Fertilizer May Power the Planet

Ammonia (chemical formula NH3) is so pervasive in our history that human beings simply wouldn't exist without it: 4 billion people on this planet are fed by food grown using ammonia fertilizer, but this powerful molecule consumes nearly 2% of the world's energy supply to be produced at an industrial scale. This talk will first explore the energy challenges of ammonia's current means of industrial production, followed by a new vision for its synthesis using only electricity, air and water, and opportunities to use ammonia as a hydrogen source. Fertilizer may one day fuel more than just our mouths.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗