Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Artificial Intelligence and Computer Vision for Cost-Effective Benthic Habitat Characterizations

Machine learning applied to computer vision and pattern recognition is a type of artificial intelligence that has advanced rapidly in the last 10 to 15 years, spurred forward by breakthroughs in deep convolutional neural networks. These state-of-the-art methods are poised to become widely used in environmental monitoring applications as a result of the increasing abundance of data available from different imaging platforms (e.g., fixed-point cameras, drone surveys, high-resolution satellite data) that can be analyzed to observe, model, and understand environmental conditions. Computer vision and pattern recognition (CVPR) tools advance our ability to use imagery and camera-based tools in cost-effective ways for environmental monitoring. Although these techniques offer great potential, some challenges remain, such as the need for large sets of labeled images for model training and validation and optimized hardware and software to ensure that the models can be trained effectively and in a reasonable amount of time. Here, we have overcome many of these rate-limiting challenges by using a diverse image library built across multiple projects coupled with staff expertise and onsite computing resources. We are working toward a fully automated SPI processing system and also are moving to develop CVPR analytical tools for other imaging platforms and data sets.

02 PETROLEUM↗
DOE OSTI2021

Chapter 18: Learning and Tracking Ad Hoc Fiducial Markers in Spatial Augmented Reality

We describe a spatial augmented reality system with a tangible user interface used to control computer simulations of complex systems. In spatial augmented reality, the user’s physical space is augmented with projected imagery, blending real objects with projected information, and a tangible user interface enables users to manipulate physical objects as controllers for interactive visualizations. Our system learns ad hoc objects in the user’s environment as fiducial markers (i.e., objects that are visually recognized and tracked). When combined with simulation and visualization tools, these interfaces allow the user to control simulations or ensembles of simulations via physical objects using apt metaphors. While other research has leveraged the use of depth cameras, our system enables the use of standard cameras in readily available smartphones and webcams and has an implementation that runs completely in JavaScript in the web browser. We discuss the prerequisite object-recognition requirements for such tangible user interfaces and describe computer-vision and machine-learning algorithms meeting those requirements. We conclude by presenting example applications, which are also available online.

energy distribution↗
DOE OSTI2022

DOE OE 2021 Strategy White Papers on Microgrids: Program Vision, Objectives, and R&D Targets in 5 and 10 years–Topic Area #1

This white paper describes the program vision, objectives, and R&D targets in 5 to 10 years for the Department of Energy (DOE) Office of Electricity (OE) Microgrid R&D Program. The vision is to facilitate the nation’s transitions to (1) a more resilient and reliable, (2) more decarbonized electricity infrastructure, in which (3) microgrids have a reduced cost to implement. This strategy is developed in the context that the United States’ electricity delivery system is becoming more distributed in nature. The electricity generation capacity in 10 years may be 30-50% distributed energy assets.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Next Generation Logistics Systems for Delivering Optimal Biomass Feedstocks to Biorefining Industries in the Southeastern U.S.

The diverse portfolio of biomass sources that is available in the Southeastern U.S., including a significant supply of pine “residue”, represents a valuable strategic position for the region. Through blends formulated based on critical properties, this project will take full advantage of the range in biomass properties afforded by the portfolio to produce a consistent, high-performance feedstock for the industry, while lowering cost. Key developments being targeted to enable this potential include whole-tree transport to a state-of-the-art merchandising depot that will further access biomass from ongoing, forest industry operations. The approach will more effectively utilize the tree and distribute cost, while minimizing in-woods contamination of the woody biomass component. To implement this vision, information on the chemical composition and changes that are induced during multiple preprocessing steps (size reduction, moisture removal, densification, etc.) is needed. New NIR sensor technology will be developed for online monitoring of important biomass properties. The data will be incorporated into a statistical process control platform to improve process efficiency and meet required specifications. Advanced process models are being developed to inform the techno-economic and life-cycle assessment of the program’s impact. The new system will ultimately reduce operational risks from supply chain disruptions, and allow operation of larger-scale biorefineries.

09 BIOMASS FUELS↗
DOE OSTI2022

Volcanic electrification: recent advances and future perspectives

Abstract The electrification of volcanic plumes has been described intermittently since at least the time of Pliny the Younger and the 79 AD eruption of Vesuvius. Although sometimes disregarded in the past as secondary effects, recent work suggests that the electrical properties of volcanic plumes reveal intrinsic and otherwise inaccessible parameters of explosive eruptions. An increasing number of volcanic lightning studies across the last decade have shown that electrification is ubiquitous in volcanic plumes. Technological advances in engineering and numerical modelling, paired with close observation of recent eruptions and dedicated laboratory studies (shock-tube and current impulse experiments), show that charge generation and electrical activity are related to the physical, chemical, and dynamic processes underpinning the eruption itself. Refining our understanding of volcanic plume electrification will continue advancing the fundamental understanding of eruptive processes to improve volcano monitoring. Realizing this goal, however, requires an interdisciplinary approach at the intersection of volcanology, atmospheric science, atmospheric electricity, and engineering. Our paper summarizes the rapid and steady progress achieved in recent volcanic lightning research and provides a vision for future developments in this growing field.

58 GEOSCIENCES↗
DOE OSTI2021

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗
DOE OSTI2024

A Vision for the Science of Rare Isotopes

The field of nuclear science has considerably advanced since its beginning just over a century ago. Today, the science of rare isotopes is on the cusp of a new era with theoretical and computing advances complementing experimental capabilities at new facilities internationally. In this article we present a vision for the science of rare isotope beams (RIBs). We do not attempt to cover the full breadth of the field; rather, we provide a perspective and address a selection of topics that reflect our own interests and expertise. We focus in particular on systems near the drip lines, where one often finds nuclei that are referred to as exotic and where the role of the nuclear continuum is only just starting to be explored. An important aspect of this article is its attempt to highlight the crucial connections between nuclear structure and the nuclear reactions required to fully interpret and leverage the rich data to be collected in the next years at RIB facilities. Further, we connect the efforts in structure and reactions to key questions of nuclear astrophysics.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2026

Future Generation High Performance Computing Center (FG-HPCC): RFI Technical Considerations

Lawrence Livermore National Security, LLC (LLNS) is interested in receiving information about technologies that could be available in the 2029-2030 timeframe that may serve to enable the vision for a Future Generation High Performance Computing (HPC) Center (FG-HPCC) described in this document. The future HPC Center vision has been conceived to meet the future mission needs of the Advanced Simulation and Computing (ASC) Program within the National Nuclear Security Administration (NNSA). LLNS envisions a center composed not of many independent clusters, but of heterogeneous elements accessible to users as a single system. The capabilities will be integrated to create a scalable, flexible, yet tightly coupled computing center capable of integrated HPC, AI, and cloud-like workloads.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Building Neutron Scattering Infrastructure in Louisiana for Advanced Materials (Final Report)

The main objective of the Louisiana Consortium for Neutron Scattering (LaCNS) is to build a major neutron scattering infrastructure capable of treating both soft and hard materials. The goal is to create a sustainable effort having the quality, breadth, and depth necessary to produce competitive proposals including collaborative and center type proposals. Our scientific aim is to understand the role of coupling in emergent complex materials and its impact on the structure/property relationship and to explore how to tune the key couplings to guide the design of materials with the desired properties. This naturally includes building a base of users of the Spallation Neutron Source (SNS) and the High Flux Isotope Reactor (HFIR) in Louisiana; to train highly talented graduate and post-doctoral students in synthesis, neutron scattering, and simulation and modeling techniques, thereby helping to produce the next generation of scientist who use neutron scattering techniques as a crucial part of their research. The goal of our hard matter program is to understand the interplay between spin, charge, orbital, and lattice degrees of freedom in carefully selected complex materials. We have made considerable progress on number of complex systems including the oxide Sr3(Ru1-xMnx)2O7 where short-range magnetic ordering with anisotropic spin texture is initiated at the metal-insulator transition that clearly indicates a strong spin-charge coupling. Another critical area is in quantum materials. For example, in the topological semimetal BaMnSb2, we found a 3D canted antiferromagnetic Weyl semimetal with a 2D electronic structure and a nontrivial Berry phase. In addition, in the hexagonal chiral Mn1/3NbS2 system, we found soliton/soliton and soliton/antisoliton domain walls where the application of small fields or small currents can be used to control nanoscopic magnetic domains where the control of domain walls is crucially important for information storage. In addition, chemical transformation investigations were performed on the VISION instrument at Spallation Neutron Source (SNS). The soft matter effort was focused on understanding the role of non-covalent interactions on the structure and dynamics of fluid-based soft matter. One key focus was on sequence-defined (SD) amphiphilic peptoid polymers that allow encoding of molecular interactions and thereby systematic investigations of how charge directs the solution self-assembly of amphiphilic polymers in water. Another important area was on the dynamics of lipids self-assembled into membranes for exploring the permeability and mechanical using both neutron spin echo (NSE) spectroscopy and quasielastic neutron scattering (QENS) to distinguished between viscoelasticity and permeability at the molecular scale. Overall, the LaCNS project was quite successful, generating 145 publications and 245 presentations. Our graduate and post-doctoral students were well trained resulting in positions in national laboratories (Oak Ridge National Laboratory (ORNL), Argonne National Laboratory and Los Alamos National Laboratory), major research universities, and industry. We also developed a uniaxial pressure cell along with ORNL for SNS. A critical goal of this project was to establish a foundation for competing nationally in federally funded research programs. To this end, we were quite successful in generating over twenty-two federally and non-federally funded grants including awards from NSF, DOE, and DOD, and two early career awards. Equally important, we were able to secure a key major piece of instrumentation via a large ARO grant for a state-of-the-art electron microscope.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Leveraging artificial intelligence and advanced food processing techniques for enhanced food safety, quality, and security: a comprehensive review

Artificial intelligence is emerging as a transformative force in addressing the multifaceted challenges of food safety, food quality, and food security. This review synthesizes advancements in AI-driven technologies, such as machine learning, deep learning, natural language processing, and computer vision, and their applications across the food supply chain, based on a comprehensive analysis of literature published from 1990 to 2024. AI enhances food safety through real-time contamination detection, predictive risk modeling, and compliance monitoring, reducing public health risks. It improves food quality by automating defect detection, optimizing shelf-life predictions, and ensuring consistency in taste, texture, and appearance. Furthermore, AI addresses food security by enabling resource-efficient agriculture, yield forecasting, and supply chain optimization to ensure the availability and accessibility of nutritious food resources. This review also highlights the integration of AI with advanced food processing techniques such as high-pressure processing, ultraviolet treatment, pulsed electric fields, cold plasma, and irradiation, which ensure microbial safety, extend shelf life, and enhance product quality. Additionally, the integration of AI with emerging technologies such as the Internet of Things, blockchain, and AI-powered sensors enables proactive risk management, predictive analytics, and automated quality control. By examining these innovations' potential to enhance transparency, efficiency, and decision-making within food systems, this review identifies current research gaps and proposes strategies to address barriers such as data limitations, model generalizability, and ethical concerns. These insights underscore the critical role of AI in advancing safer, higher-quality, and more secure food systems, guiding future research and fostering sustainable food systems that benefit public health and consumer trust.

AI↗
DOE OSTI2026

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training

Distributed training increases the number of batches processed per iteration either by scaling-out (adding more nodes) or scaling-up (increasing the batch-size). However, the largest configuration does not necessarily yield the best performance. Horizontal scaling introduces additional communication overhead, while vertical scaling is constrained by computation cost and device memory limits. Thus, simply increasing the batch-size leads to diminishing returns: training time and cost decrease initially but eventually plateaus, creating a knee-point in the time/cost vs. batch-size pareto curve. The optimal batch-size therefore depends on the underlying model, data and available compute resources. Large batches also suffer from worse model quality due to the well-known “generalization gap”. In this paper, we present Tula, an online service that automatically optimizes time, cost, and convergence quality for large-batch training of convolutional models. It combines parallel-systems modeling with statistical performance prediction to identify the optimal batchsize. Tula predicts training time and cost within 7.5−14% error across multiple models, and achieves up to 20× overall speedup and improves test accuracy by ≈9% on average over standard large-batch training on various vision tasks, thus successfully mitigating the generalization gap and accelerating training at the same time.

Tyagi, Sahil [ORNL] (ORCID:0009000783144745)↗
DOE OSTI2021

2021 Thermal Energy Storage Systems for Buildings Workshop: Priorities and Pathways to Widespread Deployment of Thermal Energy Storage in Buildings

The 2021 U.S. Department of Energy's (DOE) "Thermal Energy Storage Systems for Buildings Workshop: Priorities and Pathways to Widespread Deployment of Thermal Energy Storage in Buildings" was hosted virtually on May 11 and 12, 2021. This report provides an overview of the workshop proceedings. Organized by DOE's Building Technologies Office (BTO), the National Renewable Energy Laboratory, Lawrence Berkeley National Laboratory, and Oak Ridge National Laboratory, the workshop convened more than 600 stakeholders from around the world to discuss the need for advancing the deployment of thermal energy storage (TES) in buildings. This workshop was designed to build on BTO's webinar series and 2019 workshop. The goals of this workshop were to promote discussion on TES related to: 1. Market adoption and deployment barriers, 2. Key applications and value drivers, 3. System cost, performance, and market requirements, and 4. End-use specific needs. The workshop took place over two days and consisted of keynote presentations, moderated panels, breakout sessions, and open discussion forums. The keynote presentations introduced opportunities for building TES, barriers to widespread deployment, and future visions. Moderated panel discussions presented diverse perspectives, breakout sessions provided opportunities for more intimate conversations, and open discussions captured feedback from the entire workshop group. Over the course of the two days, attendees exchanged experiences and ideas surrounding multiple aspects of TES in buildings. The first section of this report provides background on the motivations behind advancing TES for residential and commercial buildings and elaborates on the workshop objectives. The second section details the workshop structure and participant demographics. The third section provides key findings of the discussions that took place during the breakout sessions. Finally, this report details recommendations and actions to increase the TES deployment. Several recommendations from workshop attendees are presented in Table ES-1. TES holds significant potential to help increase building efficiency, grid-interactivity, and energy resilience, as well as reduce associated carbon emissions. The outputs generated from this workshop will aid stakeholders in advancing TES in buildings through a deeper understanding of the opportunities and barriers surrounding widespread deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Aqueous titanium redox flow batteries—State-of-the-art and future potential

Market-driven deployment of inexpensive (but intermittent) renewable energy sources, such as wind and solar, in the electric power grid necessitates grid-stabilization through energy storage systems Redox flow batteries (RFBs), with their rated power and energy decoupled (resulting in a sub-linear scaling of cost), are an inexpensive solution for the efficient electrochemical storage of large amounts of electrical energy. Titanium-based RFBs, first developed by NASA in the 1970s, are an interesting albeit less examined chemistry and are the focus of the present review. Ti, constituting 0.6% of the Earth’s crust and an ingredient in inexpensive white paints, is amongst the few elements (V and Mn being some others) which exhibit multiple soluble oxidation states in aqueous electrolytes. Further, the very high (approaching 10 M) solubility of Ti in low pH solutions suggests the possibility of developing exceptionally high energy density aqueous Redox Flow Batteries systems. With these advantages in mind, we present the state-of the-art in Ti-RFBs with a focus on Ti/Mn, Ti/Fe and Ti/Ce couples and systems that use Ti as an additive (such as Ti/V/Mn). The inherent advantages of inexpensive Ti actives and relatively high energy density is contrasted with potential side-reactions resulting in reduced energy efficiency. Technological pathways are presented with a view to overcoming critical bottlenecks and a vision is presented for the future development of Ti-RFBs.

25 ENERGY STORAGE↗
DOE OSTI2021

Ionizing-radiation beamline monitoring system

Embodiments are directed generally to an ionizing-radiation beamline monitoring system that includes a vacuum chamber structure with vacuum compatible flanges through which an incident ionizing-radiation beam enters the monitoring system. Embodiments further include at least one scintillator within the vacuum chamber structure that can be at least partially translated in the ionizing-radiation beam while oriented at an angle greater than 10 degrees to a normal of the incident ionizing-radiation beam, a machine vision camera coupled to a light-tight structure at atmospheric/ambient pressure that is attached to the vacuum chamber structure by a flange attached to a vacuum-tight viewport window with the camera and lens optical axis oriented at an angle of less than 80 degrees with respect to a normal of the scintillator, and at least one ultraviolet (“UV”) illumination source facing the scintillator in the ionizing-radiation beam for monitoring a scintillator stability comprising scintillator radiation damage.

Friedman, Peter S.↗
DOE OSTI2023

Ionizing-radiation beamline monitoring system

Embodiments are directed generally to an ionizing-radiation beamline monitoring system that includes a vacuum chamber structure with vacuum compatible flanges through which an incident ionizing-radiation beam enters the monitoring system. Embodiments further include at least one scintillator within the vacuum chamber structure that can be at least partially translated in the ionizing-radiation beam while oriented at an angle greater than 10 degrees to a normal of the incident ionizing-radiation beam, a machine vision camera coupled to a light-tight structure at atmospheric/ambient pressure that is attached to the vacuum chamber structure by a flange attached to a vacuum-tight viewport window with the camera and lens optical axis oriented at an angle of less than 80 degrees with respect to a normal of the scintillator, and at least one ultraviolet (“UV”) illumination source facing the scintillator in the ionizing-radiation beam for monitoring a scintillator stability comprising scintillator radiation damage.

Friedman, Peter S.↗
DOE OSTI2021

Autonomous experimentation systems for materials development: A community perspective

Solutions to many of the world's problems depend upon materials research and development. However, advanced materials can take decades to discover and decades more to fully deploy. Humans and robots have begun to partner to advance science and technology orders of magnitude faster than humans do today through the development and exploitation of closed-loop, autonomous experimentation systems. This review discusses the specific challenges and opportunities related to materials discovery and development that will emerge from this new paradigm. Our perspective incorporates input from stakeholders in academia, industry, government laboratories, and funding agencies. We outline the current status, barriers, and needed investments, culminating with a vision for the path forward. We intend the article to spark interest in this emerging research area and to motivate potential practitioners by illustrating early successes. We also aspire to encourage a creative reimagining of the next generation of materials science infrastructure. To this end, we frame future investments in materials science and technology, hardware and software infrastructure, artificial intelligence and autonomy methods, and critical workforce development for autonomous research.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Risk-based System Upgrade Planning for AOT-IC Presentation [Slides]

The number of deployed systems and different HW/SW form factors makes it difficult to maintain a complete understanding of their health which leads to a reduced level of certainty when assessing risk and trying to prioritize system upgrade efforts. AOT-IC must constantly plan and execute system upgrade and replacement projects to ensure the longevity of the control system. There are many more projects needed than the group can realistically accomplish given schedule and resource constraints. The group must prioritize their upgrade projects to choose only the highest priority projects to execute each year. Currently plans upgrade and replacement projects based on alignment with mission needs, group vision, resource availability, and qualitative risk assessments based on SME estimates. The group maintains a risk register. This is useful as a tool for shaping strategic planning but currently lacks the quantitative data and process needed to generate accurate risk assessments.

43 PARTICLE ACCELERATORS↗