Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

LCLS Big Data Handling – How I Learned to Stop Worrying and Love the Data Deluge

Advanced data and computing systems are vital to Linac Coherent Light Source (LCLS) operations, data interpretation and overall scientific productivity. The transition to MHz-era operation marks a fundamental change in scale that requires new infrastructure and architectures to link LCLS to the required scale of computing needed for scientific interpretation. The LCLS-II Data System meets big data challenges by implementing configurable data reduction that can adapt to multiple science areas, real-time analysis frameworks to provide visualization and fast feedback, and the ability to transfer data to local and remote computational facilities for near real time analysis at the appropriate scale. Feature extracted information generated in the data analysis pipeline - at the edge, local compute, or remote High-Performance Computing (HPC) resources - can be used to steer experiments and inform user decisions during beam time. Artificial Intelligence and Machine Learning (AI/ML) techniques present new opportunities to rapidly analyse large datasets and direct experiments, but create new challenges in scaling, adaptability, complexity, and trustworthiness. We describe how the LCLS-II Data System architecture addresses its data-driven challenges in the areas of data acquisition, data processing, data management, and workflow orchestration to decrease the overall time-to-science and provide a vision for future developments.

artificial intelligence↗
DOE OSTI2011

Key Residential Building Equipment Technologies for Control and Grid Support PART I (Residential)

Electrical energy consumption of the residential sector is a crucial area of research that has in the past primarily focused on increasing the efficiency of household devices such as water heaters, dishwashers, air conditioners, and clothes washer and dryer units. However, the focus of this research is shifting as objectives such as developing the smart grid and ensuring that the power system remains reliable come to the fore, along with the increasing need to reduce energy use and costs. Load research has started to focus on mechanisms to support the power system through demand reduction and/or reliability services. The power system relies on matching generation and load, and day-ahead and real-time energy markets capture most of this need. However, a separate set of grid services exist to address the discrepancies in load and generation arising from contingencies and operational mismatches, and to ensure that the transmission system is available for delivery of power from generation to load. Currently, these grid services are mostly provided by generation resources. The addition of renewable resources with their inherent variability can complicate the issue of power system reliability and lead to the increased need for grid services. Using load as a resource, through demand response programs, can fill the additional need for flexible resources and even reduce costly energy peaks. Loads have been shown to have response that is equal to or better than generation in some cases. Furthermore, price-incentivized demand response programs have been shown to reduce the peak energy requirements, thereby affecting the wholesale market efficiency and overall energy prices. The residential sector is not only the largest consumer of electrical energy in the United States, but also has the highest potential to provide demand reduction and power system support, as technological advancements in load control, sensor technologies, and communication are made. The prevailing loads based on the largest electrical energy consumers in the residential sector are space heating and cooling, washer and dryer, water heating, lighting, computers and electronics, dishwasher and range, and refrigeration. As the largest loads, these loads provide the highest potential for delivering demand response and reliability services. Many residential loads have inherent flexibility that is related to the purpose of the load. Depending on the load type, electric power consumption levels can either be ramped, changed in a step-change fashion, or completely removed. Loads with only on-off capability (such as clothes washers and dryers) provide less flexibility than resources that can be ramped or step-changed. Add-on devices may be able to provide extra demand response capabilities. Still, operating residential loads effectively requires awareness of the delicate balance of occupants health and comfort and electrical energy consumption. This report is Phase I of a series of reports aimed at identifying gaps in automated home energy management systems for incorporation of building appliances, vehicles, and renewable adoption into a smart grid, specifically with the intent of examining demand response and load factor control for power system support. The objective is to capture existing gaps in load control, energy management systems, and sensor technology with consideration of PHEV and renewable technologies to establish areas of research for the Department of Energy. In this report, (1) data is collected and examined from state of the art homes to characterize the primary residential loads as well as PHEVs and photovoltaic for potential adoption into energy management control strategies; and (2) demand response rules and requirements across the various demand response programs are examined for potential participation of residential loads. This report will be followed by a Phase II report aimed at identifying the current state of technology of energy management systems, sensors, and communication technologies for demand response and load factor control applications for the residential sector. The purpose is to cover the gaps that exist in the information captured by the sensors for energy management system to be able to provide demand response and load factor control. The vision is the development of an energy management system or other controlling enterprise hardware and software that is not only able to control loads, PHEVs, and renewable generation for demand response and load factor control, but also to do so with consumer comforts in mind and in an optimal fashion.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Resolving femtosecond photoinduced energy flow: capture of nonadiabatic reaction pathway topography and wavepacket dynamics from photoexcitation through the conical intersection seam (Final Technical Report)

The dynamics that take place within just tens to hundreds of femtoseconds following the absorption of light by a molecule can play a critical role in how the absorbed energy is directed, allowing it to be used for a specific function or dissipated harmlessly. The form of chemical change that occurs rapidly in these molecules is called a “nonadiabatic electronic transition.” Such transitions are known to mediate energy flow in natural biological systems such as the ultraviolet photoprotection mechanism of DNA and the first step of the human vision response. Understanding how these mechanisms work precisely may help scientists achieve controlled manipulation of solar energy or optical control of a wide range of energy management functions in artificial systems. Experimental methods, however, have not yet allowed a precisely resolved and complete measurement of nonadiabatic electronic transitions. This constitutes a major obstacle to progress in the field. For progress to occur that would inform a wide body of research aiming to efficiently harness the energy of light for practical purposes, it is especially important to benchmark computational models of the molecules undergoing these rapid changes with experimental measurements, in order to learn which models are accurate. With Dept. of Energy funding, we have made strong progress towards establishing a new optical method for experimentally detecting the full nonadiabatic electronic transition. This requires having coordinated pulses of light covering the visible through the mid-infrared range of the electromagnetic spectrum that last only ten femtoseconds. We have developed a new, relatively simple approach for generating such pulses of laser light, and have incorporated them into a time-resolved spectrometer for measuring rapid changes in molecules. These tools can provide the greater precision and new types of data that are needed to benchmark computational models of molecular change and thus to make progress in the field. Our tools were tested on graphene, an excellent solid-state sample for verifying the capabilities and limitations of our instrumentation. The investment made in these tools by the Dept. of Energy Office of Science will allow new fundamental scientific understanding of energy dynamics in molecules in future studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2015

Office of Fusion Energy Sciences. A ten-year perspective (2015-2025)

The vision described here builds on the present U.S. activities in fusion plasma and materials science relevant to the energy goal and extends plasma science at the frontier of discovery. The plan is founded on recommendations made by the National Academies, a number of recent studies by the Fusion Energy Sciences Advisory Committee (FESAC), and the Administration’s views on the greatest opportunities for U.S. scientific leadership.This report highlights five areas of critical importance for the U.S. fusion energy sciences enterprise over the next decade: 1) Massively parallel computing with the goal of validated whole-fusion-device modeling will enable a transformation in predictive power, which is required to minimize risk in future fusion energy development steps; 2) Materials science as it relates to plasma and fusion sciences will provide the scientific foundations for greatly improved plasma confinement and heat exhaust; 3) Research in the prediction and control of transient events that can be deleterious to toroidal fusion plasma confinement will provide greater confidence in machine designs and operation with stable plasmas; 4) Continued stewardship of discovery in plasma science that is not expressly driven by the energy goal will address frontier science issues underpinning great mysteries of the visible universe and help attract and retain a new generation of plasma/fusion science leaders; 5) FES user facilities will be kept world-leading through robust operations support and regular upgrades. Finally, we will continue leveraging resources among agencies and institutions and strengthening our partnerships with international research facilities.

Source record↗
DOE OSTI2015

Office of Fusion Energy Sciences: A Ten-Year Perspective (2015-2025)

The vision described here builds on the present U.S. activities in fusion plasma and materials science relevant to the energy goal and extends plasma science at the frontier of discovery. The plan is founded on recommendations made by the National Academies, a number of recent studies by the Fusion Energy Sciences Advisory Committee (FESAC), and the Administration’s views on the greatest opportunities for U.S. scientific leadership. This report highlights five areas of critical importance for the U.S. fusion energy sciences enterprise over the next decade: 1) Massively parallel computing with the goal of validated whole-fusion-device modeling will enable a transformation in predictive power, which is required to minimize risk in future fusion energy development steps. 2) Materials science as it relates to plasma and fusion sciences will provide the scientific foundations for greatly improved plasma confinement and heat exhaust. 3) Research in the prediction and control of transient events that can be deleterious to toroidal fusion plasma confinement will provide greater confidence in machine designs and operation with stable plasmas. 4) Continued stewardship of discovery in plasma science that is not expressly driven by the energy goal will address frontier science issues underpinning great mysteries of the visible universe and help attract and retain a new generation of plasma/fusion science leaders. 5) FES user facilities will be kept world-leading through robust operations support and regular upgrades. Finally, we will continue leveraging resources among agencies and institutions and strengthening our partnerships with international research facilities.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility

One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.

domain of applicability↗
DOE OSTI2025

Basic Research Needs for Inverse Methods for Complex Systems under Uncertainty [Brochure]

The four priority research directions outlined in this brochure represent a cohesive vision for advancing the science of inverse problems for complex systems under uncertainty. Together, they address the critical challenges of: discovering, exploiting, and preserving physical and problem structure; overcoming model limitations; integrating disparate, multimodal, and/or dynamic data; and tailoring the solution of inverse problems to downstream tasks. While each PRD focuses on a distinct aspect of inverse-problem research, their interconnected nature highlights the importance of a holistic approach that leverages progress across all areas to achieve transformative solutions. This agenda calls for research across mathematics, statistics, and computer science disciplines, which are guided and complemented by rapid advances in artificial intelligence, high-performance computing, and experimental facilities, to unlock new capabilities, maximize scientific impact, and meet the growing demands of inverse problems that arise across applications that are critical to DOE's mission.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Vision Foundation Models in Remote Sensing: A survey

Artificial intelligence (AI) technologies have profoundly transformed the field of remote sensing (RS), revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, RS research has been significantly enhanced by the advent of foundation models (FMs)—large-scale pretrained AI models capable of performing a wide array of tasks with unprecedented accuracy and efficiency. This article provides a comprehensive survey of FMs in the RS domain. We categorize these models based on their architectures, pretraining datasets, and methodologies. Through detailed performance comparisons, we highlight emerging trends and the significant advancements achieved by those FMs. Additionally, we discuss technical challenges, practical implications, and future research directions, addressing the need for high-quality data, computational resources, and improved model generalization. Our research also finds that pretraining methods, particularly self-supervised learning (SSL) techniques like contrastive learning (CL) and masked autoencoders (MAEs), remarkably enhance the performance and robustness of FMs. This survey aims to serve as a resource for researchers and practitioners by providing a panorama of advances and promising pathways for the continued development and application of FMs in RS.

data models↗
DOE OSTI2014

An automated miniature robotic vehicle inspection system

A novel, autonomous reconfigurable robotic inspection system for quantitative NDE mapping is presented. The system consists of a fleet of wireless (802.11g) miniature robotic vehicles, each approximately 175 × 125 × 85 mm with magnetic wheels that enable them to inspect industrial structures such as storage tanks, chimneys and large diameter pipe work. The robots carry one of a number of payloads including a two channel MFL sensor, a 5 MHz dry coupled UT thickness wheel probe and a machine vision camera that images the surface. The system creates an NDE map of the structure overlaying results onto a 3D model in real time. The authors provide an overview of the robot design, data fusion algorithms (positioning and NDE) and visualization software.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

A systems engineering vision for floating offshore wind cost optimization

The U.S. offshore wind resource potential is immense, and often in close proximity to densely-populated coastal load centers. In many U.S. coastal areas, water depths favor the deployment of floating over fixed-bottom offshore wind technology. Floating offshore wind plants have the potential to be cost-competitive with fixed-bottom installations, but because the technology has not yet been deployed at commercial scale, it is not clear when and with what configurations this potential cost parity can be achieved. This article first reviews the state of floating offshore wind technology and deployments to identify key gaps that must be addressed to bring down the overall cost of energy produced. The article then puts forth a long-term vision for a research program and design methodology that may be able to push floating wind plants toward a lower levelized cost of energy than fixed-bottom offshore wind. The method involves a fully integrated systems-engineering and techno-economic design approach to capture the complex interactions between the physics, manufacturing, installation, and operation of floating wind turbines to achieve transformational cost reductions. The approach also envisions multifidelity and uncertainty management strategies to examine the most robust and viable concepts in the design trade-space. To better focus the computational resources, engineering lessons learned from existing offshore wind systems and concept studies are used to develop a set of criteria that can be applied to prefilter candidate technology building blocks that have the greatest cost reduction potential.

17 WIND ENERGY↗
DOE OSTI2026

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training

Distributed training increases the number of batches processed per iteration either by scaling-out (adding more nodes) or scaling-up (increasing the batch-size). However, the largest configuration does not necessarily yield the best performance. Horizontal scaling introduces additional communication overhead, while vertical scaling is constrained by computation cost and device memory limits. Thus, simply increasing the batch-size leads to diminishing returns: training time and cost decrease initially but eventually plateaus, creating a knee-point in the time/cost vs. batch-size pareto curve. The optimal batch-size therefore depends on the underlying model, data and available compute resources. Large batches also suffer from worse model quality due to the well-known “generalization gap”. In this paper, we present Tula, an online service that automatically optimizes time, cost, and convergence quality for large-batch training of convolutional models. It combines parallel-systems modeling with statistical performance prediction to identify the optimal batchsize. Tula predicts training time and cost within 7.5−14% error across multiple models, and achieves up to 20× overall speedup and improves test accuracy by ≈9% on average over standard large-batch training on various vision tasks, thus successfully mitigating the generalization gap and accelerating training at the same time.

Tyagi, Sahil [ORNL] (ORCID:0009000783144745)↗
DOE OSTI2022

Meta-optic accelerators for object classifiers

Rapid advances in deep learning have led to paradigm shifts in a number of fields, from medical image analysis to autonomous systems. These advances, however, have resulted in digital neural networks with large computational requirements, resulting in high energy consumption and limitations in real-time decision-making when computation resources are limited. Here, we demonstrate a meta-optic–based neural network accelerator that can off-load computationally expensive convolution operations into high-speed and low-power optics. In this architecture, metasurfaces enable both spatial multiplexing and additional information channels, such as polarization, in object classification. End-to-end design is used to co-optimize the optical and digital systems, resulting in a robust classifier that achieves 93.1% accurate classification of handwriting digits and 93.8% accuracy in classifying both the digit and its polarization state. This approach could enable compact, high-speed, and low-power image and information processing systems for a wide range of applications in machine vision and artificial intelligence.

42 ENGINEERING↗
DOE OSTI2022

Lens-free compound eye cameras based on angle-sensitive meta-surfaces

A lens-free ultrathin imaging sensor using a compound-eye vision modality can be formed by forming a metasurface on each pixel of an array of pixels in a solid state imaging sensor. The metasurface can be configured to form a diffraction grating that directs light incident on the metasurface at a predefined angle to excite surface plasmon polaritons into the solid state imaging sensor and light incident at any other angle is reflected or diffracted away from the metasurface. Each pixel of the imaging sensor can be configured using the metasurface to only receive light incident from a different portion of a field of view. A computational imaging system can be used to construct the image from the individual pixels.

Paiella, Roberto↗
DOE OSTI2024

Toward the validation of crowdsourced experiments for lightness perception

Crowdsource platforms have been used to study a range of perceptual stimuli such as the graphical perception of scatterplots and various aspects of human color perception. Given the lack of control over a crowdsourced participant’s experimental setup, there are valid concerns on the use of crowdsourcing for color studies as the perception of the stimuli is highly dependent on the stimulus presentation. Here, we propose that the error due to a crowdsourced experimental design can be effectively averaged out because the crowdsourced experiment can be accommodated by the Thurstonian model as the convolution of two normal distributions, one that is perceptual in nature and one that captures the error due to variability in stimulus presentation. Based on this, we provide a mathematical estimate for the sample size needed to produce a crowdsourced experiment with the same power as the corresponding in-person study. We tested this claim by replicating a large-scale, crowdsourced study of human lightness perception with a diverse sample with a highly controlled, in-person study with a sample taken from psychology undergraduates. Our claim was supported by the replication of the results from the latter. These findings suggest that, with sufficient sample size, color vision studies may be completed online, giving access to a larger and more representative sample. With this framework at hand, experimentalists have the validation that choosing either many online participants or few in person participants will not sacrifice the impact of their results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array

The bioinspired camera, comprising a single lens and a curved image sensor—a photodiode array on a curved surface—, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2021

Assessment of the High Flux Isotope Reactor Cybersecurity Initiative

Recent cyber-attacks on industrial control systems, and inadvertent exposure of nuclear plant systems to cyber-exploits underscore the need for plant operators to adopt and deploy cyber-security defense solutions made for industrial control systems. Of increasing concern is the fact that international cyber hackers are beginning to target critical infrastructure, and because these more modern controls systems depend on advanced use of digital systems, they are more vulnerable than ever before to cyber-attacks. Traditional cyber defense strategies and products that have been available for decades are tailored for use on IT or corporate networks but can cause interruptions and catastrophic damage when deployed on industrial control system networks. The Department of Energy (DOE) Office of Nuclear Energy established the Gateway for Accelerated Innovation in Nuclear (GAIN) program to provide private companies pursuing innovative nuclear energy technologies with access to the technical support necessary to move toward commercialization. One of these GAIN small business vouchers was awarded to Dragos, Inc. to enable collaboration with Oak Ridge National Laboratory (ORNL) to evaluate the Dragos Platform on a production nuclear reactor test bed, hence laying the path for future commercial adoption. The vision was to provide a guide for industrial operators on implementing an industrial monitoring solution and to show how these solutions can be deployed without causing safety and reliability issues. This report documents the results of the collaboration between ORNL and Dragos, Inc.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

The VIBES Are Shifting: Assessing Emergent Capabilities in Multi-Modal Models

Researchers assessing open-source domains such as the internet, and particularly those studying information conflict, often have no single prescribed workflow. In the course of their research, they may need to perform a diverse array of tasks far beyond simply identifying an ever-changing set of objects. These analytical tasks can include ascertaining the provenance of images, understand an image in the context of accompanying text-based data, or identifying indicators of digital image manipulation. They must further be able to do this at the scale of tens of thousands of images or more. Traditional machine vision models have typically lacked the flexibility and breadth of performance sufficient for these needs. The research team from Pacific Northwest National Laboratory assessed the performance of a single baseline CLIP ViT-L model against a series of analytical tasks relevant for the study of online information conflict.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Deep learning approaches for neural decoding across architectures and recording modalities

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain–computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. Here, we describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

59 BASIC BIOLOGICAL SCIENCES↗