Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Clean Hydrogen Production R&D at NREL

Comprehensive, concerted efforts supported by the U.S. Department of Energy (DOE), Office of Energy Efficiency and Renewable Energy (EERE), Hydrogen and Fuel Cell Technologies Office (HFTO) are advancing research and development to demonstrate clean hydrogen production and industrial decarbonization pathways. These pathways enable an economically competitive and environmentally beneficial future energy system across sectors and can address specific applications that are difficult to decarbonize. NREL's research accelerates development, integration, and scale up of hydrogen and fuel cell technologies to enable widespread deployment across multiple energy sectors. Our work helps industry overcome technical challenges and supports DOE's H2@Scale vision for clean hydrogen across multiple applications and economic sectors. We also bridge technologies with other research areas across the lab and through multiple DOE and national lab research initiatives, consortia, and collaborations including: H2NEW: Hydrogen from Next-generation Electrolyzers of Water Consortium, HydroGEN: Advanced Water Splitting Materials Consortium, H2@Scale CRADA, and helping de-risk the hydrogen systems via large-scale validation and demonstration.

clean hydrogen↗
DOE OSTI2026

RDPP: Accelerating Diversity in DOE Climate Science and Resilience Research (Final Report)

The scope of the project was set out to accelerate the inclusion of diversity into the Department of Energy (DOE) Earth and Environmental Systems Sciences Division (EESSD) relevant climate science and resilience research to inclusively advance solutions. The Project Objectives were to usher in equitable use-inspired climate-related research with underrepresented Minorities of which this project helped fund 7 HU graduate students work with the DOE (three of which will graduate in Spring 2025). The two key aims underpinning that core goal were AIM1: developing partnerships (18 organized engaged, see partners list) and AIM2: Developing capabilities (3 visits to DOE facilities, 5 DOE partners visits to HU, increased visiting faculty participation in BNL-DOE lab, secured 5 grants together totaling 1.2 million in funds for HU). The project objectives were highly successful as they were designed to ambitiously pull together DOE lab researchers with the long-standing and successful transdisciplinary climate science research programs of the PI and local DC groups. The major outcomes of this RDPP program will be in the new fundamentally inclusive partnerships with DOE and HU tasked to understand the urban-rural impacts due to climate change in the US, Eastern South Atlantic (ESA) Region, related to energy issues driven by heat stress and the water cycle. Overall, this project contributes to the DOE and science community vision for catalyze connections for project-ready underrepresented minorities (URMs) at a prominent HBCU to DOE projects supported by the Biological and Environmental research (BER) Program; particularly, the Earth and Environmental Systems Sciences Division (EESSD).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2024

A framework of computer vision-enhanced microfluidic approach for automated assessment of the transient sickling kinetics in sickle red blood cells

The occurrence of vaso-occlusive crisis greatly depends on the competition between the sickling delay time and the transit time of individual sickle cells, i.e., red blood cells from sickle cell disease (SCD) patients, while they are traversing the circulatory system. Many drugs for treating SCD work by inhibiting the polymerization of sickle hemoglobin (HbS), effectively delaying the sickling process in sickle cells (SS RBCs). Most previous studies on screening anti-sickling drugs, such as voxelotor, rely on in vitro testing of sickling characteristics, often conducted under prolonged deoxygenation for up to 1 hour. However, since the microcirculation of RBCs typically takes less than 1 minute, the results of these studies may be less accurate and less relevant for in vitro-in vivo correlation. In our current study, we introduce a computer vision-enhanced microfluidic framework designed to automatically capture the transient sickling kinetics of SS RBCs within a 1-min timeframe. Our study has successfully detected differences in the transient sickling kinetics between vehicle control and voxelotor-treated SS RBCs. This approach has the potential for broader applications in screening anti-sickling therapies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Thermographic phosphor digital image correlation

The invention advances the ratio method of phosphor thermography using two machine vision cameras for full-field temperature measurements of a solid surface. As an example, algorithms from digital image correlation (DIC) can be used to determine the stereoscopic imaging system intrinsic and extrinsic parameters, and accurately register material points on the sample to subpixel locations in each image with 0.07 px or better accuracy. A phosphor calibration sample fabricated using aerosol deposition can be used for in situ determination of the temperature-versus-intensity ratio relationship. The full calibration methodology and several improvements on two-color phosphor thermography open the door for full-field temperature measurements in dynamic tests with deforming test specimens. In particular, thermographic phosphors can be combined with stereo digital image correlation in a novel diagnostic, TP+DIC, to measure time-resolved full-field surface strains and temperatures simultaneously, thereby enabling testing in combined thermo-mechanical environments.

Winters, Caroline↗
DOE OSTI2023

A New Reflected Target Optical Assessment System: Stage 1 Development Results

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL’s outdoor Non-Intrusive Optical (NIO) measurement technique [1]. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed to require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements, making it a valuable tool for quality assurance and laboratory measurement of heliostat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. In this paper, we describe the methodology behind the measurement system, present an initial analysis of its uncertainty and sensitivity, and compare it with established optical measurement systems.

Kesseli, Devon (ORCID:0000000193113036)↗
DOE OSTI2020

Neural-based time series forecasting of loss of coolant accidents in nuclear power plants

During the last few years, deep learning in neural networks has demonstrated impressive successes in the areas of computer vision, speech and image recognition, text generation, and many others. However, sensitive engineering areas such as nuclear engineering benefited less from these efficient techniques. In this work, deep learning expert systems are utilized to model and predict time series progression of a design-basis nuclear accident, featuring a loss of coolant accident. Two major findings are accomplished in this work. First, the ability to train expert systems with high accuracy, which could help nuclear power plant operators to figure out plant responses during the accident. Second, building fast, efficient, and accurate deep models to simulate nuclear phenomena, which could be valuable to nuclear computational science. In this work, large amount of time series data is obtained from simulation tools by simulating different conditions of the base-case/nominal accident scenario. Four critical outputs/responses are monitored during the accident (e.g. temperature, pressure, break flow rate, water level). Two approaches are adopted in this work. The first approach is to use feedforward deep neural networks (DNN) to fit all time steps and outputs in a single model. The second approach is to use long short-term memory (LSTM) to fit all time steps together for each reactor response separately. Both DNN and LSTM demonstrate very good performance in predicting the test and base-case scenarios, with accuracy as low as 92% and as high as 99%, where these test scenarios are unknown to the expert systems and are not included in the model training. In addition, both approaches demonstrate a significant reduction in computational costs, as the deep expert system is able to accurately predict the accident 100,000 times faster than the original simulation tool. Given sufficient data, the methodology adopted in this study demonstrates that DNN/LSTM expert systems can be used as a decision support system to model advanced time series phenomena within nuclear power plants with high accuracy and negligible computational costs.

42 ENGINEERING↗
DOE OSTI2025

Designing Future Energy Systems with Generative AI

Energy systems are experiencing various changes that impact the distribution, use, and reliability of energy. Local utilities and municipalities must respond and adapt to these changes, moving towards a future energy system with modernized infrastructure and other targeted investments and policy decisions. However, planning for and enacting these advancements requires significant effort from experts and engineers to develop strategies that ensure a reliable and secure energy future. This includes characterizing the current energy infrastructure, identifying areas for development, and engaging with local community members. Emerging generative artificial intelligence techniques can alleviate pain points and help support the development of the next generation of energy systems. Here, in this article, we highlight on-going generative AI work in the areas of atmospheric modeling, building energy management, and distribution network design, and we propose a vision for the role of generative AI that considers opportunities and identifies challenges inherent to this technology.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Coordination and Planning for Water and Power System Resilience (Workshop Report)

Water and power utilities are interdependent, subject to many of the same natural and manmade hazards, and critical for the well-being of communities and society. In April 2021, a virtual workshop was held that brought together representatives from water, wastewater, and electric utilities; government organizations; water and electricity based professional associations; consulting firms; and researcher organizations to explore water and power system interdependencies and resilience. The workshop, organized by Pacific Northwest National Laboratory (PNNL) and funded by the United States Department of Energy (DOE) Water Power Technologies Office (WPTO), explored a vision for coordinated and resilient water and electric utilities of the future and identified barriers and strategies for increased coordination and integrated planning between water and power utilities. Workshop participants suggested next steps and areas where federal research and support would be beneficial. This report documents that key outcomes of the workshop.

13 HYDRO ENERGY↗
DOE OSTI2024

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments [Slides]

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. The ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

14 SOLAR ENERGY↗
DOE OSTI2026

Project 1: COLLECTS Project and Project 2: M&V for Saputo Cheese Project: Cooperative Research and Development (Final Report)

Project 1: Combined Power's Hyperlight Energy and NLR will collaborate on the DOE Concentrating Optics for Lower Levelized Energy CosTS (COLLECTS) project, DE-FOA-0001268. COLLECTS funding opportunity announcement (FOA) seeks to further concentrated solar power (CSP) system technologies by soliciting disruptive, transformative projects for the concentrating solar collectors in the CSP plant. These innovative projects will seek to surpass the targets set out in the SunShot Vision Study, enabling CSP to be cost-competitive with conventional forms of electric power generation. Projects will target the design and manufacturing of novel solar collectors with the ability to significantly reduce the solar field contribution to the overall levelized cost of energy (LCOE) of the CSP plant, and which have not been previously specifically targeted by CSP FOAs. Project 2: Hyperlight will perform measurement and verification (M&V) of Green House Gases and NLR will evaluate energy consumption reduction.

14 SOLAR ENERGY↗
DOE OSTI2024

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. Our ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

artificial intelligence↗
DOE OSTI2024

LBNF/DUNE Nitrogen Refrigeration System Update

The Deep Underground Neutrino Experiment (DUNE) is supported by the infrastructure of the Long Baseline Neutrino Facility (LBNF). The central feature of DUNE is the liquid argon filled cryostats, which house the neutrino detector components. In order to maintain the argon in a liquid state, heat must be continuously removed. Argon condensers will remove this heat, and liquefy the argon, through the evaporation of liquid nitrogen. The supply of liquid nitrogen relies heavily on a near-industrial scale nitrogen refrigeration/liquefaction system. The nitrogen system will be a closed loop, in which the liquid nitrogen is supplied to users and, after being vaporized, is recycled to the nitrogen liquefaction units to be liquefied again. The system will also include nitrogen generation, to increase inventory in the closed loop, as well as to make up for losses. All of this will be installed nearly one mile underground (1.5km) on the 4850 level of the Sanford Underground Research Facility (SURF). The final DUNE vision requires 400kW of liquid nitrogen cooling capacity. Based on the operation modes and phased installation of the experiment, modularity of this cooling capacity is required. Nitrogen liquefaction will occur in four units which will afford a wide operational range of production (nominally 100kW each). Due to the experiment’s location deep underground in an inactive gold mine, there are unique and challenging constraints. These include limited access, footprint, and utilities. This poster describes the engineering effort, and provides an overview of the refrigeration system. The design includes a unique compressor arrangement which is covered in detail. Pictures and models are included where possible to help visualize the system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Roadmap for Solar Photovoltaic (PV) Cybersecurity: A vision for improving cyber maturity of distributed and utility-scale solar energy installations

As the solar energy sector continues to expand, its integration into the broader energy infrastructure presents both unprecedented opportunities and new risks. The increasing reliance on digital technologies and interconnected systems in solar energy creates an expanded attack surface for motivated cyber adversaries. Cyberattacks have the potential to cause disruptions in energy production, damage to equipment, financial losses, and compromises in national security. Therefore, ensuring robust cybersecurity measures is paramount to protect the integrity, availability, confidentiality, and access control of solar energy systems. However, there are still key gaps and challenges to be addressed in industry and research, which stakeholders must race to address as they combat a growing number of real-world cyber incidents that affect solar energy systems and a growing number of vulnerabilities discovered and disclosed in key types of equipment. This roadmap explore the current state of solar PV cybersecurity and the gaps and challenges still to be addressed.

14 - SOLAR ENERGY↗
DOE OSTI2021

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Flat optics for image differentiation

Image processing has become a critical technology in a variety of science and engineering disciplines. Although most image processing is performed digitally, optical analog processing has the advantages of being low-power and high-speed, but it requires a large volume. Here, we demonstrate flat optics for direct image differentiation, allowing us to significantly shrink the required optical system size. We first demonstrate how the differentiator can be combined with traditional imaging systems such as a commercial optical microscope and camera sensor for edge detection with a numerical aperture up to 0.32. We next demonstrate how the entire processing system can be realized as a monolithic compound flat optic by integrating the differentiator with a metalens. The compound nanophotonic system manifests the advantage of thin form factor as well as the ability to implement complex transfer functions, and could open new opportunities in applications such as biological imaging and computer vision.

36 MATERIALS SCIENCE↗