Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Adversarial Attacks on Deep Neural Network-based Power System Event Classification Models

Online event classification is essential to strengthening the reliability of the power transmission system. Recently, deep learning based methods have achieved great success in numerous domains such as computer vision and natural language processing. Researchers began to adopt deep learning based methods to solve the power system event identification problem and achieved effective results. However, these previous works do not consider that deep learning models are vulnerable to adversarial attacks, potentially influencing real-world applications' reliability. In this paper, we adopt several adversarial attack mechanisms by adding tailored noise signal to the input Phasor Measurement Units (PMU) time series and make the deep learning model misclassify the power system event. This numerical study discloses that current state-of-the-art deep learning based power system event classifiers are extremely vulnerable to adversarial attacks, which may jeopardize the reliability of the power transmission system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Next Generation System Analysis Model: Recently Added Features and Future Plans

To better enable informed decision-making regarding the back-end of the nuclear fuel cycle, the Integrated Waste Management System (IWMS) program within the U.S. Department of Energy, Office of Nuclear Energy (DOE-NE) has been sponsoring the development and application of system analysis tools capable of analyzing various system options for the management of spent nuclear fuel (SNF) and high-level radioactive waste (HLW).With these tools, IWMS architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). The Next Generation System Analysis Model (NGSAM) is an agent-based simulation software tool expressly designed to be capable of modeling features within various IWMS architectures. NGSAM imports data from Oak Ridge National Laboratory (ORNL)’s unified database (e.g., historic assembly information, thermal profiles for assembly heat, and at-reactor dry storage loadings) to ensure that each simulation initializes with a realistic representation of the state of commercial SNF in the U.S. Recent major enhancements implemented into NGSAM in the period since NGSAM was last presented at the WM2019 conference include: • Tracking of railroad escort car acquisition and buffer car acquisition • The addition of heavy haul truck (HHT) and barge routes for some sites, as well as support for user-defined inter-modal routes • Updates to the logic that checks the transportation cask thermal limit maps prior to package transport • An allocation method that predicts when reactor sites would pack assemblies from their spent fuel pools for dry storage, and prioritizes shipments directly from the pools of those reactor sites in the preceding periods (before the predicted loadings to dry storage), thus reducing the number of casks loaded into dry storage at reactor sites • The addition of “reactor site family” operational limits to restrict the number of loads of SNF taken from the pool and from dry storage at a given reactor site each year • Added support for multiple canister loading map options and packages with multiple compatible transportation overpacks • Updates to the handling of non-commercial SNF, including a new database that contains data to support the updates • Updates to allow analysis of hypothetical scenarios which include repackaging at reactor sites, e.g., for possible comparative analysis with other scenarios • Implementation of additional output reports, or modification of existing ones • The ability to generate and implement user edits via the NGSAM website • The ability to model loading SNF from pool storage at an interim storage facility (ISF) into dry storage at the ISF • The ability to model consolidating SNF from different existing storage containers at a DOE site into the same DOE standard canister • The ability to model transferring SNF casks from one transportation mode to another, e.g., from HHT to rail, referred to as transloading. These new features have improved NGSAM capabilities and users’ experience with the model. Preliminary NGSAM requirements for modeling advanced reactor fuels, reprocessing, treatment, and conditioning were considered, and this paper describes them at a high level. Other nuclear fuel cycle system analysis tools developed under sponsorship of DOE-NE, like the VISION code developed at Idaho National Laboratory, might be better suited for initial high-level analysis of those technologies and advanced fuel cycles. As technologies are developed and system concepts evolve, NGSAM could provide value by providing more detailed modeling of transport, storage, and disposal of spent fuel and wastes from advanced reactors and advanced fuel cycles at the fuel element and waste container level.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Selective Amnesia using Contrastive Subnet Erasure for Class Level Unlearning in Vision Models

We study concept-level forgetting in pretrained vision models: removing an entire semantic category so the system no longer recognizes that object in unseen images and contexts, rather than merely forgetting specific training examples. Prior work either applies blunt global projections or fine-tunes parameters, which can introduce collateral damage to unrelated features, add compute, and become unstable as forgetting strength increases. We introduce Contrastive Subnet Erasure (CSE), a training-free, encoder-centric edit that targets a compact set of channels most responsible for the class and attenuates them in a calibrated manner. The modification is algebraically folded into the subsequent layer, yielding no inference-time overhead and leaving task heads unchanged. To evaluate whether forgetting generalizes beyond the data used to specify the class, we introduce a cross dataset protocol in which the class is defined on a source dataset and performance is measured on a disjoint target dataset drawn from a different distribution with no shared images. This setup tests whether the model still fails to recognize the object when it looks different or appears in new scenes, and it helps avoid overfitting to patterns in the source dataset. Across CIFAR 10, CIFAR 100, and ImageNet under this protocol, CSE achieves stronger forgetting of the target class while better preserving non target utility than existing baselines in both single class and multi class settings. Overall, CSE provides a simple, stable, and deployment-ready mechanism for class-level unlearning in vision.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗
DOE OSTI2020

Iron-Doped Sodium Vanadium Oxyflurophosphate Cathodes for Sodium-Ion Batteries—Electrochemical Characterization and In Situ Measurements of Heat Generation

Sodium-ion batteries (NaIBs) are increasingly being envisioned for grid-scale energy-storage systems because of cost advantages. However, implementation of this vision has been challenged by the low-energy densities delivered by most NaIB cathodes. Toward addressing this challenge, the authors report the synthesis and characterization of a new iron-doped Na 3 Fe 0.3 V 1.7 O(PO 4 ) 2 F 2 cathode using a novel facile hydrothermal route. The synthesized material was characterized using scanning electron microscopy, X-ray diffraction, and Mössbauer spectroscopy techniques. The obtained discharge capacity in the half-cell configuration lies from 119 to 125 to 130 mA h/g at C/10 while tested using three different electrolyte formulations, dimethyl carbonate–ethylene carbonate (EC)–propylene carbonate (PC), diethyl carbonate–EC, and EC–PC, respectively. The synthesized cathodes were also evaluated in full-cell configurations, which delivered an initial discharge capacity of 80 mA h/g with NaTi 2 (PO 4 ) 3 MWCNT as the anode. Ionic diffusivity and interfacial charge transfer kinetics were also evaluated as a function of temperature and sodium concentration, which revealed that electrochemical rate performances in this material were limited by charge-transfer kinetics. To understand the heat generation mechanism of the Na/Na 3 Fe 0.3 V 1.7 O(PO 4 ) 2 F 2 half-cell during charge and discharge processes, an electrochemical isothermal calorimetry measurement was carried out at different current rates for two different temperatures (25 and 45 °C). The results showed that the amount of heat generated was strongly affected by the operating charge/discharge state, C-rate, and temperature. Altogether, this work provides a new synthesis route for the development of iron-doped Na 3 Fe 0.3 V 1.7 O(PO 4 ) 2 F 2 -based high-performance sodium cathode materials aimed at providing a viable pathway for the development and deployment of large-scale energy-storage based on sodium battery systems.

25 ENERGY STORAGE↗
DOE OSTI2022

Vision 0.3.2 Users Guide: Revision 0

Vision is a research software application developed by Pacific Northwest National Laboratory (PNNL) that incorporates the scientific and operational expertise for reviewing data from treaty monitoring radionuclide stations. These stations are part of a worldwide network to monitor for nuclear explosions, and the data they produce are critical to make the determination of whether a sample is from a nuclear explosion or some other source (i.e., nuclear reactor or medical isotope production facility). Stations deliver their measurements and system status to the International Monitoring System (IMS), which forwards it via email to all subscribers. Vision provides tools for viewing and analyzing these stations’ state of health data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

To Exascale and Beyond—The Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM), a Performance Portable Global Atmosphere Model for Cloud-Resolving Scales

The new generation of heterogeneous CPU/GPU computer systems offer much greater computational performance but are not yet widely used for climate modeling. One reason for this is that traditional climate models were written before GPUs were available and would require an extensive overhaul to run on these new machines. In addition, even conventional “high–resolution” simulations don't currently provide enough parallel work to keep GPUs busy, so the benefits of such overhaul would be limited for the types of simulations climate scientists are accustomed to. The vision of the Simple Cloud-Resolving Energy Exascale Earth System (E3SM) Atmosphere Model (SCREAM) project is to create a global atmospheric model with the architecture to efficiently use GPUs and horizontal resolution sufficient to fully take advantage of GPU parallelism. After 5 years of model development, SCREAM is finally ready for use. In this paper, we describe the design of this new code, its performance on both CPU and heterogeneous machines, and its ability to simulate real-world climate via a set of four 40 day simulations covering all 4 seasons of the year.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Meta-optic accelerators for object classifiers

Rapid advances in deep learning have led to paradigm shifts in a number of fields, from medical image analysis to autonomous systems. These advances, however, have resulted in digital neural networks with large computational requirements, resulting in high energy consumption and limitations in real-time decision-making when computation resources are limited. Here, we demonstrate a meta-optic–based neural network accelerator that can off-load computationally expensive convolution operations into high-speed and low-power optics. In this architecture, metasurfaces enable both spatial multiplexing and additional information channels, such as polarization, in object classification. End-to-end design is used to co-optimize the optical and digital systems, resulting in a robust classifier that achieves 93.1% accurate classification of handwriting digits and 93.8% accuracy in classifying both the digit and its polarization state. This approach could enable compact, high-speed, and low-power image and information processing systems for a wide range of applications in machine vision and artificial intelligence.

42 ENGINEERING↗
DOE OSTI2020

Basic Design Layout of a Modular Pumped Hydro Teaching Unit

This work was originally completed in July 2015 as a proposal to Santa Fe Community College (SFCC) for their engineering program and a follow up to a feasibility study completed for the Community College the year earlier as indicated below. The work was ahead of its time and funding was hard to obtain to implement a project. This work is now being formally released for distribution to a wider audience based on the evolving circumstances in greater society that now favor this approach with funding more readily available. Due to the distribution outside of SFCC, specific architectural drawing sets of the pertinent buildings called out in the design have been removed. No changes to the design have been made. The design layout utilizing a building is not meant to limit the implementation of the design. The elevation difference required may be obtained with a building, a small hill, jacking up the upper tank, or similar means. The design presented is a basic design, identifying major components and how they are connected together. The user may change components under their own liability. All local applicable codes and standards must be followed when building an actual unit, under the authority of a responsible engineer or owner. Appropriate measures must be followed to protect people from hazards such as electricity, water pressure, and general construction. A leak test to verify water tightness of the system should be conducted prior to any operations. The vision of this design is to allow a class of 10 to 15 students to construct the assembly within a month or so time period, and then learn to operate the assembly at their school location under the guidance of their instructor. This will allow the students to learn about the practical concept of storing electricity with water, and gain a hands on experience of the real world challenges faced with full Modular Pumped Hydro Projects.

13 HYDRO ENERGY↗
DOE OSTI2022

Integrated Monitoring of Macroalgae Farms Using Acoustics and UUV Sensing

The vision of this project was to develop an integrated system for autonomous underwater vehicle (AUV) monitoring of offshore kelp farms using acoustic, environmental, and optical sensors. This project supports the overall MARINER goals of developing an offshore kelp aquaculture industry to produce low-carbon or carbon-neutral biofuels. The project commenced in the spring of 2018 and used laboratory experiments to test the efficacy of acoustic sensors for monitoring kelp farm lines and growing kelp biomass. Sensors were then integrated onto two AUVs as well as an autonomous surface vehicle in order to establish the optimal type, price point, and vehicle to most efficiently monitor kelp farm structures, kelp biomass, and the surrounding environment. Multiple field deployments of these vehicles and sensors in Massachusetts, New Hampshire, and Maine confirmed that farm lines and kelp could be visualized and that monitoring the spatial patterns of environmental variables was possible. The COVID-19 pandemic severely limited fieldwork activities and laboratory testing, with deployments around kelp farms not occurring again until January 2021. Time spent away from the field focused on data visualization and the development of a low-cost, vessel-based sensor system. Unfortunately, the low-cost system experienced a disk failure during its first deployment and due to multiple resignations from the project team further engineering and development was not possible. Additionally, final results from acoustic sensor testing in 2021 were also not able to be completed due to the resignation of the postdoc leading the analysis. Despite these setbacks, multiple avenues for further development of optical imagery processing from the 360-degree Kelpcam camera and testing of the low-cost sensor system may be possible.

09 BIOMASS FUELS↗
DOE OSTI2025

Real-time process monitoring and automated control for direct ink write 3D printing of frontally polymerizing thermosets

Additive manufacturing (AM) enables the fabrication of complex geometries, yet its application to thermosets remains limited by post-processing requirements. Frontal ring-opening metathesis polymerization (FROMP) offers a promising alternative, enabling energy-efficient, in situ curing of freestanding thermoset structures. This study presents a real-time process monitoring and automated control system for direct ink writing (DIW) of FROMP thermosets. By integrating thermochromic leuco dyes and computer vision, we enable real-time polymerization front tracking, allowing autonomous printing parameter adjustments for consistent geometries across resin formulations. The system’s accuracy was validated against manual tracking, demonstrating precise front velocity detection. Its adaptability was confirmed by printing freestanding mechanical springs with different resins, achieving consistent geometries and mechanical properties despite front velocity variations. These findings highlight the potential of automated DIW control for scalable, repeatable, and material-agnostic 3D printing of thermosets.

Mejia, Edgar Brian [Sandia National Laboratories (↗
DOE OSTI2026

Machine Learning on Heterogeneous, Edge, and Quantum Hardware for Particle Physics (ML-HEQUPP)

The next generation of particle physics experiments will face a new era of challenges in data acquisition, due to unprecedented data rates and volumes along with extreme environments and operational constraints. Harnessing this data for scientific discovery demands real-time inference and decision-making, intelligent data reduction, and efficient processing architectures beyond current capabilities. Crucial to the success of this experimental paradigm are several emerging technologies, such as artificial intelligence and machine learning (AI/ML) and silicon microelectronics, and the advent of quantum algorithms and processing. Their intersection includes areas of research such as low-power and low-latency devices for edge computing, heterogeneous accelerator systems, reconfigurable hardware, novel codesign and synthesis strategies, readout for cryogenic or high-radiation environments, and analog computing. This white paper presents a community-driven vision to identify and prioritize research and development opportunities in hardware-based ML systems and corresponding physics applications, contributing towards a successful transition to the new data frontier of fundamental science.

Gonski, Julia [SLAC]↗
DOE OSTI2024

Using Fiducial Markers for Pose Estimation of an OSWEC in a Wave Tank: Preprint

In this study, we consider a novel method of sensing the motion of a wave energy converter during testing in a wave flume under the influence of incoming waves. The wave energy converter considered in our research is an oscillating surge wave energy converter, which is a hinged paddle that responds to incoming waves. Motion sensing is normally done with inertial sensors, which can hinder the motion due to suspended cables that carry power and transmit signals. Our proposed method is contactless and can be implemented economically. A camera is used to record different marker patterns affixed to the moving paddle and the motion deduced by pose estimation algorithms. Fiducial markers are commonly used for robot localization and in augmented reality. There are many types of fiducial markers, including ArUco-type markers which are accurate, fast and robust. The system consists of markers attached to the paddle element and recorded using a machine vision camera. A pose estimation algorithm is then applied to the detected markers to estimate the tilt of the paddle. In this work, we examine the challenges of image acquisition and calibration for underwater targets, compare the motion obtained by this new system with a calibrated tilt sensor and identify areas where the new system may be superior.

computer vision↗
DOE OSTI2022

MultiSector Dynamics: Advancing the Science of Complex Adaptive Human-Earth Systems

The field of MultiSector Dynamics (MSD) explores the dynamics and co-evolutionary pathways of human and Earth systems with a focus on critical goods, services, and amenities delivered to people through interdependent sectors. This commentary lays out core definitions and concepts, identifies MSD science questions in the context of the current state of knowledge, and describes ongoing activities to expand capacities for open science, leverage revolutions in data and computing, and grow and diversify the MSD workforce. Central to our vision is the ambition of advancing the next generation of complex adaptive human-Earth systems science to better address interconnected risks, increase resilience, and improve sustainability. This will require convergent research and the integration of ideas and methods from multiple disciplines. Understanding the tradeoffs, synergies, and complexities that exist in coupled human-Earth systems is particularly important in the context of energy transitions and increased future shocks.

Reed, Patrick↗
DOE OSTI2020

Advanced Synchrophasor-based Application for Potential Distributed Energy Resources Management: Key Technology, Challenge and Vision

With an increasing number of distributed energy resources (DERs) integrating into the power system, the power grid is becoming more complex and uncertain. Owing to most of DERs are through grid-connected converters to integrate into the power system, the intermittent nature and resource-depended characteristic of the DERs are challenging their monitoring and control. Conventional synchronized measurement devices (SMDs) may be difficult to provide qualified data for DERs management for its accuracy and reporting-rate limitation. The monitoring systems developed basing on SMDs may be insufficient for depicting detailed dynamic manifestations of power systems with a high proportion integration of DERs. This paper shares some advanced synchrophasor-based applications developed in FNET/GridEye, which have a broad prospect for assisting system operator on the control and integration of the DERs.

Wang, Weikang↗
DOE OSTI2022

Adaptive Protective Relay Settings – A Vision to the Future

Adaptive relaying utilizes the continuously changing status of the power system as the basis for online adjustment of the power system relay settings. Fundamentally they are protection schemes that adjust settings and/or logic of operations based on the prevailing conditions of the system. These adjustments can include, but are not limited to, the logging of data for post-mortem analysis, communication throughout the system, as well as changing relay parameters. Adaptive relaying considers the fact that the status of a power system can change. These include system configuration changes, load effect, cold load pickup, end-of-line protection, transformer protection, and automatic reclosing. In this research, the author focus on the need for a secure, selective, and reliable system for adaptive overcurrent protection in T&D and Distributed Energy Systems. Various types of adaptive methods are presented and explained along with some pros and cons of each.

Mukherjee, Srijib↗
DOE OSTI2021

Scoreboard

Emerging HPC machines have given rise to enhanced compute power that far outstrips the machine's ability to save large scale results for post-processing. To combat this, in situ data analysis techniques are slowly being adopted. With in situ data management favoring workflows composed of multiple simulations and analyses connected in transit on heterogeneous machines, scientists and engineers need a tool that enables them to create data extracts, visualizations, and interactively monitor and steer their simulations. Scoreboard Phase II is a next generation analysis software that supports composite in transit workflows on heterogeneous architectures and restores interactivity to in situ data analysis through simulation monitoring and computational steering. Scoreboard provides a simulation dashboard with graphs of metrics over time, controls for setting custom simulation steering parameters, controls for managing the set of data extracts being produced in the simulation, as well as the ability to explore data extracts, all from a web browser. Realizing the vision outlined in this project required research into making a system that integrates end to end from simulations all the way to the user. In situ tools generally suffer from complexity and excessive software dependencies. Scoreboard, by contrast, is easy to build and integrate into simulation codes and it provides first class FORTRAN support. The Scoreboard library is capable of in situ and in transit data analysis that can produce data extracts commonly needed for Computational Fluid Dynamics (CFD) analysis. Simulations can transparently stage data in transit to a Scoreboard Endpoint program, which can accept their data and produce the requested data extracts. This lets simulations return to their work while the Endpoint works on the analysis. Efficiently staging the data at scale was a topic of this research. Scoreboard provides the means to let the user manage data extracts and monitor/steer many simulations from a web browser. This area of the research focused on discovery of in transit network components to expose and control their steering parameters within an interactive browser-based user interface that includes: system topology, gathered metrics, notifications, dynamically-generated steering controls, and exploration of visualization data products.

Whitlock, BradJoseph [Intelligent Light] (00000001↗
DOE OSTI2022

High-Accuracy Angle Generator for Angular Calibrations to Support Optical Metrology Laboratories and Light Source Facilities

The overarching vision for this project was to build the most accurate full-rotation angular positioning system in the Americas, and that goal remains. In labs performing similar work, the environment is typically closer to a clean room than an office space, like we had before the upgrades. We are now positioned to achieve our intended result with our upgraded infrastructure, system hardware, calibration techniques, and software. As detailed below, the combination of the pandemic schedule and technical challenges have set us back, but we will continue on the path toward our vision beyond the end of this Phase 2. It’s too important for us, for industry, and for the nation not to do so.

47 OTHER INSTRUMENTATION↗