VAPO: Visibility-Aware Keypoint Localization for Efficient 6DoF Object Pose Estimation
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “object localization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Architecting the Grid Edge: Ensuring Reliability and Resilience
Changes in technology, customer expectations, and business and regulatory environments are rapidly evolving causing fundamental changes in the nation’s electrical infrastructure. Nowhere is this more apparent that at the “grid edge”, where there is an increasing number of new devices and systems, as well as complex new interactions between them. This is leading to the traditional relationship between the end-use customers and their utilities being expanded by an increasing number of stakeholders, each with their own operational and financial objectives, governed by regulatory policy. While there are concerns about the rapidly increasing complexity negatively impacting reliable and resilience of the electrical infrastructure, these changes are also bringing new resources and opportunities that hold great potential if they can be properly coordinated. This white paper outlines the considerations for the coordination of multi-stakeholder objectives with electric utility requirements using the concept of grid services. Describing a framework that enables new stakeholders to achieve their local technical and economic objectives, while simultaneously delivering operational benefits to the electrical infrastructure. The concepts of grid architecture are presented as a tool to evaluate how stakeholders might participate in, and benefit from, services, and how utilities can make decision on the reliance on services to ensure reliability and resilience, translating abstract concepts into actionable information for utilities and grid edge stakeholders. The end result of proper coordination, informed by grid architecture, will be a range of new devices and systems, operated by new stakeholders, achieving their local objectives while also increasing the reliability, resilience, security, and affordability of the nation’s critical electrical infrastructure.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Architecting the Grid Edge: Ensuring Reliability and Resilience
Changes in technology, customer expectations, and business and regulatory environments are rapidly evolving causing fundamental changes in the nation’s electrical infrastructure. Nowhere is this more apparent that at the “grid edge”, where there is an increasing number of new devices and systems, as well as complex new interactions between them. This is leading to the traditional relationship between the end-use customers and their utilities being expanded by an increasing number of stakeholders, each with their own operational and financial objectives, governed by regulatory policy. While there are concerns about the rapidly increasing complexity negatively impacting reliable and resilience of the electrical infrastructure, these changes are also bringing new resources and opportunities that hold great potential if they can be properly coordinated. This white paper outlines the considerations for the coordination of multi-stakeholder objectives with electric utility requirements using the concept of grid services. Describing a framework that enables new stakeholders to achieve their local technical and economic objectives, while simultaneously delivering operational benefits to the electrical infrastructure. The concepts of grid architecture are presented as a tool to evaluate how stakeholders might participate in, and benefit from, services, and how utilities can make decision on the reliance on services to ensure reliability and resilience, translating abstract concepts into actionable information for utilities and grid edge stakeholders. The end result of proper coordination, informed by grid architecture, will be a range of new devices and systems, operated by new stakeholders, achieving their local objectives while also increasing the reliability, resilience, security, and affordability of the nation’s critical electrical infrastructure.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Deep Learning Systems for Increased Safeguards Surveillance Review Productivity
Nuclear safeguards inspectors expend significant time and maintain intense focus in reviewing video surveillance for safeguards relevant events. To increase efficiency and reduce the time burden of safeguards inspectors performing surveillance data review, this paper presents a novel deep learning (DL) systems concept to integrate generalized DL models into the safeguards surveillance review workflow. The Agency is investigating several DL algorithms for object recognition, localization, tracking, and flagging relevant activities. The project team is working closely with nuclear safeguards inspectors to identify review use cases (based on specific safeguards objectives) and collect their associated requirements. We focused on CANDU and LWR Nuclear Power Plants (NPPs) and their associated dry storage areas as these present a particularly heavy burden on the inspector surveillance review process due to the number of these facilities under safeguards worldwide. Initial DL algorithm results on safeguards data are promising. Using a convolutional neural network, the team attained a mean average precision (mAP) of 92.9% identifying and localizing spent fuel (SF) casks from a 475 surveillance image dataset. Further, the team had initial success in training a recurrent neural network to identify reactor area activities in video clips, successfully indicating when SF casks enter or exit a pool. We discuss how such DL algorithms would be integrated into the Next Generation Surveillance Review (NGSR) software application. Another issue impacting review productivity is the long time inspectors may have to wait when running these algorithms in NGSR. We present a concept to pre-process remotely collected surveillance data with DL models as the data arrives to IAEA headquarters so that results are already available when starting a new review in NGSR. The proposed DL system concept shows a pathway and workflow for increasing an inspector’s surveillance review productivity by quickly and accurately identifying declared and undeclared safeguards relevant objects and activities in large quantities of surveillance imagery data.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
SharP Unified Memory Allocator: An Intent-Based Memory Allocator for Extreme-Scale Systems
The pre-exascale systems will soon be deployed with a deep, complex memory hierarchy composed of many heterogeneous memories. This presents multiple challenges for users including: how to allocate data objects with locality between memories and devices for the various memories in these systems, which includes DRAM, High-bandwidth Memory (HBM), and non-volatile random access memory (NVRAM), and how to perform these allocations while providing portability for their application. Currently, the user can make use of multiple, disjoint libraries to allocate data objects on these memories. However, it is difficult to obtain locality between memories and devices when using libraries that are unaware of each other. This paper presents the Unified Memory Allocator (UMA) of the SHARed data-structure centric Programming abstraction (SharP) library, which provides a unified interface for memory allocations across DRAM, HBM, and NVRAM and is extensible to support future memory types. In addition, the SharP UMA allows for portability between systems by supporting both explicit and implicit, intent-based memory allocations. To demonstrate the ease of use of the SharP UMA, we have extended both Open MPIand OpenSHMEM-Xto support SharP. We validate this work by evaluating the performance implications and intent-based approach with synthetic benchmarks as well as adaptations of the Graph500 benchmark.
Aderholdt, William↗
A Two-Tier Convolutional Neural Network for Combined Detection and Segmentation in Biological Imagery
Deep learning techniques have been useful for modern microscopy imaging techniques to further study and analyze biological structures and organs. Convolutional neural networks (CNN) have improved 2D object detection, localization, and segmentation. For imagery containing biological structures with depth, it is especially desirable to perform these tasks in 3D. Traditionally, performing these tasks simultaneously in 3D has proven to be computationally expensive. Currently available methodologies thus largely work to segment 3D objects from 2D images (without context from captured 3D volumes). In this work, we present a novel approach to perform fast and accurate localization, detection, and segmentation of volumes containing cells. Specifically, in our method, we modify and tune two state-of-the-art CNNs, namely 2D YOLOv2 and 3D U-Net, and combine them with a new fusion and image processing algorithms. Annotated volumes in this space are limited, and we have created synthetic data that mimics actual structures for training and testing our proposed approach. Promising results on this test data demonstrate the value of the technique and offers a methodology for 3D cell analysis in real microscopy imagery.
Ziabari, Amir↗
Vertex Reordering for Real-world Graphs and Applications: An Empirical Evaluation
Vertex reordering is a way to improve locality in graph computations. Given an input (or ``natural'') order, reordering aims to compute an alternate permutation of the vertices that is aimed at maximizing a locality-based objective. Given decades of research on this topic, there are tens of graph reordering schemes, and there are also several linear arrangement ``gap'' measures for treatment as objectives. However, a comprehensive empirical analysis of the efficacy of the ordering schemes against the different gap measures, and against real-world applications is currently lacking. In this study, we present an extensive empirical evaluation of up to 11 ordering schemes, taken from different classes of approaches, on a set of 34 real-world graphs emerging from different application domains. Our study is presented in two parts: a) a thorough comparative evaluation of the different ordering schemes on their effectiveness to optimize different linear arrangement gap measures, relevant to preserving locality; and b) extensive evaluation of the impact of the ordering schemes on two real-world, parallel graph applications, namely, community detection and influence maximization. Our studies show a significant divergence among the ordering schemes (up to $40\times$ between the best and the poor) in their effectiveness to reduce the gap measures; and a wide ranging impact of the ordering schemes on various aspects including application runtime (up to $4\times$), memory and cache use, load balancing, and parallel work and efficiency. The comparative study also help reveal the nuances of a parallel environment (compared to serial) on the ordering schemes and their role in optimizing applications.
Barik, Reet↗
Distributed model predictive control for coordinated, grid-interactive buildings
Continued focus on reducing carbon emissions and improving energy efficiency requires buildings to become grid-interactive and not just behave as static consumers. A distributed model predictive control (DMPC) algorithm known as Limited-Communication (LC) DMPC is modified to enable grid-interactive buildings. A grid-aggregator subsystem is added that allows for a bulk grid power reference signal to be followed while the individual building subsystems also achieve their local comfort objectives. The LC-DMPC algorithm is applied for the first time to systems with multiple buildings. Adequate power tracking is shown for different simulation scenarios involving heterogeneous buildings, and next steps are discussed.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Enhanced early galaxy formation in JWST from axion dark matter?
We demonstrate that enhanced early galaxy formation can generically arise in axion-like particle (ALP) dark matter (DM) models with a delayed onset of axion field oscillation. In these models, the formation of localized massive objects enhances structure formation, potentially addressing the excess recently observed by the James Webb Space Telescope (JWST), while remaining consistent with existing constraints. We identify viable parameter space with the ALP mass in the range of 10 −22 eV m a < 10 –19 eV. In addition, we show that the ALP parameter regions of interest can lead to intriguing complementary signatures in the small scale structure of DM halos and existing experimental searches for ALPs.
Bird, Simeon↗
Theory of Defect-Induced Crystal Field Perturbations in Rare-Earth Magnets
We present a theory describing the single-ion anisotropy of rare-earth (RE) magnets in the presence of point defects. Taking the RE-lean 1 ∶ 12 magnet class as a prototype, we use first-principles calculations to show how the introduction of Ti substitutions into SmFe 12 perturbs the crystal field, generating new coefficients due to the lower symmetry of the RE environment. We then demonstrate that these perturbations can be described extremely efficiently using a screened point charge model. We provide analytical expressions for the anisotropy energy that can be straightforwardly implemented in atomistic spin dynamics simulations, meaning that such simulations can be carried out for an arbitrary arrangement of point defects. The significant crystal field perturbations calculated here demonstrate that a sample that is single phase from a structural point of view can nonetheless have a dramatically varying anisotropy profile at the atomistic level if there is compositional disorder, which may influence localized magnetic objects like domain walls or skyrmions. Published by the American Physical Society 2024
25 ENERGY STORAGE↗
Assessing the Performance of a Circular Economy for Wind Energy Technologies: A Summary of Three Analytical Tools
A circular economy emphasizes the efficient use of all resources and presents opportunities for addressing series of economic and environmental objectives at local, regional, and national levels. Despite anticipated overall benefits to society, the transition to a circular economy is likely to create regional differences in impacts. As a result, it is important to evaluate the performance and tradeoffs associated with circular economy transitions. This poster summaries three previously published analytical tools that were used to assess the performance of developing a circular economy for wind energy technologies: the Renewable Energy Materials Properties Database (REMPD), a circular economy agent-based model for wind blades (CE Wind ABM), and the Circular Economy Lifecycle Assessment and Visualization (CELAVI) framework. The REMPD is a comprehensive database of materials used in wind and solar plants, including material quantities and physical materials availability. The CE Wind ABM allows us to understand how wind stakeholders' end-of-life behaviors influence wind blade circularity and evaluate the impact of regional variables (e.g., logistics and transportation). And, the CELAVI framework is a modular framework that can be used to evaluate the impacts associated with circular economy transitions. These three analytical tools have been applied to evaluate circular economy transitions for wind energy technologies and they could be expanded to other technologies and products.
agent-based modeling↗
Localization of Nonblinking Point Sources Using Higher-Order-Mode Detection and Optical Heterodyning: Developing a Strategy for Extending the Scope of Molecular, Super-resolution Imaging
While the stochastic, “blinking” nature of fluorescent systems has enabled the super-resolution of their localization by the fitting of their point-spread functions (PSFs), this strategy cannot be exploited for similar resolution of “nonblinking” systems, such as those that might be encountered in a coherent Raman experiment. An alternative method for subdiffraction-limited imaging lies in the exploitation of optical heterodyning. For example, if a Gaussian PSF (a TEM00 mode) of a point emitter is displaced with respect to the origin of the optical system, photons in the higher-order TEM modes carry information about that displacement. Information concerning the displacement can be extracted from photons in these higher-order modes. These photons can be collected by optical heterodyning, which exploits the large gain in a detector’s response to an optical signal from an emitter coupled to a local oscillator, which is prepared in the TEM of interest, e.g., TEM10. We have generalized and developed the heterodyning technique to localize point emitters via the detection of higher-order spatial modes. We have developed a theoretical approach to find a practical estimation limit of the localization parameters using a realistic model that accounts for shot noise, background noise, and Gaussian noise. To demonstrate the applicability of the method, we designed experiments in which a laser is a surrogate for one and two point emitters. Using the Fisher information and its accompanying Cramér-Rao lower bound, we demonstrate super-resolution localization in these cases: we show that objects can be localized to roughly 2–3 orders of magnitude of their point-spread function’s size for a given optical system. Finally and most importantly, it is suggested that the results will ultimately be generalizable to multiple emitters and, most importantly, to “nonblinking” molecular systems, which will be essential for broadening the scope of super-resolution measurements beyond the limits of fluorescence-based techniques.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Localization and coherent imaging of hidden moving objects using laser speckle
Imaging and sensing of moving objects through opaque scattering media is a challenging but important problem in a variety of applications, including environmental sensing, biomedical imaging, and material inspection. We have previously demonstrated a technique to coherently image a moving object through thick, heavily scattering random media using correlations of speckle images as a function of the object’s spatial translation. Here, we demonstrate that this technique can be combined with localization to achieve imaging without prior knowledge of the object’s motion, greatly extending the application domain. This method is effective beyond the thin or weakly scattering regime and, rather than motion being deleterious, exploits the information available when the hidden object is moving, as could be the case in a cluttered terrestrial environment or through substantial levels of biological tissue scatter.
Hastings, Ryan L. (ORCID:0009000095977807)↗
Computational Imaging for Intelligence in Highly Scattering Aerosols (Final Report)
Natural and man-made degraded visual environments pose major threats to national security. The random scattering and absorption of light by tiny particles suspended in the air reduces situational awareness and causes unacceptable down-time for critical systems and operations. To improve the situation, we have developed several approaches to interpret the information contained within scattered light to enhance sensing and imaging in scattering media. These approaches were tested at the Sandia National Laboratory Fog Chamber facility and with tabletop fog chambers. Computationally efficient light transport models were developed and leveraged for computational sensing. The models are based on a weak angular dependence approximation to the Boltzmann or radiative transfer equation that appears to be applicable in both the moderate and highly scattering regimes. After the new model was experimentally validated, statistical approaches for detection, localization, and imaging of objects hidden in fog were developed and demonstrated. A binary hypothesis test and the Neyman-Pearson lemma provided the highest theoretically possible probability of detection for a specified false alarm rate and signal-to-noise ratio. Maximum likelihood estimation allowed estimation of the fog optical properties as well as the position, size, and reflection coefficient of an object in fog. A computational dehazing approach was implemented to reduce the effects of scatter on images, making object features more readily discernible. We have developed, characterized, and deployed a new Tabletop Fog Chamber capable of repeatably generating multiple unique fog-analogues for optical testing in degraded visual environments. We characterized this chamber using both optical and microphysical techniques. In doing so we have explored the ability of droplet nucleation theory to describe the aerosols generated within the chamber, as well as Mie scattering theory to describe the attenuation of light by said aerosols, and correlated the aerosol microphysics to optical properties such as transmission and meteorological optical range (MOR). This chamber has proved highly valuable and has supported multiple efforts inclusive to and exclusive of this LDRD project to test optics in degraded visual environments. Circularly polarized light has been found to maintain its polarization state better than linearly polarized light when propagating through fog. This was demonstrated experimentally in both the visible and short-wave infrared (SWIR) by imaging targets made of different commercially available retroreflective films. It was found that active circularly polarized imaging can increase contrast and range compared to linearly polarized imaging. We have completed an initial investigation of the capability for machine learning methods to reduce the effects of light scattering when imaging through fog. Previously acquired experimental long-wave images were used to train an autoencoder denoising architecture. Overfitting was found to be a problem because of lack of variability in the object type in this data set. The lessons learned were used to collect a well labeled dataset with much more variability using the Tabletop Fog Chamber that will be available for future studies. We have developed several new sensing methods using speckle intensity correlations. First, the ability to image moving objects in fog was shown, establishing that our unique speckle imaging method can be implemented in dynamic scattering media. Second, the speckle decorrelation over time was found to be sensitive to fog composition, implying extensions to fog characterization. Third, the ability to distinguish macroscopically identical objects on a far-subwavelength scale was demonstrated, suggesting numerous applications ranging from nanoscale defect detection to security. Fourth, we have shown the capability to simultaneously image and localize hidden objects, allowing the speckle imaging method to be effective without prior object positional information. Finally, an interferometric effect was presented that illustrates a new approach for analyzing speckle intensity correlations that may lead to more effective ways to localize and image moving objects. All of these results represent significant developments that challenge the limits of the application of speckle imaging and open important application spaces. A theory was developed and simulations were performed to assess the potential transverse resolution benefit of relative motion in structured illumination for radar systems. Results for a simplified radar system model indicate that significant resolution benefits are possible using data from scanning a structured beam over the target, with the use of appropriate signal processing.
58 GEOSCIENCES↗
Formulation analysis and computation of an optimization-based local-to-nonlocal coupling method
We present an optimization-based coupling method for local and nonlocal continuum models. Our approach couches the coupling of the models into a control problem where the states are the solutions of the nonlocal and local equations, the objective is to minimize their mismatch on the overlap of the local and nonlocal problem domains, and the virtual controls are the nonlocal volume constraint and the local boundary condition. We present the method in the context of Local-to-Nonlocal diffusion coupling. Numerical examples illustrate the theoretical properties of the approach.
97 MATHEMATICS AND COMPUTING↗
Semi-automatic image annotation using 3D LiDAR projections and depth camera data
Efficient image annotation is necessary to utilize deep learning object recognition neural networks in nuclear safeguards, such as for the detection and localization of target objects like nuclear material containers (NMCs). This capability can help automate the inventory accounting of different types of NMCs within nuclear storage facilities. The conventional manual annotation process is labor-intensive and time-consuming, hindering the rapid deployment of deep learning models for NMC identifications. This paper introduces a novel semi-automatic method for annotating 2D images of nuclear material containers (NMCs) by combining 3D light detection and ranging (LiDAR) data with color and depth camera images collected from a handheld scan system. The annotation pipeline involves an operator manually marking new target objects on a LiDAR-generated map, and projecting these 3D locations to images, thereby automatically creating annotations from the projections. The semi-automatic approach significantly reduces manual efforts and the expertise in image annotation that is required to perform the task, allowing deep learning models to be trained on-site within a few hours. The paper compares the performance of models trained on datasets annotated through various methods, including semi-automatic, manual, and commercial annotation services. The evaluation demonstrates that the semi-automatic annotation method achieves comparable or superior results, with a mean average precision (mAP) above 0.9, showcasing its efficiency in training object recognition models. Additionally, the paper explores the application of the proposed method to instance segmentation, achieving promising results in detecting multiple types of NMCs in various formations.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
Faster Storm Surge Modeling with Local Time-Stepping
The objective is to evaluate the efficiency and efficacy of local time-stepping (LTS) methods in the Model for Prediction Across Scales-Ocean (MPAS-Ocean).
58 GEOSCIENCES↗
Development of Preliminary VERA-CS Crud Induced Localized Corrosion Modeling Capability
The objective of this milestone was to develop a crud-induced localized corrosion (CILC) screening capability in VERA-CS using existing codes and capabilities that had been developed in the Consortium for Advanced Simulation of Light Water Reactors (CASL) as part of the efforts to resolve the crud challenge problem. The milestone work focused on improving existing CASL software and implementing clad corrosion modeling into VERA-CS. Clad corrosion modeling was implemented by creating an application interface (API) in the Cicada software so that its clad heat transfer and corrosion models could be used in VERA-CS. Cicada was coupled to the subchannel code CTF for solving crud and corrosion growth. Additionally, a clad corrosion model was added directly to CTF to serve as an alternate approach. The rod thermal hydraulic reconstruction (ROTHCON) process, which is used for capturing computational fluid dynamics (CFD)-predicted rod-surface heat and turbulence behavior that can impact crud-induced power shift (CIPS) and CILC prediction, was also implemented into VERA-CS. Usability improvements were made to this feature, which was developed over several previous milestones, so that the VERA-CS user can link spacer grids in a VERA-CS model to an applicable pregenerated spacer grid data file if available. Several assessments were performed to demonstrate the proper functioning of the new capability. Sensitivity studies were performed to demonstrate the effect of crud lithium content, oxide thermal conductivity, Cicada mesh refinement, and ROTHCON coupling mesh refinement on predicted amounts of crud and oxide growth. A full-scale demonstration was performed by running Seabrook Cycle 5 with the CILC capability. Some general observations were made from the assessments. It was observed that predicted corrosion thickness is less than anticipated for CILC cases, so further work is needed to better understand and improve the corrosion modeling. Refining the coupling mesh in the ROTHCON process leads to increased corrosion and crud thickness, which can affect where crud and corrosion grow, how thick it gets, and how many rods experience crud and corrosion growth. Results indicate that applying the ROTHCON process and refining the coupling mesh leads to only a slight increase in total core maximum crud and corrosion thickness, but it leads to a significant increase in the number of rods with a maximum thickness that surpasses a set threshold value (i.e., more rods grow thicker corrosion and crud). Computational performance of the simulation is degraded by a factor of 5{6 with high coupling mesh refinement. The impact of the ROTHCON coupling mesh refinement on total core crud mass is less significant; however, using the ROTHCON process with CFD-generated data over the Yao{Hochreiter{Leech (YHL) model in CTF leads to significantly different amounts of total core crud mass. Future work on the CILC screening capability will include model improvement and validation, development and testing of a CILC-risk screening criteria, and performance improvements.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗