Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Navigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Cancer cell membrane-coated rare earth doped nanoparticles for tumor surgery navigation in NIR-II imaging window

With the attractive characteristics of low toxicity, narrow emission spectra, long fluorescence lifetime, and no photobleaching, rare-earth doped nanoparticles (RENPs) have become promising imaging nanoplatforms in the second near-infrared window (NIR-II, 1000–1700 nm). Many studies have been devoted to different surface modification strategies of RENPs to achieve good NIR-II tumor imaging property. However, the tumor imaging efficiency of these approaches remains disappointing. Herein, two methods were pursued to modify RENPs with either polyethylene glycol (PEG) or cancer-cell-membrane to generate PEGylated-RENPs and cancer-cell-membrane camouflaged RENPs (CC-RENPs), respectively. Furthermore, this study demonstrated that cancer-cell-membrane coating of RENPs greatly improved tumor imaging performance in NIR-II window than PEG coating. Besides, CC-RENPs uptakes in liver and spleen significantly decreased. Importantly, CC-RENPs was found to be capable to aid us to pursue precise resection of the tumor. In conclusion, CC-RENPs are capable of targeting tumors and show high tumor NIR-II imaging quality. They are highly promising nanomaterials for future medical applications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

Sensitivity of back‐projection algorithm (BPA) synthetic aperture radar (SAR) image formation to initial position, velocity, and attitude navigation errors

Abstract The Back‐Projection Algorithm (BPA) is a time‐domain‐matched filtering technique to form synthetic aperture radar (SAR) images. To produce high‐quality BPA images, precise navigation data for the radar platform must be known. Errors in position, velocity, or attitude result in improperly formed images that are corrupted by shifting and blurring. The contribution of this paper is the development of analytical expressions that characterise the relationship between navigation errors and image formation errors from an inertial navigation point of view, where trajectory estimation errors in position, velocity, and attitude propagate through time and cause compounding errors in the vehicle state vector. These analytical expressions are verified via simulated image formation and real‐data image formation.

Lindstrom, Colton↗
DOE OSTI2020

Radiation Mapping for an Unmanned Aerial Vehicle: Development and Simulated Testing of Algorithms for Source Mapping and Navigation Path Generation

Image reconstruction algorithms were developed for radiation source mapping and used for generating the search path of a moving radiation detector, such as one onboard an unmanned aerial vehicle. Simulations consisted of first assuming radioactive sources of varying complexity and estimating the radiation fields that would then be produced by that source distribution. Next, the "measurements" that would result from a pair of adjacent spatial locations were computed. A crude estimate of the source distribution likely to have produced such "measurements" was reconstructed based upon the limited measurements. Location of the next "measurement" was then determined as halfway between the location of the estimated source and the current "measurement." With each additional sample, improved source distribution reconstructions were made and used to inform the immediate direction of detector motion. Source reconstruction or mapping was formulated as an inverse problem solved with either maximum a posteriori or least squares (LS) regression deconvolution methods. Different amounts of noise were added to the simulated "measurements," allowing evaluation of the methods' performances as functions of signal-to-noise ratio of the measured map. As expected, methods that promote sparsity were better suited in reconstructing point sources. Reliable prior information of the source distribution also improved the reconstruction results, especially with distributed sources. With a non-negative least square algorithm and the suggested paths it generated, location of sources was successfully estimated to an accuracy of 0.014 m within nine iterations in a single-source scenario and 12 iterations in a two-source scenario, given a 10% error on the integrated counts and a Poisson distribution of the noise associated with the measured counts.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2022

Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy

Abstract Physics‐driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here, this work develops and experimentally implements a deep kernel learning (DKL) workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics‐based selection of acquisition function, which autonomously guides the navigation of the image space. Compared to classical Bayesian optimization (BO) methods, this approach allows to capture the complex spatial features present in the images of realistic materials, and dynamically learn structure–property relationships. In combination with the flexible scalarizer function that allows to ascribe the degree of physical interest to predicted spectra, this enables physical discovery in automated experiment. Here, this approach is illustrated for nanoplasmonic studies of nanoparticles and experimentally implemented in a truly autonomous fashion for bulk‐ and edge plasmon discovery in MnPS 3 , a lesser‐known beam‐sensitive layered 2D material. This approach is universal, can be directly used as‐is with any specimen, and is expected to be applicable to any probe‐based microscopic techniques including other STEM modalities, scanning probe microscopies, chemical, and optical imaging.

42 ENGINEERING↗
DOE OSTI2020

Constructing Self-Labeled Materials Imaging Datasets from Open Access Scientific Journals with EXSCLAIM!

Due to recent improvements in image resolution and acquisition speeds, materials microscopy is experiencing an explosion in imaging data. Yet, despite the volume of images generated, the overall accessibility landscape is highly fragmented, as researchers who do release images to the public, often only do so as snapshots of their larger private dataset in context of scientific journal publications. The effort to automatically consolidate images and descriptive information from web-based platforms has garnered broad attention from the computer vision, language technologies, and chemistry/materials informatics communities. However, these methods are problematic for scientific figures because over 30% of figures are compound in nature, and it is the individual images themselves, paired with relevant context, that are necessary for construction a proper labeled dataset. To this end, we outline in this paper the design of a software pipeline for the automatic EXtraction, Separation, and Caption-based natural Language Annotation of IMages from scientific figures (EXSCLAIM!). Successful consolidation of materials imaging across literature sources will enhance navigation and searchability of materials microscopy images for both novice and experienced researchers, as well as establish the framework necessary for users to search by images, text, or some combination of both.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Diamond magnetometer enhanced by ferrite flux concentrators

Magnetometers based on nitrogen-vacancy (NV) centers in diamond are promising room-temperature, solid-state sensors. However, their reported sensitivity to magnetic fields at low frequencies (≲1 kHz) is presently ≳10 pTs 1/2 , precluding potential applications in medical imaging, geoscience, and navigation. Here we show that high-permeability magnetic flux concentrators, which collect magnetic flux from a larger area and concentrate it into the diamond sensor, can be used to improve the sensitivity of diamond magnetometers. By inserting an NV-doped diamond membrane between two ferrite cones in a bowtie configuration, we realize a ~ 250-fold increase of the magnetic field amplitude within the diamond. We demonstrate a sensitivity of ~ 0.9pTs 1/2 to magnetic fields in the frequency range between 10 and 1000 Hz. This is accomplished using a dual-resonance modulation technique to suppress the effect of thermal shifts of the NV spin levels. The magnetometer uses 200 mW of laser power and 20 mW of microwave power. This work introduces a new degree of freedom for the design of diamond sensors by using structured magnetic materials to manipulate magnetic fields.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Operational Uncrewed Aircraft Systems Development for Meteorology and Atmospheric Physics Field Campaign Report

The overarching goal of the project is to develop integrated small, unmanned aircraft systems (SUAS) capabilities for enhanced atmospheric physics measurements. This team included atmospheric scientists, meteorologists, engineers, computer scientists, geographers, and chemists necessary to evaluate the needs and develop the advanced sensing and imaging, robust autonomous navigation, enhanced data communication, and data management capabilities required to use SUAS in atmospheric physics. The flight campaigns at the Southern Great Plains (SGP) U.S. Department of Energy Atmospheric Radiation Measurement (ARM) observatory were an integrated evaluation of the systems in coordinated field tests. This enabled sensor testing, and validation of SUAS technology and integration of unmanned aircraft into the airspace. The set of experiments enabled evaluation and progression of remote UAS deployment operations with observing atmospheric sensors. Each flight test endeavor was notable for the significant lessons learned during every deployment event. Team size and roles, equipment use, aircraft instruments, meteorological instruments, and deployment logistics, were all evaluated and improved at every flight-testing day. The details of these are further discussed in the Results section.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

A Proof for the Unbiased Nature of Range-Doppler Measurements in Coarse-Resolution Dechirp-on-Receive Feedback Synthetic Aperture Radar Navigation

In feedback synthetic aperture radar (SAR) navigation, observables extracted from SAR range-Doppler images correct position and velocity errors accumulated within an associated navigation system. Unlike most other sensors, which produce measurements without input from a navigation system, SARs require a prior estimate of the radar’s position and velocity to adjust the radar’s matched filter during range-Doppler image formation. Consequently, it is possible for position and velocity errors within a navigation system to manifest as additional errors (biases) in the range-Doppler measurement observables. Prior work has not tackled this possibility in the context of feedback SAR navigation with a dechirp-on-receive radar. This paper offers a proof demonstrating that range-Doppler observables extracted from coarse-resolution vertical SAR images formed with a dechirp-on-receive radar may be safely modeled as unbiased measurements of the radar’s true position and velocity despite the presence of moderate navigation errors.

dechirp-on-receive↗
DOE OSTI2025

Mechanically flexible mid-wave infrared imagers using black phosphorus ink films

The mid-wave infrared (MWIR) spectral range (λ = 3–8 μm) enables important sensing and imaging applications, including non-invasive bioimaging, night vision, and autonomous navigation. Commercial MWIR photodetectors are limited to rigid imagers based on heteroepitaxial materials. There is an emerging need for mechanically flexible MWIR imagers to broaden their functionality and practicality. Recently, photodetectors using van der Waals (vdW) black phosphorus (BP) flakes have demonstrated highly sensitive room-temperature photodetection. Additionally, vdW materials are solution-processable, facilitating scalable processing and flexible device fabrication. In this work, we present flexible MWIR imagers consisting of photodiodes fabricated on thin plastic substrates using BP ink films. We demonstrate mechanically robust responsivity up to 2.5-mm bending radii and after 5000 bending cycles. Leveraging this flexibility, we achieve full-azimuthal imaging, detecting directional light sources with precision. These results establish a scalable approach for large-area, conformable MWIR imaging and pave the way for integration with flexible electronics.

Wijaya, Theodorus Jonathan↗
DOE OSTI2021

System Calibration Including Time Delay Estimation for GNSS/INS-Assisted Pushbroom Scanners Onboard UAV Platforms

Unmanned aerial vehicles (UAVs ) equipped with imaging sensors and integrated global navigation satellite system/inertial navigation system (GNSS/INS ) units are used for numerous applications. Deriving reliable 3D coordinates from such UAVs is contingent on accurate geometric calibration, which encompasses the estimation of mounting parameters and synchronization errors. Through a rigorous impact analysis of such systematic errors, this article proposes a direct approach for spatial and temporal calibration (estimating system parameters through a bundle adjustment procedure) of a GNSS/INS -assisted pushbroom scanner onboard a UAV platform. The calibration results show that the horizontal and vertical accuracies are within the ground sampling distance of the sensor. Unlike for frame camera systems, this article also shows that the indirect approach is not a feasible solution for pushbroom scanners due to their limited ability for decoupling system parameters. This finding provides further support that the direct approach is recommended for spatial and temporal calibration of UAV pushbroom scanner systems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

202508 HAIIC IR Images with Attitude Data at BNF

This campaign aims to collect infrared imagery using a custom data acquisition system to improve and validate a previously developed attitude estimation algorithm, with a focus on ensuring reliable performance at higher altitudes. The system integrates a Boson+320 infrared camera, a VN-200 IMU for recording attitude data synchronized with image acquisition, and a Raspberry Pi 4B+ for onboard processing and storage. Image orientation was controlled using a Gremsy T7 gimbal. The primary dataset spans roll angles from −40° to 40° and pitch angles from −20° to 40°, sampled at 1° increments. Additional, smaller datasets were also collected at 2.5° angular intervals.

Boson+320↗
DOE OSTI2022

The sound of a Martian dust devil

Dust devils (convective vortices loaded with dust) are common at the surface of Mars, particularly at Jezero crater, the landing site of the Perseverance rover. They are indicators of atmospheric turbulence and are an important lifting mechanism for the Martian dust cycle. Improving our understanding of dust lifting and atmospheric transport is key for accurate simulation of the dust cycle and for the prediction of dust storms, in addition to being important for future space exploration as grain impacts are implicated in the degradation of hardware on the surface of Mars. Here we describe the sound of a Martian dust devil as recorded by the SuperCam instrument on the Perseverance rover. The dust devil encounter was also simultaneously imaged by the Perseverance rover’s Navigation Camera and observed by several sensors in the Mars Environmental Dynamics Analyzer instrument. Combining these unique multi-sensorial data with modelling, we show that the dust devil was around 25 m large, at least 118 m tall, and passed directly over the rover travelling at approximately 5 m s –1 . Acoustic signals of grain impacts recorded during the vortex encounter provide quantitative information about the number density of particles in the vortex. The sound of a Martian dust devil was inaccessible until SuperCam microphone recordings. This chance dust devil encounter demonstrates the potential of acoustic data for resolving the rapid wind structure of the Martian atmosphere and for directly quantifying wind-blown grain fluxes on Mars.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Radar Motion Measurements and Synthetic Aperture Radar Image Geolocation Accuracy

Once a Synthetic Aperture Radar (SAR) image is formed, the natural question then is, "Where is this image?" and/or "Where exactly is this feature displayed in the image?" Thus, geolocation is an important exploitation of the SAR image. Since SAR measures relative location to its own position, it is crucial to understand how the radars position and motion imp acts the ability to geolocate a feature in the SAR image. Furthermore, accuracy and precision of navigation aids like GPS directly impact the goodness of the geolocation solution. These relationships are developed and discussed.

58 GEOSCIENCES↗
DOE OSTI2026

Extremized nonlinear and linearized responses in soft metamaterials enabled by gradient-based design and grayscale digital light processing

In this study, we develop a gradient-based design approach that exploits grayscale digital light processing (DLP) 3D printing for extremizing the nonlinear and linearized response of soft metamaterials — materials that harness engineered geometric instabilities to undergo large and programmable changes in configuration. Grayscale DLP approaches modulate local mechanical properties at the pixel scale by tuning the light intensity within a single grayscale image, unlocking an exceptionally large design space. To effectively navigate this space, we develop smooth mappings between local light intensity values and global quantities of interest that characterize the behavior of soft metamaterials. Enabling these smooth mappings are robust and differentiable nonlinear finite element simulations powered by a trust region solver. A PDE-constrained optimization problem is then solved to invert these mappings and produce light intensity distributions that endow the printed part with varying stiffness and flexibility in distinctive regions. It is shown that optimizing the distribution of soft and stiff phases throughout a metamaterial structure results in markedly different buckling and self-contact configurations to drive extremized nonlinear compression and linearized vibration responses. Optimized light intensity distributions are translated to grayscale images and directly used to print soft metamaterial samples, showing remarkable agreement between the buckling and self-contact response in simulated and measured deformed configurations.

Additive manufacturing↗
DOE OSTI2025

Sim2Real Autonomous Robotic Exploration [Poster]

Autonomous robots offer promising solutions for exploration in environments that are inaccessible or hazardous to humans. Despite this, physical training of such robots is often constrained by safety risks, high cost or limited accessibility. This project presents an end-to-end simulation to reality pipeline leveraging Nvidia Isaac Sim and Boston Dynamics' Spot to enable autonomous navigation in indoor environments. A reinforcement learning policy is first trained using Nvidia Isaac Lab to establish Spot's locomotion pattern. Virtual LiDAR sensors are then integrated to perform SLAM-based navigation using simulated odometry. Finally, the simulated navigation scheme is transferred to a physical Spot robot to inspect and record images of a real-world room by repeating the learnt trajectory. The proposed framework highlights the potential of scalable training in simulation and reliable deployment in physical environments. Future directions include dynamic trajectory generation in unseen and challenging environments and integration of environmental sensing like temperature, radiation or humidity via sensor and material simulation.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Binder-benchmarking

SAND2025-07593O Binder-benchmarking evaluates the speed and memory impacts of C++, Python, and Matlab code binders. As a repository, it provides a way to locally run computation-based and memory-based benchmark suites on pybind11 and nanobind-based code in a Docker image. The software runs simple-speed and memory benchmarks on primitive navigation and integration exemplar algorithms. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Walker II, Michael [Sandia National Lab. (SNL-CA),↗
DOE OSTI2020

Image Processing Algorithms for Tuning Quantum Devices and Nitrogen-Vacancy Imaging

Semiconductor quantum dot devices can be challenging to configure into a regime where they are suitable for qubit operation. This challenge arises from variations in gate control of quantum dot electron occupation and tunnel coupling between quantum dots on a single device or across several devices. Furthermore, a single control gate usually has capacitive coupling to multiple quantum dots and tunnel barriers between dots. If the device operator, be it human or machine, has quantitative knowledge of how gates control the electrostatic and dynamic properties of multiqubit devices, the operator can more quickly and easily navigate the multidimensional gate space to find a qubit operating regime. We have developed and applied image analysis techniques to quantitatively detect where charge offsets from different quantum dots intersect, so called anticrossings. In this document we outline the details of our algorithm for detecting single anticrossings, which has been used to fine-tune the inter-dot tunnel rates for a three quantum dot system. Additionally, we show that our algorithm can detect multiple anticrossings in the same dataset, which can aid in the coarse tuning the electron occupation of multiple quantum dots. We also include an application of cross correlation to the imaging of magnetic fields using nitrogen vacancies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗