Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optical data fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Robotic vision/sensing for space applications

A review is presented of efforts currently in progress at the NASA/Johnson Space Center and Rice University, the accomplishments to date, and some of the anticipated future developments. Both systems and algorithms are discussed. The evolution of future vision/sensing is projected to included the fusion of multisensors ranging from microwave to optical with multimode capability to include position, attitude, recognition, and motion parameters. The algorithms for information extraction are expected to incorporate aspects of intelligence and knowledge for the interpolation and extrapolation of the needed data. The key features of the overall system design will be small size and weight, fast signal processing, robust algorithms, and accurate parameter determination. These aspects of vision/sensing are also discussed.

Krishen, Kumar↗

Processing LiDAR Data to Predict Natural Hazards

ELF-Base and ELF-Hazards (wherein 'ELF' signifies 'Extract LiDAR Features' and 'LiDAR' signifies 'light detection and ranging') are developmental software modules for processing remote-sensing LiDAR data to identify past natural hazards (principally, landslides) and predict future ones. ELF-Base processes raw LiDAR data, including LiDAR intensity data that are often ignored in other software, to create digital terrain models (DTMs) and digital feature models (DFMs) with sub-meter accuracy. ELF-Hazards fuses raw LiDAR data, data from multispectral and hyperspectral optical images, and DTMs and DFMs generated by ELF-Base to generate hazard risk maps. Advanced algorithms in these software modules include line-enhancement and edge-detection algorithms, surface-characterization algorithms, and algorithms that implement innovative data-fusion techniques. The line-extraction and edge-detection algorithms enable users to locate such features as faults and landslide headwall scarps. Also implemented in this software are improved methodologies for identification and mapping of past landslide events by use of (1) accurate, ELF-derived surface characterizations and (2) three LiDAR/optical-data-fusion techniques: post-classification data fusion, maximum-likelihood estimation modeling, and hierarchical within-class discrimination. This software is expected to enable faster, more accurate forecasting of natural hazards than has previously been possible.

Fairweather, Ian↗

Mars Planetary Network for Human Exploration Era – Potential Challenges and Solutions

During 2016-2017, a study was conducted under the sponsorship of the NASA’s Space Communications and Navigation (SCaN) Program to investigate the deep space communications capacity taking into account the needs of all the present and envisioned future missions toward 2030s. It was soon recognized that planning for human exploration to Mars would impose certain unprecedent challenges, both fiscal and technical, to the current space communications paradigm. Targeting the assumed missions concepts, i.e., Crewed Mission to Phobos (CMTP) and Mars Short Stay Mission (MSSM), a Mars Planetary Network for the human exploration era has been formulated. The activity modeling and network traffic simulation/modeling we performed gave some insight into the technical challenges in space communications for the envisioned human Mars exploration era. Chief among the potential challenges are: (1) the high demand on the deep space network (DSN) assets for achieving the high-rate links, both return and forward, from Mars farthest/farther distance (up to 2.67 AU); (2) the need for resilient, persistent communication coverage for crewed vehicles, on surface and in orbits; (3) the significant period of outage for the Mars-Earth link due to superior solar conjunction; (4) the need for on-demand, simultaneous access to the proximity link by multiple vehicles and astronauts in the exploration zone; (5) the capability of determining precise, real-time, positions of surface vehicles and astronauts by the deep space habitat and/or other tele-operations entities. Solution space to each of the above challenges has been explored and analyzed in the context of the individual problem domain and, more importantly, in conjunction with that for the other challenges. This has led to an end-to-end definition of a Mars Planetary Network that would feature: (1) the fusion of deep space Ka-band and optical communications for achieving Mars-Earth high-rate links taking advantage of the optical/RF hybrid 8m/34m antennas in DSN; (2) the integrated application of the Multiple Spacecraft Per Antenna (MSPA) technique, for return link data acquisition, and the Multiple Uplink Per Antenna (MUPA) technique, for forward link data trasnmission, to reduce the number of 34m beam-wave guide (BWG) antennas needed for the era; (3) the integration of three, arrayed, 34m beam-wave guide (BWG) antennas, to provide a high G/T aperture, with the MSPA/MUPA techniques, and a dual “trunk link”approach to cut down the needed G/T -- hence, reducing the number of 34m antennas, relative to that in the single trunk approach by 50%; (4) the deployment of two areostationary/areosynchronous Mars relay orbiters; one of them could also function as (or be served by) a notional Deep Space Habitat (DSH); (5) the opportunistic deployment of a science orbiter in a Pioneer-6 type orbit, equidistant Mars/Earth, that could also serve as an intermediary relay during the Mars superior solar conjunction perod; (6) the existence of the multi-function Mars proximity link that provides the demand-assigned, multiple access (DAMA) capability; and (7) the provision of tracking observables, by leveraging on the planned Mars orbiting and surface infrastructure, to enable the in-situ navigation for surface and orbiting vehicles. This paper provides the description of the proposed Mars Planetary Network in the human exploration era, the trade-off analysis for the various alternative architectures, and the optimal solutions to the key challenges in defining this end-to-end network.

Cheung, Kar-Ming↗

Microwave and camera sensor fusion for the shape extraction of metallic 3D space objects

The vacuum of space presents special problems for optical image sensors. Metallic objects in this environment can produce intense specular reflections and deep shadows. By combining the polarized RCS with an incomplete camera image, it has become possible to better determine the shape of some simple three-dimensional objects. The radar data are used in an iterative procedure that generates successive approximations to the target shape by minimizing the error between computed scattering cross-sections and the observed radar returns. Favorable results have been obtained for simulations and experiments reconstructing plates, ellipsoids, and arbitrary surfaces.

Shaw, Scott W.↗

The Additive Manufacturing Moment Measure (AM3) Approach to Predictions of Solid Cooling Rate and Time Above Melt

Qualification of a laser powder bed fusion additive manufacturing (LPBF-AM) process requires knowledge of the multi-scale material physics during the process, per part. As the LPBF-AM build occurs, each moment is influenced by the process history. Knowledge of the build sequence can be used to generate a discretized time-space-condition point field that when coupled with a nearest neighbors’ calculation results in a generalized and fully parallel process model computation. This GPU accelerated approach was developed for part-scale analysis of build files along with in-situ process monitoring sensor data and is termed the “Additive Manufacturing Moment Measure” (AM3). The AM3 approach will be presented and then used to evaluate an AM Bench relevant geometry with synchronized in-situ process data, ex-situ nondestructive evaluation, and optical microscopy observations. These comparisons permit a better understanding of how the process actions can affect the LPBF-AM build quality and the signals generated during in-situ process monitoring.

Additive Manufacturing↗

Using 100G Network Technology in Support of Petascale Science

NASA in collaboration with a number of partners conducted a set of individual experiments and demonstrations during SC 10 that collectively were titled "Using 100G Network Technology in Support of Petascale Science". The partners included the iCAIR, Internet2, LAC, MAX, National LambdaRail (NLR), NOAA and SCinet Research Sandbox (SRS) as well as the vendors Ciena, Cisco, ColorChip, cPacket, Extreme Networks, Fusion-io, HP and Panduit who most generously allowed some of their leading edge 40G/100G optical transport, Ethernet switch and Internet Protocol router equipment and file server technologies to be involved. The experiments and demonstrations featured different vendor-provided 40G/100G network technology solutions for full-duplex 40G and 100G LAN data flows across SRS-deployed single-node fiber-pairs among the Exhibit Booths of NASA, the National Center for Data lining, NOAA and the SCinet Network Operations Center, as well as between the NASA Exhibit Booth in New Orleans and the Starlight Communications Exchange facility in Chicago across special SC 10- only 80- and 100-Gbps wide area network links provisioned respectively by the NLR and Internet2, then on to GSFC across a 40-Gbps link. provisioned by the Mid-Atlantic Crossroads. The networks and vendor equipment were load-stressed by sets of NASA/GSFC High End Computer Network Team-built, relatively inexpensive, net-test-workstations that are capable of demonstrating greater than 100Gbps uni-directional nuttcp-enabled memory-to-memory data transfers, greater than 80-Gbps aggregate--bidirectional memory-to-memory data transfers, and near 40-Gbps uni-directional disk-to-disk file copying. This paper will summarize the background context, key accomplishments and some significances of these experiments and demonstrations.

Gary, James P.↗

NASA NeMO-Net

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low- resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with global low-resolution (m, km-scale) airborne and spaceborne imagery to reduce classification errors up to 80% over regional scales. Such technologies can substantially enhance our ability to assess coral reef ecosystems dynamics.

NASA↗

NeMO-Net & Fluid Lensing: The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment Using Fluid Lensing Augmentation of NASA EOS Data

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with global low-resolution (m, km-scale) airborne and spaceborne imagery to reduce classification errors up to 80% over regional scales. Such technologies can substantially enhance our ability to assess coral reef ecosystems dynamics.

satellite data↗

Localization Using Visual Odometry and a Single Downward-Pointing Camera

Stereo imaging is a technique commonly employed for vision-based navigation. For such applications, two images are acquired from different vantage points and then compared using transformations to extract depth information. The technique is commonly used in robotics for obstacle avoidance or for Simultaneous Localization And Mapping, (SLAM). Yet, the process requires a number of image processing steps and therefore tends to be CPU-intensive, which limits the real-time data rate and use in power-limited applications. Evaluated here is a technique where a monocular camera is used for vision-based odometry. In this work, an optical flow technique with feature recognition is performed to generate odometry measurements. The visual odometry sensor measurements are intended to be used as control inputs or measurements in a sensor fusion algorithm using low-cost MEMS based inertial sensors to provide improved localization information. Presented here are visual odometry results which demonstrate the challenges associated with using ground-pointing cameras for visual odometry. The focus is for rover-based robotic applications for localization within GPS-denied environments.

Swank, Aaron J.↗

Fusion Approach for Remotely-Sensed Mapping of Agriculture (FARMA): A Scalable Open Source Method for Land Cover Monitoring Using Data Fusion

The increasing availability of very-high resolution (VHR; <2 m) imagery has the potential to enable agricultural monitoring at increased resolution and cadence, particularly when used in combination with widely available moderate-resolution imagery. However, scaling limitations exist at the regional level due to big data volumes and processing constraints. Here, we demonstrate the Fusion Approach for Remotely-Sensed Mapping of Agriculture (FARMA), using a suite of open source software capable of efficiently characterizing time-series field-scale statistics across large geographical areas at VHR resolution. We provide distinct implementation examples in Vietnam and Senegal to demonstrate the approach using WorldView VHR optical, Sentinel-1 Synthetic Aperture Radar, and Sentinel-2 and Sentinel-3 optical imagery. This distributed software is open source and entirely scalable, enabling large area mapping even with modest computing power. FARMA provides the ability to extract and monitor sub-hectare fields with multisensor raster signals, which previously could only be achieved at scale with large computational resources. Implementing FARMA could enhance predictive yield models by delineating boundaries and tracking productivity of smallholder fields, enabling more precise food security observations in low and lower-middle income countries.

fusion↗

The Additive Manufacturing Moment Measure - A Parallel Computation Technique for Determining Build Variance in the Laser Powder Bed Fusion Process

Additive manufacturing (AM) has unique process attributes that facilitate the creation of optimized, complex, and unique parts for aerospace applications. However, the multi-scale and complicated building process for AM parts can cause unexpected build conditions that result in microstructural variability within the deposited material. The need for richer datasets and computational modeling capabilities to improve AM process reliability is a consequence of this microstructural variability. A computational approach, referred to as the Additive Manufacturing Moment Measure (AM3), addresses this need by leveraging the way AM processes fuse material in precise, incremental steps. During the layering sequence, each previous step contributes to the condition of the current step at the center of the heat source. The precise steps can be selected to systematically create a time-space point field with co-located machine input and in-situ sensor data. The sequential nature of the AM process, coupled with nearest neighbor calculations, allows for a fully parallel computation for part-scale build profile analysis. The AM3 concept introduced here enables part-scale assessment directly from build files and in-situ process monitoring sensors alike. The AM moment measures were calculated for build point fields and compared with co-located in-situ and ex-situ nondestructive evaluation and optical microscopy observations. These comparisons permit a better understanding of how the sequential process actions can affect the quality of a laser powder bed fusion (LPBF) build. Details of the AM3technique will be discussed and compared to measured LPBF part characteristics. The AM3 results indicate a strong potential to advance the qualification process for aerospace applications.

Additive Manufacturing↗

A sensor fusion field experiment in forest ecosystem dynamics

The background of the Forest Ecosystem Dynamics field campaign is presented, a progress report on the analysis of the collected data and related modeling activities is provided, and plans for future experiments at different points in the phenological cycle are outlined. The ecological overview of the study site is presented, and attention is focused on forest stands, needles, and atmospheric measurements. Sensor deployment and thermal and microwave observations are discussed, along with two examples of the optical radiation measurements obtained during the experiment in support of radiative transfer modeling. Future activities pertaining to an archival system, synthetic aperture radar, carbon acquisition modeling, and upcoming field experiments are considered.

Smith, James A.↗

Monolithic millimeter-wave diode array beam controllers: Theory and experiment

In the current work, multi-function beam control arrays have been fabricated and have successfully demonstrated amplitude control of transmitted beams in the W and D bands (75-170 GHz). While these arrays are designed to provide beam control under DC bias operation, new designs for high-speed electronic and optical control are under development. These arrays will fill a need for high-speed watt-level beam switches in pulsed reflectometer systems under development for magnetic fusion plasma diagnostics. A second experimental accomplishment of the current work is the demonstration in the 100-170 GHz (D band) frequency range of a new technique for the measurement of the transmission phase as well as amplitude. Transmission data can serve as a means to extract ('de-embed') the grid parameters; phase information provides more complete data to assist in this process. Additional functions of the array beam controller yet to be tested include electronically controlled steering and focusing of a reflected beam. These have application in the areas of millimeter-wave electronic scanning radar and reflectometry, respectively.

Sjogren, L. B.↗

Integrated fiber optic probe for dynamic light scattering

An integrated fiber optic probe, comprising a monomode optical fiber fusion spliced to a short length of a graded-index multimode fiber, is fabricated for use as a coherent receiver in dynamic light scattering. The multimode fiber is cleaved to provide a gradient-index fiber lens with a focal length of 125 microns and an f-number close to unity. An integrated fiber receiver is used to measure the intensity-intensity autocorrelation data from a 0.05 percent by weight concentration of an aqueous suspension of polystyrene latex spheres. Analysis of 100 independent data sets indicates that the particle size can be recovered with an accuracy of +/- 1 percent.

Dhadwal, Harbans S.↗

Experimental results for the rapid determination of the freezing point of fuels

Two methods for the rapid determination of the freezing point of fuels were investigated: an optical method, which detected the change in light transmission from the disappearance of solid particles in the melted fuel; and a differential thermal analysis (DTA) method, which sensed the latent heat of fusion. A laboratory apparatus was fabricated to test the two methods. Cooling was done by thermoelectric modules using an ice-water bath as a heat sink. The DTA method was later modified to eliminate the reference fuel. The data from the sample were digitized and a point of inflection, which corresponds to the ASTM D-2386 freezing point (final melting point), was identified from the derivative. The apparatus was modifified to cool the fuel to -60 C and controls were added for maintaining constant cooling rate, rewarming rate, and hold time at minimum temperature. A parametric series of tests were run for twelve fuels with freezing points from -10 C to -50 C, varying cooling rate, rewarming rate, and hold time. Based on the results, an optimum test procedure was established. The results showed good agreement with ASTM D-2386 freezing point and differential scanning calorimetry results.

Mathiprakasam, B.↗

Ultra lightweight mirror performance at 8 degrees kelvin

Earlier work funded by DARPA, evaluating the optical stability of a 0.5-m ultra-lightweight, frit-bonded, fused silica mirror, is extended from the previous 100 deg K specification down to 8 deg K. The thermal stability is excellent and comparable to that for conventional fusion and solid mirrors. The total mirror change of 0.10 lambda rms (lambda = 0.6328 microns) meets the needs of most IR systems. Thermal elastic quilting is excellent (0.008 lambda). Ames Research Center and Kodak data evaluations, done independently, are in very good agreement.

Crowe, D. A.↗

Bridging the Last Mile with Open-Source Advancements: Empowering Communities through Fusion of Aerosol Optical Depth (AOD) Products from Multi-Satellite Sensors

Aerosol Optical Depth (AOD) is a crucial parameter for understanding atmospheric aerosol distribution and their impact on climate and air quality. With the growing number of Earth observation satellites, there is an abundance of AOD products derived from various sensors onboard both geostationary and low-orbit satellites. The availability of multiple datasets provides an opportunity to harness the strengths of each sensor and create comprehensive and accurate AOD datasets for climate and air quality studies at different temporal and spatial scales. Our NASA aerosol MEaSURES project has made significant strides in recent years by undertaking the ambitious task of developing an open-source package tailored for fusing AOD products from different sources. The package is based on OOP (Object-Oriented Programming) design and is implemented in Python modules. Generic interfaces enable easy inclusion of large and heterogeneous data. The package may be utilized to produce harmonized AOD datasets with enhanced spatial and temporal coverage. The latest version of the package is able to process and integrate the dark-target AOD data from six different sensors: AHI Himawari-8, ABI GOES-West, ABI GOES-East, MODIS AQUA, MODIS TERRA, and VIIRS SNPP. Rigorous validation and intercomparison studies have been performed to assess the accuracy and reliability of the fused AOD product against ground-based measurements and reference datasets. The open-source nature of the developed package ensures transparency, reproducibility, and community engagement. The research community and stakeholders can access, contribute to, and further improve the fusion methodology, making it adaptable to other studies, or expanding it to include new satellite data as they become available. In this poster presentation, we will introduce the accomplishments and challenges faced during the development of the open-source package for AOD data fusion, and demonstrate the advantages of combining AOD products from the six aforementioned satellite sensors. The presentation aims to foster discussions, collaborations, and future directions in integrating Earth observation and remote sensing data, which may contribute to a better understanding of atmospheric aerosols and their impacts on our environment.

Zhaohui Zhang↗

Ground to Air Testing of a Fused Optical-Radar Aircraft Detection and Tracking System

Onboard detection and tracking capability are integral to the sensing component in collision avoidance systems needed to safely operate autonomous urban air taxis and small Unmanned Aircraft Systems. Ground-based validation of detection and tracking systems is an important milestone towards the end goal of real-time collision avoidance using onboard sensors and algorithms. In this work, we evaluate three Extended Kalman Filter(EKF)based fusion trackers with radar and vision detection inputs, and compare them with baseline trackers for each sensor type. Performance is assessed using field collected data of ground to air test flights with the sensors co-located on a stable platform with an instrumented multirotor acting as the intruder performing a waypoint pattern at a distance of1.1km to 0.3km to simulate a head-on collision geometry. Fusing an image-based morphological detector with a radar detector using an EKF covered 74% of the ground truth position updates logged by the flight controller on the multirotor within 50 meters after accounting for alignment offsets while covering 15% more ground truth updates relative to radar only. Removing timestamps when the intruder aircraft is occluded by trees and only considering timestamps where the radar has an update, the EKF image-based morphological detector combined with the radar detector covered 90% of the of the ground truth position updates within 50metersand 97% within 100 meters.

Chester V Dolph↗