Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning

Recent progress in machine learning methods and the emerging availability of programmable interfaces for scanning probe microscopes (SPMs) have propelled automated and autonomous microscopies to the forefront of attention of the scientific community. However, enabling automated microscopy requires the development of task-specific machine learning methods, understanding the interplay between physics discovery and machine learning, and fully defined discovery workflows. This, in turn, requires balancing the physical intuition and prior knowledge of the domain scientist with rewards that define experimental goals and machine learning algorithms that can translate these to specific experimental protocols. Here, we discuss the basic principles of Bayesian active learning and illustrate its applications for SPM. We progress from the Gaussian process as a simple data-driven method and Bayesian inference for physical models as an extension of physics-based functional fits to more complex deep kernel learning methods, structured Gaussian processes, and hypothesis learning. These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment. Here, the discussed framework can be universally applied to all techniques combining imaging and spectroscopy, SPM methods, nanoindentation, electron microscopy and spectroscopy, and chemical imaging methods and can be particularly impactful for destructive or irreversible measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep medical image analysis with representation learning and neuromorphic computing

Deep learning is increasingly used in medical imaging, improving many steps of the processing chain, from acquisition to segmentation and anomaly detection to outcome prediction. Yet significant challenges remain: (i) image-based diagnosis depends on the spatial relationships between local patterns, something convolution and pooling often do not capture adequately; (ii) data augmentation, the de facto method for learning three-dimensional pose invariance, requires exponentially many points to achieve robust improvement; (iii) labelled medical images are much less abundant than unlabelled ones, especially for heterogeneous pathological cases; and (iv) scanning technologies such as magnetic resonance imaging can be slow and costly, generally without online learning abilities to focus on regions of clinical interest. To address these challenges, novel algorithmic and hardware approaches are needed for deep learning to reach its full potential in medical imaging.

60 APPLIED LIFE SCIENCES↗

Alaska SAR processor implementation of E-ERS-1

The synthetic aperture radar (SAR) data processing algorithm used by the Alaska SAR Facility (ASF) for the European Space Agency's first Remote-Sensing Satellite (E-ERS-1) SAR data are examined. Preprocessing highlights two features: signal measurement, which includes signal-to-noise ratio, replica measurement, and noise measurement; and Doppler measurement, which includes clutter lock and autofocus. The custom pipeline architecture performs the main processing with controls at the input interface, range correlator, corner-turn memory, azimuth correlator, and multi-look memory. The control software employs a flexible control scheme. The Committee on Earth Observation Satellites (CEOS) format encapsulates the ASF products. System performance for SAR image processing of E-ERS-1 data is reviewed.

Cuddy, David↗

Clouds and the Earth's Radiant Energy System (CERES) algorithm theoretical basis document: Overviews (subsystem 0) - Volume 1

The theoretical bases for the Release 1 algorithms that will be used to process satellite data for investigation of the Clouds and the Earth's Radiant Energy System (CERES) are described. The architecture for software implementation of the methodologies is outlined. Volume 1 provides both summarized and detailed overviews of the CERES Release 1 data analysis system. CERES will produce global top-of-the-atmosphere shortwave and longwave radiative fluxes at the top of the atmosphere, at the surface, and within the atmosphere by using the combination of a large variety of measurements and models. The CERES processing system includes radiance observations from CERES scanning radiometers, cloud properties derived from coincident satellite imaging radiometers, temperature and humidity fields from meteorological analysis models, and high-temporal-resolution geostationary satellite radiances to account for unobserved times. CERES will provide a continuation of the ERBE record and the lowest error climatology of consistent cloud properties and radiation fields. CERES will also substantially improve our knowledge of the Earth's surface radiation budget.

Wielicki, Bruce A.↗

A Real-Time MODIS Vegetation Composite for Land Surface Models and Short-Term Forecasting

The NASA Short-term Prediction Research and Transition (SPoRT) Center is producing real-time, 1- km resolution Normalized Difference Vegetation Index (NDVI) gridded composites over a Continental U.S. domain. These composites are updated daily based on swath data from the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor aboard the polar orbiting NASA Aqua and Terra satellites, with a product time lag of about one day. A simple time-weighting algorithm is applied to the NDVI swath data that queries the previous 20 days of data to ensure a continuous grid of data populated at all pixels. The daily composites exhibited good continuity both spatially and temporally during June and July 2010. The composites also nicely depicted high greenness anomalies that resulted from significant rainfall over southwestern Texas, Mexico, and New Mexico during July due to early-season tropical cyclone activity. The SPoRT Center is in the process of computing greenness vegetation fraction (GVF) composites from the MODIS NDVI data at the same spatial and temporal resolution for use in the NASA Land Information System (LIS). The new daily GVF dataset would replace the monthly climatological GVF database (based on Advanced Very High Resolution Radiometer [AVHRR] observations from 1992-93) currently available to the Noah land surface model (LSM) in both LIS and the public version of the Weather Research and Forecasting (WRF) model. The much higher spatial resolution (1 km versus 0.15 degree) and daily updates based on real-time satellite observations have the capability to greatly improve the simulation of the surface energy budget in the Noah LSM within LIS and WRF. Once code is developed in LIS to incorporate the daily updated GVFs, the SPoRT Center will conduct simulation sensitivity experiments to quantify the impacts and improvements realized by the MODIS real-time GVF data. This presentation will describe the methodology used to develop the 1-km MODIS NDVI composites and show sample output from summer 2010, compare the MODIS GVF data to the AVHRR monthly climatology, and illustrate the sensitivity of the Noah LSM within LIS and/or the coupled LIS/WRF system to the new MODIS GVF dataset.

Case, Jonathan L.↗

Digital processing of stereoscopic image pairs.

The problem under consideration is concerned with scene analysis during robot navigation on the surface of Mars. In this mode, the world model of the robot must be continuously updated to include sightings of new obstacles and scientific samples. In order to describe the content of a particular scene, it is first necessary to segment it into known objects. One technique for accomplishing this segmentation is by analyzing the pair of images produced by the stereoscopic cameras mounted on the robot. A heuristic method is presented for determining the range for each point in the two-dimensional scene under consideration. The method is conceptually based on a comparison of corresponding points in the left and right images of the stereo pair. However, various heuristics which are adaptive in nature are used to make the algorithm both efficient and accurate. Examples are given of the use of this so-called range picture for the purpose of scene segmentation.

Levine, M. D.↗

Super-Resolution Ptychography with Small Segmented Detectors

To overcome the spatial resolution limit set by aperture-limited diffraction in traditional scanning transmission electron microscopy, microscopists have developed ptychography enabled by iterative phase retrieval algorithms and high-dynamic-range pixel array detectors. Current detector designs are limited by the data rate off chip, so a high-pixel-count detector has a proportionally lower frame rate than the few-segment detectors used for differential phase contrast (DPC) imaging. This slower acquisition speed leads to heightened vulnerability to scan noise, drift, and potential sample damage. This creates opportunities for repurposing fast segmented detectors for ptychography by trading a reduction in reciprocal space pixels for an increase in real space pixels. Here, we explore a strategy of oversampling in real space and instead apply detector pixel upsampling during the reconstruction process. Further, we demonstrate the viability of achieving super-resolution ptychography on thin objects using only 2 × 2 detector pixels, surpassing the resolution of integrated DPC (iDPC) imaging. With optimization using simulated datasets and experiments on MoTe 2 /WSe 2 bilayer moiré superlattices, we achieved super-resolution ptychography reconstructions under rapid acquisition conditions (37.5 pA, 1 μs dwell time), yielding over 50% improvements in contrast and information limit compared to annular dark field and iDPC imaging on the same detectors.

2D materials↗

Image-Based Methods to Score Fungal Pathogen Symptom Progression and Severity in Excised Arabidopsis Leaves

Image-based symptom scoring of plant diseases is a powerful tool for associating disease resistance with plant genotypes. Advancements in technology have enabled new imaging and image processing strategies for statistical analysis of time-course experiments. There are several tools available for analyzing symptoms on leaves and fruits of crop plants, but only a few are available for the model plant Arabidopsis thaliana (Arabidopsis). Arabidopsis and the model fungus Botrytis cinerea (Botrytis) comprise a potent model pathosystem for the identification of signaling pathways conferring immunity against this broad host-range necrotrophic fungus. Here, we present two strategies to assess severity and symptom progression of Botrytis infection over time in Arabidopsis leaves. Thus, a pixel classification strategy using color hue values from red-green-blue (RGB) images and a random forest algorithm was used to establish necrotic, chlorotic, and healthy leaf areas. Secondly, using chlorophyll fluorescence (ChlFl) imaging, the maximum quantum yield of photosystem II (Fv/Fm) was determined to define diseased areas and their proportion per total leaf area. Both RGB and ChlFl imaging strategies were employed to track disease progression over time. This has provided a robust and sensitive method for detecting sensitive or resistant genetic backgrounds. A full methodological workflow, from plant culture to data analysis, is described.

59 BASIC BIOLOGICAL SCIENCES↗

Radiometric Calibration of the Earth Observing System's Imaging Sensors

The work on the grant was mainly directed towards developing new, accurate, redundant methods for the in-flight, absolute radiometric calibration of satellite multispectral imaging systems and refining the accuracy of methods already in use. Initially the work was in preparation for the calibration of MODIS and HIRIS (before the development of that sensor was canceled), with the realization it would be applicable to most imaging multi- or hyper-spectral sensors provided their spatial or spectral resolutions were not too coarse. The work on the grant involved three different ground-based, in-flight calibration methods reflectance-based radiance-based and diffuse-to-global irradiance ratio used with the reflectance-based method. This continuing research had the dual advantage of: (1) developing several independent methods to create the redundancy that is essential for the identification and hopefully the elimination of systematic errors; and (2) refining the measurement techniques and algorithms that can be used not only for improving calibration accuracy but also for the reverse process of retrieving ground reflectances from calibrated remote-sensing data. The grant also provided the support necessary for us to embark on other projects such as the ratioing radiometer approach to on-board calibration (this has been further developed by SBRS as the 'solar diffuser stability monitor' and is incorporated into the most important on-board calibration system for MODIS)- another example of the work, which was a spin-off from the grant funding, was a study of solar diffuser materials. Journal citations, titles and abstracts of publications authored by faculty, staff, and students are also attached.

Slater, Philip N.↗

Intelligent Observation Strategies for Geosynchronous Remote Sensing for Natural Hazards

Geosynchronous satellites offer a unique perspective for monitoring environmental factors important to understanding natural hazards and supporting the disasters management life cycle, namely forecast, detection, response, recovery and mitigation. In the NASA decadal survey for Earth science, the GEO-CAPE mission was proposed to address coastal and air pollution events in geosynchronous orbit, complementing similar initiatives in Asia by the South Koreans and by ESA in Europe, thereby covering the northern hemisphere. In addition to analyzing the challenges of identifying instrument capabilities to meet the science requirements, and the implications of hosting the instrument payloads on commercial geosynchronous satellites, the GEO-CAPE mission design team conducted a short study to explore strategies to optimize the science return for the coastal imaging instrument. The study focused on intelligent scheduling strategies that took into account cloud avoidance techniques as well as onboard processing methods to reduce the data storage and transmission loads. This paper expands the findings of that study to address the use of intelligent scheduling techniques and near-real time data product acquisition of both the coastal water and air pollution events. The topics include the use of onboard processing to refine and execute schedules, to detect cloud contamination in observations, and to reduce data handling operations. Analysis of state of the art flight computing capabilities will be presented, along with an assessment of cloud detection algorithms and their performance characteristics. Tools developed to illustrate operational concepts will be described, including their applicability to environmental monitoring domains with an eye to the future. In the geostationary configuration, the payload becomes a networked thing with enough connectivity to exchange data seamlessly with users. This allows the full field of view to be sensed at very high rate under the control of ground infrastructure, resulting in improved efficiencies, accuracy and science benefits. Hence a remote sensing payload and its data may become one of millions of connected objects in the emerging Internet of Things (IoT), and be as easily accessible by a users smart phone as any other smart appliance.

Automated Tracking of Shallow Maritime Clouds on Geostationary Imagery to Extract Lifecycle Characteristics

Shallow moist convection is ubiquitous throughout the tropics and represents a key player in boundary layer processes. Satellites have provided many statistics on shallow clouds, such as size, structure, and geographical coverage, from static views of recurring cloud fields. But determining why certain cloud features appear and persist for different periods requires a time-evolving view of their behaviors. Geostationary satellites provide a unique opportunity to follow the time evolution of individual convective features, given their enhanced spatial and temporal sampling. A cloud-tracking tool was developed to identify properties of cloud lifecycle from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2EX) field campaign of 2019. The mission conducted intensive sampling of shallow cumulus in the West Pacific Ocean, in tandem with Rapid Scan imagery from the Advanced Himawari Imager (AHI) on the Japan Meteorological Agency’s (JMA) Himawari-8 satellite. Shallow cumulus was segmented according to thresholds in 0.5-km visible reflectance and with blurring techniques. Despite being limited to daytime hours, the segmentations yielded the best resolution possible for capturing cloud initiation and decay. The tracking procedure is based on a computer vision package that includes Kalman filters for motion prediction, object overlap search, and the Hungarian (or Kuhn-Munkres) matching algorithm for track designation. AHI radiances available within the tracked cloud boundaries are assembled to form individual spectral histories. The resulting catalog provides thousands of cloud histories for domains measuring only a few degrees in latitude and longitude. We present an overview of the cloud-tracking tool, strategies to identify development stages from cloud tracks, and preliminary results that document cumulus lifecycle properties from satellite. The application of AHI 0.5-km reflectance has both strengths and limitations when attempting to track lifecycles of the smallest resolvable clouds. We show that by aggregating cloud tracks from a few case studies of CAMP2EX, we can discern differences in cloud lifetime and development according to ensembles selected from areas of interest. The results demonstrate an ability to quantify lifetimes and assess rates of change in cloud characteristics that are likely controlled by the surrounding environment and meteorology.

Cloud Tracking↗

Dispersion and Aging of Volcanic Aerosols after the La Soufriere Eruption in April 2021

Volcanic aerosols change the atmospheric composition and thereby affect weather and climate. Aerosol dynamic processes such as nucleation, condensation, and coagulation modify the shape, size, and mass of aerosol particles, which influence their atmospheric lifetime and radiative properties. Nevertheless, most models omit these processes for ash particles. In this work, we explore the ash aerosol aging and sulfate production during the first 4 days following the 2021 La Soufrière (St. Vincent) eruption with the ICON-ART model (ICOsahedral Nonhydrostatic model with Aerosol and Reactive Trace gases). Online coupling of ICON-ART with a one-dimensional volcanic plume model calculates volcanic emission, which makes it possible to resolve the different eruption phases of the noncontinuous La Soufrière eruption. We compared our simulated aerosol distribution and composition with observations from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument, the Multiangle Imaging SpectroRadiometer (MISR) Research Aerosol (RA) Algorithm, and the Barbados Cloud Observatory (BCO). We show that online coupling is essential to adequately model the emissions and plume development close to the volcano. The modeled aerosol aging is in very good agreement with observations from MISR near the emission source and with CALIOP at larger distances. Furthermore, particle aging occurs faster in the troposphere than in the stratosphere due to the availability of water vapor and OH, but a layer of coated ash appears at the plume top due to faster oxidation of SO2 and lofting by aerosol-radiation interaction. This paper gives the first direct comparison of aerosol aging in volcanic eruption plumes between simulations and observations

volcanic aerosols↗

Artificial Intelligence Application to D and D - 20492

As aging facilities across the DOE complex await decommissioning, there is an ongoing need to understand any changes in the structural conditions. Many of these facilities were built over 50 years ago and, in some cases, these facilities have gone beyond the expected operational lifetime. Many facilities have been placed in a state of 'cold and dark,' sitting unused and awaiting decommissioning. Especially challenging are the aging facilities that provide unique operational/production capabilities to support critical DOE missions and cannot be shut down. In any of these scenarios, the structural integrity of these facilities may become compromised as time passes. It is critical that adequate inspections be performed on a continual basis and that the data collected undergoes sufficient analysis to support timely identification of any new or worsening structural issues as well as prompt needed maintenance and repairs to maintain the facilities in a safe condition. In recent days, Artificial Intelligence (AI) [1] and its application to various domains are growing at fast speed. FIU is performing research in this area and exploring the associated technologies to solve nuclear decommissioning problems. Artificial intelligence refers to the capability of a program to autonomously act, react and adapt to the working environment. AI enables the machine to behave like humans and perform the cognitive functions such as 'learning' and 'problem solving'. AI systems gradually moving from traditional approaches (algorithms and expert systems) towards more efficient and advanced technologies (machine learning [1] and deep learning [2] [3]). AI is the study of algorithms and statistical models that is being used by computers to perform specific tasks without using explicit instructions. FIU is working to develop a pilot-scale infrastructure to implement structural health monitoring using AI technologies with focus on machine learning, deep learning. This research is focused on Computer Vision/Image Classification area of AI applications. This can also be expanded to other areas of AI related to Object Recognition and Character Recognition in images. In addition to utilizing existing data sets, FIU will collect and investigate image and video data using FIU test-bed mockups to monitor structural health of the facility. Resulting data will be processed and analyzed using machine learning/deep learning technologies. The proposed pilot system is intended to serve as a starting point to engage the DOE field sites on related data sets and their decision making needs. It is anticipated that proposed machine learning/deep learning technologies can be effectively employed using anomaly detection to solve EM challenges in surveillance and maintenance of the D and D facilities. FIU will work with research stakeholders to identify applications at various sites and other DOE facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Imaging and Segmenting Grains and Subgrains Using Backscattered Electron Techniques

We present two new methods of processing data from backscattered electron signals in a scanning electron microscope to image grains and subgrains. The first combines data from multiple backscattered electron images acquired at different specimen geometries to (1) better reveal grain boundaries in recrystallized microstructures and (2) distinguish between recrystallized and unrecrystallized regions in partially recrystallized microstructures. The second utilizes spherical harmonic transform indexing of electron backscatter diffraction patterns to produce high angular resolution orientation data that enable the characterization of subgrains. Subgrains are produced during high-temperature plastic deformation and have boundary misorientation angles ranging from a few degrees down to a few hundredths of a degree. Here, we also present an algorithm to automatically segment grains from combined backscattered electron image data or grains and subgrains from high angular resolution electron backscatter diffraction data. Together, these new techniques enable rapid measurements of individual grains and subgrains from large populations.

36 MATERIALS SCIENCE↗

Preliminary Design and Analysis of the GIFTS Instrument Pointing System

The Geosynchronous Imaging Fourier Transform Spectrometer (GIFTS) Instrument is the next generation spectrometer for remote sensing weather satellites. The GIFTS instrument will be used to perform scans of the Earth s atmosphere by assembling a series of field-of- views (FOV) into a larger pattern. Realization of this process is achieved by step scanning the instrument FOV in a contiguous fashion across any desired portion of the visible Earth. A 2.3 arc second pointing stability, with respect to the scanning instrument, must be maintained for the duration of the FOV scan. A star tracker producing attitude data at 100 Hz rate will be used by the autonomous pointing algorithm to precisely track target FOV s on the surface of the Earth. The main objective is to validate the pointing algorithm in the presence of spacecraft disturbances and determine acceptable disturbance limits from expected noise sources. Proof of concept validation of the pointing system algorithm is carried out with a full system simulation developed using Matlab Simulink. Models for the following components function within the full system simulation: inertial reference unit (IRU), attitude control system (ACS), reaction wheels, star tracker, and mirror controller. With the spacecraft orbital position and attitude maintained to within specified limits the pointing algorithm receives quaternion, ephemeris, and initialization data that are used to construct the required mirror pointing commands at a 100 Hz rate. This comprehensive simulation will also aid in obtaining a thorough understanding of spacecraft disturbances and other sources of pointing system errors. Parameter sensitivity studies and disturbance analysis will be used to obtain limits of operability for the GIFTS instrument. The culmination of this simulation development and analysis will be used to validate the specified performance requirements outlined for this instrument.

Zomkowski, Paul P.↗

Automated Tracking of Shallow Maritime Clouds on Geostationary Imagery to Extract Lifecycle Characteristics

Shallow moist convection is ubiquitous throughout the tropics and represents a key player in boundary layer processes. Satellites have provided valuable insight on shallow clouds, such as size, structure, and geographical coverage, from static views of recurring cloud fields. But determining why certain cloud features appear and persist for different periods requires a time-evolving view of their behaviors. Geostationary satellites provide a unique opportunity to follow the time evolution of individual convective features, given their enhanced spatial and temporal sampling. A cloud-tracking tool was developed to identify properties of cloud lifecycle from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2EX) field campaign of 2019. The mission conducted intensive sampling of shallow cumulus in the West Pacific Ocean, in tandem with Rapid Scan imagery from the Advanced Himawari Imager (AHI) on the Japan Meteorological Agency’s (JMA) Himawari-8 satellite. Shallow cumulus were segmented according to thresholds in 0.5-km visible reflectance and with blurring techniques. Despite being limited to daytime hours, the segmentations yielded the best resolution available for capturing cloud initiation, growth, and decay. The tracking procedure is based on a computer vision package that includes Kalman filters for motion prediction, object overlap search, and the Hungarian (or Kuhn-Munkres) matching algorithm for track designation. AHI radiances available within the tracked cloud boundaries are assembled to form individual spectral histories. The resulting catalog provides thousands of cloud histories for domains measuring only a few degrees in latitude and longitude. We present an overview of the cloud-tracking tool and its results for cloud fields sampled throughout CAMP2EX by the airborne P-3. Cloud tracks were selected from about 10 flights to form ensembles, specific groups of tracks occurring in a region with airborne sampling. Cloud lifecycle properties, including duration and maximum area, are calculated for all ensemble members, and analyzed for cloud behavior and P-3 coincidences. By following this strategy, we quantitatively assess the degree of airborne sampling for specific cloud classes defined by the lifecycle calculations. We can summarize which cloud classes had more sampling, the stage of development during sampling, and general differences in character (e.g., isolated congestus vs. cold-pool producer).

Cloud Tracking↗

Automated thematic mapping and change detection of ERTS-A images

The author has identified the following significant results. In the first part of the investigation, spatial and spectral features were developed which were employed to automatically recognize terrain features through a clustering algorithm. In this part of the investigation, the size of the cell which is the number of digital picture elements used for computing the spatial and spectral features was varied. It was determined that the accuracy of terrain recognition decreases slowly as the cell size is reduced and coincides with increased cluster diffuseness. It was also proven that a cell size of 17 x 17 pixels when used with the clustering algorithm results in high recognition rates for major terrain classes. ERTS-1 data from five diverse geographic regions of the United States were processed through the clustering algorithm with 17 x 17 pixel cells. Simple land use maps were produced and the average terrain recognition accuracy was 82 percent.

Gramenopoulos, N.↗

X-ray nano-holotomography reconstruction with simultaneous probe retrieval

In conventional tomographic reconstruction, the pre-processing step includes flat-field correction, where each sample projection on the detector is divided by a reference image taken without the sample. When using coherent X-rays as a probe, this approach overlooks the phase component of the illumination field (probe), leading to artifacts in phase-retrieved projection images, which are then propagated to the reconstructed 3D sample representation. The problem intensifies in nano-holotomography with focusing optics, which, due to various imperfections creates high-frequency components in the probe function. Here, we present a new iterative reconstruction scheme for holotomography, simultaneously retrieving the complex-valued probe function. Implemented on GPUs, this algorithm results in 3D reconstruction resolving twice thinner layers in a 3D ALD standard sample measured using nano-holotomography.

Nikitin, Viktor↗