Search NASA⌕ Search

SEARCH · Search NASA

Results for “Advanced Image Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Onboard image processing

The possibility of onboard geometric correction of Thematic Mapper type imagery to make possible image registration is considered. Typically, image registration is performed by processing raw image data on the ground. The geometric distortion (e.g., due to variation in spacecraft location and viewing angle) is estimated by using a Kalman filter updated by correlating the received data with a small reference subimage, which has known location. Onboard image processing dictates minimizing the complexity of the distortion estimation while offering the advantages of a real time environment. In keeping with this, the distortion estimation can be replaced by information obtained from the Global Positioning System and from advanced star trackers. Although not as accurate as the conventional ground control point technique, this approach is capable of achieving subpixel registration. Appropriate attitude commands can be used in conjunction with image processing to achieve exact overlap of image frames. The magnitude of the various distortion contributions, the accuracy with which they can be measured in real time, and approaches to onboard correction are investigated.

Martin, D. R.↗

User's guide to image processing applications of the NOAA satellite HRPT/AVHRR data. Part 1: Introduction to the satellite system and its applications. Part 2: Processing and analysis of AVHRR imagery

The use of NOAA Advanced Very High Resolution Radar/High Resolution Picture Transmission (AVHRR/HRPT) imagery for earth resource applications is provided for the applications scientist for use within the various Earth science, resource, and agricultural disciplines. A guide to processing NOAA AVHRR data using the hardware and software systems integrated for this NASA project is provided. The processing steps from raw data on computer compatible tapes (1B data format) through usable qualitative and quantitative products for applications are given. The manual is divided into two parts. The first section describes the NOAA satellite system, its sensors, and the theoretical basis for using these data for environmental applications. Part 2 is a hands-on description of how to use a specific image processing system, the International Imaging Systems, Inc. (I2S) Model 75 Array Processor and S575 software, to process these data.

Huh, Oscar Karl↗

Land and Atmosphere Near-Real-Time Capability for Earth Observing System

The past decade has seen a rapid increase in availability and usage of near-real-time data from satellite sensors. The EOSDIS (Earth Observing System Data and Information System) was not originally designed to provide data with sufficiently low latency to satisfy the requirements for near-real-time users. The EOS (Earth Observing System) instruments aboard the Terra, Aqua and Aura satellites make global measurements daily, which are processed into higher-level 'standard' products within 8-40 hours of observation and then made available to users, primarily earth science researchers. However, applications users, operational agencies, and even researchers desire EOS products in near-real-time to support research and applications, including numerical weather and climate prediction and forecasting, monitoring of natural hazards, ecological/invasive species, agriculture, air quality, disaster relief and homeland security. These users often need data much sooner than routine science processing allows, usually within 3 hours, and are willing to trade science product quality for timely access. While Direct Broadcast provides more timely access to data, it does not provide global coverage. In 2002, a joint initiative between NASA (National Aeronautics and Space Administration), NOAA (National Oceanic and Atmospheric Administration), and the DOD (Department of Defense) was undertaken to provide data from EOS instruments in near-real-time. The NRTPE (Near Real Time Processing Effort) provided products within 3 hours of observation on a best-effort basis. As the popularity of these near-real-time products and applications grew, multiple near-real-time systems began to spring up such as the Rapid Response System. In recognizing the dependence of customers on this data and the need for highly reliable and timely data access, NASA's Earth Science Division sponsored the Earth Science Data and Information System Project (ESDIS)-led development of a new near-real-time system called LANCE (Land, Atmosphere Near-Real-Time Capability for EOS) in 2009. LANCE consists of special processing elements, co-located with selected EOSDIS data centers and processing facilities. A primary goal of LANCE is to bring multiple near-real-time systems under one umbrella, offering commonality in data access, quality control, and latency. LANCE now processes and distributes data from the Moderate Resolution Imaging Spectroradiometer (MODIS), Atmospheric Infrared Sounder (AIRS), Advanced Microwave Scanning Radiometer Earth Observing System (AMSR-E), Microwave Limb Sounder (MLS) and Ozone Monitoring Instrument (OMI) instruments within 3 hours of satellite observation. The Rapid Response System and the Fire Information for Resource Management System (FIRMS) capabilities will be incorporated into LANCE in 2011. LANCE maintains a central website to facilitate easy access to data and user services. LANCE products are extensively tested and compared with science products before being made available to users. Each element also plans to implement redundant network, power and server infrastructure to ensure high availability of data and services. Through the user registration system, users are informed of any data outages and when new products or services will be available for access. Building on a significant investment by NASA in developing science algorithms and products, LANCE creates products that have a demonstrated utility for applications requiring near-real-time data. From lower level data products such as calibrated geolocated radiances to higher-level products such as sea ice extent, snow cover, and cloud cover, users have integrated LANCE data into forecast models and decision support systems. The table above shows the current near-real-time product categories by instrument. The ESDIS Project continues to improve the LANCE system and use the experience gained through practice to seek adjustments to improve the quality and performance of the system. For example, anGC-compliant Web Map Service (WMS) will be added shortly that will allow users to download geo-referenced MODIS images for arbitrary bounding boxes. Further, an OGC-compliant Web Coverage Service (WCS) will be added later this year that will expedite user access to arbitrary data subsets or re-formatted products. AIRS images are now served through WMS and available in multiple formats (PNG, GeoTIFF, KMZ). NASA has established a LANCE User Working Group to steer the development of the system and create a forum for sharing ideas and experiences that are expected to further improve the LANCE capabilities. The LANCE system has proved a success by satisfying the growing needs of the applications and operational communities for land and atmosphere data in near-real-time. NASA's Earth Sciences Division was able to leverage existing science research capabilities to provide the near-real-time community with products and imagery that support monitoring of disasters in a timely manner.

Murphy, Kevin J.↗

Lessons Learned from Recent Rapid Imaging of Earthquake Ruptures with Satellite Geodesy

Rapid determination of the location and extent of earthquake ruptures at the surface and at depth is helpful for disaster response, as it allows prediction of the likely area of major damage from the earthquake and can help with rescue and recovery planning. The Caltech-Jet Propulsion Laboratory (JPL) Advanced Rapid Imaging and Analysis (ARIA) project has responded to many recent large earthquakes to process geodetic data and help determine the location and extent of ruptures. With the increasing availability of near real-time data from the Global Positioning System (GPS) and other global navigation satellite system receivers in active tectonic regions, and with the shorter repeat times of many recent and newly launched radar satellites, geodetic data can now be obtained quickly after earthquakes or other disasters. We have been building an ARIA data system that can ingest, catalog, and process geodetic data and combine it with seismic analysis to estimate the fault rupture locations and slip distributions for large earthquakes that are on or near land.

Simons, Mark↗

Conference on Charge-Coupled Device Technology and Applications

Papers were presented from the conference on charge coupled device technology and applications. The following topics were investigated: data processing; infrared; devices and testing; electron-in, x-ray, radiation; and applications. The emphasis was on the advances of mutual relevance and potential significance both to industry and NASA's current and future requirements in all fields of imaging, signal processing and memory.

Source record↗

Characteristics of maximum-value composite images from temporal AVHRR data

Red and near-infrared satellite data from the Advanced Very High Resolution Radiometer sensor have been processed over several days and combined to produce spatially continuous cloud-free imagery over large areas with sufficient temporal resolution to study green-vegetation dynamics. The technique minimizes cloud contamination, reduces directional reflectance and off-nadir viewing effects, minimizes sun-angle and shadow effects, and minimizes aerosol and water-vapor effects. The improvement is highly dependent on the state of the atmosphere, surface-cover type, and the viewing and illumination geometry of the sun, target and sensor. An example from southern Africa showed an increase of 40 percent from individual image values tothe final composite image. Limitations associated with the technique are discussed, and recommendations are given to improve this approach.

Holben, Brent N.↗

Optimized manufacturing process for multilayer two-dimensional focusing mirrors in laboratory X-ray applications

Recent advances in laboratory X-ray applications require high-performance optical components that achieve exceptional imaging resolution and beam uniformity within compact experimental setups. Montel mirrors have become a preferred solution due to their unique dual-reflection focusing mechanism and a space-efficient design. Here, in this study, we present an effective manufacturing process for producing Montel mirrors tailored to focus laboratory X-ray beams. The mirrors were fabricated from single-crystal silicon substrates, chosen for their high mechanical stability and compatibility with precision polishing techniques. Our approach begins with the integration of a deterministic chemo-mechanical polishing (CMP)-based pre-shaping step followed by ion beam figuring (IBF), significantly improving manufacturing efficiency. Subsequently, our custom-developed advanced metrology and IBF techniques were employed for fabricating an off-axis, elliptical cylinder Montel mirror system with a 6-mrad total slope, with stringent optical specifications. While post-IBF processes, including multilayer coating, dicing, and gluing, introduced minor surface errors, yet their impact on performance remained negligible. The Montel mirrors manufactured with the optimized process exhibited significantly improved beam uniformity and a reduced focal spot size. These findings validate our approach as a viable solution for high-precision Montel mirror fabrication and facilitate further advancements in laboratory X-ray applications.

36 MATERIALS SCIENCE↗

Impact of atomic substitution on core-hole relaxation dynamics: A study of Br 2 and IBr

Understanding inner-shell decay processes in heavy-element molecules is essential for unraveling x-ray-induced photodynamics and advancing molecular imaging techniques. Here, in this study, we investigate the influence of atomic substitution on core-hole relaxation dynamics and molecular fragmentation in Br 2 and IBr, initiated by x-ray ionization absorption at the Br K-edge. Using a combination of x-ray/ion coincidence measurements and Monte Carlo/molecular dynamics simulations, we track the charge distribution and the kinetic energy release (KER) of fragment ions with a total charge from 2+ to 8+. For both molecules, the simulated KER values show good agreement with experiment across different fragmentation channels. Our comparison reveals that substituting Br with the heavier I atom in IBr has a minimal impact on the inner-shell electronic decay process but significantly influences nuclear motion, leading to slower dissociation and thus a KER close to the Coulomb limit—an effect attributed to the atomic mass. These findings highlight the interplay between electronic and nuclear effects in molecular fragmentation, particularly in heavy-element species, and provide new insights into medical therapies, structural biology, and astrophysics.

Bhat, Nivedita [Argonne National Laboratory (ANL),↗

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging↗

Radar clutter suppression

I have been working on something called clutter, which is an amount of “noise” caused by the surrounding environment in a radar system photo or image. The radar system is called “synthetic aperture radar” or SAR. Our group is trying to clarify the photo and hence data of an SAR image by removing clutter (and noise) from the photograph. This is done by utilizing advanced signal processing techniques and the MATLAB programming language on our computer.

Evans, Bradley [External Affiliation]↗

The EOS CERES Global Cloud Mask

To detect long-term climate trends, it is essential to produce long-term and consistent data sets from a variety of different satellite platforms. With current global cloud climatology data sets, such as the International Satellite Cloud Climatology Experiment (ISCCP) or CLAVR (Clouds from Advanced Very High Resolution Radiometer), one of the first processing steps is to determine whether an imager pixel is obstructed between the satellite and the surface, i.e., determine a cloud 'mask.' A cloud mask is essential to studies monitoring changes over ocean, land, or snow-covered surfaces. As part of the Earth Observing System (EOS) program, a series of platforms will be flown beginning in 1997 with the Tropical Rainfall Measurement Mission (TRMM) and subsequently the EOS-AM and EOS-PM platforms in following years. The cloud imager on TRMM is the Visible/Infrared Sensor (VIRS), while the Moderate Resolution Imaging Spectroradiometer (MODIS) is the imager on the EOS platforms. To be useful for long term studies, a cloud masking algorithm should produce consistent results between existing (AVHRR) data, and future VIRS and MODIS data. The present work outlines both existing and proposed approaches to detecting cloud using multispectral narrowband radiance data. Clouds generally are characterized by higher albedos and lower temperatures than the underlying surface. However, there are numerous conditions when this characterization is inappropriate, most notably over snow and ice of the cloud types, cirrus, stratocumulus and cumulus are the most difficult to detect. Other problems arise when analyzing data from sun-glint areas over oceans or lakes over deserts or over regions containing numerous fires and smoke. The cloud mask effort builds upon operational experience of several groups that will now be discussed.

Berendes, T. A.↗

Observations of breakup processes of liquid jets using real-time X-ray radiography

To unravel the liquid-jet breakup process in the nondilute region, a newly developed system of real-time X-ray radiography, an advanced digital image processor, and a high-speed video camera were used. Based upon recorded X-ray images, the inner structure of a liquid jet during breakup was observed. The jet divergence angle, jet breakup length, and fraction distributions along the axial and transverse directions of the liquid jets were determined in the near-injector region. Both wall- and free-jet tests were conducted to study the effect of wall friction on the jet breakup process.

Char, J. M.↗

Atomic resolution scanning transmission electron microscopy at liquid helium temperatures for quantum materials

Fundamental quantum phenomena in condensed matter, ranging from correlated electron systems to quantum information processors, manifest their emergent characteristics and behaviors predominantly at low temperatures. This necessitates the use of liquid helium (LHe) cooling for experimental observation. Atomic resolution scanning transmission electron microscopy combined with LHe cooling (cryo-STEM) provides a powerful characterization technique to probe local atomic structural modulations and their coupling with charge, spin and orbital degrees-of-freedom in quantum materials. However, achieving atomic resolution in cryo-STEM is exceptionally challenging, primarily due to sample drifts arising from temperature changes and noises associated with LHe bubbling, turbulent gas flow, etc. In this work, we demonstrate atomic resolution cryo-STEM imaging at LHe temperatures using a commercial side-entry LHe cooling holder. Firstly, we examine STEM imaging performance as a function of He gas flow rate, identifying two primary noise sources: He-gas pulsing and He-gas bubbling. Secondly, we propose two strategies to achieve low noise conditions for atomic resolution STEM imaging: either by temporarily suppressing He gas flow rate using the needle valve or by acquiring images during the natural warming process. Lastly, we show the applications of image acquisition methods and image processing techniques in investigating structural phase transitions in Cr 2 Ge 2 Te 6 , CuIr 2 S 4 , and CrCl 3 . In conclusion, our findings represent an advance in the field of atomic resolution electron microscopy imaging for quantum materials and devices at LHe temperatures, which can be applied to other commercial side-entry LHe cooling TEM holders.

36 MATERIALS SCIENCE↗

ThermoPore: Predicting part porosity based on thermal images using deep learning

Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R 2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.

Deep learning↗

Advanced InSb monolithic Charge Coupled Infrared Imaging Devices (CCIRID)

The continued development of monolithic InSb charge coupled infrared imaging devices (CCIRIDs) is discussed. The processing sequence and structural design of 20-element linear arrays are discussed. Also, results obtained from radiometric testing of the 20-element arrays using a clamped sample-and-hold output circuit are reported. The design and layout of a next-generation CCIRID chip are discussed. The major devices on this chip are a 20 by 16 time-delay-and-integration (TDI) area array and a 100-element linear imaging array. The development of a process for incorporating an ion implanted S(+) planar channel stop into the CCIRID structure and the development of a thin film transparent photogate are also addressed. The transparent photogates will increase quantum efficiency to greater than 70% across the 2.5 to 5.4 micrometer spectral region in future front-side illuminated CCIRIDs.

Koch, T. L.↗

Ranger's Legacy

With its Landsat satellites, development of sensors, and advancement of processing techniques, NASA provided the initial technology base for another Earth-benefit application of image processing, Earth resources survey by means of remote sensing. Since each object has its own unique "signature," it is possible to distinguish among surface features and to generate computer-processed imagery identifying specific features of importance to resource managers. This capability, commercialized by Perceptive Scientific Instruments, Inc., offers practical application in such areas as agricultural crop forecasting, rangeland and forest management, land use planning, mineral and petroleum exploration, map making, water quality evaluation and disaster assessment. Major users of the technology have been federal, state, and local governments, but it is making its way into commercial operations, for example, resource exploration companies looking for oil, gas and mineral sources, and timber production firms seeking more efficient treeland management. Supporting both government and private users is a small industry composed of companies producing the processing hardware software. As is the case in the medical application, many of these companies are direct offspring of NASA's work.

Source record↗

DBSAR's First Multimode Flight Campaign

The Digital Beamforming SAR (DBSAR) is an airborne imaging radar system that combines phased array technology, reconfigurable on-board processing and waveform generation, and advances in signal processing to enable techniques not possible with conventional SARs. The system exploits the versatility inherently in phased-array technology with a state-of-the-art data acquisition and real-time processor in order to implement multi-mode measurement techniques in a single radar system. Operational modes include scatterometry over multiple antenna beams, Synthetic Aperture Radar (SAR) over several antenna beams, or Altimetry. The radar was flight tested in October 2008 on board of the NASA P3 aircraft over the Delmarva Peninsula, MD. The results from the DBSAR system performance is presented.

Rincon, Rafael F.↗

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking interpretability, an essential aspect for deriving neuroscientific insight. To address this gap, we propose MoRE-Brain, a neuro-inspired framework designed for high-fidelity, adaptable, and interpretable visual reconstruction. MoRE-Brain uniquely employs a hierarchical Mixture-of-Experts architecture where distinct experts process fMRI signals from functionally related voxel groups, mimicking specialized brain networks. The experts are first trained to encode fMRI into the frozen CLIP space. A finetuned diffusion model then synthesizes images, guided by expert outputs through a novel dual-stage routing mechanism that dynamically weighs expert contributions across the diffusion process. MoRE-Brain offers three main advancements: First, it introduces a novel Mixture-of-Experts architecture grounded in brain network principles for neuro-decoding. Second, it achieves efficient cross-subject generalization by sharing core expert networks while adapting only subject-specific routers. Third, it provides enhanced mechanistic insight, as the explicit routing reveals precisely how different modeled brain regions shape the semantic and spatial attributes of the reconstructed image. Extensive experiments validate MoRE-Brain’s high reconstruction fidelity, with bottleneck analyses further demonstrating its effective utilization of fMRI signals, distinguishing genuine neural decoding from over-reliance on generative priors. Consequently, MoRE-Brain marks a substantial advance towards more generalizable and interpretable fMRI-based visual decoding.

Wei, Yuxiang [Georgia Institute of Technology]↗