Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Verification of TROPOMI NO2 Product Using OMI NO2 algorithm

We evaluated S5P TROPOspheric Monitoring Instrument (TROPOMI) operational nitrogen dioxide (NO2) product by comparing with the NO2 retrievals from Ozone Monitoring Instrument (OMI) onboard NASA’s Aura satellite. We compared spatially matched NO2 vertical column density (VCD) data from OMI and TROPOMI to identify any discrepancies between the two operational products. We also applied OMI Air-Mass Factor (AMF) algorithm to TROPOMI Slant Column Density (SCD) data (v02.03.01) aiming to create long-term merged NO2 Earth Science Data Record (https://disc.gsfc.nasa.gov/datasets/TROPOMI_MINDS_NO2_1.1/summary ). The algorithm (version 4.0) uses new Geometry-dependent Lambertian Equivalent surface Reflectivity (GLER) product available for each TROPOMI pixel. GLER is pre-calculated using the vector linearized discrete ordinate radiative transfer (VLIDORT) model, which uses as input high-resolution bidirectional reflectance distribution function (BRDF) information from NASA's Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) over land and the wind-dependent Cox–Munk wave-facet slope distribution over water, the latter with a contribution from the water-leaving radiance based on MODIS gap-filled in-water chlorophyll-a data. The GLER data, combined with consistently retrieved cloud parameters, provide improved information for the calculation of the scattering weight profiles. Additional AMF improvements result from using high resolution (0.25o latitude x 0.25o longitude) a priori NO2 profile shapes and other auxiliary information from the Global Modeling Initiative (GMI) Replay simulation sampled using S5P orbital simulator. Our TROPOMI_MINDS_NO2 algorithm employs the stratosphere-troposphere separation scheme, de-striping, and surface snow/ice treatment consistently with the latest OMI NO2 re-processing (version 4). We evaluate the TROPOMI_MINDS_NO2 product by comparing with the S5P operational NO2 product as well as with independent NO2 observations from ground-based Pandora and aircraft observations. Our results indicate that the new TROPOMI_MINDS_NO2 retrievals are generally higher than the S5P operational NO2 product over polluted regions and show improved agreement with independent validation data.

TROPOMI↗

Simulated Feasibility of 3-D Lightning Mapping From Space

In addition to the awe it inspires, lightning can illuminate the microphysical processes hidden away within deep convection. The current generation of space-based lightning mapping uses mostly 2-D optical imaging to connect overall flash characteristics to their parent storm dynamics, but are missing a dimension’s worth of information. With lightning now classified as an essential climate variable, future spaceborne mappers will need improved capabilities to take advantage of the 3-D structure of lightning flashes to support meteorological and climate modeling. We report here on a study of the feasibility of high-resolution 3-D lightning mapping using a radio frequency (RF)-based network of satellites from low-Earth orbit (LEO). Lightning sources are simulated using existing lightning mapping array (LMA) tools, modified for orbital detection, and spatially reconstructed using a Levenberg–Marquardt geolocation algorithm to assess sources of uncertainty in these solutions. We analyze the benefits and limitations of this approach compared to existing orbital and ground-based methods. Results of this study show that lightning can be mapped in 3-D with a vertical location accuracy better than 2 km using as few as five satellites in LEO capable of measuring the time-of-arrival of impulsive RF signals in the very high-frequency (VHF) band. The consequence of this study is that high-resolution, spaceborne 3-D mapping of lightning is achievable across most of the globe, having crucial implications for our understanding of not only lightning, but also severe weather development, climate science, and more.

47 OTHER INSTRUMENTATION↗

Open Reproducible Electron Microscopy Data Analysis

Electron microscopy (EM) is a cornerstone technique in the materials and biological sciences capable of imaging structures at nano- to atomic-scale resolution. Advances in technologies mean that one acquires datasets at increasing data rates and sizes. These advancements present enormous opportunities for researchers to understand complex systems. However, processing the resulting large-scale, complex data in a reproducible and shareable way is a real challenge for researchers. The building, managing, and maintaining complex workflows in a reproducible manner requires extensive knowledge in several areas outside the researchers’ core skill sets, such as software engineering, data science, and high-performance computing (HPC). Our work demonstrates an innovative approach to solving these problems, enabling reproducible EM data analysis through container encapsulated pipelines. Using modern container technologies, we encapsulate processing elements and connect them using shared memory. We expose user-friendly, advanced algorithms and tools to allow end users to utilize without expert programming skills. The platform enables reproducible, scalable, shareable pipelines for the analysis and visualization of EM data. Focusing on interoperability, we leverage the DOE and other agencies’ existing investments to provide a powerful software platform for EM data analysis.

Harris, Christopher↗

Simulated Feasibility of 3D Lightning Mapping from Space

In addition to the awe it inspires, lightning can illuminate the microphysical processes hidden away within deep convection. The current generation of space-based lightning mapping uses mostly 2D optical imaging to connect overall flash characteristics to their parent storm dynamics, but are missing a dimension’s worth of information. With lightning now classified as an essential climate variable, future spaceborne mappers will need improved capabilities to take advantage of the 3D structure of lightning flashes to support meteorological and climate modeling. We report here on a study of the feasibility of implementing a radio frequency (RF)–based network of satellites for 3D lightning mapping in high resolution from low Earth orbit (LEO). Lightning sources are simulated using existing tools of the Lightning Mapping Array (LMA), modified for orbital detection, and spatially reconstructed using a Levenberg-Marquardt geolocation algorithm to assess sources of uncertainty in these solutions. We analyze the benefits and limitations of this approach compared to existing orbital and ground-based methods. Results of this study show that lightning can be mapped in 3D with a vertical location accuracy better than 2 km using as few as five satellites in LEO capable of measuring the time-of-arrival of impulsive RF signals in the very high frequency (VHF) band. The consequence of this study is that high-resolution, spaceborne 3D mapping of lightning is achievable across most of the globe, having crucial implications for our understanding of not only lightning, but also severe weather development, climate science, and more.

CubeSpark↗

On the optimality of a universal noiseless coder

Rice developed a universal noiseless coding structure that provides efficient performance over an extremely broad range of source entropy. This is accomplished by adaptively selecting the best of several easily implemented variable length coding algorithms. Variations of such noiseless coders have been used in many NASA applications. Custom VLSI coder and decoder modules capable of processing over 50 million samples per second have been fabricated and tested. In this study, the first of the code options used in this module development is shown to be equivalent to a class of Huffman code under the Humblet condition, for source symbol sets having a Laplacian distribution. Except for the default option, other options are shown to be equivalent to the Huffman codes of a modified Laplacian symbol set, at specified symbol entropy values. Simulation results are obtained on actual aerial imagery over a wide entropy range, and they confirm the optimality of the scheme. Comparison with other known techniques are performed on several widely used images and the results further validate the coder's optimality.

Yeh, Pen-Shu↗

Cluster Analysis of IRIS Spectroscopic Line Profiles and SDO/AIA EUV Emission in Observations and RMHD Simulations of the Solar Atmosphere

Spatially-resolved observations from the IRIS and SDO/AIA satellites, especially when coupled with realistic 3D RMHD simulations, are a powerful tool for analysis of processes in the solar chromosphere, transition region, and corona. However, the complexity of the data makes understanding the observations and modeling results difficult. In this work, we apply unsupervised clustering algorithms for analysis of observational and synthetic chromospheric Mg II h&k 2796Å&2803Å and transition region C II 1334Å&1335Å line profiles observed by IRIS, and extreme ultraviolet (EUV) emission observed by SDO/AIA, for various types of problems. The synthetic line profiles are computed for simulations of the quiescent solar atmosphere (using the StellarBox and RH1.5 codes). The K-Means clustering algorithm is applied, and the selection of an optimal number of clusters is supported by the average silhouette width technique. We discuss applications of the line profile clustering method to 1) visualization of computational and observational spectroscopic imaging data; 2) understanding of evolutionary trends and behavior patterns of quiet Sun emission and during solar flares; and 3) recognition of heating events and shock waves.

Sadykov, Viacheslav↗

Improving reproducibility in synchrotron tomography using implementation-adapted filters

For reconstructing large tomographic datasets fast, filtered backprojection-type or Fourier-based algorithms are still the method of choice, as they have been for decades. These robust and computationally efficient algorithms have been integrated in a broad range of software packages. The continuous mathematical formulas used for image reconstruction in such algorithms are unambiguous. However, variations in discretization and interpolation result in quantitative differences between reconstructed images, and corresponding segmentations, obtained from different software. This hinders reproducibility of experimental results, making it difficult to ensure that results and conclusions from experiments can be reproduced at different facilities or using different software. In this paper, a way to reduce such differences by optimizing the filter used in analytical algorithms is proposed. These filters can be computed using a wrapper routine around a black-box implementation of a reconstruction algorithm, and lead to quantitatively similar reconstructions. Use cases for this approach are demonstrated by computing implementation-adapted filters for several open-source implementations and applying them to simulated phantoms and real-world data acquired at the synchrotron. Our contribution to a reproducible reconstruction step forms a building block towards a fully reproducible synchrotron tomography data processing pipeline.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Data-Driven Framework for Direct Local Tensile Property Prediction of Laser Powder Bed Fusion Parts

This article proposes a generalizable, data-driven framework for qualifying laser powder bed fusion additively manufactured parts using part-specific in situ data, including powder bed imaging, machine health sensors, and laser scan paths. To achieve part qualification without relying solely on statistical processes or feedstock control, a sequence of machine learning models was trained on 6299 tensile specimens to locally predict the tensile properties of stainless-steel parts based on fused multi-modal in situ sensor data and a priori information. A cyberphysical infrastructure enabled the robust spatial tracking of individual specimens, and computer vision techniques registered the ground truth tensile measurements to the in situ data. The co-registered 230 GB dataset used in this work has been publicly released and is available as a set of HDF5 files. The extensive training data requirements and wide range of size scales were addressed by combining deep learning, machine learning, and feature engineering algorithms in a relay. The trained models demonstrated a 61% error reduction in ultimate tensile strength predictions relative to estimates made without any in situ information. Lessons learned and potential improvements to the sensors and mechanical testing procedure are discussed.

36 MATERIALS SCIENCE↗

Tropical Oceanic Precipitation Changes After the 1991 Pinatubo Eruption

Passive microwave channels like those flown on the Special Sensor Microwave Imager (SSM/I) contain two primary type of information on oceanic precipitation: condensate below the freezing level and precipitation-size condensate above the freezing level. The authors explore the question of whether these two separate pieces of information might contain insight into climate processes during a perturbation in the climate system. In particular, the relative fluctuations of rain and ice signals could be related to precipitation efficiency, an important determinant of the equilibrium climate, and thus a potential feedback mechanism in climate change. As an example of this potential application, SSM/I-derived liquid and frozen precipitation signals are used to infer changes in tropical oceanic precipitation characteristics during the cool period following the 1991 eruption of Mount Pinatubo. The need for an assessment of the temperature sensitivity of precipitation-retrieval algorithms is also discussed.

Spencer, Roy W.↗

Development of a Compact Lidar Sensor for Terrain Relative Navigation and Terrain Hazard Avoidance

A Lidar sensor utilizing linear-mode flash lidar technology and a novel Super-Resolution technique has been developed for providing Terrain Relative Navigation and Hazard Avoidance capabilities onboard landing vehicles. Processing algorithms for precision navigation and safe landing location identification take advantage of the uniform fixed pixels property of generated high resolution Digital Elevation Maps to achieve high reliability operation in near real-time. This paper describes the results of drone and helicopter flight tests of a breadboard system, explains the design and capabilities of a recently built compact prototype unit, and proposes a concepts of operation for future landing missions.

3-D Imaging↗

Phase retrieval for refraction-enhanced x-ray radiography using a deep neural network

X-ray refraction-enhanced radiography (RER) or phase contrast imaging is widely used to study internal discontinuities within materials. The resulting radiograph captures both the decrease in intensity caused by material absorption along the x-ray path, as well as the phase shift, which is highly sensitive to gradients in density. A significant challenge lies in effectively analyzing the radiographs to decouple the intensity and phase information and accurately ascertain the density profile. Conventional algorithms often yield ambiguous and unrealistic results due to difficulties in including physical constraints and other relevant information. We have developed an algorithm that uses a deep neural network to address these issues and applied it to extract the detailed density profile from an experimental RER. To generalize the applicability of our algorithm, we have developed a technique that quantitatively evaluates the complexity of the phase retrieval process based on the characteristics of the sample and the configuration of the experiment. Accordingly, this evaluation aids in the selection of the neural network architecture for each specific case. Beyond RER, the model has potential applications for other diagnostics where phase retrieval analysis is required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Task scheduling in dataflow computer architectures

Dataflow computers provide a platform for the solution of a large class of computational problems, which includes digital signal processing and image processing. Many typical applications are represented by a set of tasks which can be repetitively executed in parallel as specified by an associated dataflow graph. Research in this area aims to model these architectures, develop scheduling procedures, and predict the transient and steady state performance. Researchers at NASA have created a model and developed associated software tools which are capable of analyzing a dataflow graph and predicting its runtime performance under various resource and timing constraints. These models and tools were extended and used in this work. Experiments using these tools revealed certain properties of such graphs that require further study. Specifically, the transient behavior at the beginning of the execution of a graph can have a significant effect on the steady state performance. Transformation and retiming of the application algorithm and its initial conditions can produce a different transient behavior and consequently different steady state performance. The effect of such transformations on the resource requirements or under resource constraints requires extensive study. Task scheduling to obtain maximum performance (based on user-defined criteria), or to satisfy a set of resource constraints, can also be significantly affected by a transformation of the application algorithm. Since task scheduling is performed by heuristic algorithms, further research is needed to determine if new scheduling heuristics can be developed that can exploit such transformations. This work has provided the initial development for further long-term research efforts. A simulation tool was completed to provide insight into the transient and steady state execution of a dataflow graph. A set of scheduling algorithms was completed which can operate in conjunction with the modeling and performance tools previously developed. Initial studies on the performance of these algorithms were done to examine the effects of application algorithm transformations as measured by such quantities as number of processors, time between outputs, time between input and output, communication time, and memory size.

Katsinis, Constantine↗

The GPM Common Calibrated Brightness Temperature Product

The Global Precipitation Measurement (GPM) project will provide a core satellite carrying the GPM Microwave Imager (GMI) and will use microwave observations from a constellation of other satellites. Each partner with a satellite in the constellation will have a calibration that meets their own requirements and will decide on the format to archive their brightness temperature (Tb) record in GPM. However, GPM multi-sensor precipitation algorithms need to input intercalibrated Tb's in order to avoid differences among sensors introducing artifacts into the longer term climate record of precipitation. The GPM Common Calibrated Brightness Temperature Product is intended to address this problem by providing intercalibrated Tb data, called "Tc" data, where the "c" stands for common. The precipitation algorithms require a Tc file format that is both generic and flexible enough to accommodate the different passive microwave instruments. The format will provide detailed information on the processing history in order to allow future researchers to have a record of what was done. The format will be simple, including the main items of scan time, latitude, longitude, and Tc. It will also provide spacecraft orientation, spacecraft location, orbit, and instrument scan type (cross-track or conical). Another simplification is to store data in real numbers, avoiding the ambiguity of scaled data. Finally, units and descriptions will be provided in the product. The format is built on the concept of a swath, which is a series of scans that have common geolocation and common scan geometry. Scan geometry includes pixels per scan, sensor orientation, scan type, and incidence angles. The Tc algorithm and data format are being tested using the pre-GPM Precipitation Processing System (PPS) software to generate formats and 1/0 routines. In the test, data from SSM/I, TMI, AMSR-E, and WindSat are being processed and written as Tc products.

Stout, John↗

Rapid Optimization of Total Variation with Applications in Imaging, Additive Manufacturing, and Qualification

Total Variation optimization penalizes the gradient of a control variable or state. While this work focuses on image processing in particular, it has also found applications in inverse problems and topology optimization. In image processing, the goal is to maintain faithfulness to the original image while denoising and/or deblurring. Additionally, bilevel optimization over the spatially varying regularization weights can illuminate interfaces such as damage regions and other anomalies. We will address two fundamental challenges with TV-optimization: (i) the typical slow convergence of existing TV-optimization methods, and (ii) the selection of spatially varying TV parameters to promote interface detection. Additionally, we will apply such techniques to image data collected in additive manufacturing. In said context, stochasticity in build events induces flaws in the manufactured piece, compromising the integrity of said part. There is a critical need for in-situ monitoring to spot anomalies once they form, and in this setting we apply our total variation and hyperparameter solvers. We will develop a customized algorithm based on for extreme-scale TV-optimization that achieves super-linear or quadratic-convergence, a critical property for real-time, image-by-image analysis. A worst-case outcome is a preprocessing step that enhances image quality in-situ, specifically for out-of-focus and noisy images.

36 MATERIALS SCIENCE↗

Sparse regression for plasma physics

Many scientific problems can be formulated as sparse regression, i.e., regression onto a set of parameters when there is a desire or expectation that some of the parameters are exactly zero or do not substantially contribute. This includes many problems in signal and image processing, system identification, optimization, and parameter estimation methods such as Gaussian process regression. Sparsity facilitates exploring high-dimensional spaces while finding parsimonious and interpretable solutions. In the present work, we illustrate some of the important ways in which sparse regression appears in plasma physics and point out recent contributions and remaining challenges to solving these problems in this field. Further, a brief review is provided for the optimization problem and the state-of-the-art solvers, especially for constrained and high-dimensional sparse regression.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Resource Management for Real-Time Adaptive Agents

Increased autonomy and automation in onboard flight systems offer numerous potential benefits, including cost reduction and greater flexibility. The existence of generic mechanisms for automation is critical for handling unanticipated science events and anomalies where limitations in traditional control software with fixed, predetermined algorithms can mean loss of science data and missed opportunities for observing important terrestrial events. We have developed such a mechanism by adding a Hierarchical Agent-based ReaLTime technology (HART) extension to our Dynamic Resource Management (DRM) middleware. Traditional DRM provides mechanisms to monitor the realtime performance of distributed applications and to move applications among processors to improve real-time performance. In the HART project we have designed and implemented a performance adaptation mechanism to improve reaktime performance. To use this mechanism, applications are developed that can run at various levels of quality. The DRM can choose a setting for the quality level of an application dynamically at run-time in order to manage satellite resource usage more effectively. A groundbased prototype of a satellite system that captures and processes images has also been developed as part of this project to be used as a benchmark for evaluating the resource management framework A significant enhancement of this generic mission-independent framework allows scientists to specify the utility, or "scientific benefit," of science observations under various conditions like cloud cover and compression method. The resource manager then uses these benefit tables to determine in redtime how to set the quality levels for applications to maximize overall system utility as defined by the scientists running the mission. We also show how maintenance functions llke health and safety data can be integrated into the utility framework. Once thls framework has been certified for missions and successfully flight tested it can be reused with little development overhead for other missions. In contrast, current space missions llke Swift manage similar types of resource trade -off completely with the scientific application code itself, and such code must be re-certified and tested for each mission even if a large portion of the code base is shared. This final report discusses some of the major issues motivating this research effort, provides a literature review of the related work, discusses the resource management framework and ground-based satellite system prototype that has been developed, indicates what work is yet to be performed, and provides a list of publications resulting from this work.

Welch, Lonnie↗

Cloud-top pressure retrieval with DSCOVR EPIC oxygen A- and B-band observations

An analytic transfer inverse model for Earth Polychromatic Imaging Camera (EPIC) observations is proposed to retrieve the cloud-top pressure (CTP) with the consideration of in-cloud photon penetration. In this model, an analytic equation was developed to represent the reflection at the top of the atmosphere from above cloud, in cloud, and below cloud. The coefficients of this analytic equation can be derived from a series of EPIC simulations under different atmospheric conditions using a nonlinear regression algorithm. With estimated cloud pressure thickness, the CTP can be retrieved from EPIC observation data by solving the analytic equation. To simulate the EPIC measurements, a program package using the double-k approach was developed. Compared to line-by-line calculation, this approach can calculate high-accuracy results with a 100-fold computation time reduction. During the retrieval processes, two kinds of retrieval results, i.e., baseline CTP and retrieved CTP, are provided. The baseline CTP is derived without considering in-cloud photon penetration, and the retrieved CTP is derived by solving the analytic equation, taking into consideration in-cloud and below-cloud interactions. The retrieved CTPs for the oxygen A and B bands are smaller than their related baseline CTP. At the same time, both baseline CTP and retrieved CTP at the oxygen B band are larger than those at the oxygen A band. Compared to the difference in baseline CTP between the B band and A band, the difference in retrieved CTP between these two bands is generally reduced. Out of around 10 000 cases, in retrieved CTP between the A and B bands we found an average bias of 93 mb with a standard deviation of 81 mb. The cloud layer top pressure from Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) measurements is used for validation. Under single-layer cloud situations, the retrieved CTPs for the oxygen A band agree well with the CTPs from CALIPSO, the mean difference of which within 5 mb in the case study. Under multiple-layer cloud situations, the CTPs derived from EPIC measurements may be larger than the CTPs of high-level thin clouds due to the effect of photon penetration.

DSCOVR↗

A LIS Validation Study at the KSC-ER using LDAR and Field Mill Data

The chance of having the TRMM satellite pass over east central Florida when there is lightning over the NASA Kennedy Space Center (KSC) and USAF Eastern Range (ER) is small; however, such a condition did occur on September 21, 1998 (Day 264). Starting at about 20:40 GMT, the Lightning Imaging Sensor (LIS) reported 5 flashes during a 90 second interval that the KSC-ER was within the sensor field of view. Ground-based instrumentation, the Lightning Detection and Ranging (LDAR) system and a network of electric field mills (FM), detected 6 flashes in the same interval. In this paper, we will compare the times and locations of the optical pulses that were detected by LIS with the times and locations of RF sources (LDAR) and the charges that were deposited by the flash (FM network). We will show that LIS responded to all flashes that the LDAR and FM network detected; however, two discharges that were separated by less than 1 second in time and by about 10 km in space were grouped as one flash by the LIS data processing algorithm. In spite of the fact that all flashes occurred near the edge of the LIS field of view, the locations of the LIS events were consistent with both the LDAR and FM locations (the latter are usually within 1-2 kilometers of each other and often are co-located). Two of the 5 flashes reported by LIS were shifted north by about 8 km from the corresponding LDAR and FM locations. The LIS flash times tended to be after the first LDAR pulse was detected and before the last, and the integrated light signal (per LIS event) was surprisingly constant over the 5 flashes that were detected by LIS. In the future, we plan to study more correlated events and will try to determine whether and how the LIS light signal is related to the charge transfer in the flash and/or the number and spatial extent of RF sources.

Koshak, William J.↗