Search NASA⌕ Search

SEARCH · Search NASA

Results for “image based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Planetary Crater Detection and Registration Using Marked Point Processes, Multiple Birth and Death Algorithms, and Region-Based Analysis

Because of the large variety of sensors and spacecraft collecting data, planetary science needs to integrate various multi-sensor and multi-temporal images. These multiple data represent a precious asset, as they allow the study of targets spectral responses and of changes in the surface structure; because of their variety, they also require accurate and robust registration. A new crater detection algorithm, used to extract features that will be integrated in an image registration framework, is presented. A marked point process-based method has been developed to model the spatial distribution of elliptical objects (i.e. the craters) and a birth-death Markov chain Monte Carlo method, coupled with a region-based scheme aiming at computational efficiency, is used to find the optimal configuration fitting the image. The extracted features are exploited, together with a newly defined fitness function based on a modified Hausdorff distance, by an image registration algorithm whose architecture has been designed to minimize the computational time.

Image Processing:Pattern Recognition↗

Determination of Chlorophyll Content in Selected Grass Communities of Krkonoše Mts. Tundra Based on Laboratory Spectroscopy and Aerial Hyperspectral Data

The study focuses on the determination of chlorophyll content in four prevailing grasses in the relict arctic-alpine tundra located in the Krkonoše Mountains National Park, Czech Republic. We compared two methods for determination of leaf chlorophyll content (LCC) – spectrophotometric determination in the laboratory, and the LCC assessed by fluorescence portable chlorophyll meter CCM-300. Relationships were established between the LCCs and vegetation indices calculated from leaf spectra acquired with contact probe coupled with an ASD FieldSpec4 Wide-Res spectroradiometer. Canopy chlorophyll contents (CCC) were computed from the LCCs and green leaf area index (LAI), and modelled based on the field spectra measured by the spectroradiometer and the hyperspectral images acquired by Headwall Nano-Hyperspec® mounted on the DJI Matrice 600 Pro drone. The calculations are performed on datasets acquired in June, July and August 2020 together and separately for species and months. In general, the correlations based on June datasets work the best at both levels: median R 2 for all indices was 0.52 for all species together at leaf level and median R 2 = 0.47 at the canopy level (vegetation indices computed from field spectra). Canopy chlorophyll content map was created based on the results of stepwise multiple linear regression. The R 2 was 0.42 when using four wavelengths from the red and red edge spectral region. We attribute the weak model performance to a combination of several factors: leaf structure may bias LCC from laboratory measurements, effects of LAI variability on CCC, and the sampling design, probably not covering the whole phenology equally for all studied species.

L. Cervena↗

Effect of interfacial transition zone on the Young's modulus of carbon nanofiber reinforced cement concrete

Identifying the properties of the region where the cement paste meets the aggregate surface (interfacial transition zone, ITZ) is critical to understanding the strength and fracture behavior of carbon nanofiber (CNF) reinforced cement concrete. In this study, the finite element method is employed to investigate the effect of the ITZ on the Young's modulus of cement concrete made with CNF. The numerical models for cement concrete with and without CNF are constructed based on the digital image processing technique. To consider the interface effect, the concept of ''effective aggregate'' is put forward, namely, the Young's modulus and Poisson's ratio for each aggregate particle are replaced by an effective Young's modulus and effective Poisson's ratio, in which the effect of thickness and the Young's modulus of ITZ is taken into account in an averaged manner. Then, the quantitative nanomechanical mapping (based on atomic force microscopy) technique is adopted to measure the Young's modulus and thickness of ITZ with and without CNFs, which are further used as the input parameters in the numerical model. The numerical simulation results are verified by experimental testing, which indicates that the ITZ effect should be considered when implementing the numerical simulation. In addition, this analysis shows that compared with the plain cement concrete, CNFs can greatly enhance the mechanical properties of ITZ, which will in turn improve the Young's modulus of cement concrete significantly. Finally, the effect of thickness and Young's modulus of ITZ on the Young's modulus of CNF reinforced cement concrete is also discussed.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

WE-H-207A-06: Hypoxia Quantification in Static PET Images: The Signal in the Noise

Purpose: Quantification of hypoxia from PET images is of considerable clinical interest. In the absence of dynamic PET imaging the hypoxic fraction (HF) of a tumor has to be estimated from voxel values of activity concentration of a radioactive hypoxia tracer. This work is part of an effort to standardize quantification of tumor hypoxic fraction from PET images. Methods: A simple hypoxia imaging model in the tumor was developed. The distribution of the tracer activity was described as the sum of two different probability distributions, one for the normoxic (and necrotic), the other for the hypoxic voxels. The widths of the distributions arise due to variability of the transport, tumor tissue inhomogeneity, tracer binding kinetics, and due to PET image noise. Quantification of HF was performed for various levels of variability using two different methodologies: a) classification thresholds between normoxic and hypoxic voxels based on a non-hypoxic surrogate (muscle), and b) estimation of the (posterior) probability distributions based on maximizing likelihood optimization that does not require a surrogate. Data from the hypoxia imaging model and from 27 cervical cancer patients enrolled in a FAZA PET study were analyzed. Results: In the model, where the true value of HF is known, thresholds usually underestimate the value for large variability. For the patients, a significant uncertainty of the HF values (an average intra-patient range of 17%) was caused by spatial non-uniformity of image noise which is a hallmark of all PET images. Maximum likelihood estimation (MLE) is able to directly optimize for the weights of both distributions, however, may suffer from poor optimization convergence. For some patients, MLE-based HF values showed significant differences to threshold-based HF-values. Conclusion: HF-values depend critically on the magnitude of the different sources of tracer uptake variability. A measure of confidence should also be reported.

60 APPLIED LIFE SCIENCES↗

Measuring Local Turbulence Along the Optical Path: Multi-Beam Optical Seeing Sensor

Deflection of light along the optical path is a major source of image degradation for ground-based telescopes. Methods have been developed to measure upper atmospheric seeing based on models of the turbulence in the atmosphere, but due to boundary conditions, transmission within telescope enclosures is more complex. The Multi-beam Optical Seeing Sensor (MOSS) directly measures the component of the image quality degradation from inhomogeneity of the index of refraction within the telescope dome. MOSS outputs four near-parallel beams of light that travel along the optical path and are imaged by the telescope’s detector, landing like starlight on the telescope’s focal plane. By using a strobed light source, we can ‘freeze’ the instantaneous index variations transverse to the optical path. This system captures both ‘dome’ and ‘mirror’ seeing. Through plotting the standard deviation of differential motion between pairs of beams, MOSS enables characterization of the length scale of turbulence within the dome. The temporal coherence of temperature gradients can be probed with different pulse lengths, and the spatial coherence by comparing pairs at different separations across the aperture of the telescope. Optical path turbulence measurements, alongside other telemetry metrics, will guide thermal and airflow management to optimize image quality. A MOSS prototype was installed in the 1.2[Formula: see text]m Auxiliary Telescope (AuxTel) at the Vera C. Rubin Observatory in Chile, and preliminary data constrain the optical path turbulence with a lower bound of 1.4 arcsec. The optical path turbulence varied throughout the night of observing.

Astronomical seeing↗

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗

Hierarchical deep reinforcement learning reveals a modular mechanism of cell movement

Time-lapse images of cells and tissues contain rich information about dynamic cell behaviours, which reflect the underlying processes of proliferation, differentiation and morphogenesis. However, we lack computational tools for effective inference. Here we exploit deep reinforcement learning (DRL) to infer cell–cell interactions and collective cell behaviours in tissue morphogenesis from three-dimensional (3D) time-lapse images. We use hierarchical DRL (HDRL), known for multiscale learning and data efficiency, to examine cell migrations based on images with a ubiquitous nuclear label and simple rules formulated from empirical statistics of the images. When applied to Caenorhabditis elegans embryogenesis, HDRL reveals a multiphase, modular organization of cell movement. Imaging with additional cellular markers confirms the modular organization as a novel migration mechanism, which we term sequential rosettes. Furthermore, HDRL forms a transferable model that successfully differentiates sequential rosettes-based migration from others. Our study demonstrates a powerful approach to infer the underlying biology from time-lapse imaging without prior knowledge.

59 BASIC BIOLOGICAL SCIENCES↗

L-dwarf Detection from SDSS Images using Improved Faster R-CNN

We present a data-driven approach to automatically detect L dwarfs from Sloan Digital Sky Survey (SDSS) images using an improved Faster R-CNN framework based on deep learning. The established L-dwarf automatic detection (LDAD) model distinguishes L dwarfs from other celestial objects and backgrounds in SDSS field images by learning the features of 387 SDSS images containing L dwarfs. Applying the LDAD model to the SDSS images containing 93 labeled L dwarfs in the test set, we successfully detected 83 known L dwarfs with a recall rate of 89.25% for known L dwarfs. Several techniques are implemented in the LDAD model to improve its detection performance for L dwarfs, including the deep residual network and the feature pyramid network. As a result, the LDAD model outperforms the model of the original Faster R-CNN, whose recall rate of known L dwarfs is 80.65% for the same test set. The LDAD model was applied to detect L dwarfs from a larger validation set including 843 labeled L dwarfs, resulting in a recall rate of 94.42% for known L dwarfs. The newly identified candidates include L dwarfs, late M and T dwarfs, which were estimated from color (i – z) and spectral type relation. The contamination rates for the test candidates and validation candidates are 8.60% and 9.27%, respectively. The detection results indicate that our model is effective to search for L dwarfs from astronomical images.

79 ASTRONOMY AND ASTROPHYSICS↗

Systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data

In accordance with some embodiments, systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data are provided. In some embodiments, the system comprises: first detectors configured to detect a level of photons proportional to incident photon flux; second detectors configured to detect arrival of individual photons; a processor programmed to: receive, from the first detectors, first values indicative of photon flux from a scene with a first resolution; receive, from the second detectors, second values indicative of photon flux from the scene with a lower resolution; provide a first encoder of a trained machine learning model first flux values based on the first values, provide the second encoder of the model second flux values; receive, as output, values indicative of photon flux from the scene; and generate a high dynamic range image based on the third plurality of values.

Gutierrez Barragan, Felipe↗

Identifying atmospheric rivers and their poleward latent heat transport with generalizable neural networks: ARCNNv1

Abstract. Atmospheric rivers (ARs) are extreme weather events that can alleviate drought or cause billions of US dollars in flood damage. By transporting significant amounts of latent energy towards the poles, they are crucial to maintaining the climate system's energy balance. Since there is no first-principle definition of an AR grounded in geophysical fluid mechanics, AR identification is currently performed by a multitude of expert-defined, threshold-based algorithms. The variety of AR detection algorithms has introduced uncertainty into the study of ARs, and the thresholds of the algorithms may not generalize to new climate datasets and resolutions. We train convolutional neural networks (CNNs) to detect ARs while representing this uncertainty; we name these models ARCNNs. To detect ARs without requiring new labeled data and labor-intensive AR detection campaigns, we present a semi-supervised learning framework based on image style transfer. This framework generalizes ARCNNs across climate datasets and input fields. Using idealized and realistic numerical models, together with observations, we assess the performance of the ARCNNs. We test the ARCNNs in an idealized simulation of a shallow-water fluid in which nearly all the tracer transport can be attributed to AR-like filamentary structures. In reanalysis and a high-resolution climate model, we use ARCNNs to calculate the contribution of ARs to meridional latent heat transport, and we demonstrate that this quantity varies considerably due to AR detection uncertainty.

54 ENVIRONMENTAL SCIENCES↗

COMPARISON OF FORCE-FREE CORONAL MAGNETIC FIELD MODELING USING VECTOR FIELDS FROM HINODE AND SOLAR DYNAMICS OBSERVATORY

Photospheric magnetic vector maps from two different instruments are used to model the nonlinear force-free coronal magnetic field above an active region. We use vector maps inferred from polarization measurements of the Solar Dynamics Observatory/Helioseismic and Magnetic Imager (HMI) and the Solar Optical Telescope's Spectropolarimeter (SP) on board Hinode. Besides basing our model calculations on HMI data, we use both SP data of original resolution and scaled down to the resolution of HMI. This allows us to compare the model results based on data from different instruments and to investigate how a binning of high-resolution data affects the model outcome. The resulting three-dimensional magnetic fields are compared in terms of magnetic energy content and magnetic topology. We find stronger magnetic fields in the SP data, translating into a higher total magnetic energy of the SP models. The net Lorentz forces of the HMI and SP lower boundaries verify their force-free compatibility. We find substantial differences in the absolute estimates of the magnetic field energy but similar relative estimates, e.g., the fraction of excess energy and of the flux shared by distinct areas. The location and extension of neighboring connectivity domains differ and the SP model fields tend to be higher and more vertical. Hence, conclusions about the magnetic connectivity based on force-free field models are to be drawn with caution. We find that the deviations of the model solution when based on the lower-resolution SP data are small compared to the differences of the solutions based on data from different instruments.

79 ASTRONOMY AND ASTROPHYSICS↗

Investigation of mesoscale cloud features viewed by LANDSAT

The author has identified the following significant results. Some 50 LANDSAT images displaying mesoscale cloud features were analyzed. This analysis was based on the Rayleigh-Kuettner model describing the formation of that type of mesoscale cloud feature. This model lends itself to computation of the average wind speed in northerly flow from the dimensions of the cloud band configurations measured from a LANDSAT image. In nearly every case, necessary conditions of a curved wind profile and orientation of the cloud streets within 20 degrees of the direction of the mean wind in the convective layer were met. Verification of the results by direct observation was hampered, however, by the incompatibility of the resolution of conventional rawinsonde observations with the scale of the banded cloud patterns measured from LANDSAT data. Comparison seems to be somewhat better in northerly flows than in southerly flows, with the largest discrepancies in wind speed being within 8m/sec, or a factor of two.

Sherr, P. E.↗

Observation simulation experiments with regional prediction models

Research efforts in FY 1990 included studies employing regional scale numerical models as aids in evaluating potential contributions of specific satellite observing systems (current and future) to numerical prediction. One study involves Observing System Simulation Experiments (OSSEs) which mimic operational initialization/forecast cycles but incorporate simulated Advanced Microwave Sounding Unit (AMSU) radiances as input data. The objective of this and related studies is to anticipate the potential value of data from these satellite systems, and develop applications of remotely sensed data for the benefit of short range forecasts. Techniques are also being used that rely on numerical model-based synthetic satellite radiances to interpret the information content of various types of remotely sensed image and sounding products. With this approach, evolution of simulated channel radiance image features can be directly interpreted in terms of the atmospheric dynamical processes depicted by a model. Progress is being made in a study using the internal consistency of a regional prediction model to simplify the assessment of forced diabatic heating and moisture initialization in reducing model spinup times. Techniques for model initialization are being examined, with focus on implications for potential applications of remote microwave observations, including AMSU and Special Sensor Microwave Imager (SSM/I), in shortening model spinup time for regional prediction.

Diak, George↗

Modeling, simulation, and analysis of optical remote sensing systems

Remote Sensing of the Earth's resources from space-based sensors has evolved in the past 20 years from a scientific experiment to a commonly used technological tool. The scientific applications and engineering aspects of remote sensing systems have been studied extensively. However, most of these studies have been aimed at understanding individual aspects of the remote sensing process while relatively few have studied their interrelations. A motivation for studying these interrelationships has arisen with the advent of highly sophisticated configurable sensors as part of the Earth Observing System (EOS) proposed by NASA for the 1990's. Two approaches to investigating remote sensing systems are developed. In one approach, detailed models of the scene, the sensor, and the processing aspects of the system are implemented in a discrete simulation. This approach is useful in creating simulated images with desired characteristics for use in sensor or processing algorithm development. A less complete, but computationally simpler method based on a parametric model of the system is also developed. In this analytical model the various informational classes are parameterized by their spectral mean vector and covariance matrix. These class statistics are modified by models for the atmosphere, the sensor, and processing algorithms and an estimate made of the resulting classification accuracy among the informational classes. Application of these models is made to the study of the proposed High Resolution Imaging Spectrometer (HRIS). The interrelationships among observational conditions, sensor effects, and processing choices are investigated with several interesting results.

Kerekes, John Paul↗

Three-Dimensional Electrical Resistivity Tomography of the Solfatara Crater (Italy): Implication for the Multiphase Flow Structure of the Shallow Hydrothermal System: Resistivity Model of Solfatara Crater

The Solfatara volcano is the main degassing area of the Campi Flegrei caldera, characterized by 30 of unrest. Assessing and understanding such renewal activity is a challenging task because hydrothermal interactions with magmatic gases remain poorly understood. In this study, we decipher the complex structure of the shallow Solfatara hydrothermal system by performing the first 3-D, high-resolution, Electrical Resistivity Tomography (ERT) of the volcano. The 3-D resistivity model was obtained from the inversion of 43,432 resistance measurements performed on an area of 0.68 km 2 . The proposed interpretation of the multiphase hydrothermal structures is based on the resistivity model, a high-resolution infrared surface temperature image, and 1,136 soil CO 2 flux measurements. In addition, we realized 27 soil Cation Exchange Capacity (CEC) and pH measurements demonstrating a negligible contribution of surface conductivity to the shallow bulk electrical conductivity. Hence, we demonstrate that the resistivity changes are mainly controlled by fluid content and temperature. The high-resolution tomograms identify for the first time the structure of the gas-dominated reservoir at 50 m depth that feeds the Bocca Grande fumarole through a ~10-m-thick channel. In addition, the resistivity model reveals a channel-like conductive structure where the liquid produced by steam condensation around the main fumaroles flows down to the Fangaia area within a buried fault. The model delineates the emplacement of the main geological structures: Mt Olibano, Solfatara crypto-dome, and tephra deposits. It also reveals the anatomy of the hydrothermal system, especially two liquid-dominated plumes, the Fangaia mud pool and the Pisciarelli fumarole, respectively.

58 GEOSCIENCES↗

Synchrotron based infrared imaging and spectroscopy via focal plane array on live fibroblasts in D2O enriched medium

We tested the viability of using synchrotron based infrared imaging to study biochemical processes inside living cells. As a model system, we studied fibroblast cells exposed to a medium highly enriched with D2O. We could show that the experimental technique allows us to reproduce at the cellular level measurements that are normally performed on purified biological molecules. We can obtain information about lipid conformation and distribution, kinetics of hydrogen/deuterium exchange, and the formation of concentration gradients of H and O isotopes in water that are associated with cell metabolism. The implementation of the full field technique in a sequential imaging format gives a description of cellular biochemistry and biophysics that contains both spatial and temporal information.

Cell Lipids↗

A simulation pipeline for fast neutron imaging and spectroscopy using quantified detector attributes

Radiation imaging capabilities, essential in the nuclear nonproliferation regime, facilitate source localization and, in certain cases, spectroscopy. Scatter-based neutron cameras, which can measure the neutron signatures from special nuclear material, hold particular interest. Systems incorporating organic scintillators can extract neutron energy spectra, potentially distinguishing fission neutron sources from others, such as alpha-neutron sources. The development and testing of a scatter-based neutron imager, however, can be challenging without having an accurate simulation model or first constructing a prototype. This work describes a simulation pipeline that takes output from MCNPX-PoliMi simulations and creates the expected back-projection neutron images and neutron energy spectra. This pipeline was developed to improve the modeling of fast neutron imagers and bridge the current gap in literature, which predominantly focuses on gamma-ray Compton imager models. This work also reports on the significance of various real-world system considerations and their effects on the simulated detector responses. The pipeline was verified and validated with experimental data collected using a 252 Cf spontaneous fission source using a fast neutron scattering imager developed at the University of Michigan.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

AI-enabled Lorentz microscopy for quantitative imaging of nanoscale magnetic spin textures

The manipulation and control of nanoscale magnetic spin textures are of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the nanoscale, but quantitative characterization of in situ data is extremely challenging. Here, we present an AI-enabled phase-retrieval method based on integrating a generative deep image prior with an image formation forward model for LTEM. Our approach uses a single out-of-focus image for phase retrieval and achieves significantly higher accuracy and robustness to noise compared to existing methods. Furthermore, our method is capable of isolating sample heterogeneities from magnetic contrast, as shown by application to simulated and experimental data. This approach allows quantitative phase reconstruction of in situ data and can also enable near real-time quantitative magnetic imaging.

36 MATERIALS SCIENCE↗