Search NASA⌕ Search

SEARCH · Search NASA

Results for “image based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Recognition of simple visual images using a sparse distributed memory: Some implementations and experiments

Previously, a method was described of representing a class of simple visual images so that they could be used with a Sparse Distributed Memory (SDM). Herein, two possible implementations are described of a SDM, for which these images, suitably encoded, will serve both as addresses to the memory and as data to be stored in the memory. A key feature of both implementations is that a pattern that is represented as an unordered set with a variable number of members can be used as an address to the memory. In the 1st model, an image is encoded as a 9072 bit string to be used as a read or write address; the bit string may also be used as data to be stored in the memory. Another representation, in which an image is encoded as a 256 bit string, may be used with either model as data to be stored in the memory, but not as an address. In the 2nd model, an image is not represented as a vector of fixed length to be used as an address. Instead, a rule is given for determining which memory locations are to be activated in response to an encoded image. This activation rule treats the pieces of an image as an unordered set. With this model, the memory can be simulated, based on a method of computing the approximate result of a read operation.

Jaeckel, Louis A.↗

Io's fast sodium: Implications for molecular and atomic atmospheric escape

Recent observational evidence for sodium-bearing molecular ions in the Io plasma torus has strong implications for the nature of Io's atmosphere (Schneider et al. 1991). We use a Monte Carlo model offast-sodium production to analyze high-resolution ground-based images of sodium emission. We find the observations can be explained if a significant fraction of Io's exobase is molecular, possible including a sodium-bearing molecule, Total sodium loss rates from Io imply a collisionally thick atmosphere. Most of the images indicate significant slow-down of the corotating plasma near Io.

Wilson, Jody K.↗

Modeling of the Magnetosphere-Ionosphere-Atmosphere System

Data was obtained from the UVI imager, ground based magnetometers, incoherent scatter radars, HF radars (SuperDarn), DMSP satellites, and NOAA TIROS satellites. The data from these sources have been integrated into a consistent description of the ionosphere, using the AMIE technique.

Source record↗

Synthesis of Speaker Facial Movement to Match Selected Speech Sequences

A system is described which allows for the synthesis of a video sequence of a realistic-appearing talking human head. A phonic based approach is used to describe facial motion; image processing rather than physical modeling techniques are used to create video frames.

phonics speech synthesis imaging image processing ↗

Stream Flow Prediction by Remote Sensing and Genetic Programming

A genetic programming (GP)-based, nonlinear modeling structure relates soil moisture with synthetic-aperture-radar (SAR) images to present representative soil moisture estimates at the watershed scale. Surface soil moisture measurement is difficult to obtain over a large area due to a variety of soil permeability values and soil textures. Point measurements can be used on a small-scale area, but it is impossible to acquire such information effectively in large-scale watersheds. This model exhibits the capacity to assimilate SAR images and relevant geoenvironmental parameters to measure soil moisture.

Chang, Ni-Bin↗

Method and System for Temporal Filtering in Video Compression Systems

Three related innovations combine improved non-linear motion estimation, video coding, and video compression. The first system comprises a method in which side information is generated using an adaptive, non-linear motion model. This method enables extrapolating and interpolating a visual signal, including determining the first motion vector between the first pixel position in a first image to a second pixel position in a second image; determining a second motion vector between the second pixel position in the second image and a third pixel position in a third image; determining a third motion vector between the first pixel position in the first image and the second pixel position in the second image, the second pixel position in the second image, and the third pixel position in the third image using a non-linear model; and determining a position of the fourth pixel in a fourth image based upon the third motion vector. For the video compression element, the video encoder has low computational complexity and high compression efficiency. The disclosed system comprises a video encoder and a decoder. The encoder converts the source frame into a space-frequency representation, estimates the conditional statistics of at least one vector of space-frequency coefficients with similar frequencies, and is conditioned on previously encoded data. It estimates an encoding rate based on the conditional statistics and applies a Slepian-Wolf code with the computed encoding rate. The method for decoding includes generating a side-information vector of frequency coefficients based on previously decoded source data and encoder statistics and previous reconstructions of the source frequency vector. It also performs Slepian-Wolf decoding of a source frequency vector based on the generated side-information and the Slepian-Wolf code bits. The video coding element includes receiving a first reference frame having a first pixel value at a first pixel position, a second reference frame having a second pixel value at a second pixel position, and a third reference frame having a third pixel value at a third pixel position. It determines a first motion vector between the first pixel position and the second pixel position, a second motion vector between the second pixel position and the third pixel position, and a fourth pixel value for a fourth frame based upon a linear or nonlinear combination of the first pixel value, the second pixel value, and the third pixel value. A stationary filtering process determines the estimated pixel values. The parameters of the filter may be predetermined constants.

Lu, Ligang↗

NASA Space Radiation Program Integrative Risk Model Toolkit

NASA Space Radiation Program Element scientists have been actively involved in development of an integrative risk models toolkit that includes models for acute radiation risk and organ dose projection (ARRBOD), NASA space radiation cancer risk projection (NSCR), hemocyte dose estimation (HemoDose), GCR event-based risk model code (GERMcode), and relativistic ion tracks (RITRACKS), NASA radiation track image (NASARTI), and the On-Line Tool for the Assessment of Radiation in Space (OLTARIS). This session will introduce the components of the risk toolkit with opportunity for hands on demonstrations. The brief descriptions of each tools are: ARRBOD for Organ dose projection and acute radiation risk calculation from exposure to solar particle event; NSCR for Projection of cancer risk from exposure to space radiation; HemoDose for retrospective dose estimation by using multi-type blood cell counts; GERMcode for basic physical and biophysical properties for an ion beam, and biophysical and radiobiological properties for a beam transport to the target in the NASA Space Radiation Laboratory beam line; RITRACKS for simulation of heavy ion and delta-ray track structure, radiation chemistry, DNA structure and DNA damage at the molecular scale; NASARTI for modeling of the effects of space radiation on human cells and tissue by incorporating a physical model of tracks, cell nucleus, and DNA damage foci with image segmentation for the automated count; and OLTARIS, an integrated tool set utilizing HZETRN (High Charge and Energy Transport) intended to help scientists and engineers study the effects of space radiation on shielding materials, electronics, and biological systems.

Kim, Myung-Hee Y.↗

Using Empirical Models for Communication Prediction of Spacecraft

A viable communication path to a spacecraft is vital for its successful operation. For human spaceflight, a reliable and predictable communication link between the spacecraft and the ground is essential not only for the safety of the vehicle and the success of the mission, but for the safety of the humans on board as well. However, analytical models of these communication links are challenged by unique characteristics of space and the vehicle itself. For example, effects of radio frequency during high energy solar events while traveling through a solar array of a spacecraft can be difficult to model, and thus to predict. This presentation covers the use of empirical methods of communication link predictions, using the International Space Station (ISS) and its associated historical data as the verification platform and test bed. These empirical methods can then be incorporated into communication prediction and automation tools for the ISS in order to better understand the quality of the communication path given a myriad of variables, including solar array positions, line of site to satellites, position of the sun, and other dynamic structures on the outside of the ISS. The image on the left below show the current analytical model of one of the communication systems on the ISS. The image on the right shows a rudimentary empirical model of the same system based on historical archived data from the ISS.

Quasny, Todd↗

Current Activities in the Advanced Exploration Systems ISRU Project

Media Filter MOXIE support: completed flow performance tests and initial dust loading tests of the MOXIE HEPA filter in the Mars Flow Loop Designed and fabricated prototype full-scale scroll filter for testing of renewable filter performance Mars Flow Loop upgrades: installed more sensitive instrumentation, improved imaging, and increased run duration capability Electrostatic Precipitator (ESP) Plasma-physics based model predicts particle charge and trajectory Characterizing dust environment from fluidized-bed injection dust environment using laser sheet visualization and Fine Particle Analyzer Sabatier Design Study Defined the Sabatier design space, including reactor type, thermal management, gas recycling/separation Modeled Sabatier systems with one or two reactors with different types of thermal management Adding thermal management schemes and recycling and gas separation to model Catalyst Screening Performing compression testing on new and used catalyst pellets Performing vibration testing on different catalyst pellet types under different load conditions Preparing to test catalysts for performance and degradation

In-Situ Resource Utilization↗

Diffraction Modeling of Finite Subband EFC Probing on Dark Hole Contrast with WFIRST-CGI Shaped Pupil Coronagraph

The current NASA WFIRST (Wide-Field InfraRed Survey Telescope) coronagraph instrument (CGI) design allocates two subband filters per each full science band in order to contain system complexity and cost. We present our detailed investigation results on the adequacy of such a limited number of finite subband filters in achieving broadband dark hole contrast with a shaped pupil coronagraph (SPC). The study is based on diffraction propagation modeling with realistic WFIRST optics, where each subband’s image plane electric field is estimated from pairwise pupil plane deformable mirror (DM) probing and image plane intensity averaging of the resulting fields of multiple (subband) wavelengths. Multiple subband choices and probing and control strategies are explored, including standard subband probing; mixed wavelength and/or weighted Jacobian matrix; subband probing with intensity subtraction; and extended subband probing with intensity subtraction. Overall, the investigation shows that the achievable contrast with a limited number of finite subbands is about 2~2.5x worse than the designed contrast for the current SPC. The result suggests that future shaped pupil designs should be optimized for slightly broader bandwidths than the intended science bandpasses if limited subbands are used for wavefront sensing via probing.

WFIRST↗

Modeling EUV Intensity at the Top of the Transition Region Using SPICE Data on Board Solar Orbiter

The Spectral Imaging of Coronal Environment (SPICE; SPICE Consortium et al. 2020) provides an extraordinary opportunity to study the chromosphere and transition region using EUV wavelengths, e.g., Ne VIII 770 Å, CIII 977 Å, OVI 1032 Å, and Lyman-𝛽 025 Å. We present results modeling Ne VIII 770 Å intensity using images from SPICE and the COronal DEnsity and Temperature (CODET) model. This model is based on relationships between the magnetic field, density, and temperature. It uses a flux transport model, the Potential Field Extrapolation model (PFSS), an emission model based on Chianti atomic database 10.0.2, and an optimization algorithm. In addition, we assume that the emission from the top of the transition region (Ne VIII 770 Å) can be described using the magnetic field in the coronal base at 1.014𝑅⨀ (from PFSS). We found the mean full disc electron density in the transition region obtained from the CODET model for Ne VIII 770 Å (𝑙𝑜𝑔10𝑇[𝐾] = 5.8) corresponds to ∼ 𝑙𝑜𝑔10𝑁 𝑐𝑚−3 >9, and temperature value is 𝑙𝑜𝑔10𝑇[𝐾]~6. This value agrees with the Ne VIII 770 Å temperature formation 𝑙𝑜𝑔10𝑇[𝐾]~5.8. The density above sunspots (𝐵 > 50 𝐺) corresponds to 𝑙𝑜𝑔10𝑁 𝑐𝑚−3 > 9, while in quiet Sun regions (𝐵 < 50 𝐺) the mean density is 𝑙𝑜𝑔10𝑁[𝑐𝑚−3 ] = 8 .

Jenny M Rodriguez Gomez↗

Gaussian Multiple Instance Learning Approach for Mapping the Slums of the World Using Very High Resolution Imagery

In this paper, we present a computationally efficient algo- rithm based on multiple instance learning for mapping infor- mal settlements (slums) using very high-resolution remote sensing imagery. From remote sensing perspective, infor- mal settlements share unique spatial characteristics that dis- tinguish them from other urban structures like industrial, commercial, and formal residential settlements. However, regular pattern recognition and machine learning methods, which are predominantly single-instance or per-pixel classi- fiers, often fail to accurately map the informal settlements as they do not capture the complex spatial patterns. To overcome these limitations we employed a multiple instance based machine learning approach, where groups of contigu- ous pixels (image patches) are modeled as generated by a Gaussian distribution. We have conducted several experi- ments on very high-resolution satellite imagery, represent- ing four unique geographic regions across the world. Our method showed consistent improvement in accurately iden- tifying informal settlements.

Vatsavai, Raju↗

FESTR, Version 0.x

FESTR is a modeling tool for calculating spectroscopic-quality synthetic outputs (e.g., spectra and images) based on (in general) the time evolutions of 3-D spatial distributions of materials characterized by their chemical composition, temperature, and density conditions. FESTR performs raytracing across unstructured meshes, builds intrinsic optical properties of mixed materials by performing equation-of-state lookups in external data, and then solves the radiation-transport equation along rays to obtain emergent time and space resolved synthetic spectra. These results can be further processed into time and/or space integrated spectra, as well as into spectral-band-integrated synthetic images, radiated power histories, and total radiated energy values. FESTR is also applicable to spatial reconstructions of material properties via the analysis of experimental data.

Hakel, Peter↗

Influence of dissolved salts and impurities on seawater on heat transfer and fluid flow through fuel channels and debris bed

This project aims to better understand this mechanism and its effect on heat transfer. Specifically, experimental research was conducted to investigate the long term coolability issues in scaled test setups. Advanced diagnostic and measurement techniques were investigated and incorporated into an annular test facility and a debris bed test facility. The diagnostic techniques investigated included: radioactively tagged salt solution, Frisch collar radiation detector array, neutron and x-ray imaging systems, and a Rayleigh backscatter-based fiber-optic temperature system. Models were checked against the in-situ experimental data and recommendations were made for modeling purposes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Machine learning pipeline for denoising low signal-to-noise ratio and out-of-distribution transmission electron microscopy datasets

High-resolution transmission electron microscopy (HRTEM) is crucial for observing material’s structural and morphological evolution at Angstrom scales, but the electron beam can alter these processes. Devices such as CMOS-based direct-electron detectors operating in electron-counting mode can be utilized to substantially reduce the electron dosage. However, the resulting images often lead to a low signal-to-noise ratio, which requires frame integration that sacrifices temporal resolution. Several machine learning (ML) models have been recently developed to successfully denoise HRTEM images. Yet, these models are often computationally expensive, and their inference speeds on GPUs are outpaced by the imaging speed of advanced detectors, precluding in situ analysis. Furthermore, the performance of these denoising models on datasets with imaging conditions that deviate from the training datasets has not been evaluated. To mitigate these gaps, we propose a new self-supervised ML denoising pipeline specifically designed for time-series HRTEM images. This pipeline integrates a blind-spot convolution neural network with pre-processing and post-processing steps, including drift correction and low-pass filtering. Results demonstrate that our model outperforms various other ML and non-ML denoising methods in noise reduction and contrast enhancement, leading to improved visual clarity of atomic features. Additionally, the model is drastically faster than U-Net-based ML models and demonstrates excellent out-of-distribution generalization. The model’s computational inference speed is in the order of milliseconds per image, rendering it suitable for application in in-situ HRTEM experiments.

36 MATERIALS SCIENCE↗

Exploring Gradient-Based Multi-directional Controls in GANs

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-box, leaving its controllable generation an open problem, especially when spurious correlations between different semantic attributes exist in the image distributions. To address this problem, previous methods typically learn linear directions or individual channels that control semantic attributes in the image space. However, they often suffer from imperfect disentanglement, or are unable to obtain multi-directional controls. Furthermore, in this work, in light of the above challenges, we propose a novel approach that discovers nonlinear controls, which enables multi-directional manipulation as well as effective disentanglement, based on gradient information in the learned GAN latent space. More specifically, we first learn interpolation directions by following the gradients from classification networks trained separately on the attributes, and then navigate the latent space by exclusively controlling channels activated for the target attribute in the learned directions. Empirically, with small training data, our approach is able to gain fine-grained controls over a diverse set of bi-directional and multi-directional attributes, and we showcase its ability to achieve disentanglement significantly better than state-of-the-art methods both qualitatively and quantitatively.

97 MATHEMATICS AND COMPUTING↗

Model-independent measurement of the charge density distribution along an Fe atom probe needle using off-axis electron holography without mean inner potential effects

The one-dimensional charge density distribution along an electrically biased Fe atom probe needle is measured using a model-independent approach based on off-axis electron holography in the transmission electron microscope. Both the mean inner potential and the magnetic contribution to the phase shift are subtracted by taking differences between electron-optical phase images recorded with different voltages applied to the needle. The measured one-dimensional charge density distribution along the needle is compared with a similar result obtained using model-based fitting of the phase shift surrounding the needle. On the assumption of cylindrical symmetry, it is then used to infer the three-dimensional electric field and electrostatic potential around the needle with ∼10 nm spatial resolution, without needing to consider either the influence of the perturbed reference wave or the extension of the projected potential outside the field of view of the electron hologram. The present study illustrates how a model-independent approach can be used to measure local variations in charge density in a material using electron holography in the presence of additional contributions to the phase, such as those arising from changes in mean inner potential and specimen thickness.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Validating and improving CT ventilation imaging by correlating with ventilation 4D-PET/CT using {sup 68}Ga-labeled nanoparticles

Purpose: CT ventilation imaging is a novel functional lung imaging modality based on deformable image registration. The authors present the first validation study of CT ventilation using positron emission tomography with{sup 68}Ga-labeled nanoparticles (PET-Galligas). The authors quantify this agreement for different CT ventilation metrics and PET reconstruction parameters. Methods: PET-Galligas ventilation scans were acquired for 12 lung cancer patients using a four-dimensional (4D) PET/CT scanner. CT ventilation images were then produced by applying B-spline deformable image registration between the respiratory correlated phases of the 4D-CT. The authors test four ventilation metrics, two existing and two modified. The two existing metrics model mechanical ventilation (alveolar air-flow) based on Hounsfield unit (HU) change (V{sub HU}) or Jacobian determinant of deformation (V{sub Jac}). The two modified metrics incorporate a voxel-wise tissue-density scaling (ρV{sub HU} and ρV{sub Jac}) and were hypothesized to better model the physiological ventilation. In order to assess the impact of PET image quality, comparisons were performed using both standard and respiratory-gated PET images with the former exhibiting better signal. Different median filtering kernels (σ{sub m} = 0 or 3 mm) were also applied to all images. As in previous studies, similarity metrics included the Spearman correlation coefficient r within the segmented lung volumes, and Dice coefficient d{sub 20} for the (0 − 20)th functional percentile volumes. Results: The best agreement between CT and PET ventilation was obtained comparing standard PET images to the density-scaled HU metric (ρV{sub HU}) with σ{sub m} = 3 mm. This leads to correlation values in the ranges 0.22 ⩽ r ⩽ 0.76 and 0.38 ⩽ d{sub 20} ⩽ 0.68, with r{sup ¯}=0.42±0.16 and d{sup ¯}{sub 20}=0.52±0.09 averaged over the 12 patients. Compared to Jacobian-based metrics, HU-based metrics lead to statistically significant improvements in r{sup ¯} and d{sup ¯}{sub 20} (p < 0.05), with density scaled metrics also showing higher r{sup ¯} than for unscaled versions (p < 0.02). r{sup ¯} and d{sup ¯}{sub 20} were also sensitive to image quality, with statistically significant improvements using standard (as opposed to gated) PET images and with application of median filtering. Conclusions: The use of modified CT ventilation metrics, in conjunction with PET-Galligas and careful application of image filtering has resulted in improved correlation compared to earlier studies using nuclear medicine ventilation. However, CT ventilation and PET-Galligas do not always provide the same functional information. The authors have demonstrated that the agreement can improve for CT ventilation metrics incorporating a tissue density scaling, and also with increasing PET image quality. CT ventilation imaging has clear potential for imaging regional air volume change in the lung, and further development is warranted.

62 RADIOLOGY AND NUCLEAR MEDICINE↗