Search NASA⌕ Search

SEARCH · Search NASA

Results for “image synthesis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

(abstract) Synthesis of Speaker Facial Movements to Match Selected Speech Sequences

We are developing a system for synthesizing image sequences the simulate the facial motion of a speaker. To perform this synthesis, we are pursuing two major areas of effort. We are developing the necessary computer graphics technology to synthesize a realistic image sequence of a person speaking selected speech sequences. Next, we are developing a model that expresses the relation between spoken phonemes and face/mouth shape. A subject is video taped speaking an arbitrary text that contains expression of the full list of desired database phonemes. The subject is video taped from the front speaking normally, recording both audio and video detail simultaneously. Using the audio track, we identify the specific video frames on the tape relating to each spoken phoneme. From this range we digitize the video frame which represents the extreme of mouth motion/shape. Thus, we construct a database of images of face/mouth shape related to spoken phonemes. A selected audio speech sequence is recorded which is the basis for synthesizing a matching video sequence; the speaker need not be the same as used for constructing the database. The audio sequence is analyzed to determine the spoken phoneme sequence and the relative timing of the enunciation of those phonemes. Synthesizing an image sequence corresponding to the spoken phoneme sequence is accomplished using a graphics technique known as morphing. Image sequence keyframes necessary for this processing are based on the spoken phoneme sequence and timing. We have been successful in synthesizing the facial motion of a native English speaker for a small set of arbitrary speech segments. Our future work will focus on advancement of the face shape/phoneme model and independent control of facial features.

graphics audio digitizing morphing enunciation pho↗

Synthesis of 3D Model of a Magnetic Field-Influenced Body from a Single Image

A method for recovery of a 3D model of a cloud-like structure that is in motion and deforming but approximately governed by magnetic field properties is described. The method allows recovery of the model from a single intensity image in which the structure's silhouette can be observed. The method exploits envelope theory and a magnetic field model. Given one intensity image and the segmented silhouette in the image, the method proceeds without human intervention to produce the 3D model. In addition to allowing 3D model synthesis, the method's capability to yield a very compact description offers further utility. Application of the method to several real-world images is demonstrated.

Wang, Cuilan↗

Institutional Schlieren: A Production-Level Wind Tunnel Test Measurement

The following details recent efforts undertaken at the NASA Ames Unitary Plan Wind Tunnel to design and deploy an advanced, institutional, production-level data system for the classical Schlieren-shadowgraph technique. Motivation for the selection of individual system components is discussed along with a software methodology that combines image acquisition and processing into a production-level wind tunnel test measurement. In general terms, a production-level measurement refers to any data system that is seamlessly integrated into the primary wind tunnel data system, and whose data products are available real-time (e.g. force and moment, pressure, temperature data). The advantage of integrating a measurement in such a manner is an immediate increase in data product efficiency, productivity, reliability, and quality. Coupled with these benefits and leveraging recent advancements in high-speed imaging and image processing, automated, synchronized, time-resolved Schlieren-shadowgraph imaging for dynamic flow phenomena is now a reality. This makes possible the synthesis of dynamic off-body imaging with unsteady on-body measurements to produce a uniquely descriptive data product invaluable to the modern researcher.

Shadowgraph↗

Efficient Synthesis and HPLC-Based Characterization for Developing Vanadium-48-Labeled Vanadyl Acetylacetonate as a Novel Cancer Radiotracer for PET Imaging

Bis(acetylacetonato)oxidovanadium(IV) [(VO(acac) 2 ], generally known as vanadyl acetylacetonate, has been shown to be preferentially sequestered in malignant tissue. Vanadium-48 ( 48 V) generated with a compact medical cyclotron has been used to label VO(acac) 2 as a potential radiotracer in positron emission tomography (PET) imaging for the detection of cancer, but requires lengthy synthesis. Current literature protocols for the characterization of VO(acac) 2 require macroscale quantities of reactants and solvents to identify products by color and to enable crystallization that are not readily adaptable to the needs of radiotracer synthesis. We present an improved method to produce vanadium-48-labeled VO(acac) 2 , [ 48 V]VO(acac) 2 , and characterize it using high-performance liquid chromatography (HPLC) with radiation detection in combination with UV detection. The approach is suitable for radiotracer-level quantities of material. These methods are readily applicable for production of [ 48 V]VO(acac) 2 . Preliminary results of preclinical, small-animal PET studies are presented.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Chemical and physical transformations of carbon-based nanomaterials observed by liquid phase transmission electron microscopy

This article addresses recent advances in liquid phase transmission electron microscopy (LPTEM) for studying nanoscale synthetic processes of carbon-based materials that are independent of the electron beam—those driven by nonradiolytic chemical or thermal reactions. In particular, we focus on chemical/physical formations and the assembly of nanostructures composed of organic monomers/polymers, peptides/DNA, and biominerals. The synthesis of carbon-based nanomaterials generally only occurs at specific conditions, which cannot be mimicked by aqueous solution radiolysis. Carbon-based structures themselves are also acutely sensitive to the damaging effects of the irradiating beam, which make studying their synthesis using LPTEM a unique challenge that is possible when beam effects can be quantifi ed and mitigated. With new direct sensing, high frame rate cameras, and advances in liquid-cell holder designs, combined with a growing understanding of irradiation effects and proper experimental controls, microscopists have been able to make strides in observing traditionally problematic carbon-based materials under conditions where synthesis can be controlled, and imaged free from beam effects, or with beam effects quantified and accounted for. These materials systems and LPTEM experimental techniques are discussed, focusing on nonradiolytic chemical and physical transformations relevant to materials synthesis.

Parent, Lucas R.↗

Feature-Identification and Data-Compression Software

A report discusses the continuing development of Windows Interface for Nominal Displacement Selection (WINDS), a computer program for automated analysis of images of the Sun and planets acquired by scientific instruments aboard spacecraft. WINDS is intended to afford capabilities for identification of features, measurement of displacements and velocities, analysis of terrain and of atmospheres, and synthesis of animation sequences of images of terrains and atmospheres from small sets of samples by use of velocity-based interpolation. A major element of WINDS will be a nonlinear correlator capable of tracking small features in complex image sequences. For dynamic image sequences, the correlator will enable compression of data by factors >100. In processing image data, WINDS will take account of such factors as texture in image data, rotation of features during measurement intervals, effects of viewing and solar illumination angles, and vertical structures of atmospheres. WINDS will also take account of positions, aiming directions, and fields of view of cameras to determine three-dimensional feature structures by use of triangulation and stereoscopic analysis techniques.

Jong, Eric De↗

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗

The Synthescope: A Vision for Combining Synthesis with Atomic Fabrication

Here, the scanning transmission electron microscope, a workhorse instrument in materials characterization, is being transformed into an atomic-scale material-manipulation platform. With an eye on the trajectory of recent developments and the obstacles toward progress in this field, a vision for a path toward an expanded set of capabilities and applications is provided. The microscope is reconceptualized as an instrument for fabrication and synthesis with the capability to image and characterize atomic-scale structural formation as it occurs. Further development and refinement of this approach may have substantial impact on research in microelectronics, quantum information science, and catalysis, where precise control over atomic-scale structure and chemistry of a few “active sites” can have a dramatic impact on larger-scale functionality and where developing a better understanding of atomic-scale processes can help point the way to larger-scale synthesis approaches.

36 MATERIALS SCIENCE↗

Versatile compact heater design for in situ nano-tomography by transmission X-ray microscopy

A versatile, compact heater designed at National Synchrotron Light Source-II for in situ X-ray nano-imaging in a full-field transmission X-ray microscope is presented. Heater design for nano-imaging is challenging, combining tight spatial constraints with stringent design requirements for the temperature range and stability. Finite-element modeling and analytical calculations were used to determine the heater design parameters. Performance tests demonstrated reliable and stable performance, including maintaining the exterior casing close to room temperature while the heater is operating at above 1100°C, a homogenous heating zone and small temperature fluctuations. Two scientific experiments are presented to demonstrate the heater capabilities: (i) in situ 3D nano-tomography including a study of metal dealloying in a liquid molten salt extreme environment, and (ii) a study of pore formation in icosahedral quasicrystals. The progression of structural changes in both studies were clearly resolved in 3D, showing that the new heater enables powerful capabilities to directly visualize and quantify 3D morphological evolution of materials under real conditions by X-ray nano-imaging at elevated temperature during synthesis, fabrication and operation processes. This heater design concept can be applied to other applications where a precise, compact heater design is required.

36 MATERIALS SCIENCE↗

STEM Imaging of Materials: Final Report for DE-FG02-08ER46547

This project supported research advancing the state of the art in scanning transmission electron microscopy (STEM) imaging and characterization of materials, especially electronic materials. The project began with studies of point defects in materials using high-resolution Z-contrast STEM, then evolved to including methods in four-dimensional (4D) STEM and machine learning. Highlights include: (1) the discovery of stable, p-type ZnO via Sb doping, (2) demonstration that the high performance of InGaN LEDs is not due to In composition fluctuations as previously proposed, (3) the demonstration of the first sub-pm precision high-resolution STEM images using non-rigid registration of a series of STEM images, (4) the extension of high-precision STEM to low dose imaging and spectrum imaging, (5) discovery of a synthesis method for twisted spiral growth of transition-metal dichalcogenide materials via chemical vapor deposition, and (6) development of machine-learning methods for analysis and denoising of enormous 4D STEM data sets.

36 MATERIALS SCIENCE↗

On Hilbert-Huang Transform Based Synthesis of a Signal Contaminated by Radio Frequency Interference or Fringes

Norden E. Huang et al. had proposed and published the Hilbert-Huang Transform (HHT) concept correspondently in 1996, 1998. The HHT is a novel method for adaptive spectral analysis of non-linear and non-stationary signals. The HHT comprises two components: - the Huang Empirical Mode Decomposition (EMD), resulting in an adaptive data-derived basis of Intrinsic Mode functions (IMFs), and the Hilbert Spectral Analysis (HSA1) based on the Hilbert Transform for 1-dimension (1D) applied to the EMD IMF's outcome. Although paper describes the HHT concept in great depth, it does not contain all needed methodology to implement the HHT computer code. In 2004, Semion Kizhner and Karin Blank implemented the reference digital HHT real-time data processing system for 1D (HHT-DPS Version 1.4). The case for 2-Dimension (2D) (HHT2) proved to be difficult due to the computational complexity of EMD for 2D (EMD2) and absence of a suitable Hilbert Transform for 2D spectral analysis (HSA2). The real-time EMD2 and HSA2 comprise the real-time HHT2. Kizhner completed the real-time EMD2 and the HSA2 reference digital implementations respectively in 2013 & 2014. Still, the HHT2 outcome synthesis remains an active research area. This paper presents the initial concepts and preliminary results of HHT2-based synthesis and its application to processing of signals contaminated by Radio-Frequency Interference (RFI), as well as optical systems' fringe detection and mitigation at design stage. The Soil Moisture Active Passive (SMAP mission (SMAP) carries a radiometer instrument that measures Earth soil moisture at L1 frequency (1.4 GHz polarimetric - H, V, 3rd and 4th Stokes parameters). There is abundant RFI at L1 and because soil moisture is a strategic parameter, it is important to be able to recover the RFI-contaminated measurement samples (15% of telemetry). State-of-the-art only allows RFI detection and removes RFI-contaminated measurements. The HHT-based analysis and synthesis facilitates recovery of measurements contaminated by all kinds of RFI, including jamming [7-8]. The fringes are inherent in optical systems and multi-layer complex contour expensive coatings are employed to remove the unwanted fringes. HHT2-based analysis allows test image decomposition to analyze and detect fringes, and HHT2-based synthesis of useful image.

Spacecraft Electronics Equipment↗

Comparative morphological analysis of Puppis A at radio, infrared, optical, and X-ray wavelengths

This paper presents a new radio image of the supernova remnant Puppis A obtained with the Molonglo Observatory synthesis telescope (MOST) and the Parkes telescope, and infrared images of Puppis A and its surrounding medium obtained with the IRAS, and compares the remnant morphologies at radio, infrared, optical, and X-ray wavelengths. The radio image, which includes large-scale emission, shows a clumpy shell of emission with moderate central brightness. The infrared observations have the advantage of offering a detailed look at the medium into which the remnant is expanding. From the IR data, evidence is found of the remnant's expansion into a strong density gradient (distinct from the more gentle gradient of the Galactic plane). A strong isolated knot of enhanced X-ray and radio emission is a region of enhanced infrared emission as well. Detailed correlative analysis of the infrared, radio, and X-ray emission shows that the IR emission correlates very well with the X-ray emission, confirming the idea that the IR emission arises from dust that is collisionally heated by the shocked gas.

Arendt, Richard G.↗

The Owens Valley solar array

Solar microwave emission contains essential information for the study of the coronal magnetic structure of active regions and of thermal and nonthermal flare electrons. To exploit this potential requires BOTH imaging and spectroscopy with sufficient resolution to resolve spatial and spectral features. The VLA provides excellent solar imaging (when in the C and D configurations) but inadequate spectral coverage. The existing Owens Valley system has excellent spectral coverage but imaging that is adequate only for very simple sources. The Owens Valley system is currently undergoing an expansion, which when completed in October 1990 will provide a SOLAR-DEDICATED 5 antenna array (10 baselines). By using frequency-synthesis, this will provide a significant imaging capability in addition to its current spectral coverage.

Hurford, G. J.↗

Visualization of a Limonene Synthesis Metabolon Inside Living Bacteria by Hyperspectral SRS Microscopy

Abstract Monitoring biosynthesis activity at single‐cell level is key to metabolic engineering but is still difficult to achieve in a label‐free manner. Using hyperspectral stimulated Raman scattering imaging in the 670–900 cm −1 region, localized limonene synthesis are visualized inside engineered Escherichia coli . The colocalization of limonene and GFP‐fused limonene synthase is confirmed by co‐registered stimulated Raman scattering and two‐photon fluorescence images. The finding suggests a limonene synthesis metabolon with a polar distribution inside the cells. This finding expands the knowledge of de novo limonene biosynthesis in engineered bacteria and highlights the potential of SRS chemical imaging in metabolic engineering research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Structure-controlled intramolecular charge transfer in asymmetric pyrene-based luminogens: synthesis, characterization and optical properties

Full-colour emitting materials have been widely studied driven by their promising potential application in fluorescence imaging and optoelectronic devices. In this paper, the synthesis and charactization of four asymmetric D–A type pyrene-based luminogens 2 is presented. Here, the experimental results revealed that this type of pyrene derivative possesses tunable optical properties by introducing D/A groups at the 1-, 3-positions and K-region (5-position) of the pyrene core. Wide emission bands from deep blue (429 nm) to yellow (567 nm) were obtained in different solutions or states. Combined with the theoretical calculations, this work provides an efficient strategy to develop pyrene-based full-colour photoelectric materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Synthesis of Speaker Facial Movement to Match Selected Speech Sequences

A system is described which allows for the synthesis of a video sequence of a realistic-appearing talking human head. A phonic based approach is used to describe facial motion; image processing rather than physical modeling techniques are used to create video frames.

phonics speech synthesis imaging image processing ↗