Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

3D microwave tomography of the breast using prior anatomical information

Purpose: The authors have developed a new 3D breast image reconstruction technique that utilizes the soft tissue spatial resolution of magnetic resonance imaging (MRI) and integrates the dielectric property differentiation from microwave imaging to produce a dual modality approach with the goal of augmenting the specificity of MR imaging, possibly without the need for nonspecific contrast agents. The integration is performed through the application of a soft prior regularization which imports segmented geometric meshes generated from MR exams and uses it to constrain the microwave tomography algorithm to recover nearly uniform property distributions within segmented regions with sharp delineation between these internal subzones. Methods: Previous investigations have demonstrated that this approach is effective in 2D simulation and phantom experiments and also in clinical exams. The current study extends the algorithm to 3D and provides a thorough analysis of the sensitivity and robustness to misalignment errors in size and location between the spatial prior information and the actual data. Results: Image results in 3D were not strongly dependent on reconstruction mesh density, and the changes of less than 30% in recovered property values arose from variations of more than 125% in target region size—an outcome which was more robust than in 2D. Similarly, changes of less than 13% occurred in the 3D image results from variations in target location of nearly 90% of the inclusion size. Permittivity and conductivity errors were about 5 times and 2 times smaller, respectively, with the 3D spatial prior algorithm in actual phantom experiments than those which occurred without priors. Conclusions: The presented study confirms that the incorporation of structural information in the form of a soft constraint can considerably improve the accuracy of the property estimates in predefined regions of interest. These findings are encouraging and establish a strong foundation for using the soft prior technique in clinical studies, where their microwave imaging system and MRI can simultaneously collect breast exam data in patients.

60 APPLIED LIFE SCIENCES↗

MO-DE-202-02: Advances in Image Registration and Reconstruction for Image-Guided Neurosurgery

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504 Disclosure and CoI: IGI Technologies, small-business partner on the grants.

60 APPLIED LIFE SCIENCES↗

MO-DE-202-03: Image-Guided Surgery and Interventions in the Advanced Multimodality Image-Guided Operating (AMIGO) Suite

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504 Disclosure and CoI: IGI Technologies, small-business partner on the grants.

60 APPLIED LIFE SCIENCES↗

MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504 Disclosure and CoI: IGI Technologies, small-business partner on the grants.

60 APPLIED LIFE SCIENCES↗

Moving metal artifact reduction in cone-beam CT scans with implanted cylindrical gold markers

Purpose: Implanted gold markers for image-guided radiotherapy lead to streaking artifacts in cone-beam CT (CBCT) scans. Several methods for metal artifact reduction (MAR) have been published, but they all fail in scans with large motion. Here the authors propose and investigate a method for automatic moving metal artifact reduction (MMAR) in CBCT scans with cylindrical gold markers. Methods: The MMAR CBCT reconstruction method has six steps. (1) Automatic segmentation of the cylindrical markers in the CBCT projections. (2) Removal of each marker in the projections by replacing the pixels within a masked area with interpolated values. (3) Reconstruction of a marker-free CBCT volume from the manipulated CBCT projections. (4) Reconstruction of a standard CBCT volume with metal artifacts from the original CBCT projections. (5) Estimation of the three-dimensional (3D) trajectory during CBCT acquisition for each marker based on the segmentation in Step 1, and identification of the smallest ellipsoidal volume that encompasses 95% of the visited 3D positions. (6) Generation of the final MMAR CBCT reconstruction from the marker-free CBCT volume of Step 3 by replacing the voxels in the 95% ellipsoid with the corresponding voxels of the standard CBCT volume of Step 4. The MMAR reconstruction was performed retrospectively using a half-fan CBCT scan for 29 consecutive stereotactic body radiation therapy patients with 2–3 gold markers implanted in the liver. The metal artifacts of the MMAR reconstructions were scored and compared with a standard MAR reconstruction by counting the streaks and by calculating the standard deviation of the Hounsfield units in a region around each marker. Results: The markers were found with the same autosegmentation settings in 27 CBCT scans, while two scans needed slightly changed settings to find all markers automatically in Step 1 of the MMAR method. MMAR resulted in 15 scans with no streaking artifacts, 11 scans with 1–4 streaks, and 3 scans with severe streaking artifacts. The corresponding numbers for MAR were 8 (no streaks), 1 (1–4 streaks), and 20 (severe streaking artifacts). The MMAR method was superior to MAR in scans with more than 8 mm 3D marker motion and comparable to MAR for scans with less than 8 mm motion. In addition, the MMAR method was tested on a 4D CBCT reconstruction for which it worked equally well as for the 3D case. The markers in the 4D case had very low motion blur. Conclusions: An automatic method for MMAR in CBCT scans was proposed and shown to effectively remove almost all streaking artifacts in a large set of clinical CBCT scans with implanted gold markers in the liver. Residual streaking artifacts observed in three CBCT scans may be removed with better marker segmentation.

60 APPLIED LIFE SCIENCES↗

MO-FG-CAMPUS-TeP1-05: Rapid and Efficient 3D Dosimetry for End-To-End Patient-Specific QA of Rotational SBRT Deliveries Using a High-Resolution EPID

Purpose: EPID-based patient-specific quality assurance provides verification of the planning setup and delivery process that phantomless QA and log-file based virtual dosimetry methods cannot achieve. We present a method for EPID-based QA utilizing spatially-variant EPID response kernels that allows for direct calculation of the entrance fluence and 3D phantom dose. Methods: An EPID dosimetry system was utilized for 3D dose reconstruction in a cylindrical phantom for the purposes of end-to-end QA. Monte Carlo (MC) methods were used to generate pixel-specific point-spread functions (PSFs) characterizing the spatially non-uniform EPID portal response in the presence of phantom scatter. The spatially-variant PSFs were decomposed into spatially-invariant basis PSFs with the symmetric central-axis kernel as the primary basis kernel and off-axis representing orthogonal perturbations in pixel-space. This compact and accurate characterization enables the use of a modified Richardson-Lucy deconvolution algorithm to directly reconstruct entrance fluence from EPID images without iterative scatter subtraction. High-resolution phantom dose kernels were cogenerated in MC with the PSFs enabling direct recalculation of the resulting phantom dose by rapid forward convolution once the entrance fluence was calculated. A Delta4 QA phantom was used to validate the dose reconstructed in this approach. Results: The spatially-invariant representation of the EPID response accurately reproduced the entrance fluence with >99.5% fidelity with a simultaneous reduction of >60% in computational overhead. 3D dose for 10{sub 6} voxels was reconstructed for the entire phantom geometry. A 3D global gamma analysis demonstrated a >95% pass rate at 3%/3mm. Conclusion: Our approach demonstrates the capabilities of an EPID-based end-to-end QA methodology that is more efficient than traditional EPID dosimetry methods. Displacing the point of measurement external to the QA phantom reduces the necessary complexity of the phantom itself while offering a method that is highly scalable and inherently generalizable to rotational and trajectory based deliveries. This research was partially supported by Varian.

60 APPLIED LIFE SCIENCES↗

NeMO-Net & Fluid Lensing: The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment Using Fluid Lensing Augmentation of NASA EOS Data

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with global low-resolution (m, km-scale) airborne and spaceborne imagery to reduce classification errors up to 80% over regional scales. Such technologies can substantially enhance our ability to assess coral reef ecosystems dynamics.

satellite data↗

SU-E-T-500: Initial Implementation of GPU-Based Particle Swarm Optimization for 4D IMRT Planning in Lung SBRT

Purpose 4D-IMRT planning, combined with dynamic MLC tracking delivery, utilizes the temporal dimension as an additional degree of freedom to achieve improved OAR-sparing. The computational complexity for such optimization increases exponentially with increase in dimensionality. In order to accomplish this task in a clinically-feasible time frame, we present an initial implementation of GPU-based 4D-IMRT planning based on particle swarm optimization (PSO). Methods The target and normal structures were manually contoured on ten phases of a 4DCT scan of a NSCLC patient with a 54cm3 right-lower-lobe tumor (1.5cm motion). Corresponding ten 3D-IMRT plans were created in the Eclipse treatment planning system (Ver-13.6). A vendor-provided scripting interface was used to export 3D-dose matrices corresponding to each control point (10 phases × 9 beams × 166 control points = 14,940), which served as input to PSO. The optimization task was to iteratively adjust the weights of each control point and scale the corresponding dose matrices. In order to handle the large amount of data in GPU memory, dose matrices were sparsified and placed in contiguous memory blocks with the 14,940 weight-variables. PSO was implemented on CPU (dual-Xeon, 3.1GHz) and GPU (dual-K20 Tesla, 2496 cores, 3.52Tflops, each) platforms. NiftyReg, an open-source deformable image registration package, was used to calculate the summed dose. Results The 4D-PSO plan yielded PTV coverage comparable to the clinical ITV-based plan and significantly higher OAR-sparing, as follows: lung Dmean=33%; lung V20=27%; spinal cord Dmax=26%; esophagus Dmax=42%; heart Dmax=0%; heart Dmean=47%. The GPU-PSO processing time for 14940 variables and 7 PSO-particles was 41% that of CPU-PSO (199 vs. 488 minutes). Conclusion Truly 4D-IMRT planning can yield significant OAR dose-sparing while preserving PTV coverage. The corresponding optimization problem is large-scale, non-convex and computationally rigorous. Our initial results indicate that GPU-based PSO with further software optimization can make such planning clinically feasible. This work was supported through funding from the National Institutes of Health and Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

PTT System Performance Evaluation in 3-D Imaging of AM Components

Additive manufacturing (AM, or 3D printing) for commercial nuclear energy applications is an emerging method for cost-efficient manufacturing aimed at replacing aging nuclear reactor parts and reducing costs for new construction. Because of the geometry of metallic structures of interest for nuclear applications, which consist of planar primitives with no symmetry of revolution, limited options are available for non-destructive evaluation (NDE) either during or post manufacturing. Known material flaws in AM include low density regions consisting of nonsintered powder, which have to be detected to ensure the safety of long-term performance nuclear reactor components. As a solution to NDE of AM, we are developing pulsed thermal tomography (PTT) models and depth inversion algorithms for 3D imaging. PTT has many advantages because the method is non-contact and allows for in-service, NDE of AM nuclear reactor parts. By analyzing transients of surface temperature response due to internal thermal resistances, one can obtain 3D reconstructions of material effusivity using a unique inversion algorithm developed at Argonne. This study investigates the capability of PTT in imaging several AM structures fabricated from Inconel 718 (IN718) feedstock. The AM structures have complex geometry, but do not have calibrated internal defects. The objective is to determine PTT settings, such as the total integration time, for imaging of representative AM structures. A new FLIR X8500sc IR camera with higher spatial resolution (1280x1024 at 181Hz frame rate) was integrated into the PTT laboratory setup. Software tools were developed to ensure compatibility of new camera files with legacy effusivity reconstruction codes. The new camera was used to obtain 3-D reconstructions of IN718 nozzle plate and a particle filter plate. The results demonstrate the capability of PTT in 3- D imaging of complex geometry AM structures. Further, increased resolution imaging is achieved compared to prior results using older FLIR SC4000 IR camera. In addition, preliminary studies were conducted on developing image processing algorithms for automated detection of flaws. Initial demonstrations are shown for segmentation of PTT images of flat bottom hole (FBH) specimens. Imaging of FBH specimens was described in a prior report. Intermediate results demonstrated in this report will be developed further in detection of flaws in AM specimens.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Historical Overview of the NASA Orbital Debris Program Office’s Laboratory Optical Measurements

The NASA Orbital Debris Program Office (ODPO) has used laboratory measurements to help bring ground-based measurements together with models to ascertain Earth-orbiting target parameters of interest to support various orbital debris models. In 2005, the Optical Measurement Center (OMC) was established to simulate space-based illumination conditions using equipment and techniques that recreate telescopic observations, particularly source-target-sensor orientations. The intent was to recreate light curves using known aspect angles of known targets and phase angles (angle is defined by the vertex between illumination source-object-detector) to complement telescopic observations that could be used to update the current optical size estimation model (OSEM) – a model that converts object brightness into size for orbital debris models. To support the above goals, the laboratory has undergone several equipment upgrades to increase capabilities over almost 20 years of operation. The primary instrumentation acquires reflectance measurements and includes a solar-like light source, CCD camera with astrometric filters, and robotic arm. A rotary arm was added approximately five years after full operation to allow acquisition through a full 360° range of phase angles. Another part of the OMC instrumentation is a field spectrometer, predominately used for field operations to acquire pre- and post-flight spacecraft material spectral measurements. Additionally, reflectance spectroscopy of various materials is also of interest resulting from hypervelocity impact tests, pristine spacecraft materials, or samples of materials that are used in spacecraft design. These measurements are stored in NASA’s Spectral Material Database, a resource that is still being populated today. The study of spectral measurements also enabled the development of spectral unmixing routines to support the identification of spacecraft materials from spectral data gathered by ground based telescopes. Preliminary OMC investigations focused on feasibility studies to acquire 360° rotation light curves of simple shapes at a single-phase angle and extended to measurements of representative fragments from ground-based explosion tests. To correlate the light curves with ground-based optical measurements, a focused study on high area to mass materials was conducted in support of a newly identified population (at the time) in geosynchronous orbit (GEO) consisting of multi-layered insulation. To further characterize orbital debris, a larger selection of materials was analyzed using laboratory photometric measurements that included representative targets from pristine spacecraft materials and ground-based impact tests. Around 2012, an initiative was requested to understand the feasibility of active debris removal (ADR) of larger targets using grappling methods for spent rocket bodies. Using a priori information on selected targets, scaled-down versions of rocket bodies were generated thanks to improvements in 3D printing technology and machining. These targets were studied in the OMC to understand rotation characteristics. These were compared with telescopic data to determine if the tumble and rotation angles would allow ADR. In 2013, the OMC focused on combining spectral measurements with photometric data to characterize GEO orbital debris. Several years later, NASA acquired a Titan III Transtage test article from “The Boneyard” with a high-resemblance to on-orbit Titan III Transtage rocket bodies, allowing physical access to a representative rocket body that suffered fragmentations in GEO. This prompted the creation of 3D models using lidar technology and spectral measurements of the materials. Focused research also transitioned to specific materials (i.e., solar cells) when telescopic surveys requested characterization of specific GEO targets. In the different research products presented, the focus has been to understand the various parameters that influence optical size estimation, including albedo, phase functions, and brightness variations. Work in this area continues with newer sources of data, including DebriSat, a high-fidelity 56-kg spacecraft replica representative of a modern low Earth orbit (LEO) satellite subjected to a laboratory hypervelocity impact test to understand fragmentation events and to support updates to satellite breakup models and size estimation models. Utilizing the vast population of fragments from DebriSat and prior laboratory impact experiments, the ODPO has focused on acquiring bidirectional reflectance distribution function (BRDF) data to characterize targets in the laboratory, thus removing aspect angle dependencies. Additionally, the DebriSat project has provided improved processes for measuring size via image acquisition, such that a true fragment size can be directly compared to the derived size using the OSEM. The team continues to assess BRDFs and use spectral measurement data to investigate the parameters used in the OSEM, specifically magnitudes, albedo, and phase functions.

Heather Cowardin↗

Experimental validation of a three-dimensional linear system model for breast tomosynthesis

A three-dimensional (3D) linear model for digital breast tomosynthesis (DBT) was developed to investigate the effects of different imaging system parameters on the reconstructed image quality. In the present work, experimental validation of the model was performed on a prototype DBT system equipped with an amorphous selenium (a-Se) digital mammography detector and filtered backprojection (FBP) reconstruction methods. The detector can be operated in either full resolution with 85 {mu}m pixel size or 2x1 pixel binning mode to reduce acquisition time. Twenty-five projection images were acquired with a nominal angular range of {+-}20 deg. The images were reconstructed using a slice thickness of 1 mm with 0.085x0.085 mm in-plane pixel dimension. The imaging performance was characterized by spatial frequency-dependent parameters including a 3D noise power spectrum (NPS) and in-plane modulation transfer function (MTF). Scatter-free uniform x-ray images were acquired at four different exposure levels for noise analysis. An aluminum (Al) edge phantom with 0.2 mm thickness was imaged to measure the in-plane presampling MTF. The measured in-plane MTF and 3D NPS were both in good agreement with the model. The dependence of DBT image quality on reconstruction filters was investigated. It was found that the slice thickness (ST) filter, a Hanning window to limit the high-frequency components in the slice thickness direction, reduces noise aliasing and improves 3D DQE. An ACR phantom was imaged to investigate the effects of angular range and detector operational modes on reconstructed image quality. It was found that increasing the angular range improves the MTF at low frequencies, resulting in better detection of large-area, low-contrast mass lesions in the phantom. There is a trade-off between noise and resolution for pixel binning and full resolution modes, and the choice of detector mode will depend on radiation dose and the targeted lesion.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Improving light propagation Monte Carlo simulations with accurate 3D modeling of skin tissue

In this paper, we present a 3D light propagation model to simulate multispectral reflectance images of large skin surface areas. In particular, we aim to simulate more accurately the effects of various physiological properties of the skin in the case of subcutaneous vein imaging compared to existing models. Our method combines a Monte Carlo light propagation model, a realistic three-dimensional model of the skin using parametric surfaces and a vision system for data acquisition. We describe our model in detail, present results from the Monte Carlo modeling and compare our results with those obtained with a well established Monte Carlo model and with real skin reflectance images.

60 APPLIED LIFE SCIENCES↗

Integrated fluorescence light microscopy-guided cryo-focused ion beam-milling for in situ montage cryo-ET

Cryogenic-electron tomography (cryo-ET) permits the in situ visualization of biological macromolecules at the molecular level. Owing to the variable thickness of cells, tissues and organisms, frozen specimens may need to be thinned by cryo-focused ion beam (FIB) milling to produce thin (<500 nm) cryo-lamellae suitable for cryo-ET. Locating regions of interest remains a challenge because untargeted milling can lead to inadvertent ablation and removal of regions of interest. Correlative light and electron microscopy, combined with cryo-FIB milling, can guide the identification of labeled targets in the cellular milieu. Multiple transfers between cryo-imaging instruments, cumbersome correlation algorithms, limited accuracy and low throughput have hindered the routine adoption of cryo-FIB milling within a multimodal correlative workflow for in situ structural biology. Here, in this study, we present a workflow for 3D correlative cryo-fluorescence light microscopy-FIB-ET that streamlines fluorescence light microscopy-guided FIB milling, improving throughput while preserving both structural and contextual information. The complete integration of hardware and software described here minimizes sample contamination from cross-platform exchanges and greatly enhances the efficiency of 3D targeting in cryo-milling. We then describe procedures for implementing montage parallel array cryo-ET (MPACT), which can be easily adapted to any modern life-science transmission electron microscope. MPACT supports high-throughput cryo-ET acquisitions (10 tilt series in 1.5 h) for structure determination and comprehensive contextual understanding of macromolecules within their native surroundings. A complete session from sample preparation to MPACT data processing takes 5−7 d for an individual experienced in both cryo-EM and cryo-FIB milling.

Yang, Jie E. [Univ. of Wisconsin, Madison, WI (Uni↗

Aerospace Cognitive Engineering Laboratory (ACELAB) Simulator for Electric Vertical Takeoff and Landing (eVOTL) Research and Development

A new generation of aerospace innovators are looking for ways to quickly and efficiently transport people in a safe and environmentally friendly manner. In the not-too-distant future, passengers and goods are expected to routinely fly aboard a new breed of cleaner, smarter air vehicles. This represents a new and significant challenge to the Federal Aviation Agency (FAA) which is responsible for aircraft certification, pilot licensing, operating approval and airspace integration. To help streamline this process, NASA has formulated its Advanced Air Mobility (AAM) project to provide research capabilities for development and evaluation of these new concepts and an environment where industry and regulators can work together to understand the requirements and work toward consensus standards for the new market. This paper will describe the development of the Aerospace Cognitive Engineering Lab Rapid Automation Test (ACELeRATE) simulator. ACELeRATE is an adaptable fixed-base aircraft simulator focused on the investigation of the performance and interaction of pilots and increasingly automated aircraft systems. ACELeRATE can be re-configured to support various simulation environments. The simulator includes a simple reconfigurable cockpit placed within a 10-foot spherical dome with a cluster of real-time image generators, high-resolution displays and highly realistic scenery with the surrounding digital terrain and required cultural area details (e.g., hangars, runways, ramp areas, taxiways, test range apparatus, buildings with designated rooftop landing areas, and other man-made 3D structures). This paper will also describe the various hardware and software tools employed in the ACELeRATE simulator, including engineering tools used by NASA for electric Vertical Takeoff and Landing (eVTOL) vehicle equations of motion, wind-model simulation in an urban environment, as well as the various modeling techniques and tools used to quickly generate highly realistic 3D terrain models for low level flight including urban terrain and obstacle depictions.

AAM Simulation Cockpit↗

Seeding the explosion of a high-current-density conductor in a controlled manner through the addition of micron-scale surface defects

Inhomogeneities in a current-carrying conductor promote non-uniform heating and expansion through the complex feedback between current density, electrical resistivity, Ohmic heating, temperature, and hydrodynamics. Three-dimensional-magnetohydrodynamic (3D-MHD) simulations suggest that μm-scale resistive inclusions or voids seed local overheating and through hydrodynamic explosion generate continuously growing craters which become several times larger than the initial perturbation. The ejected mass is the genesis of an electrothermally driven plasma filament which develops at lower current than plasmas on uniform surfaces adjacent to the defect. This result suggests that 1D or even 2D treatments are largely inadequate for detailed prediction of plasma formation. To test computational predictions, z-pinch experiments driven to 1 MA studied ultra-high-purity aluminum rods which were then machined to include pairs of quasi-hemispherical voids or “engineered defects (ED)” on the current-carrying surface. ED are the dominant current-density perturbation and reproducibly drive local overheating which can be compared with 3D-MHD simulation. Data from high-resolution-gated imagers of visible surface emissions confirm many simulation predictions, including the surface topography of local overheating, and the propensity for neighboring ED to prematurely source plasmas which then connect to form a plasma filament. Results also provide conditional support of theory which suggests heating similarity; that is, heating is independent of ED size for geometrically scaled ED.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Derivation of Multiple Covarying Material and Process Parameters Using Physics-Based Modeling of X-ray Data

There is considerable interest in developing multimodal characterization frameworks capable of probing critical properties of complex materials by relying on distinct, complementary methods or tools. Any such framework should maximize the amount of information that is extracted from any given experiment and should be sufficiently powerful and efficient to enable on-the-fly analysis of multiple measurements in a self-consistent manner. Such a framework is demonstrated in this work in the context of self-assembling polymeric materials, where theory and simulations provide the language to seamlessly mesh experimental data from two different scattering measurements. Specifically, the samples considered here consist of diblock copolymers (BCP) that are self-assembled on chemically nanopatterned surfaces. The copolymers microphase separate into ordered lamellae with characteristic dimensions on the scale of tens of nanometers that are perfectly aligned by the substrate over macroscopic areas. These aligned lamellar samples provide ideal standards with which to develop the formalism introduced in this work and, more generally, the concept of high-information-content, multimodal experimentation. In conclusion, the outcomes of the proposed analysis are then compared to images generated by 3D scanning electron microscopy tomography, serving to validate the merit of the framework and ideas proposed here.

36 MATERIALS SCIENCE↗

In-situ Imaging of Pyrolyzing Aerospace Materials

Tracking morphological changes of materials during heating is crucial to understand its response in fire protection, biofuel production, thermal protection systems (TPS) for hypersonic flight. As materials are heated, they undergo physical and chemical changes due to water loss, stretching or shrinking, pyrolysis and chemical reactions in the ambient environment. The effects of these changes can have a profound impact on the material’s performance, indicated by changes in on the porosity and volume. While materials such as wood shrink as they pyrolyze and lose mass, others swell due to their inherent characteristics when exposed to heat [1]. This study focuses on experiments conducted at the Advanced Light Source (ALS) beamline 8.3.2, where in situ micro-computed tomography (µ-CT) is performed on materials as they are being pyrolyzed. Through in situ µ-CT, the change in total volume and porosity can be obtained in real-time, allowing for better understanding of the underlying thermophysical and chemical processes as a function of temperature. This study also focuses on the implementation of the Porous Microstructure Analysis software (PuMA) [2] to obtain thermal conductivity, permeability, and other properties of the material from the 3D tomographies. The information gained from these tomographies will supplement microscale model development of material morphological change and will aid macroscale modeling for high-temperature applications. For this study, Room Temperature Vulcanizing silicone (RTV) [3-5] is heated from room temperature to 1000°C using an infrared lamp heating system, and tomographies are continuously collected as the sample is heated. The tomographies are then segmented to obtain solid and void phases, from which estimates of pore size, porosity and total volume are extracted as a function of temperature. PuMA is deployed on the segmented tomographies to obtain thermal conductivity, permeability, and other properties as a function of temperature. Preliminary results show that RTV first intumesces (swells) as pyrolysis begins, due to build-up of pyrolysis gases in closed pores, and then shrinks significantly as more open pores are formed and the pyrolysis gases outgas. Pore network visualization of the tomographies using OpenPNM [6] showed the increase in pore connectivity with increase in temperature. Future work will focus on using PuMA to obtain macroscopic properties of RTV as a function of temperature.

Tomography↗

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Atmospheric 3D winds in the horizontal and vertical directions are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we use a state-of-the-art convolutional neural network for optical flow (FlowNetS) in a physics-guided deep learning framework for predicting AMVs in the horizontal direction. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations (DYAMOND) for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

geostationary↗