Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D live images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Augmenting C. elegans Microscopic Dataset for Accelerated Pattern Recognition

The detection of cell shape changes in 3D time-lapse images of complex tissues is an important task. However, it is a challenging and tedious task to establish a comprehensive dataset to improve the performance of deep learning models. In the paper, we present a deep learning approach to augment 3D live images of the Caenorhabditis elegans embryo, so that we can further speed up the specific structure pattern recognition. We use an unsupervised training over unlabeled images to generate supplementary datasets for further pattern recognition. Technically, we used Alex-style neural networks in a generative adversarial network framework to generate new datasets that have common features of the C. elegans membrane structure. We also made the dataset available for a broad scientific community.

Lu, Zheng↗

Light-sheet autofluorescence lifetime imaging with a single-photon avalanche diode array

Significance: Fluorescence lifetime imaging microscopy (FLIM) of the metabolic co-enzyme nicotinamide adenine dinucleotide (phosphate) [NAD(P)H] is a popular method to monitor single-cell metabolism within unperturbed, living 3D systems. However, FLIM of NAD(P)H has not been performed in a light-sheet geometry, which is advantageous for rapid imaging of cells within live 3D samples. Aim: We aim to design, validate, and demonstrate a proof-of-concept light-sheet system for NAD(P)H FLIM. Approach: A single-photon avalanche diode camera was integrated into a light sheet microscope to achieve optical sectioning and limit out-of-focus contributions for NAD(P)H FLIM of single cells. Results: An NAD(P)H light-sheet FLIM system was built and validated with fluores cence lifetime standards and with time-course imaging of metabolic perturbations in pancreas cancer cells with 10 s integration times. NAD(P)H light-sheet FLIM in vivo was demonstrated with live neutrophil imaging in a larval zebrafish tail wound also with 10 s integration times. Finally, the theoretical and practical imaging speeds for NAD(P)H FLIM were compared across laser scanning and light-sheet geometries, indicating a 30× to 6× acquisition speed advantage for the light sheet compared to the laser scanning geometry. Conclusions: FLIM of NAD(P)H is feasible in a light-sheet geometry and is attrac tive for 3D live cell imaging applications, such as monitoring immune cell metabolism and migration within an organism.

47 OTHER INSTRUMENTATION↗

What can we learn from in-soil imaging of a live plant: X-ray Computed Tomography and 3D numerical simulation of root-soil system

Plant roots play a critical role in plant-soil-microbe interactions that occur in the rhizosphere, as well as processes with important implications to farming, forest management and climate change. X-ray computed tomography (XCT) has been proven to be an effective tool for non-invasive root imaging and analysis. A combination of XCT, open-source software, and our own code was used to noninvasively image a prairie dropseed (Sporobolus heterolepis) specimen, segment the root data to obtain a 3D image of the root structure at 31µm resolution, and extract quantitative information (root volume and surface area) from the 3D data, respectively. Based on the mesh generated from the root structure, computational fluid dynamics (CFD) simulations were applied to numerically investigate the root-soil-groundwater system. The plant root conductivity, soil hydraulic conductivity and transpiration rate were shown to control the groundwater distribution. The flow variability and soil water distributions under different scenarios were investigated. Parameterizations were evaluated to show their impacts on the average conductivity. The pore-scale modeling approach provides realistic simulations of rhizosphere flow processes and provides useful information that can be linked to upscaled models.

54 ENVIRONMENTAL SCIENCES↗

An Observation Data Driven Simulation and Analysis Framework for Early Stage C. elegans Embryogenesis

Recent developments in cutting-edge live microscopy and image analysis provide a unique opportunity to systematically investigate individual cell’s dynamics as well as simulation-based hypothesis testing. After a summary of data generation and analysis in the observation and modeling efforts related to C. elegans embryogenesis, we develop a systematic approach to model the basic behaviors of individual cells. Next, we present our ideas to model cell fate, division, and movement using 3D time-lapse images within an agent-based modeling framework. Then, we summarize preliminary result and discuss efforts in cell fate, division, and movement modeling. Finally, we discuss the ongoing efforts and future directions for C. elegans embryo modeling, including an inferred developmental landscape for cell fate, a quasi-equilibrium model for cell division, and multi-agent, deep reinforcement learning for cell movement.

3D live images↗

Equally sloped X-ray microtomography of living insects with low radiation dose and improved resolution capability

Three-dimensional X-ray imaging of living specimens is challenging due to the limited resolution of conventional absorption contrast X-ray imaging and potential irradiation damage of biological specimens. In this letter, we present microtomography of a living specimen combining phase-contrast imaging and a Fourier-based iterative algorithm termed equally sloped tomography. Non-destructive 3D imaging of an anesthetized living yellow mealworm Tenebrio molitor was demonstrated with a relatively low dose using synchrotron generated X-rays. Based on the high-quality 3D images, branching tracheoles and different tissues of the insect in a natural state were identified and analyzed, demonstrating a significant advantage of the technique over conventional X-ray radiography or histotomy. Additionally, the insect survived without problem after a 1.92-s X-ray exposure and subsequent absorbed radiation dose of ∼1.2 Gy. No notable physiological effects were observed after reviving the insect from anesthesia. The improved static tomographic method demonstrated in this letter shows advantage in the non-destructive structural investigation of living insects in three dimensions due to the low radiation dose and high resolution capability, and offers many potential applications in biological science.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Template-based CTA to x-ray angio rigid registration of coronary arteries in frequency domain with automatic x-ray segmentation

Purpose: A key challenge for image guided coronary interventions is accurate and absolutely robust image registration bringing together preinterventional information extracted from a three-dimensional (3D) patient scan and live interventional image information. In this paper, the authors present a novel scheme for 3D to two-dimensional (2D) rigid registration of coronary arteries extracted from preoperative image scan (3D) and a single segmented intraoperative x-ray angio frame in frequency and spatial domains for real-time angiography interventions by C-arm fluoroscopy.Methods: Most existing rigid registration approaches require a close initialization due to the abundance of local minima and high complexity of search algorithms. The authors' method eliminates this requirement by transforming the projections into translation-invariant Fourier domain for estimating the 3D pose. For 3D rotation recovery, template Digitally Reconstructed Radiographs (DRR) as candidate poses of 3D vessels of segmented computed tomography angiography are produced by rotating the camera (image intensifier) around the DICOM angle values with a specific range as in C-arm setup. The authors have compared the 3D poses of template DRRs with the segmented x-ray after equalizing the scales in three domains, namely, Fourier magnitude, Fourier phase, and Fourier polar. The best rotation pose candidate was chosen by one of the highest similarity measures returned by the methods in these domains. It has been noted in literature that frequency domain methods are robust against noise and occlusion which was also validated by the authors' results. 3D translation of the volume was then recovered by distance-map based BFGS optimization well suited to convex structure of the authors' objective function without local minima due to distance maps. A novel automatic x-ray vessel segmentation was also performed in this study.Results: Final results were evaluated in 2D projection space for patient data; and with ground truth values and landmark distances for the images acquired with a solid phantom vessel. Results validate that rotation recovery in frequency domain is robust against differences in segmentations in two modalities. Distance-map translation is successful in aligning coronary trees with highest possible overlap.Conclusions: Numerical and qualitative results show that single view rigid alignment in projection space is successful. This work can be extended with multiple views to resolve depth ambiguity and with deformable registration to account for nonrigid motion in patient data.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Improvements in intrinsic feature pose measurement for awake animal imaging

Development has continued with intrinsic feature optical motion tracking for awake animal imaging to measure 3D position and orientation (pose) for motion compensated reconstruction. Prior imaging results have been directed towards head motion measurement for SPECT brain studies in awake unrestrained mice. This work improves on those results in extracting and tracking intrinsic features from multiple camera images and computing pose changes from the tracked features over time. Previously, most motion tracking for 3D imaging has been limited to measuring extrinsic features such as retro-reflective markers applied to an animal's head. While this approach has been proven to be accurate, the use of external markers is undesirable for several reasons. The intrinsic feature approach has been further developed from previous work to provide full pose measurements for a live mouse scan. Surface feature extraction, matching, and pose change calculation with point tracking and accuracy results are described. Experimental pose calculation and 3D reconstruction results from live images are presented.

60 APPLIED LIFE SCIENCES↗

Improvements in Intrinsic Feature Pose Measurement for Awake Animal Imaging

Development has continued with intrinsic feature optical motion tracking for awake animal imaging to measure 3D position and orientation (pose) for motion compensated reconstruction. Prior imaging results have been directed towards head motion measurement for SPECT brain studies in awake unrestrained mice. This work improves on those results in extracting and tracking intrinsic features from multiple camera images and computing pose changes from the tracked features over time. Previously, most motion tracking for 3D imaging has been limited to measuring extrinsic features such as retro-reflective markers applied to an animal s head. While this approach has been proven to be accurate, the use of external markers is undesirable for several reasons. The intrinsic feature approach has been further developed from previous work to provide full pose measurements for a live mouse scan. Surface feature extraction, matching, and pose change calculation with point tracking and accuracy results are described. Experimental pose calculation and 3D reconstruction results from live images are presented.

59 BASIC BIOLOGICAL SCIENCES↗

The impact of different nanoparticle surface chemistry and size on uptake and toxicity in a murine macrophage cell line

This study investigated the uptake, kinetics and cellular distribution of different surface coated quantum dots (QDs) before relating this to their toxicity. J774.A1 cells were treated with organic, COOH and NH{sub 2} (PEG) surface coated QDs (40 nM). Model 20 nm and 200 nm COOH-modified coated polystyrene beads (PBs) were also examined (50 {mu}g ml{sup -1}). The potential for uptake of QDs was examined by both fixed and live cell confocal microscopy as well as by flow cytometry over 2 h. Both the COOH 20 nm and 200 nm PBs were clearly and rapidly taken up by the J774.A1 cells, with uptake of 20 nm PBs being relatively quicker and more extensive. Similarly, COOH QDs were clearly taken up by the macrophages. Uptake of NH{sub 2} (PEG) QDs was not detectable by live cell imaging however, was observed following 3D reconstruction of fixed cells, as well as by flow cytometry. Cells treated with organic QDs, monitored by live cell imaging, showed only a small amount of uptake in a relatively small number of cells. This uptake was insufficient to be detected by flow cytometry. Imaging of fixed cells was not possible due to a loss in cell integrity related to cytotoxicity. A significant reduction (p < 0.05) in the fluorescent intensity in a cell-free environment was found with organic QDs, NH{sub 2} (PEG) QDs, 20 nm and 200 nm PBs at pH 4.0 (indicative of an endosome) after 2 h, suggesting reduced stability. No evidence of exocytosis was found over 2 h. These findings confirm that surface coating has a significant influence on the mode of NP interaction with cells, as well as the subsequent consequences of that interaction.

60 APPLIED LIFE SCIENCES↗

Design and Development of Modules to Support Live Microscopic Imaging on Ground-Based Microgravity Simulators

In space, astronauts are exposed to environmental stressors that often result in physiological changes. One prominent stressor in spaceflight is microgravity, and research has shown that long term microgravity exposure causes muscle atrophy, bone loss, cardiovascular concerns, and vision impairment. It is critical to understand how altered gravity affects physiology on the cellular, molecular, and gene level in order to accurately assess health risks and to develop effective countermeasures. Ground-based microgravity simulators such as random positioning machines (RPMs) are used to produce some of the biological effects of altered gravity on different cell types and organisms. Real-time imaging during simulations are of particular interest as we can study how basic cell functions such as cell division, cell migration, and proliferation progress under microgravity conditions. However, design limitations of present microgravity simulators such as susceptibility to parasitic vibration and displacement of the sample from the center of rotation challenge the accuracy of experiment results and live images. We have developed a cell culture sample holder module suitable for live microscopic imaging on an RPM. CAD modeling and 3D printing technology were used to implement modifications to the sample holder and to install a digital microscope to perform live bright-field and fluorescent imaging. Vibration damping materials were also investigated to allow for stable imaging while the microgravity simulator was within a cell culture incubator. Novel methods and hardware modifications for improving live cell imaging on ground-based microgravity simulators were proposed and discussed.

3D printing↗

pnnl/brain_ohsu

Light sheet microscopy has made possible the 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. We fine-tuned an existing model, TrailMap, using expert labeled data from axonal structures in neocortex. Without changing the network architecture, we implemented nnU-Net framework modifications in data augmentation, data foreground sampling, window learning rate, and the inference overlap method. The resulting model from these combined approaches yielded an improved F1 score

Oostrom, Marjolein↗

Fine-tuning TrailMap: The utility of transfer learning to improve the performance of deep learning in axon segmentation of light-sheet microscopy images

Light-sheet microscopy has made possible the 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual undertaking. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through optimizing transfer learning. We fine-tuned the existing TrailMap model using expert-labeled data from noradrenergic axonal structures in the mouse brain. By changing the cross-entropy weights and using augmentation, we demonstrate a generally improved adjusted F1-score over using the originally trained TrailMap model within our test datasets.

97 MATHEMATICS AND COMPUTING↗

Data-driven Mapping of the Mouse Connectome: The utility of transfer learning to improve the performance of deep learning models performing axon segmentation on light-sheet microscopy images

Light sheet microscopy has made possible the high temporal and spatial 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual process. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through the application of refinements such as transfer learning.

59 BASIC BIOLOGICAL SCIENCES↗

Snapshot 3D tracking of insulin granules in live cells

Rapid and accurate volumetric imaging remains a challenge, yet has the potential to enhance understanding of cell function. We developed and used a multifocal microscope (MFM) for 3D snapshot imaging to allow 3D tracking of insulin granules labeled with mCherry in MIN6 cells. MFM employs a special diffractive optical element (DOE) to simultaneously image multiple focal planes. This simultaneous acquisition of information deteunines the 3D location of single objects at a speed only limited by the array detector's frame rate. We validated the accuracy of MFM imaging/tracking with fluorescence beads; the 3D positions and trajectories of single fluorescence beads can be detelinined accurately over a wide range of spatial and temporal scales. The 3D positions and trajectories of single insulin granules in a 3.2um deep volume were deteunined with imaging processing that combines 3D decovolution, shift correction, and finally tracking using the Imaris software package. We find that the motion of the granules is super diffusive, but less so in 3D than 2D for cells grown on coverslip surfaces, suggesting an anisotropy in the cytoskeleton (e.g. microtubules and action).

3D tracking↗

A limited-angle intrafraction verification (LIVE) system for radiation therapy

Purpose: Currently, no 3D or 4D volumetric x-ray imaging techniques are available for intrafraction verification of target position during actual treatment delivery or in-between treatment beams, which is critical for stereotactic radiosurgery (SRS) and stereotactic body radiation therapy (SBRT) treatments. This study aims to develop a limited-angle intrafraction verification (LIVE) system to use prior information, deformation models, and limited angle kV-MV projections to verify target position intrafractionally. Methods: The LIVE system acquires limited-angle kV projections simultaneously during arc treatment delivery or in-between static 3D/IMRT treatment beams as the gantry moves from one beam to the next. Orthogonal limited-angle MV projections are acquired from the beam's eye view (BEV) exit fluence of arc treatment beam or in-between static beams to provide additional anatomical information. MV projections are converted to kV projections using a linear conversion function. Patient prior planning CT at one phase is used as the prior information, and the on-board patient volume is considered as a deformation of the prior images. The deformation field is solved using the data fidelity constraint, a breathing motion model extracted from the planning 4D-CT based on principal component analysis (PCA) and a free-form deformation (FD) model. LIVE was evaluated using a 4D digital extended cardiac torso phantom (XCAT) and a CIRS 008A dynamic thoracic phantom. In the XCAT study, patient breathing pattern and tumor size changes were simulated from CT to treatment position. In the CIRS phantom study, the artificial target in the lung region experienced both size change and position shift from CT to treatment position. Varian Truebeam research mode was used to acquire kV and MV projections simultaneously during the delivery of a dynamic conformal arc plan. The reconstruction accuracy was evaluated by calculating the 3D volume percentage difference (VPD) and the center of mass (COM) difference of the tumor in the true on-board images and reconstructed images. Results: In both simulation and phantom studies, LIVE achieved substantially better reconstruction accuracy than reconstruction using PCA or FD deformation model alone. In the XCAT study, the average VPD and COM differences among different patient scenarios for LIVE system using orthogonal 30° scan angles were 4.3% and 0.3 mm when using kV+BEV MV. Reducing scan angle to 15° increased the average VPD and COM differences to 15.1% and 1.7 mm. In the CIRS phantom study, the VPD and COM differences for the LIVE system using orthogonal 30° scan angles were 6.4% and 1.4 mm. Reducing scan angle to 15° increased the VPD and COM differences to 51.9% and 3.8 mm. Conclusions: The LIVE system has the potential to substantially improve intrafraction target localization accuracy by providing volumetric verification of tumor position simultaneously during arc treatment delivery or in-between static treatment beams. With this improvement, LIVE opens up a new avenue for margin reduction and dose escalation in both fractionated treatments and SRS and SBRT treatments.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-E-J-134: An Augmented-Reality Optical Imaging System for Accurate Breast Positioning During Radiotherapy

Purpose: Breast radiotherapy, particularly electronic compensation, may involve large dose gradients and difficult patient positioning problems. We have developed a simple self-calibrating augmented-reality system, which assists in accurately and reproducibly positioning the patient, by displaying her live image from a single camera superimposed on the correct perspective projection of her 3D CT data. Our method requires only a standard digital camera capable of live-view mode, installed in the treatment suite at an approximately-known orientation and position (rotation R; translation T). Methods: A 10-sphere calibration jig was constructed and CT imaged to provide a 3D model. The (R,T) relating the camera to the CT coordinate system were determined by acquiring a photograph of the jig and optimizing an objective function, which compares the true image points to points calculated with a given candidate R and T geometry. Using this geometric information, 3D CT patient data, viewed from the camera's perspective, is plotted using a Matlab routine. This image data is superimposed onto the real-time patient image, acquired by the camera, and displayed using standard live-view software. This enables the therapists to view both the patient's current and desired positions, and guide the patient into assuming the correct position. The method was evaluated using an in-house developed bolus-like breast phantom, mounted on a supporting platform, which could be tilted at various angles to simulate treatment-like geometries. Results: Our system allowed breast phantom alignment, with an accuracy of about 0.5 cm and 1 ± 0.5 degree. Better resolution could be possible using a camera with higher-zoom capabilities. Conclusion: We have developed an augmented-reality system, which combines a perspective projection of a CT image with a patient's real-time optical image. This system has the potential to improve patient setup accuracy during breast radiotherapy, and could possibly be used for other disease sites as well.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Awake Animal Imaging Motion Tracking Software

The Awake Animal Motion Tracking Software code calculates the 3D movement of the head motion of a live, awake animal during a medical imaging scan. In conjunction with markers attached to the head, images acquired from multiple cameras are processed and marker locations precisely determined. Using off-line camera calibration data, the 3D positions of the markers are calculated along with a 6 degree of freedom position and orientation (pose) relative to a fixed initial position. This calculation is performed in real time at frame rates up to 30 frames per second. A time stamp with microsecond accuracy from a time base source is attached to each pose measurement.

Goddard, James↗

Sci-Thur AM: YIS – 03: Combining sagittally-reconstructed 3D and live-2D ultrasound for high-dose-rate prostate brachytherapy needle segmentation

Ultrasound-guided high-dose-rate prostate brachytherapy (HDR-BT) needle segmentation is performed clinically using live-2D sagittal images. Organ segmentation is then performed using axial images, introducing a source of geometric uncertainty. Sagittally-reconstructed 3D (SR3D) ultrasound enables both needle and organ segmentation, but suffers from shadow artifacts. We present a needle segmentation technique augmenting SR3D with live-2D sagittal images using mechanical probe tracking to mitigate image artifacts and compare it to the clinical standard. Seven prostate cancer patients underwent TRUS-guided HDR-BT during which the clinical and proposed segmentation techniques were completed in parallel using dual ultrasound video outputs. Calibrated needle end-length measurements were used to calculate insertion depth errors (IDEs), and the dosimetric impact of IDEs was evaluated by perturbing clinical treatment plan source positions. The proposed technique provided smaller IDEs than the clinical approach, with mean±SD of −0.3±2.2 mm and −0.5±3.7mm respectively. The proposed and clinical techniques resulted in 84% and 43% of needles with IDEs within ±3mm, and IDE ranges across all needles of [−7.7mm, 5.9mm] and [−9.3mm, 7.7mm] respectively. The proposed and clinical IDEs lead to mean±SD changes in the volume of the prostate receiving the prescription dose of −0.6±0.9% and −2.0±5.3% respectively. The proposed technique provides improved HDR-BT needle segmentation accuracy over the clinical technique leading to decreased dosimetric uncertainty by eliminating the axial-to-sagittal registration, and mitigates the effect of shadow artifacts by incorporating mechanically registered live-2D sagittal images.

60 APPLIED LIFE SCIENCES↗