Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Moving metal artifact reduction in cone-beam CT scans with implanted cylindrical gold markers

Purpose: Implanted gold markers for image-guided radiotherapy lead to streaking artifacts in cone-beam CT (CBCT) scans. Several methods for metal artifact reduction (MAR) have been published, but they all fail in scans with large motion. Here the authors propose and investigate a method for automatic moving metal artifact reduction (MMAR) in CBCT scans with cylindrical gold markers. Methods: The MMAR CBCT reconstruction method has six steps. (1) Automatic segmentation of the cylindrical markers in the CBCT projections. (2) Removal of each marker in the projections by replacing the pixels within a masked area with interpolated values. (3) Reconstruction of a marker-free CBCT volume from the manipulated CBCT projections. (4) Reconstruction of a standard CBCT volume with metal artifacts from the original CBCT projections. (5) Estimation of the three-dimensional (3D) trajectory during CBCT acquisition for each marker based on the segmentation in Step 1, and identification of the smallest ellipsoidal volume that encompasses 95% of the visited 3D positions. (6) Generation of the final MMAR CBCT reconstruction from the marker-free CBCT volume of Step 3 by replacing the voxels in the 95% ellipsoid with the corresponding voxels of the standard CBCT volume of Step 4. The MMAR reconstruction was performed retrospectively using a half-fan CBCT scan for 29 consecutive stereotactic body radiation therapy patients with 2–3 gold markers implanted in the liver. The metal artifacts of the MMAR reconstructions were scored and compared with a standard MAR reconstruction by counting the streaks and by calculating the standard deviation of the Hounsfield units in a region around each marker. Results: The markers were found with the same autosegmentation settings in 27 CBCT scans, while two scans needed slightly changed settings to find all markers automatically in Step 1 of the MMAR method. MMAR resulted in 15 scans with no streaking artifacts, 11 scans with 1–4 streaks, and 3 scans with severe streaking artifacts. The corresponding numbers for MAR were 8 (no streaks), 1 (1–4 streaks), and 20 (severe streaking artifacts). The MMAR method was superior to MAR in scans with more than 8 mm 3D marker motion and comparable to MAR for scans with less than 8 mm motion. In addition, the MMAR method was tested on a 4D CBCT reconstruction for which it worked equally well as for the 3D case. The markers in the 4D case had very low motion blur. Conclusions: An automatic method for MMAR in CBCT scans was proposed and shown to effectively remove almost all streaking artifacts in a large set of clinical CBCT scans with implanted gold markers in the liver. Residual streaking artifacts observed in three CBCT scans may be removed with better marker segmentation.

60 APPLIED LIFE SCIENCES↗

Reduced volume of diabetic pancreatic islets in rodents detected by synchrotron X-ray phase-contrast microtomography and deep learning network

The pancreatic islet is a highly structured micro-organ that produces insulin in response to rising blood glucose. Here we develop a label-free and automatic imaging approach to visualize the islets in situ in diabetic rodents by the synchrotron radiation X-ray phase-contrast microtomography (SRμCT) at the ID17 station of the European Synchrotron Radiation Facility. The large-size images (3.2 mm × 15.97 mm) were acquired in the pancreas in STZ-treated mice and diabetic GK rats. Each pancreas was dissected by 3000 reconstructed images. The image datasets were further analysed by a self-developed deep learning method, AA-Net. All islets in the pancreas were segmented and visualized by the three-dimension (3D) reconstruction. After quantifying the volumes of the islets, we found that the number of larger islets (=>1500 μm 3 ) was reduced by 2-fold (wt 1004 ± 94 vs GK 419 ± 122, P < 0.001) in chronically developed diabetic GK rat, while in STZ-treated diabetic mouse the large islets were decreased by half (189 ± 33 vs 90 ± 29, P < 0.001) compared to the untreated mice. Our study provides a label-free tool for detecting and quantifying pancreatic islets in situ. It implies the possibility of monitoring the state of pancreatic islets in vivo diabetes without labelling.

59 BASIC BIOLOGICAL SCIENCES↗

A Real2Sim Digital Twin Pipeline for Photorealistic Robot Simulation: Evaluating VLA Policy Deployment on a Bimanual Mobile Robot

Digital twins that are automatically constructed from robot sensor data offer a promising pathway for scalable Real2Sim and Sim2Real transfer. However, it remains an open question whether photorealistic reconstruction alone is sufficient to support reliable deployment of vision-language-action (VLA) policies. We present a generative-AI-assisted Real2Sim pipeline that generates simulation-ready digital twins from real-world RGB observations with minimal manual intervention. The pipeline uses prompted segmentation to isolate scene components and a generative 3D model to directly produce simulation assets, eliminating the need for traditional multi-view reconstruction or manual 3D modeling.\r\nTo evaluate simulation fidelity, we deploy and compare policies from two VLA models in both the real robot and the reconstructed\r\nsimulation under identical tasks and initial conditions. We compare joint-level action trajectories and analyze how divergence evolves over time in closed-loop execution. Although the reconstructed environments are visually accurate, we observe increasing trajectory divergence during closedloop operation. These results indicate that photorealistic reconstruction alone is insufficient to preserve closed-loop control behavior\r\nin VLA policies, particularly in contact-rich manipulation settings where small perceptual errors compound over time.

97 MATHEMATICS AND COMPUTING↗

Contour interpolated radial basis functions with spline boundary correction for fast 3D reconstruction of the human articular cartilage from MR images

Purpose: The aim of this work is to demonstrate a new image processing technique that can provide a “near real-time” 3D reconstruction of the articular cartilage of the human knee from MR images which is user friendly. This would serve as a point-of-care 3D visualization tool which would benefit a consultant radiologist in the visualization of the human articular cartilage. Methods: The authors introduce a novel fusion of an adaptation of the contour method known as “contour interpolation (CI)” with radial basis functions (RBFs) which they describe as “CI-RBFs.” The authors also present a spline boundary correction which further enhances volume estimation of the method. A subject cohort consisting of 17 right nonpathological knees (ten female and seven male) is assessed to validate the quality of the proposed method. The authors demonstrate how the CI-RBF method dramatically reduces the number of data points required for fitting an implicit surface to the entire cartilage, thus, significantly improving the speed of reconstruction over the comparable RBF reconstruction method of Carr. The authors compare the CI-RBF method volume estimation to a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Results: The authors demonstrate how the CI-RBF method significantly reduces the number of data points (p-value < 0.0001) required for fitting an implicit surface to the cartilage, by 48%, 31%, and 44% for the patellar, tibial, and femoral cartilages, respectively. Thus, significantly improving the speed of reconstruction (p-value < 0.0001) by 39%, 40%, and 44% for the patellar, tibial, and femoral cartilages over the comparable RBF model of Carr providing a near real-time reconstruction of 6.49, 8.88, and 9.43 min for the patellar, tibial, and femoral cartilages, respectively. In addition, it is demonstrated how the CI-RBF method matches the volume estimation of a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Furthermore, the performance of the segmentation method used for the extraction of the femoral, tibial, and patellar cartilages is assessed with a Dice similarity coefficient, sensitivity, and specificity measure providing high agreement to manual segmentation. Conclusions: The CI-RBF method provides a fast, accurate, and robust 3D model reconstruction that matches Carr’s RBF method, 3D DOCTOR, and a manual benchmark method in accuracy and significantly improves upon Carr’s RBF method in data requirement and computational speed. In addition, the visualization tool has been designed to quickly segment MR images requiring only four mouse clicks per MR image slice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

X-ray microscopy enables multiscale high-resolution 3D imaging of plant cells, tissues, and organs

Capturing complete internal anatomies of plant organs and tissues within their relevant morphological context remains a key challenge in plant science. While plant growth and development are inherently multiscale, conventional light, fluorescence, and electron microscopy platforms are typically limited to imaging of plant microstructure from small flat samples that lack a direct spatial context to, and represent only a small portion of, the relevant plant macrostructures. We demonstrate technical advances with a lab-based X-ray microscope (XRM) that bridge the imaging gap by providing multiscale high-resolution three-dimensional (3D) volumes of intact plant samples from the cell to the whole plant level. Serial imaging of a single sample is shown to provide sub-micron 3D volumes co-registered with lower magnification scans for explicit contextual reference. High-quality 3D volume data from our enhanced methods facilitate sophisticated and effective computational segmentation. Advances in sample preparation make multimodal correlative imaging workflows possible, where a single resin-embedded plant sample is scanned via XRM to generate a 3D cell-level map, and then used to identify and zoom in on sub-cellular regions of interest for high-resolution scanning electron microscopy. In total, we present the methodologies for use of XRM in the multiscale and multimodal analysis of 3D plant features using numerous economically and scientifically important plant systems.

59 BASIC BIOLOGICAL SCIENCES↗

SU-E-J-207: Effect of Pulse Sequence Parameters On Geometric Distortions Induced by a Titanium Brachytherapy Applicator

Purpose: To investigate the effect of readout bandwidth and voxel size on the appearance of distortion artifacts caused by a titanium brachytherapy applicator. Methods: An acrylic phantom was constructed to rigidly hold a MR conditional, titanium Fletcher-Suit-Delclos-style applicator set (Varian Medical Systems) for imaging on CT (Philips Brilliance) and 1.5T MRI (Siemens Magnetom Aera). Several variants of MRI parameters were tried for 2D T2-weighted turbo spin echo imaging in comparison against the standard clinical protocol with the criteria to keep relative SNR loss less than 20% and imaging time as short as possible. Two 3D sequences were also used for comparison with similar parameters. The applicator tandem was segmented on axial CT images (0.4×0.4×1.5mm {sup 3} resolution) and the CT images were registered to the 3D MR images in Eclipse (Varian). The applicator volume was then overlaid on all MRI sets in 3D-Slicer and distances were measured from the tandem tip to the MRI artifact edge in right/left/superior and anterior/posterior/superior directions from coronal and sagittal 2D acquisitions, respectively, or 3D data reformats. Artifact regions were also manually contoured in coronal/sagittal orientations for area measurements. Results: As would be expected, reductions in voxel size and increases in readout bandwidth reduced artifact size (average max artifact length decreased by 0.95 mm and average max area decrease by 0.27 cm{sup 2}). Interestingly, bandwidth increases yielded reductions in area (0.19 cm{sup 2}) and in distance measurements (1 mm) even with voxel increases, as compared to a standard protocol. This could be useful when high performance protocols are not feasible due to long imaging times. Conclusion: We have characterized artifacts caused by cervical brachytherapy applicator across multiple sequence parameters at 1.5T. Future work will focus on finalizing an optimal protocol that balances artifact reduction with imaging time and then testing this new protocol in patients.

60 APPLIED LIFE SCIENCES↗

Reconstruction of implanted marker trajectories from cone-beam CT projection images using interdimensional correlation modeling

Purpose: Cone-beam CT (CBCT) is a widely used imaging modality for image-guided radiotherapy. Most vendors provide CBCT systems that are mounted on a linac gantry. Thus, CBCT can be used to estimate the actual 3-dimensional (3D) position of moving respiratory targets in the thoracic/abdominal region using 2D projection images. The authors have developed a method for estimating the 3D trajectory of respiratory-induced target motion from CBCT projection images using interdimensional correlation modeling. Methods: Because the superior–inferior (SI) motion of a target can be easily analyzed on projection images of a gantry-mounted CBCT system, the authors investigated the interdimensional correlation of the SI motion with left–right and anterior–posterior (AP) movements while the gantry is rotating. A simple linear model and a state-augmented model were implemented and applied to the interdimensional correlation analysis, and their performance was compared. The parameters of the interdimensional correlation models were determined by least-square estimation of the 2D error between the actual and estimated projected target position. The method was validated using 160 3D tumor trajectories from 46 thoracic/abdominal cancer patients obtained during CyberKnife treatment. The authors’ simulations assumed two application scenarios: (1) retrospective estimation for the purpose of moving tumor setup used just after volumetric matching with CBCT; and (2) on-the-fly estimation for the purpose of real-time target position estimation during gating or tracking delivery, either for full-rotation volumetric-modulated arc therapy (VMAT) in 60 s or a stationary six-field intensity-modulated radiation therapy (IMRT) with a beam delivery time of 20 s. Results: For the retrospective CBCT simulations, the mean 3D root-mean-square error (RMSE) for all 4893 trajectory segments was 0.41 mm (simple linear model) and 0.35 mm (state-augmented model). In the on-the-fly simulations, prior projections over more than 60° appear to be necessary for reliable estimations. The mean 3D RMSE during beam delivery after the simple linear model had established with a prior 90° projection data was 0.42 mm for VMAT and 0.45 mm for IMRT. Conclusions: The proposed method does not require any internal/external correlation or statistical modeling to estimate the target trajectory and can be used for both retrospective image-guided radiotherapy with CBCT projection images and real-time target position monitoring for respiratory gating or tracking.

60 APPLIED LIFE SCIENCES↗

SU-E-QI-17: Dependence of 3D/4D PET Quantitative Image Features On Noise

Purpose: Quantitative imaging is a fast evolving discipline where a large number of features are extracted from images; i.e., radiomics. Some features have been shown to have diagnostic, prognostic and predictive value. However, they are sensitive to acquisition and processing factors; e.g., noise. In this study noise was added to positron emission tomography (PET) images to determine how features were affected by noise. Methods: Three levels of Gaussian noise were added to 8 lung cancer patients PET images acquired in 3D mode (static) and using respiratory tracking (4D); for the latter images from one of 10 phases were used. A total of 62 features: 14 shape, 19 intensity (1stO), 18 GLCM textures (2ndO; from grey level co-occurrence matrices) and 11 RLM textures (2ndO; from run-length matrices) features were extracted from segmented tumors. Dimensions of GLCM were 256×256, calculated using 3D images with a step size of 1 voxel in 13 directions. Grey levels were binned into 256 levels for RLM and features were calculated in all 13 directions. Results: Feature variation generally increased with noise. Shape features were the most stable while RLM were the most unstable. Intensity and GLCM features performed well; the latter being more robust. The most stable 1stO features were compactness, maximum and minimum length, standard deviation, root-mean-squared, I30, V10-V90, and entropy. The most stable 2ndO features were entropy, sum-average, sum-entropy, difference-average, difference-variance, difference-entropy, information-correlation-2, short-run-emphasis, long-run-emphasis, and run-percentage. In general, features computed from images from one of the phases of 4D scans were more stable than from 3D scans. Conclusion: This study shows the need to characterize image features carefully before they are used in research and medical applications. It also shows that the performance of features, and thereby feature selection, may be assessed in part by noise analysis.

60 APPLIED LIFE SCIENCES↗

3D MRI in Musculoskeletal Imaging: Current and Future Applications

Purpose of Review: This article addresses current clinical applications, recent literature, and potential future applications of 3-dimensional magnetic resonance imaging (3D MRI) for musculoskeletal (MSK) applications. Recent Findings: The main advantage of 3D MRI over standard 2-dimensional MRI is its ability to reduce partial volume averaging artifacts and create multiplanar reconstruction (MPRs) in any plane with any slice thickness from a single high-resolution isotropic acquisition. 3D MRI acquisitions are particularly useful for the evaluation of articular cartilage, which is prone to volume averaging artifacts, and for the assessment of longitudinally coursing structures such as peripheral nerves and tendons, which are better visualized with non-orthogonal MPRs. 3D MRI is also useful for surface and volumetric analysis of bone and cartilage for preoperative and longitudinal assessments. Current research is focused on decreasing acquisition times and automating segmentation through machine learning, thus overcoming some of the current limitations of 3D MRI and providing new applications for this technique. Summary: 3D MRI is widely used in MSK imaging today, and its use is likely to continue to increase in the future, with recent advancements focused on accelerated acquisition techniques and quantitative imaging.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Aerial 3D Building Reconstruction from Drone Imagery (A3DBR) v1

This toolkit is composed of several modules for extracting buildings geometrical and thermal characteristics from RGB and thermal imagery captured using a drone. - Building 3D reconstruction module: leverage a photogrammetry software to construct a 3D point cloud from RGB drone imagery, which is then used in conjunction with image processing and geometric methods to extract building footprint and building height (i.e., 3D model of the building). - Windows to wall ratio estimation module: leverage deep learning semantic segmentation modeling to detect windows on 2D drone RGB images. The detected windows are then projected onto the extracted building 3D model (using building 3D reconstruction module) and their area is computed to obtain window to wall ratio estimation. - Thermal anomalies detection module: leverage image processing and machine learning algorithm to detect on 2D drone thermal images potential thermal anomalies within building's facades and roofs.

Granderson, Jessica↗

Implement and Test 3D Mortar Contact in BISON

We leverage the extension of the generation of mortar segment meshes to three dimensions in MOOSE’s framework to extend thermomechanical modeling capabilities to problems with three dimensions. A modular approach to gap heat transfer physics using the mortar finite element method was created and documented, mechanical contact was extended to three dimensions—including frictional behavior, performance and ease of use were improved, and steps towards scalability of solid mechanics problems involving contact were taken. Many of these new developments are demonstrated in the simulation of 3D light-water reactor (LWR) problems, where the thermomechanical interface problem is solved using the mortar finite element method. Usage of the mortar framework has improved convergence in 2D problems and has enabled employing friction in 3D problems, of which we show results of a short, local stack of 3D pellets. Consequently, the benefits of mortar in terms of solution convergence and quality are extended to three dimensions. Section 2 discusses fundamental developments that enabled the simulation of practical mortar problems in three dimensions and other general improvements, including the reduction of the derivative container size, the modification of dual basis computations when edge dropping (lack of secondary element projection) takes place, the improvement of conditioning when employing the VCP in-edge dropping conditions, and code usability and quality improvements. These latter code enhancements include the migration of tests using “old” mortar contact constraints to using dual mortar with a semi-smooth Newton solution strategy and the reuse of lower dimensional domains for straightforwardly setting up a mortar thermomechanical LWR problem, i.e. the MOOSE action is employed for mechanical contact and the thermal LWR action is employed to capture the gas conductance, contact, and radiation components of gap heat transfer physics. Independently of the mortar LWR thermal action, we developed a modular approach to gap heat transfer that resides in MOOSE and can be leveraged, e.g., in metallic fuel problems. This approach, whose code design based on MOOSE’s user objects to model specific physics was proposed by the maintenance activity, is detailed in Section 3. Based on the dual mortar finite element method, the frictional contact constraints were extended to three dimensions. A block sheared in two directions in and out of contact with a rigid plane is employed in Section 4 to show the way the approach handles changes in frictional states (e.g. stick to slip) within a competitive number of Newton iterations. Equations and numerical results on the use of the VCP with Cartesian Lagrange multipliers, whose combination enables their direct condensation, are described in Section 5.3. Two-dimensional and three-dimensional BISON LWR simulations are discussed in Section 6. Particularly, a stack of five eccentric pellets with a surface defect is simulated and the effect of pellet-cladding friction is assessed. Finally, conclusions are outlined in Section 7.

42 ENGINEERING↗

BioSig3D: High Content Screening of Three-Dimensional Cell Culture Models

BioSig3D is a computational platform for high-content screening of three-dimensional (3D) cell culture models that are imaged in full 3D volume. It provides an end-to-end solution for designing high content screening assays, based on colony organization that is derived from segmentation of nuclei in each colony. BioSig3D also enables visualization of raw and processed 3D volumetric data for quality control, and integrates advanced bioinformatics analysis. The system consists of multiple computational and annotation modules that are coupled together with a strong use of controlled vocabularies to reduce ambiguities between different users. It is a web-based system that allows users to: design an experiment by defining experimental variables, upload a large set of volumetric images into the system, analyze and visualize the dataset, and either display computed indices as a heatmap, or phenotypic subtypes for heterogeneity analysis, or download computed indices for statistical analysis or integrative biology. BioSig3D has been used to profile baseline colony formations with two experiments: (i) morphogenesis of a panel of human mammary epithelial cell lines (HMEC), and (ii) heterogeneity in colony formation using an immortalized non-transformed cell line. These experiments reveal intrinsic growth properties of well-characterized cell lines that are routinely used for biological studies. BioSig3D is being released with seed datasets and video-based documentation.

Science & Technology - Other Topics↗

Automated quantitative 3D analysis of aorta size, morphology, and mural calcification distributions

Purpose: The purpose of this work is to develop a fully automated pipeline to compute aorta morphology and calcification measures in large cohorts of CT scans that can be used to investigate the potential of these measures as imaging biomarkers of cardiovascular disease. Methods: The first step of the automated pipeline is aorta segmentation. The algorithm the authors propose first detects an initial aorta boundary by exploiting cross-sectional circularity of aorta in axial slices and aortic arch in reformatted oblique slices. This boundary is then refined by a 3D level-set segmentation that evolves the boundary to the location of nearby edges. The authors then detect the aortic calcifications with thresholding and filter out the false positive regions due to nearby high intensity structures based on their anatomical location. The authors extract the centerline and oblique cross sections of the segmented aortas and compute the aorta morphology and calcification measures of the first 2500 subjects from COPDGene study. These measures include volume and number of calcified plaques and measures of vessel morphology such as average cross-sectional area, tortuosity, and arch width. Results: The authors computed the agreement between the algorithm and expert segmentations on 45 CT scans and obtained a closest point mean error of 0.62 ± 0.09 mm and a Dice coefficient of 0.92 ± 0.01. The calcification detection algorithm resulted in an improved true positive detection rate of 0.96 compared to previous work. The measurements of aorta size agreed with the measurements reported in previous work. The initial results showed associations of aorta morphology with calcification and with aging. These results may indicate aorta stiffening and unwrapping with calcification and aging. Conclusions: The authors have developed an objective tool to assess aorta morphology and aortic calcium plaques on CT scans that may be used to provide information about the presence of cardiovascular disease and its clinical impact in smokers.

60 APPLIED LIFE SCIENCES↗

Concurrent segmentation of the prostate on MRI and CT via linked statistical shape models for radiotherapy planning

Purpose: Prostate gland segmentation is a critical step in prostate radiotherapy planning, where dose plans are typically formulated on CT. Pretreatment MRI is now beginning to be acquired at several medical centers. Delineation of the prostate on MRI is acknowledged as being significantly simpler to perform, compared to delineation on CT. In this work, the authors present a novel framework for building a linked statistical shape model (LSSM), a statistical shape model (SSM) that links the shape variation of a structure of interest (SOI) across multiple imaging modalities. This framework is particularly relevant in scenarios where accurate boundary delineations of the SOI on one of the modalities may not be readily available, or difficult to obtain, for training a SSM. In this work the authors apply the LSSM in the context of multimodal prostate segmentation for radiotherapy planning, where the prostate is concurrently segmented on MRI and CT. Methods: The framework comprises a number of logically connected steps. The first step utilizes multimodal registration of MRI and CT to map 2D boundary delineations of the prostate from MRI onto corresponding CT images, for a set of training studies. Hence, the scheme obviates the need for expert delineations of the gland on CT for explicitly constructing a SSM for prostate segmentation on CT. The delineations of the prostate gland on MRI and CT allows for 3D reconstruction of the prostate shape which facilitates the building of the LSSM. In order to perform concurrent prostate MRI and CT segmentation using the LSSM, the authors employ a region-based level set approach where the authors deform the evolving prostate boundary to simultaneously fit to MRI and CT images in which voxels are classified to be either part of the prostate or outside the prostate. The classification is facilitated by using a combination of MRI-CT probabilistic spatial atlases and a random forest classifier, driven by gradient and Haar features. Results: The authors acquire a total of 20 MRI-CT patient studies and use the leave-one-out strategy to train and evaluate four different LSSMs. First, a fusion-based LSSM (fLSSM) is built using expert ground truth delineations of the prostate on MRI alone, where the ground truth for the gland on CT is obtained via coregistration of the corresponding MRI and CT slices. The authors compare the fLSSM against another LSSM (xLSSM), where expert delineations of the gland on both MRI and CT are employed in the model building; xLSSM representing the idealized LSSM. The authors also compare the fLSSM against an exclusive CT-based SSM (ctSSM), built from expert delineations of the gland on CT alone. In addition, two LSSMs trained using trainee delineations (tLSSM) on CT are compared with the fLSSM. The results indicate that the xLSSM, tLSSMs, and the fLSSM perform equivalently, all of them out-performing the ctSSM. Conclusions: The fLSSM provides an accurate alternative to SSMs that require careful expert delineations of the SOI that may be difficult or laborious to obtain. Additionally, the fLSSM has the added benefit of providing concurrent segmentations of the SOI on multiple imaging modalities.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A method for robust segmentation of arbitrarily shaped radiopaque structures in cone-beam CT projections

Purpose: Implanted markers are commonly used in radiotherapy for x-ray based target localization. The projected marker position in a series of cone-beam CT (CBCT) projections can be used to estimate the three dimensional (3D) target trajectory during the CBCT acquisition. This has important applications in tumor motion management such as motion inclusive, gating, and tumor tracking strategies. However, for irregularly shaped markers, reliable segmentation is challenged by large variations in the marker shape with projection angle. The purpose of this study was to develop a semiautomated method for robust and reliable segmentation of arbitrarily shaped radiopaque markers in CBCT projections. Methods: The segmentation method involved the following three steps: (1) Threshold based segmentation of the marker in three to six selected projections with large angular separation, good marker contrast, and uniform background; (2) construction of a 3D marker model by coalignment and backprojection of the threshold-based segmentations; and (3) construction of marker templates at all imaging angles by projection of the 3D model and use of these templates for template-based segmentation. The versatility of the segmentation method was demonstrated by segmentation of the following structures in the projections from two clinical CBCT scans: (1) Three linear fiducial markers (Visicoil) implanted in or near a lung tumor and (2) an artificial cardiac valve in a lung cancer patient. Results: Automatic marker segmentation was obtained in more than 99.9% of the cases. The segmentation failed in a few cases where the marker was either close to a structure of similar appearance or hidden behind a dense structure (data cable). Conclusions: A robust template-based method for segmentation of arbitrarily shaped radiopaque markers in CBCT projections was developed.

60 APPLIED LIFE SCIENCES↗

Structural switching dynamically controls the doubly pseudoknotted Rous sarcoma virus–programmed ribosomal frameshifting element

A hallmark of retrovirus replication is the translation of two different polyproteins from one RNA through programmed –1 frameshifting. This is a mechanism in which the actively translating ribosome is induced to slip in the 5′ direction at a defined codon and then continues translating in the new reading frame. Programmed frameshifting controls the stoichiometry of viral proteins and is therefore under stringent evolutionary selection. Forty years ago, the first frameshifting stimulatory element was discovered in the Rous sarcoma virus. The ~120 nt RNA segment was predicted to contain a pseudoknot, but its 3D structure has remained elusive. Now, we have determined cryoEM and X-ray crystallographic structures of this classic retroviral element, finding that it adopts a butterfly-like double-pseudoknot fold. One “wing” contains a dynamic pyrimidine-rich helix, observed crystallographically in two conformations and in a third conformation via cryoEM. The other wing encompasses the predicted pseudoknot, which interacts with a second unexpected pseudoknot through a toggle residue, A2546. This key purine switches conformations between structural states and tunes the stability of interacting residues in the two wings. We find that its mutation can modulate frameshifting by as much as 50-fold, likely by altering the relative abundance of different structural states in the conformational ensemble of the RNA. Taken together, our structure–function analyses reveal how a dynamic double pseudoknot junction stimulates frameshifting by taking advantage of conformational heterogeneity, supporting a multistate model in which high Shannon entropy enhances frameshifting efficiency.

Science & Technology - Other Topics↗

Three Dimensional Urban Characterization by IFSAR Measurements

In this paper a machine vision approach is applied to Interferometric Synthetic Aperture Radars (IFSAR) data to extract the most relevant built structures in a dense urban environment. The algorithm tries to cluster primitives (line segments) into more complex surfaces (planes) to approximate the 3D shape of these objects. Very interesting results starting from TOPSAR data recorded over S, Monica are presented.

Gamba, P.↗

Statistical Modeling of the Eye for Multimodal Treatment Planning for External Beam Radiation Therapy of Intraocular Tumors

Purpose: Ocular anatomy and radiation-associated toxicities provide unique challenges for external beam radiation therapy. For treatment planning, precise modeling of organs at risk and tumor volume are crucial. Development of a precise eye model and automatic adaptation of this model to patients' anatomy remain problematic because of organ shape variability. This work introduces the application of a 3-dimensional (3D) statistical shape model as a novel method for precise eye modeling for external beam radiation therapy of intraocular tumors. Methods and Materials: Manual and automatic segmentations were compared for 17 patients, based on head computed tomography (CT) volume scans. A 3D statistical shape model of the cornea, lens, and sclera as well as of the optic disc position was developed. Furthermore, an active shape model was built to enable automatic fitting of the eye model to CT slice stacks. Cross-validation was performed based on leave-one-out tests for all training shapes by measuring dice coefficients and mean segmentation errors between automatic segmentation and manual segmentation by an expert. Results: Cross-validation revealed a dice similarity of 95% {+-} 2% for the sclera and cornea and 91% {+-} 2% for the lens. Overall, mean segmentation error was found to be 0.3 {+-} 0.1 mm. Average segmentation time was 14 {+-} 2 s on a standard personal computer. Conclusions: Our results show that the solution presented outperforms state-of-the-art methods in terms of accuracy, reliability, and robustness. Moreover, the eye model shape as well as its variability is learned from a training set rather than by making shape assumptions (eg, as with the spherical or elliptical model). Therefore, the model appears to be capable of modeling nonspherically and nonelliptically shaped eyes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗