Search NASA⌕ Search

SEARCH · Search NASA

Results for “image based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

The Formation of Life-sustaining Planets in Extrasolar Systems

The spatial exploration is providing us a large quantity of information about the composition of the planets and satellites crusts. However, most of the experiences that are proposed in the guides of activities in Planetary Geology are based exclusively on the images utilization: photographs, maps, models or artistic reconstructions [1,2]. That things help us to recognize shapes and to deduce geological processes, but they says us little about the materials that they are implicated. In order to avoid this dicotomy between shapes and materials, we have designed an experience in the one which, employing of rocks and landscapes of our geological environment more next, the pupils be able to do an exercise of compared planetology analyzing shapes, processes and material of several planetary bodies of the Solar System.

Chambers, J. E.↗

Early Results from the Solar-Minimum 2019 Total Solar Eclipse

We observed the 2 July 2019 total solar eclipse with a variety of imaging and spectroscopic instruments recording from three sites in mainland Chile: on the centerline at La Higuera, from the Cerro Tololo Inter-American Observatory, and from La Serena, as well as from a chartered flight at peak totality in mid-Pacific. Our spectroscopy monitored Fe X, Fe XIV, and Ar X lines, and we imaged Ar X with a Lyot filter adjusted from its original H-alpha bandpass. Our composite imaging has been compared with predictions based on modeling using magnetic-field measurements from the pre-eclipse month. Our time-differenced sites will be used to measure motions in coronal streamers.

Jay M Pasachoff↗

The Dark Side of Pluto

During its departure from Pluto, New Horizons used its LORRI camera to image a portion of Pluto's southern hemisphere that was in a decades-long seasonal winter darkness, but still very faintly illuminated by sunlight reflected by Charon. Recovery of this faint signal was technically challenging. The bright ring of sunlight forward-scattered by haze in the Plutonian atmosphere encircling the nightside hemisphere was severely overexposed, defeating the standard smeared-charge removal required for LORRI images. Reconstruction of the overexposed portions of the raw images, however, allowed adequate corrections to be accomplished. The small solar elongation of Pluto during the departure phase also generated a complex scattered-sunlight background in the images that was three orders of magnitude stronger than the estimated Charon-light flux (the Charon-light flux is similar to the flux of moonlight on Earth a few days before first quarter). A model background image was constructed for each Pluto image based on principal component analysis applied to an ensemble of scattered-sunlight images taken at identical Sun−spacecraft geometry to the Pluto images. The recovered Charon-light image revealed a high-albedo region in the southern hemisphere. We argue that this may be a regional deposit of N2 or CH4 ice. The Charon-light image also shows that the south polar region currently has markedly lower albedo than the north polar region of Pluto, which may reflect the sublimation of N2 ice or the deposition of haze particulates during the recent southern summer.

Pluto↗

Physics-based shape matching for intraoperative image guidance

Purpose: Soft-tissue deformations can severely degrade the validity of preoperative planning data during computer assisted interventions. Intraoperative imaging such as stereo endoscopic, time-of-flight or, laser range scanner data can be used to compensate these movements. In this context, the intraoperative surface has to be matched to the preoperative model. The shape matching is especially challenging in the intraoperative setting due to noisy sensor data, only partially visible surfaces, ambiguous shape descriptors, and real-time requirements. Methods: A novel physics-based shape matching (PBSM) approach to register intraoperatively acquired surface meshes to preoperative planning data is proposed. The key idea of the method is to describe the nonrigid registration process as an electrostatic–elastic problem, where an elastic body (preoperative model) that is electrically charged slides into an oppositely charged rigid shape (intraoperative surface). It is shown that the corresponding energy functional can be efficiently solved using the finite element (FE) method. It is also demonstrated how PBSM can be combined with rigid registration schemes for robust nonrigid registration of arbitrarily aligned surfaces. Furthermore, it is shown how the approach can be combined with landmark based methods and outline its application to image guidance in laparoscopic interventions. Results: A profound analysis of the PBSM scheme based on in silico and phantom data is presented. Simulation studies on several liver models show that the approach is robust to the initial rigid registration and to parameter variations. The studies also reveal that the method achieves submillimeter registration accuracy (mean error between 0.32 and 0.46 mm). An unoptimized, single core implementation of the approach achieves near real-time performance (2 TPS, 7–19 s total registration time). It outperforms established methods in terms of speed and accuracy. Furthermore, it is shown that the method is able to accurately match partial surfaces. Finally, a phantom experiment demonstrates how the method can be combined with stereo endoscopic imaging to provide nonrigid registration during laparoscopic interventions. Conclusions: The PBSM approach for surface matching is fast, robust, and accurate. As the technique is based on a preoperative volumetric FE model, it naturally recovers the position of volumetric structures (e.g., tumors and vessels). It cannot only be used to recover soft-tissue deformations from intraoperative surface models but can also be combined with landmark data from volumetric imaging. In addition to applications in laparoscopic surgery, the method might prove useful in other areas that require soft-tissue registration from sparse intraoperative sensor data (e.g., radiation therapy)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-E-I-56: Scan Angle Reduction for a Limited-Angle Intrafraction Verification (LIVE) System

Purpose: To develop a novel adaptive reconstruction strategy to further reduce the scanning angle required by the limited-angle intrafraction verification (LIVE) system for intrafraction verification. Methods: LIVE acquires limited angle MV projections from the exit fluence of the arc treatment beam or during gantry rotation between static beams. Orthogonal limited-angle kV projections are also acquired simultaneously to provide additional information. LIVE considers the on-board 4D-CBCT images as a deformation of the prior 4D-CT images, and solves the deformation field based on deformation models and data fidelity constraint. LIVE reaches a checkpoint after a limited-angle scan, and reconstructs 4D-CBCT for intrafraction verification at the checkpoint. In adaptive reconstruction strategy, a larger scanning angle of 30° is used for the first checkpoint, and smaller scanning angles of 15° are used for subsequent checkpoints. The onboard images reconstructed at the previous adjacent checkpoint are used as the prior images for reconstruction at the current checkpoint. As the algorithm only needs to reconstruct the small deformation occurred between adjacent checkpoints, projections from a smaller scan angle provide enough information for the reconstruction. XCAT was used to simulate tumor motion baseline drift of 2mm along sup-inf direction at every subsequent checkpoint, which are 15° apart. Adaptive reconstruction strategy was used to reconstruct the images at each checkpoint using orthogonal 15° kV and MV projections. Results: Results showed that LIVE reconstructed the tumor volumes accurately using orthogonal 15° kV-MV projections. Volume percentage differences (VPDs) were within 5% and center of mass shifts (COMS) were within 1mm for reconstruction at all checkpoints. Conclusion: It's feasible to use an adaptive reconstruction strategy to further reduce the scan angle needed by LIVE to allow faster and more frequent intrafraction verification to minimize the treatment errors in lung cancer treatments. Grant from Varian Medical System.

60 APPLIED LIFE SCIENCES↗

Data-driven high-fidelity 2D microstructure reconstruction via non-local patch-based image inpainting

Microstructure reconstruction problems are usually limited to the representation with finitely many number of phases, e.g. binary and ternary. However, images of microstructure obtained through experimental, for example, using microscope, are often represented as a RGB or grayscale image. Because the phase-based representation is discrete, more rigid, and provides less flexibility in modeling the microstructure, as compared to RGB or grayscale image, there is a loss of information in the conversion. In this paper, a microstructure reconstruction method, which produces images at the fidelity of experimental microscopy, i.e. RGB or grayscale image, is proposed without introducing any physics-based microstructure descriptor. Furthermore, the image texture is preserved and the microstructure image is represented with continuous variables (as in RGB or grayscale images), instead of binary or categorical variables, which results in a high-fidelity image of microstructure reconstruction. The advantage of the proposed method is its quality of reconstruction, which can be applied to any other binary or multiphase 2D microstructure. The proposed method can be thought of as a subsampling approach to expand the microstructure dataset, while preserving its image texture. Moreover, the size of the reconstructed image is more flexible, compared to other machine learning microstructure reconstruction method, where the size must be fixed beforehand. In addition, the proposed method is capable of joining the microstructure images taken at different locations to reconstruct a larger microstructure image. A significant advantage of the proposed method is to remedy the data scarcity problem in materials science, where experimental data is scare and hard to obtain. The proposed method can also be applied to generate statistically equivalent microstructures, which has a strong implication in microstructure-related uncertainty quantification applications. The proposed microstructure reconstruction method is demonstrated with the UltraHigh Carbon Steel micrograph DataBase (UHCSDB).

97 MATHEMATICS AND COMPUTING↗

Synchrotron CT imaging of lattice structures with engineered defects

Understanding mechanical failure, crack propagation, and compressive behavior at the micrometer scale is essential for tailoring material properties for structural performance in cellular materials. Typically, modeling of traditional polymer foam materials is clouded by the lack of control in material morphology and its inherent stochastic structure. Additive manufacturing with sub-micrometer resolution provides a direct path for experimenters to specifically tailor structures needed by modelers to explicitly probe mechanical performance. Using laboratory-based 3D X-ray computed tomographic imaging (CT), the examination of deformation and damage provides a critical path to understand how these soft materials behave. Additionally, synchrotron CT yields realistic information at higher strain rates to directly validate the robustness of our finite element modeling. For this study, nanolithographic printing was employed to generate a series of engineered lattices with increasing levels of defects through the random removal of ligaments. These structures were mechanically tested and imaged with laboratory-based microCT. Additionally, synchrotron experiments were conducted in which the structures were imaged in 3D at 14 Hz during compression at a 0.4 s –1 strain rate. These 3D images show the changes in the structure as the ligaments bend, buckle and fracture in real time. This technique provides a robust framework for developing our methodologies and future exploration of engineered structures.

36 MATERIALS SCIENCE↗

SU-E-J-253: The Radiomics Toolbox in the Computational Environment for Radiological Research (CERR)

Purpose: To present an open source and free platform to facilitate radiomics research — The “Radiomics toolbox” in CERR. Method: There is scarcity of open source tools that support end-to-end modeling of image features to predict patient outcomes. The “Radiomics toolbox” strives to fill the need for such a software platform. The platform supports (1) import of various kinds of image modalities like CT, PET, MR, SPECT, US. (2) Contouring tools to delineate structures of interest. (3) Extraction and storage of image based features like 1st order statistics, gray-scale co-occurrence and zonesize matrix based texture features and shape features and (4) Statistical Analysis. Statistical analysis of the extracted features is supported with basic functionality that includes univariate correlations, Kaplan-Meir curves and advanced functionality that includes feature reduction and multivariate modeling. The graphical user interface and the data management are performed with Matlab for the ease of development and readability of code and features for wide audience. Open-source software developed with other programming languages is integrated to enhance various components of this toolbox. For example: Java-based DCM4CHE for import of DICOM, R for statistical analysis. Results: The Radiomics toolbox will be distributed as an open source, GNU copyrighted software. The toolbox was prototyped for modeling Oropharyngeal PET dataset at MSKCC. The analysis will be presented in a separate paper. Conclusion: The Radiomics Toolbox provides an extensible platform for extracting and modeling image features. To emphasize new uses of CERR for radiomics and image-based research, we have changed the name from the “Computational Environment for Radiotherapy Research” to the “Computational Environment for Radiological Research”.

60 APPLIED LIFE SCIENCES↗

Quantification of the Impact of Acidified Brine on Fracture-Matrix Transport in a Naturally Fractured Shale Using in Situ Imaging and Modeling

Understanding flow, transport, chemical reactions, and hydromechanical processes in fractured geologic materials is key for optimizing a range of subsurface processes including carbon dioxide and hydrogen storage, unconventional energy resource extraction, and geothermal energy recovery. Flow and transport processes in naturally fractured shale rocks have been challenging to characterize due to experimental complexity and the multiscale nature of quantifying continuum scale descriptions of mass exchange between micrometer-scale fractures and nanometer-scale pores. In this study, we use positron emission tomography (PET) to image the transport of a conservative tracer in a naturally fractured Wolfcamp shale core before and after the core was exposed to low pH brine conditions. Image-based experimental observations are interpreted by fitting an analytical transport model to fracture-containing voxels in the core. Results of this analysis indicate subtle increases in matrix diffusivity and a slightly more uniform fracture velocity distribution following exposure to low pH conditions. These observations are compared with a multicomponent one-dimensional reactive transport model that indicates the capacity for a 10% increase in porosity at the fracture-matrix interface as a result of the low pH brine exposure. This porosity change is the result of the dissolution of carbonate minerals in the shale matrix to low pH conditions. Further, this image-based workflow represents a new approach for quantifying spatially resolved fracture-matrix transport processes and provides a foundation for future work to better understand the role of coupled transport, reaction, and mechanical processes in naturally fractured rocks.

58 GEOSCIENCES↗

Tumor Tracking Method Based on a Deformable 4D CT Breathing Motion Model Driven by an External Surface Surrogate

Purpose: To develop a tumor tracking method based on a surrogate-driven motion model, which provides noninvasive dynamic localization of extracranial targets for the compensation of respiration-induced intrafraction motion in high-precision radiation therapy. Methods and Materials: The proposed approach is based on a patient-specific breathing motion model, derived a priori from 4-dimensional planning computed tomography (CT) images. Model parameters (respiratory baseline, amplitude, and phase) are retrieved and updated at each treatment fraction according to in-room radiography acquisition and optical surface imaging. The baseline parameter is adapted to the interfraction variations obtained from the daily cone beam (CB) CT scan. The respiratory amplitude and phase are extracted from an external breathing surrogate, estimated from the displacement of the patient thoracoabdominal surface, acquired with a noninvasive surface imaging device. The developed method was tested on a database of 7 lung cancer patients, including the synchronized information on internal and external respiratory motion during a CBCT scan. Results: About 30 seconds of simultaneous acquisition of CBCT and optical surface images were analyzed for each patient. The tumor trajectories identified in CBCT projections were used as reference and compared with the target trajectories estimated from surface displacement with the a priori motion model. The resulting absolute differences between the reference and estimated tumor motion along the 2 image dimensions ranged between 0.7 and 2.4 mm; the measured phase shifts did not exceed 7% of the breathing cycle length. Conclusions: We investigated a tumor tracking method that integrates breathing motion information provided by the 4-dimensional planning CT with surface imaging at the time of treatment, representing an alternative approach to point-based external–internal correlation models. Although an in-room radiograph-based assessment of the reliability of the motion model is envisaged, the developed technique does not involve the estimation and continuous update of correlation parameters, thus requiring a less intense use of invasive imaging.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

WE-E-17A-03: FDG-PET-Based Radiomics to Predict Local Control and Survival Following Radiotherapy

Purpose: An exploding field in cancer research is “radiomics,” based on the hypothesis that there is statistical (hidden) information in medical images that is prognostic or predictive of outcomes. Our group has developed an efficient pipeline to extract and analyze quantitative image features from medical images as related to outcomes or diagnosis. In this work, we summarize our previous studies with positron emission tomography (PET) images and show the potential of the use of radiomics for outcomes research. Methods: We analyzed two cancer datasets, each consisting of pre-radiotherapy-treatment PET scans: 163 T1-2N0M0 non-small cell lung cancer (NSCLC) patients and 174 head and neck (H and N) cancer patients with stage III–IV. The PET scans were converted to Computational Environment for Radiological Research (CERR) format, and CERR was used to generate 24 shape, texture, and intensity-histogram based image features. Data-mining and logistic regression methods were then used to model local failure (LF) and overall survival (OS). Unbiased estimates of performance were generated using leave-one-out cross-validation (LOOCV). Results: For predicting LF, the models with biologically equivalent dose (BED) and TLG (metabolic tumor volume (MTV) x SUVmean) in NSCLC, and skewness and MTV in H and N, achieved the best performance with AUC=0.818 (p<0.0001) and AUC=0.826 (p=0.0002), respectively. For predicting OS, the models with kurtosis and volume in NSCLC and SUVmax and homogeneity in H and N achieved the best performance with AUC=0.706 (p<0.0001) and AUC=0.656 (p=0.0003), respectively. On LOOCV, all these models retained significant predictive power. Interestingly, MTV was highly correlated with LF in both sites. Conclusion: PET-based imaged features are promising tools for improving treatment management decision making. Much more research is needed to identify optimal radiomics metrics and to correlate imaging phenotype with other clinical or genomic information.

60 APPLIED LIFE SCIENCES↗

Classification and Localization of Fracture-Hit Events in Low-Frequency Distributed Acoustic Sensing Strain Rate with Convolutional Neural Networks

Summary Distributed acoustic sensing (DAS) has been used in the oil and gas industry as an advanced technology for surveillance and diagnostics. Operators use DAS to monitor hydraulic fracturing activities, examine well stimulation efficacy, and estimate complex fracture system geometries. Particularly, low-frequency DAS can detect geomechanical events such as fracture hits because hydraulic fractures propagate and create strain rate variations in the rock. Analysis of DAS data today is mostly done post-job and subject to interpretation methods. However, the continuous and dense data stream generated live by DAS poses the opportunity for more efficient and accurate real-time data-driven analysis. The objective of this study is to develop a machine learning-based workflow that can identify and locate fracture-hit events in simulated strain rate responses correlated with low-frequency DAS data. In this paper, “fracture hit” refers to a hydraulic fracture originating from a stimulated well intersecting an offset well. We start with building a single fracture propagation model to produce strain rate patterns observed at a hypothetical monitoring well. This model is used to generate two sets of strain rate responses with one set containing fracture-hit events. The labeled synthetic data are then used to train a custom convolutional neural network (CNN) model for identifying the presence of fracture-hit events. The same model is trained again for locating the event with the output layer of the model replaced with linear units. We achieved near-perfect predictions for both event classification and localization. These promising results prove the feasibility of using CNN for real-time event detection from fiber-optic sensing data. Additionally, we use edge detection techniques to recognize fracture-hit event patterns in strain rate images. The fracture-hit location can be identified using recognized pixels in the image. The accuracy of edge detection-based location identification is also plausible, but edge detection is dependent on the assumption of pattern shape and image quality, hence it is less robust compared to CNN models. This comparison further supports the need for CNN applications in image-based real-time fiber-optic sensing event detection.

Engineering↗

RELICS: Strong Lensing Analysis of MACS J0417.5–1154 and Predictions for Observing the Magnified High-redshift Universe with JWST

Strong gravitational lensing by clusters of galaxies probes the mass distribution at the core of each cluster and magnifies the universe behind it. MACS J0417.5–1154 at z = 0.443 is one of the most massive clusters known based on weak lensing, X-ray, and Sunyaev–Zel'dovich analyses. In this work we compute a strong lens model of MACS J0417 based on Hubble Space Telescope imaging observations collected, in part, by the Reionization Lensing Cluster Survey (RELICS), and recently reported spectroscopic redshifts from the MUSE instrument on the Very Large Telescope (VLT). We measure an Einstein radius of ${\theta }_{E}\simeq 36^{\prime\prime} $ at z = 9 and a mass projected within 200 kpc of ${M}_{(200\mathrm{kpc})}={1.78}_{-0.03}^{+0.01}\times {10}^{14}$ M ${}_{\odot }$. Using this model, we measure a ratio between the mass attributed to cluster-member galaxy halos and the main cluster halo of order 1:100. We assess the probability to detect magnified high-redshift galaxies in the field of this cluster, both for comparison with RELICS HST results and as a prediction for the James Webb Space Telescope (JWST) Guaranteed Time Observations upcoming for this cluster. Our lensing analysis suggests that this cluster has similar lensing strength to other clusters in the RELICS program. Our lensing analysis predicts a detection of at least a few z ~ 6–8 galaxies behind this cluster, at odds with a recent analysis that yielded no such candidates in this field. Reliable strong lensing models are important for accurately predicting the intrinsic properties of lensed galaxies. As part of the RELICS program, our strong lensing model produced with the Lenstool parametric method is publicly available through the Mikulski Archive for Space Telescopes.

79 ASTRONOMY AND ASTROPHYSICS↗

Geological terrain models

The initial phase of a program to determine the best interpretation strategy and sensor configuration for a radar remote sensing system for geologic applications is discussed. In this phase, terrain modeling and radar image simulation were used to perform parametric sensitivity studies. A relatively simple computer-generated terrain model is presented, and the data base, backscatter file, and transfer function for digital image simulation are described. Sets of images are presented that simulate the results obtained with an X-band radar from an altitude of 800 km and at three different terrain-illumination angles. The simulations include power maps, slant-range images, ground-range images, and ground-range images with statistical noise incorporated. It is concluded that digital image simulation and computer modeling provide cost-effective methods for evaluating terrain variations and sensor parameter changes, for predicting results, and for defining optimum sensor parameters.

Kaupp, V. H.↗

Defect Detection of Industrial Radiography Images of Ammonia Pipes by a Sparse Coding Model

Pipeline transportation systems for liquid anhydrous ammonia require periodic inspections for pipe defects. Defects such as crack-like flaws, including those due to stress corrosion and fatigue crack growth and fatigue of welded joints, can be tested by in situ radiography testing (RT). It is required that the detection technique should reveal the defect region without any significant distortion. Imaging noise such as that due to radiation scattering reduces contrast over the whole or part of the image, causing a reduction in image quality. Various image processing methods can be utilized to improve the outcome of RT of pipes. The sparse coding model is a powerful contrast improvement algorithm, but it tends to eliminate imaging details, passing them off as noise. We present a novel implementation of the sparse coding model based on a probabilistic interpretation to improve defect detection in ammonia pipelines radiography images. The performance of this procedure was evaluated in radiographic images of defect and corrosion regions for different pipe types. For ammonia pipes, the technique was found to offer a significant improvement in defect detection while preserving imaging details.

42 ENGINEERING↗

Mixed Effect Modeling of Dose and Linear Energy Transfer Correlations With Brain Image Changes After Intensity Modulated Proton Therapy for Skull Base Head and Neck Cancer

Intensity modulated proton therapy (IMPT) could yield high linear energy transfer (LET) in critical structures and increased biological effect. For head and neck cancers at the skull base this could potentially result in radiation-associated brain image change (RAIC). The purpose of the current study was to investigate voxel-wise dose and LET correlations with RAIC after IMPT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

TU-C-18C-01: Medical Physics 1.0 to 2.0: Introduction and Panel Discussion

Medical Physics 2.0, a new frontier in clinical imaging physics: Diagnostic imaging has always been a technological highlight of modern medicine. Imaging systems, with their ever-expanding advancement in terms of technology and application, increasingly require skilled expertise to understand the delicacy of their operation, monitor their performance, design their effective use, and ensure their overall quality and safety, scientifically and in quantitative terms. Physicists can play a crucial role in that process. But that role has largely remained a severely untapped resource. Many imaging centers fail to appreciate this potential, with medical physics groups either nonexistent or highly understaffed and their services poorly integrated into the patient care process. As a field, we have yet to define and enact how the clinical physicist can engage as an active, effective, and integral member of the clinical team, and how the services that she/he provides can be financially accounted for. Physicists do and will always contribute to research and development. However, their indispensible contribution to clinical imaging operations is something that has not been adequately established. That, in conjunction with new realities of healthcare practice, indicates a growing need to establish an updated approach to clinical medical imaging physics. This presentation aims to describe a vision as how clinical imaging physics can expand beyond traditional insular models of inspection and acceptance testing, oriented toward compliance, towards team-based models of operational engagement addressing topics such as new non-classical challenges of new technologies, quantitative imaging, and operational optimization. The Medical Physics 2.0 paradigm extends clinical medical physics from isolated characterization of inherent properties of the equipment to effective use of the equipment and to retrospective evaluation of clinical performance. This is an existential transition of the field that speaks to the new paradigms of value-based and evidence-based medicine, comparative effectiveness, and meaningful use. The panel discussion that follows includes prominent practitioners, thinkers, and leaders that would lead the discussion on how Medical Physics 2.0 can be actualized. Topics of discussion will include the administrative, financial, regulatory, and accreditation requirements of the new paradigm, effective models of practice, and the steps that we need to take to make MP 2.0 a reality. Learning Objectives: To understand the new paradigm of clinical medical physics practice extending from traditional insular models of compliance towards teambased models of operational engagement. To understand how clinical physics can most effectively contribute to clinical care. Learn to identify strengths and weaknesses in studies designed to measure the effect of low doses of ionizing radiation To recognize the impediments to Medical Physics 2.0 paradigm.

60 APPLIED LIFE SCIENCES↗

Machine learning informed control systems for extrusion printing processes

Systems and methods for controlling a material extrusion device to extrude a filament of an ink are provided. An extrusion printing control system collects from one or more sensors measurements representing an internal state of material extrusion processing during extrusion of the filament. In addition, the system collects an image of the filament as the filament is extruded. The system applies a classifier to the collected image to generate an image-derived state characterizing the filament. Based on the internal state and the image-derived state, the system estimates a derived state using a model. The system determines control parameters using the model to achieve a desired quality of the filament by minimizing a cost function based on the internal state, the image-derived state, the derived state, and constraints of the material extrusion device. Finally, the system provides the control parameters to a controller of the material extrusion device.

Howell, Brian↗