Engineering topics

Hernandez-Torres, Sofia I.

Publications and source records attributed to Hernandez-Torres, Sofia I..

6 records

DOE OSTI2023

An extended focused assessment with sonography in trauma ultrasound tissue-mimicking phantom for developing automated diagnostic technologies

Medical imaging-based triage is critical for ensuring medical treatment is timely and prioritized. However, without proper image collection and interpretation, triage decisions can be hard to make. While automation approaches can enhance these triage applications, tissue phantoms must be developed to train and mature these novel technologies. Here, we have developed a tissue phantom modeling the ultrasound views imaged during the enhanced focused assessment with sonography in trauma exam (eFAST). The tissue phantom utilized synthetic clear ballistic gel with carveouts in the abdomen and rib cage corresponding to the various eFAST scan points. Various approaches were taken to simulate proper physiology without injuries present or to mimic pneumothorax, hemothorax, or abdominal hemorrhage at multiple locations in the torso. Multiple ultrasound imaging systems were used to acquire ultrasound scans with or without injury present and were used to train deep learning image classification predictive models. Performance of the artificial intelligent (AI) models trained in this study achieved over 97% accuracy for each eFAST scan site. We used a previously trained AI model for pneumothorax which achieved 74% accuracy in blind predictions for images collected with the novel eFAST tissue phantom. Grad-CAM heat map overlays for the predictions identified that the AI models were tracking the area of interest for each scan point in the tissue phantom. Overall, the eFAST tissue phantom ultrasound scans resembled human images and were successful in training AI models. Tissue phantoms are critical first steps in troubleshooting and developing medical imaging automation technologies for this application that can accelerate the widespread use of ultrasound imaging for emergency triage.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Performance Comparison of Object Detection Networks for Shrapnel Identification in Ultrasound Images

Ultrasound imaging is a critical tool for triaging and diagnosing subjects but only if images can be properly interpreted. Unfortunately, in remote or military medicine situations, the expertise to interpret images can be lacking. Machine-learning image interpretation models that are explainable to the end user and deployable in real time with ultrasound equipment have the potential to solve this problem. We have previously shown how a YOLOv3 (You Only Look Once) object detection algorithm can be used for tracking shrapnel, artery, vein, and nerve fiber bundle features in a tissue phantom. However, real-time implementation of an object detection model requires optimizing model inference time. Here, we compare the performance of five different object detection deep-learning models with varying architectures and trainable parameters to determine which model is most suitable for this shrapnel-tracking ultrasound image application. We used a dataset of more than 16,000 ultrasound images from gelatin tissue phantoms containing artery, vein, nerve fiber, and shrapnel features for training and evaluating each model. Every object detection model surpassed 0.85 mean average precision except for the detection transformer model. Overall, the YOLOv7tiny model had the higher mean average precision and quickest inference time, making it the obvious model choice for this ultrasound imaging application. Other object detection models were overfitting the data as was determined by lower testing performance compared with higher training performance. In summary, the YOLOv7tiny object detection model had the best mean average precision and inference time and was selected as optimal for this application. Next steps will implement this object detection algorithm for real-time applications, an important next step in translating AI models for emergency and military medicine.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

An image classification deep-learning algorithm for shrapnel detection from ultrasound images

Ultrasound imaging is essential for non-invasively diagnosing injuries where advanced diagnostics may not be possible. However, image interpretation remains a challenge as proper expertise may not be available. In response, artificial intelligence algorithms are being investigated to automate image analysis and diagnosis. Here, we highlight an image classification convolutional neural network for detecting shrapnel in ultrasound images. As an initial application, different shrapnel types and sizes were embedded first in a tissue mimicking phantom and then in swine thigh tissue. The algorithm architecture was optimized stepwise by minimizing validation loss and maximizing F1 score. The final algorithm design trained on tissue phantom image sets had an F1 score of 0.95 and an area under the ROC curve of 0.95. It maintained higher than a 90% accuracy for each of 8 shrapnel types. When trained only on swine image sets, the optimized algorithm format had even higher metrics: F1 and area under the ROC curve of 0.99. Overall, the algorithm developed resulted in strong classification accuracy for both the tissue phantom and animal tissue. This framework can be applied to other trauma relevant imaging applications such as internal bleeding to further simplify trauma medicine when resources and image interpretation are scarce.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Development and Characterization of a Self-Tightening Tourniquet System

Uncontrolled hemorrhage remains a leading cause of death in both emergency and military medicine. Tourniquets are essential to stopping hemorrhage in these scenarios, but they suffer from subjective, inconsistent application. Here, we demonstrate how tourniquet application can be automated using sensors and computer algorithms. The auto-tourniquet self-tightens until blood pressure oscillations are no longer registered by the pressure sensor connected to the pneumatic pressure cuff. The auto-tourniquet’s performance in stopping the bleed was comparable to manual tourniquet application, but the time required to fully occlude the bleed was longer. Application of the tourniquet was significantly smoother, and less variable, for the automatic tourniquet compared to manual tourniquet application. This proof-of-concept study highlights how automated tourniquets can be integrated with sensors to provide a much more consistent application and use compared to manual application, even in controlled, low stress testing conditions. Future work will investigate different sensors and tourniquets to improve the application time and repeatability.

Vega, Saul J.↗

DOE OSTI2022

Supervisory Algorithm for Autonomous Hemodynamic Management Systems

Future military conflicts will require new solutions to manage combat casualties. The use of automated medical systems can potentially address this need by streamlining and augmenting the delivery of medical care in both emergency and combat trauma environments. However, in many situations, these systems may need to operate in conjunction with other autonomous and semi-autonomous devices. Management of complex patients may require multiple automated systems operating simultaneously and potentially competing with each other. Supervisory controllers capable of harmonizing multiple closed-loop systems are thus essential before multiple automated medical systems can be deployed in managing complex medical situations. The objective for this study was to develop a Supervisory Algorithm for Casualty Management (SACM) that manages decisions and interplay between two automated systems designed for management of hemorrhage control and resuscitation: an automatic extremity tourniquet system and an adaptive resuscitation controller. SACM monitors the required physiological inputs for both systems and synchronizes each respective system as needed. We present a series of trauma experiments carried out in a physiologically relevant benchtop circulatory system in which SACM must recognize extremity or internal hemorrhage, activate the corresponding algorithm to apply a tourniquet, and then resuscitate back to the target pressure setpoint. SACM continues monitoring after the initial stabilization so that additional medical changes can be quickly identified and addressed, essential to extending automation algorithms past initial trauma resuscitation into extended monitoring. Overall, SACM is an important step in transitioning automated medical systems into emergency and combat trauma situations. Future work will address further interplay between these systems and integrate additional medical systems.

42 ENGINEERING↗