autoSMIM: Automatic Superpixel-Based Masked Image Modeling for Skin Lesion Segmentation
Skin lesion segmentation from dermoscopic images plays a vital role in early diagnoses and prognoses of various skin diseases. However, it is a challenging task due to the large variability of skin lesions and their blurry boundaries. Moreover, most existing skin lesion datasets are designed for disease classification, with relatively fewer segmentation labels having been provided. To address these issues, we propose a novel automatic superpixel-based masked image modeling method, named autoSMIM, in a self-supervised setting for skin lesion segmentation. It explores implicit image features from abundant unlabeled dermoscop...
Source: IEE Transactions on Medical Imaging - June 28, 2023 Category: Biomedical Engineering Source Type: research

DSMT-Net: Dual Self-Supervised Multi-Operator Transformation for Multi-Source Endoscopic Ultrasound Diagnosis
Pancreatic cancer has the worst prognosis of all cancers. The clinical application of endoscopic ultrasound (EUS) for the assessment of pancreatic cancer risk and of deep learning for the classification of EUS images have been hindered by inter-grader variability and labeling capability. One of the key reasons for these difficulties is that EUS images are obtained from multiple sources with varying resolutions, effective regions, and interference signals, making the distribution of the data highly variable and negatively impacting the performance of deep learning models. Additionally, manual labeling of images is time-cons...
Source: IEE Transactions on Medical Imaging - June 27, 2023 Category: Biomedical Engineering Source Type: research

MCP-Net: Introducing Patlak Loss Optimization to Whole-Body Dynamic PET Inter-Frame Motion Correction
In whole-body dynamic positron emission tomography (PET), inter-frame subject motion causes spatial misalignment and affects parametric imaging. Many of the current deep learning inter-frame motion correction techniques focus solely on the anatomy-based registration problem, neglecting the tracer kinetics that contains functional information. To directly reduce the Patlak fitting error for 18F-FDG and further improve model performance, we propose an inter-frame motion correction framework with Patlak loss optimization integrated into the neural network (MCP-Net). The MCP-Net consists of a multiple-frame motion estimation b...
Source: IEE Transactions on Medical Imaging - June 27, 2023 Category: Biomedical Engineering Source Type: research

Artifact Detection and Restoration in Histology Images With Stain-Style and Structural Preservation
The artifacts in histology images may encumber the accurate interpretation of medical information and cause misdiagnosis. Accordingly, prepending manual quality control of artifacts considerably decreases the degree of automation. To close this gap, we propose a methodical pre-processing framework to detect and restore artifacts, which minimizes their impact on downstream AI diagnostic tasks. First, the artifact recognition network AR-Classifier first differentiates common artifacts from normal tissues, e.g., tissue folds, marking dye, tattoo pigment, spot, and out-of-focus, and also catalogs artifact patches by their rest...
Source: IEE Transactions on Medical Imaging - June 23, 2023 Category: Biomedical Engineering Source Type: research

Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation
Myocardial pathology segmentation (MyoPS) is critical for the risk stratification and treatment planning of myocardial infarction (MI). Multi-sequence cardiac magnetic resonance (MS-CMR) images can provide valuable information. For instance, balanced steady-state free precession cine sequences present clear anatomical boundaries, while late gadolinium enhancement and T2-weighted CMR sequences visualize myocardial scar and edema of MI, respectively. Existing methods usually fuse anatomical and pathological information from different CMR sequences for MyoPS, but assume that these images have been spatially aligned. However, ...
Source: IEE Transactions on Medical Imaging - June 22, 2023 Category: Biomedical Engineering Source Type: research

Correction for Mechanical Inaccuracies in a Scanning Talbot-Lau Interferometer
Grating-based X-ray phase-contrast and in particular dark-field radiography are promising new imaging modalities for medical applications. Currently, the potential advantage of dark-field imaging in early-stage diagnosis of pulmonary diseases in humans is being investigated. These studies make use of a comparatively large scanning interferometer at short acquisition times, which comes at the expense of a significantly reduced mechanical stability as compared to tabletop laboratory setups. Vibrations create random fluctuations of the grating alignment, causing artifacts in the resulting images. Here, we describe a novel max...
Source: IEE Transactions on Medical Imaging - June 21, 2023 Category: Biomedical Engineering Source Type: research

TransMatch: A Transformer-Based Multilevel Dual-Stream Feature Matching Network for Unsupervised Deformable Image Registration
Feature matching, which refers to establishing the correspondence of regions between two images (usually voxel features), is a crucial prerequisite of feature-based registration. For deformable image registration tasks, traditional feature-based registration methods typically use an iterative matching strategy for interest region matching, where feature selection and matching are explicit, but specific feature selection schemes are often useful in solving application-specific problems and require several minutes for each registration. In the past few years, the feasibility of learning-based methods, such as VoxelMorph and ...
Source: IEE Transactions on Medical Imaging - June 21, 2023 Category: Biomedical Engineering Source Type: research

Robust Vascular Segmentation for Raw Complex Images of Laser Speckle Contrast Based on Weakly Supervised Learning
Laser speckle contrast imaging (LSCI) is widely used for in vivo real-time detection and analysis of local blood flow microcirculation due to its non-invasive ability and excellent spatial and temporal resolution. However, vascular segmentation of LSCI images still faces a lot of difficulties due to numerous specific noises caused by the complexity of blood microcirculation’s structure and irregular vascular aberrations in diseased regions. In addition, the difficulties of LSCI image data annotation have hindered the application of deep learning methods based on supervised learning in the field of LSCI image vascular seg...
Source: IEE Transactions on Medical Imaging - June 19, 2023 Category: Biomedical Engineering Source Type: research

Concurrent Ischemic Lesion Age Estimation and Segmentation of CT Brain Using a Transformer-Based Network
The cornerstone of stroke care is expedient management that varies depending on the time since stroke onset. Consequently, clinical decision making is centered on accurate knowledge of timing and often requires a radiologist to interpret Computed Tomography (CT) of the brain to confirm the occurrence and age of an event. These tasks are particularly challenging due to the subtle expression of acute ischemic lesions and the dynamic nature of their appearance. Automation efforts have not yet applied deep learning to estimate lesion age and treated these two tasks independently, so, have overlooked their inherent complementar...
Source: IEE Transactions on Medical Imaging - June 19, 2023 Category: Biomedical Engineering Source Type: research

Locating X-Ray Coronary Angiogram Keyframes via Long Short-Term Spatiotemporal Attention With Image-to-Patch Contrastive Learning
Locating the start, apex and end keyframes of moving contrast agents for keyframe counting in X-ray coronary angiography (XCA) is very important for the diagnosis and treatment of cardiovascular diseases. To locate these keyframes from the class-imbalanced and boundary-agnostic foreground vessel actions that overlap complex backgrounds, we propose long short-term spatiotemporal attention by integrating a convolutional long short-term memory (CLSTM) network into a multiscale Transformer to learn the segment- and sequence-level dependencies in the consecutive-frame-based deep features. Image-to-patch contrastive learning is ...
Source: IEE Transactions on Medical Imaging - June 16, 2023 Category: Biomedical Engineering Source Type: research

2023 IEEE Nuclear Science Symposium
(Source: IEE Transactions on Medical Imaging)
Source: IEE Transactions on Medical Imaging - June 1, 2023 Category: Biomedical Engineering Source Type: research

Less Is More: Surgical Phase Recognition From Timestamp Supervision
Surgical phase recognition is a fundamental task in computer-assisted surgery systems. Most existing works are under the supervision of expensive and time-consuming full annotations, which require the surgeons to repeat watching videos to find the precise start and end time for a surgical phase. In this paper, we introduce timestamp supervision for surgical phase recognition to train the models with timestamp annotations, where the surgeons are asked to identify only a single timestamp within the temporal boundary of a phase. This annotation can significantly reduce the manual annotation cost compared to the full annotatio...
Source: IEE Transactions on Medical Imaging - June 1, 2023 Category: Biomedical Engineering Source Type: research

Context Label Learning: Improving Background Class Representations in Semantic Segmentation
In this study, we propose context label learning (CoLab) to improve the context representations by decomposing the background class into several subclasses. Specifically, we train an auxiliary network as a task generator, along with the primary segmentation model, to automatically generate context labels that positively affect the ROI segmentation accuracy. Extensive experiments are conducted on several challenging segmentation tasks and datasets. The results demonstrate that CoLab can guide the segmentation model to map the logits of background samples away from the decision boundary, resulting in significantly improved s...
Source: IEE Transactions on Medical Imaging - June 1, 2023 Category: Biomedical Engineering Source Type: research

GLIM-Net: Chronic Glaucoma Forecast Transformer for Irregularly Sampled Sequential Fundus Images
Chronic Glaucoma is an eye disease with progressive optic nerve damage. It is the second leading cause of blindness after cataract and the first leading cause of irreversible blindness. Glaucoma forecast can predict future eye state of a patient by analyzing the historical fundus images, which is helpful for early detection and intervention of potential patients and avoiding the outcome of blindness. In this paper, we propose a GLaucoma forecast transformer based on Irregularly saMpled fundus images named GLIM-Net to predict the probability of developing glaucoma in the future. The main challenge is that the existing fundu...
Source: IEE Transactions on Medical Imaging - June 1, 2023 Category: Biomedical Engineering Source Type: research

Hierarchical Perception Adversarial Learning Framework for Compressed Sensing MRI
The long acquisition time has limited the accessibility of magnetic resonance imaging (MRI) because it leads to patient discomfort and motion artifacts. Although several MRI techniques have been proposed to reduce the acquisition time, compressed sensing in magnetic resonance imaging (CS-MRI) enables fast acquisition without compromising SNR and resolution. However, existing CS-MRI methods suffer from the challenge of aliasing artifacts. This challenge results in the noise-like textures and missing the fine details, thus leading to unsatisfactory reconstruction performance. To tackle this challenge, we propose a hierarchic...
Source: IEE Transactions on Medical Imaging - June 1, 2023 Category: Biomedical Engineering Source Type: research