A method for breast mass segmentation using image augmentation with SAM and receptive field expansion

Binjun Zhang, Eric Rigall, Yuting Huang, Xiao Zou, Shu Zhang*, Junyu Dong, Hui Yu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Downloads (Pure)


With the development of deep learning methods and their wide application in medical image segmentation tasks, mammography, used for early breast cancer screening, can further assist clinicians in diagnosis to a certain extent. Due to the loss of fine-grained features in the downsampling process and the very few available mammograms, the main methods for extracting masses from the whole mammography are relatively ineffective. In this paper, we propose a novel mass segmentation model for mammograms based on two U-Net network models, and integrate the Receptive Field Block (RFB) module in-between to enhance the deep features captured by the model. We augmented the input image using Segment Anything Model (SAM) and evaluated the proposed architecture on two public datasets, namely the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) and INBreast, as well as on a private dataset. The results show that the proposed model for segmenting masses in ROI regions can achieve high Dice scores of 92.18% and 89.85%, and Intersection over Union (IoU) scores of 85.47% and 80.80% on both INBreast and the private dataset. In addition, our model for segmenting masses on whole mammographs in CBIS-DDSM dataset can achieve Dice scores of 58.10% and 41.96% IoU scores. Besides, our model performance improved to Dice score 61.78% and IoU score 43.00% on whole mammographs in private dataset using SAM-augmented input images.

Original languageEnglish
Title of host publicationICCPR 2023 - Proceedings of the 2023 12th International Conference on Computing and Pattern Recognition
PublisherAssociation for Computing Machinery (ACM)
Number of pages8
ISBN (Electronic)9798400707988
Publication statusPublished - 28 Feb 2024
Event12th International Conference on Computing and Pattern Recognition, ICCPR 2023 - Qingdao, China
Duration: 27 Oct 202329 Oct 2023


Conference12th International Conference on Computing and Pattern Recognition, ICCPR 2023


  • Mammography
  • RFB
  • SAM
  • semantic segmentation
  • U-Net

Cite this