DSFMA: Deeply supervised fully convolutional neural networks based on multi-level aggregation for saliency detection

Inam Ullah, Muwei Jian, Sumaira Hussain, Jie Guo, Li Lian, Hui Yu, Kashif Shaheed, Yilong Yin

Research output: Contribution to journalArticlepeer-review

Abstract

In recent years, the emergence of fully convolutional neural networks (FCNs) has delivered significant success in the field of saliency detection. Although the different levels of FCNs layers can hold different types of information for salient object detection, it is still a challenging issue for the researchers to find a generic method while integrating all relevant information synthetically with multi-level aggregation. In this paper, we present a novel multi-level aggregation method by following a U-shaped architecture of the VGG-16 network. As the shallower layers of FCNs contain the low-level integrated features which are capable of capturing the more details of salient objects, while the more profound layers that hold the high-level integrated features have more contextual information. To exploit all the relevant information, we extend the last four side-outputs of U-Net at encoder and decoder sides and then utilize the concept of skip and short-connections to incorporate the high-level contextual knowledge with low-level details. Besides, we also integrate the recurrent convolutional layers (RCLs) into our model, which provide more deepness and enhance the capability to integrate more contextual knowledge. At last, we combine all the side-outputs into a final saliency map together for salient object detection. We evaluate the performance of the proposed model on six broadly used saliency detection benchmarks by comparing it with the other 11 state-of-the-art approaches. Experimental results demonstrate that our method achieves a favorable performance for all compared evaluation measures.
Original languageEnglish
Number of pages21
JournalMultimedia Tools and Applications
Early online date26 Oct 2020
DOIs
Publication statusEarly online - 26 Oct 2020

Fingerprint

Dive into the research topics of 'DSFMA: Deeply supervised fully convolutional neural networks based on multi-level aggregation for saliency detection'. Together they form a unique fingerprint.

Cite this