Target detection based on two-stream convolution neural network with self-powered sensors information

Li Huang, Zhao Xiang, Juntong Yun, Ying Sun, Yuting Liu, Du Jiang, Hongjie Ma, Hui Yu

Research output: Contribution to journalArticlepeer-review

63 Downloads (Pure)


With the rapid development of artificial intelligence, neural network is widely used in various fields. Target detection algorithm is mainly based on neural network, but the accuracy of target detection algorithm is greatly related to the complexity of scene and texture. A target detection algorithm based on RGB-D image from the perspective of the lightweight of target detection network model and the integration of depth map to overcome the weak environmental illumination with self-powered sensors information is proposed. This paper analyzes the network model structure of YOLOv4 and MobileNet, compares the variation of parameter number between depthwise separable convolution and convolutional neural network, and combines the advantages of YOLOv4 network and MobileNetv3 network. The main network of three effective feature layers in YOLOv4 is replaced by MobileNetv3 network for initial feature layer extraction to strengthen the feature extraction network. At the same time, the standard convolution models in the network are replaced by depthwise separable convolution. The proposed method is compared with YOLOv4 and YOLOv4-MobileNetv3 in this paper, and the experimental results show that the proposed network retains its original advantages in accuracy, but the size of the network model is about 23% of that of YOLOv4 network model, and the processing speed is about 42% higher than that of YOLOv4 network model, and the detection accuracy can still reach 83% in the environment with poor lighting conditions.

Original languageEnglish
JournalIEEE Sensors Journal
Early online date16 Nov 2022
Publication statusEarly online - 16 Nov 2022


  • Depthwise separable convolution
  • MobileNet
  • Self-powered sensors information
  • Target detection
  • Two-stream convolutional neural network
  • YOLOv4


Dive into the research topics of 'Target detection based on two-stream convolution neural network with self-powered sensors information'. Together they form a unique fingerprint.

Cite this