Effective image super resolution via hierarchical convolutional neural network

Research output: Contribution to journalArticlepeer-review

409 Downloads (Pure)

Abstract

An extensive amount of research work has been carried out in image super-resolution using convolutional neural networks. The focus of a significant number of reported approaches is primarily on either increasing the depth or the width of the networks to achieve improvements in performance. This paper proposes a novel hierarchical convolutional neural network (HCNN) for effective image super-resolution by learning features from different levels. More specifically, the proposed framework implements a 3-step hierarchical process, which consists of an edge extraction branch, an edge reinforcement branch, and an image reconstruction branch. Informative edges in an image are extracted and enhanced in the edge extraction and reinforcement branch, which are used as a guidance in the image reconstruction branch. Experimental results on several public datasets demonstrate that the proposed framework can restore high-frequency edges information and achieve superior performances over the state-of-the-art methods. Moreover, through a case study in facial expression recognition, we show that the enhanced images are beneficial in improving the recognition performance, paving the way for more practical applications.
Original languageEnglish
JournalNeurocomputing
Early online date24 Sept 2019
DOIs
Publication statusEarly online - 24 Sept 2019

Keywords

  • image super-resolution
  • edges extratction
  • deep learning
  • facial expression recognition

Fingerprint

Dive into the research topics of 'Effective image super resolution via hierarchical convolutional neural network'. Together they form a unique fingerprint.

Cite this