Dual stage augmented colorful texture synthesis from hand sketch

In this paper, we investigate the texture synthesis method generated from the hand-made sketches. In recent years, GANs have been vigorously studied in the field of image generation, yet the texture synthesis from the hand sketch has not been extensively studied. In order to enable the synthesized image not only possesses the texture features, but also the vibrant color, we propose a cascaded network model that generates a texture image through a dual-stage network. The proposed framework firstly generates a grayscale image with basic texture properties from hand sketch based on the conditional GANs. This grayscale texture is then colorized in the second stage. The network in the second stage is pre-trained using our constructed dataset to learn how to translate the grayscale image to a colorful image. This paper aims to design a new network to generate realistic texture from hand sketch. A series of experiments are conducted to validate the effectiveness of our method. Encouraging results are achieved. The experimental results demonstrate that our dual stage model outperforms the state-of-art generative models in the related areas.