Skip to content

Augmented visual feature modeling for matching in low-visibility based on cycle-labeling of Superpixel Flow

Research output: Contribution to journal › Article

There are many automation systems that are required to work under poor visual conditions, such as auto-navigation in foggy or underwater environment. The low-visibility poses challenges for traditional feature modelling methods, which commonly contribute as a key component to such autonomous systems. It can thus negatively impact the performance of those computing systems. For example, the matching precision (matching quality) and the successfully identified matches (matching quantity) can both drop dramatically in low-visibility. On the other hand, human vision system can robustly identify visual features correctly despite the variations in lighting conditions. Inspired by human knowledge of perceiving visual features, this paper presents a novel feature modelling solution under poor visual conditions. Based on a color constancy enhanced illumination alignment, a new concept called Superpixel Flow (SPF) is proposed to model the visual features in images. SPF is generated considering the content motions across frame pairs, which make it easier to track across frames compared with classic Superpixels. The matching is achieved by a cycle-labelling strategy using Markov Random Field (MRF) with energy functions composed according to human knowledge of compare visual features. An outlier removal follows to further improve the matching accuracy. Competitive performance is demonstrated in the experiments compared with state-of-the-art approaches.
Original languageEnglish
Article number105699
Number of pages11
JournalKnowledge-Based Systems
Volume195
Early online date27 Feb 2020
DOIs
Publication statusPublished - 11 May 2020

Documents

  • Augmented Visual Feature Modelling based on SPF_pppdf

    Accepted author manuscript (Post-print), 16 MB, PDF document

    Due to publisher’s copyright restrictions, this document is not freely available to download from this website until: 27/02/21

    Licence: CC BY-NC-ND

Related information

Relations Get citation (various referencing formats)

ID: 20099579