Identification and extraction of digital forensic evidence from multimedia data sources using multi-algorithmic fusion

Shahlaa Mashhadani, Nathan Clarke, Fudong Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

233 Downloads (Pure)

Abstract

With the enormous increase in the use and volume of photographs and videos, multimedia-based digital evidence has come to play an increasingly fundamental role in criminal investigations. However, given the increase in the volume of multimedia data, it is becoming time-consuming and costly for investigators to analyse the images manually. Therefore, a need exists for image analysis and retrieval techniques that are able to process, analyse and retrieve images efficiently and effectively. Outside of forensics, image annotation systems have become increasingly popular for a variety of purposes and major software/IT companies, such as Amazon, Microsoft and Google all have cloud-based image annotation systems. The paper presents a series of experiments that evaluate commercial annotation systems to determine their accuracy and ability to comprehensively annotate images within a forensic image analysis context (rather than simply single object imagery, which is typically the case). The paper further proposes and demonstrates the value of utilizing a multi-algorithmic approach via fusion to achieve the best results. The results of these experiments show that by existing systems the highest Average Recall was achieved by imagga with 53%, whilst the proposed multi-algorithmic system achieved 77% across the selected datasets. These results demonstrate the benefit of using a multi-algorithmic approach.
Original languageEnglish
Title of host publicationProceedings of the 5th International Conference on Information Systems Security and Privacy - Volume 1: ICISSP
PublisherSciTePress
Pages438-448
Number of pages11
Volume1
ISBN (Print)978-989-758-359-9
DOIs
Publication statusPublished - 24 Feb 2019
EventICISSP 2019: 5th International Conference on Information Systems Security and Privacy - Prague, Czech Republic
Duration: 23 Feb 201925 Feb 2019

Conference

ConferenceICISSP 2019: 5th International Conference on Information Systems Security and Privacy
Country/TerritoryCzech Republic
CityPrague
Period23/02/1925/02/19

Keywords

  • digital forensics
  • multimedia forensics
  • automatic image annotation
  • fusion

Fingerprint

Dive into the research topics of 'Identification and extraction of digital forensic evidence from multimedia data sources using multi-algorithmic fusion'. Together they form a unique fingerprint.

Cite this