Work

Digital Cues in Multimedia Forensics

Year: 2021
Type: dissertation
Abstract: This work presents several contributions to the scientific field of digital multimedia forensics. The field addresses questions of authentication examination and source identification of multimedia files. All investigated multimedia entities are visual information carriers, i.e., images and videos. The subfield of authentication examination proposes methods which allow to verify or falsify the authenticity of the probed media object. Questions concerning source identification help to identify the source of the media file, where the term source offers different levels of granularity, for instance, the make or the model of a camera. Finding answers to questions of this kind, requires to operate with characteristic cues which suit the investigated context. Such cues, or features, can be derived from the byte stream of the file as well as from the visual content, i.e., the decoded pixels. The selected feature domain depends on the exact problem statement. Analysis on pixel data is especially revealing if the manipulation is of good quality. In contrast, applications that work with encoded files can be efficiently deployed to work on large scales of media file. Oftentimes, file-based methods are also helpful if the quality of the visual content makes working with pixel-based applications rather difficult. Therefore, this dissertation subsumes multiple of our published works from the field of digital multimedia forensics, which propose various new developed approaches for both authentication examination and source identification. Additionally, the suggested approaches work in different domains. Through this diversity, we are capable to cover a broad field of research questions and can solve different types of challenges. The first part of this work focuses on source identification. We first illustrate that the current literature does not cover developments introduced by the omnipresent usage of smartphones as imaging devices. Smartphones work with exchangeable software imaging routines. Hence, we suggest to introduce a software components axis orthogonal to a hardware components axis, i.e., proposing a new level of source identification. With the help of a large scale study on Apple devices, we demonstrate that different software versions have characteristic properties. We use this finding to predict software versions by resorting to machine learning. The influence of software when taking the image and when postprocessing is also investigated. Further, we illustrate how images from unknown models can be automatically associated with the make of the source device. The second part of the dissertation focuses on videos and their representation in modern video codecs. We discuss neural networks in terms of their ability to identify double compression in videos. Double compression is a necessary step that happens automatically when manipulating a video. The introduced method is likewise capable to predict a specific parameter, the so-called ``group of pictures'' length in the first compression of a double compressed video. We further introduce methods which are capable to locate manipulations in pixel-domain, for example, persons spliced into the footage. We demonstrate that the same method can be successfully used to probe if video sequences originate from the same video. The methods are benchmarked against state-of-the art solutions and consistently outperform them.
Author: Mullan, Patrick
Language: English
Open Access status: green
OpenAlex ID: W7009179008
Cites: 91
Cited by: 2
Related to: 10