Work

Djupinlärningsbaserad schemaläggare för effektiv objektdetektering i en distribuerad arkitektur

Year: 2023
Type: dissertation
Abstract: Object detection (OD) is a computer vision problem that involves the identification and localization of objects within an image or video stream. 5G and edge computing technologies have enabled distributed OD systems to operate more efficiently. This thesis addresses the challenge of improving an existing edge-assisted OD pipeline, developed at the Sensing and Perception team, Ericsson Research. The existing pipeline uses support vector machines (SVM)-based classifier in order to identify images where lightweight OD has failed, and calculates an introspective score based on the classifier. It combines two failure scores, i.e., the introspective score with comparison based score so-called, a golden score. Combining is done by taking the weighted average between the scores that results in detection failure metric, (DFM), which is then used to offload OD from a resource-constraint device to a more powerful device (edge). There is room for improvement, mainly in two areas. Firstly, SVM is a simple classifier and requires features from OD to infer OD failures. Secondly, the pipeline does not consider end-to-end latency, therefore it worsens significantly in degraded network conditions. Due to its significance and degree of difficulty, this problem is important to tackle and appropriate topic for a Master's thesis. To solve the first problem, this thesis proposes a deep learning-based detection failure classifier that replaces the previous SVM-based classifier in order to identify images where lightweight OD has failed. For the second problem, several approaches to make offloading decision are proposed in order to consider end-to-end latency as well as network conditions by combining two failure scores with a new latency score. The effectiveness of the proposed methods is then tested against the ImageNet Large Scale Visual Recognition Challenge 2017 (ILSVRC2017) VID dataset using several accuracy metrics and end-to-end latency. Experimental evaluation shows that the final proposed method significantly enhances the edge-assisted OD pipeline compared to SVM-based implementation and fixed weight scheduler, and increases overall pipeline performance. As a result, this work could help enhance accuracy and efficiency for edge-assisted OD pipelines in various applications, including surveillance systems, virtual reality environments and autonomous vehicles.
Language: English
Open Access status: green
OpenAlex ID: W7009370670
Cites: 23
Cited by:
Related to: 10