Work

Novel architectures for spectator crowd image analysis

Year: 2020
Type: dissertation
Abstract: Crowd image analysis can involve various tasks, such as head detection, head pose estimation, and body detection.These tasks face a range of issues including low resolution, varying crowd density, overlapping bodies, and image corruptions.Additionally, the techniques performing these tasks have computational overhead as well.Existing head detection techniques perform poorly for very low-resolution images.They also cannot perform head detection and head pose estimation simultaneously for multiple heads.To address these issues, we propose a novel neural network architecture (WNet), which performs joint tasks on low-resolution multiple heads.Experiments on the spectator crowd dataset (S-HOCK) show that fewer images can be used for the simultaneous tasks.Existing body detection techniques rely on the visibility of body parts.But in dense spectator crowd images, the bodies are occluded, and not visible clearly.We propose "pixel matching based body detection" (PMBD) technique, to reduce the effect of occlusion in body parts.It can locate the body region by color matching and proximity.Experiments are performed on the S-HOCK dataset to accurately detect occluded bodies in a crowd image.When low-resolution images, such as spectator head images, get distorted with corruptions e.g.blurriness, pixelation, and fog, they are poorly classified by the neural networks.Existing robustness techniques aim towards a specific type of corruption and improve the accuracy.We propose a novel technique, called "Edge to edge scanline smoothing" (ESS), for image enhancement to mitigate the effect of a wide range of corruption.Training of neural networks is a computationally extensive task.The proposed structure of neurons called the "Multiple Output Neurons" (MON), in contrast to conventional single output neurons, can be used in the training process to reduce computation in the neural networks.We demonstrate a reduction in computation for various tasks, such as spectator crowd head pose classification.List of Tables 3.1 Benchmark HPE average accuracy compared with WNet HPE accuracy. . .4.1 Comparison of body detection results . . . . . . . . . . . . . . . . . . . . . .5.1 Layers of ANet for S-HOCK -C, CIF AR-10-C and T iny-ImageN et-C dataset.The two parameters in each convolutional layer represent the padding and the stride values. . . . . . . . . . . . . . . . . . . . . . . . . . .5.2 Layers of BNet for CIF AR -10 -C dataset. . . . . . . . . . . . . . . . . .5.3 Corruption errors of ANets for S-HOCK dataset.Values less than 100 are more robust. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5.4 Corruption errors of ANets for CIFAR-10-C, and Tiny-ImageNet-C datasets.Values less than 100 are more robust. . . . . . . . . . . . . . . . . . . . . . .5.5 Accuracies of Original BNet and ESS based BNet, over a range of corruption errors and severity levels, of CIFAR-10-C.Bold values shows that BNet ESS has better performance than BNet Original. . . . . . . . . . . . . . . . . . .5.6 Accuracies of BNet compared with the benchmark, over a range of corruption errors and severity levels. . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Author: Yasir Jan
Institution: Murdoch University
Language: English
Open Access status: green
OpenAlex ID: W3118952845
Cites: 73
Cited by:
Related to: 10