Sensors, Vol. 20, Pages 5250: Virtual to Real Adaptation of Pedestrian Detectors

Sensors, Vol. 20, Pages 5250: Virtual to Real Adaptation of Pedestrian Detectors Sensors doi: 10.3390/s20185250 Authors: Luca Ciampi Nicola Messina Fabrizio Falchi Claudio Gennaro Giuseppe Amato Pedestrian detection through Computer Vision is a building block for a multitude of applications. Recently, there has been an increasing interest in convolutional neural network-based architectures to execute such a task. One of these supervised networks’ critical goals is to generalize the knowledge learned during the training phase to new scenarios with different characteristics. A suitably labeled dataset is essential to achieve this purpose. The main problem is that manually annotating a dataset usually requires a lot of human effort, and it is costly. To this end, we introduce ViPeD (Virtual Pedestrian Dataset), a new synthetically generated set of images collected with the highly photo-realistic graphical engine of the video game GTA V (Grand Theft Auto V), where annotations are automatically acquired. However, when training solely on the synthetic dataset, the model experiences a Synthetic2Real domain shift leading to a performance drop when applied to real-world images. To mitigate this gap, we propose two different domain adaptation techniques suitable for the pedestrian detection task, but possibly applicable to general object detection. Experiments show that the network trained with ViPeD can generalize over unseen real-world scenarios better t...
Source: Sensors - Category: Biotechnology Authors: Tags: Article Source Type: research