Abstract
Many timely computer vision problems, such as crowd event detection, individual or crowd activity recognition, person detection and re-identification, tracking, pose estimation, segmentation, require pixel-level annotations. This involves significant manual effort, and is likely to face challenges related to the privacy of individuals, due to the intrinsic nature of these problems, requiring in-depth identifying information. To cover the gap in the field and address these issues, we introduce and make publicly available a photorealistic, synthetically generated dataset, with detailed dense annotations. We also publish the tool we developed to generate it, that will allow users to not only use our dataset, but expand upon it by building their own densely annotated videos for many other computer vision problems. We demonstrate the usefulness of the dataset with experiments on unsupervised crowd anomaly detection in various scenarios, environments, lighting, weather conditions. Our dataset and the annotations provided with it allow its use in numerous other computer vision problems, such as pose estimation, person detection, segmentation, re-identification and tracking, individual and crowd activity recognition, and abnormal event detection. We present the dataset as is, along with the source code and tool to generate it, so any modification can be made and new data can be created. To our knowledge, there is currently no other photorealistic, densely annotated, realistic, synthetically generated dataset for abnormal crowd event detection, nor one that allows for flexibility of use by allowing the creation of new data with annotations for many other computer vision problems. Dataset and source code available: https://github.com/RicoMontulet/GTA5Event.
Original language | English |
---|---|
Title of host publication | Pattern Recognition. ICPR International Workshops and Challenges |
Subtitle of host publication | Virtual Event, January 10-15, 2021, Part IV |
Editors | A. Del Bimbo, R. Cucchiara, S. Sclaroff, G. M. Farinella, T. Mei, M. Bertini, H. J. Escalante, R. Vezzani |
Place of Publication | Cham |
Publisher | Springer, Cham |
Pages | 5-19 |
Number of pages | 15 |
Edition | 1 |
ISBN (Electronic) | 978-3-030-68799-1 |
ISBN (Print) | 978-3-030-68798-4 |
DOIs | |
Publication status | Published - 2020 |
Event | 25th International Conference on Pattern Recognition - Online, Milan, Italy Duration: 10 Jan 2021 → 15 Jan 2021 Conference number: 25 https://www.micc.unifi.it/icpr2020/ |
Publication series
Series | Lecture Notes in Computer Science |
---|---|
Volume | 12664 |
ISSN | 0302-9743 |
Conference
Conference | 25th International Conference on Pattern Recognition |
---|---|
Abbreviated title | ICPR2020 |
Country/Territory | Italy |
City | Milan |
Period | 10/01/21 → 15/01/21 |
Internet address |