Densely Annotated Photorealistic Virtual Dataset Generation for Abnormal Event Detection

Rico Montulet, Alexia Briassouli

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

38 Downloads (Pure)

Abstract

Many timely computer vision problems, such as crowd event detection, individual or crowd activity recognition, person detection and re-identification, tracking, pose estimation, segmentation, require pixel-level annotations. This involves significant manual effort, and is likely to face challenges related to the privacy of individuals, due to the intrinsic nature of these problems, requiring in-depth identifying information. To cover the gap in the field and address these issues, we introduce and make publicly available a photorealistic, synthetically generated dataset, with detailed dense annotations. We also publish the tool we developed to generate it, that will allow users to not only use our dataset, but expand upon it by building their own densely annotated videos for many other computer vision problems. We demonstrate the usefulness of the dataset with experiments on unsupervised crowd anomaly detection in various scenarios, environments, lighting, weather conditions. Our dataset and the annotations provided with it allow its use in numerous other computer vision problems, such as pose estimation, person detection, segmentation, re-identification and tracking, individual and crowd activity recognition, and abnormal event detection. We present the dataset as is, along with the source code and tool to generate it, so any modification can be made and new data can be created. To our knowledge, there is currently no other photorealistic, densely annotated, realistic, synthetically generated dataset for abnormal crowd event detection, nor one that allows for flexibility of use by allowing the creation of new data with annotations for many other computer vision problems. Dataset and source code available: https://github.com/RicoMontulet/GTA5Event.
Original languageEnglish
Title of host publicationPattern Recognition. ICPR International Workshops and Challenges
Subtitle of host publicationVirtual Event, January 10-15, 2021, Part IV
EditorsA. Del Bimbo, R. Cucchiara, S. Sclaroff, G. M. Farinella, T. Mei, M. Bertini, H. J. Escalante, R. Vezzani
Place of PublicationCham
PublisherSpringer, Cham
Pages5-19
Number of pages15
Edition1
ISBN (Electronic)978-3-030-68799-1
ISBN (Print)978-3-030-68798-4
DOIs
Publication statusPublished - 2020
Event25th International Conference on Pattern Recognition - Online, Milan, Italy
Duration: 10 Jan 202115 Jan 2021
Conference number: 25
https://www.micc.unifi.it/icpr2020/

Publication series

SeriesLecture Notes in Computer Science
Volume12664
ISSN0302-9743

Conference

Conference25th International Conference on Pattern Recognition
Abbreviated titleICPR2020
Country/TerritoryItaly
CityMilan
Period10/01/2115/01/21
Internet address

Cite this