A Dataset for Movie Description
| Title | A Dataset for Movie Description |
| Publication Type | Conference Paper |
| Year of Publication | 2015 |
| Authors | Rohrbach, A., Rohrbach M., Tandon N., & Schiele B. |
| Other Numbers | 3749 |
| Abstract | Descriptive video service (DVS) provides linguistic descriptions of movies and allows visually impaired people to follow a movie along with their peers. Such descriptions are by design mainly visual and thus naturally form an interesting data source for computer vision and computational linguistics. In this work we propose a novel dataset which contains transcribed DVS, which is temporally aligned to full length HD movies. In addition we also collected the aligned movie scripts which have been used in prior work and compare the two different sources of descriptions. In total the Movie Description dataset contains a parallel corpus of over 54,000 sentences and video snippets from 72 HD movies. We characterize the dataset by benchmarking different approaches for generating video descriptions. Comparing DVS to scripts, we find that DVS is far more visual and describes precisely what is shown rather than what should happen according to the scripts created prior to movie production. |
| Acknowledgment | This work was partially supported by a postdoctoral fellowship funded by the Federal Ministry of Education and Research (BMBF) through the FITweltweit program, administered by the German Academic Exchange Service (DAAD). |
| URL | http://www.icsi.berkeley.edu/pubs/vision/datasetmovie15.pdf |
| Bibliographic Notes | Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015), Boston, Massachusetts |
| Abbreviated Authors | A. Rohrbach, M. Rohrbach, N. Tandon, B. Schiele |
| ICSI Research Group | Vision |
| ICSI Publication Type | Article in conference proceedings |